Posts

Evaluate RAG - LLM's using RAGAS Python Pytest Framework

Image
 Data will be fed to embedded model which stores the data into vector database based on semantic understanding. LLM(like chatgpt, gemini, anthropic) interacts with this vector database and replies based on the user prompts RAG (Retrieval Augmented Generation) data retrieved from vector database articulation of whole question with necessary context is called augmentation Generation is about giving the answer In traditional software testing, we assert on the system responses, but in LLM's we evaluate quality of the response using benchmark metrics. Here we make use of RAGAS framework Benchmark metrics for document retrieval system context precision --> no of relavant docs retrieved / total number of docs retrieved => 3/6 50% context recall =>  no of relavent docs retrieved / total number of relavent docs retrieved Install Python Install Pycharm IDE make sure to configure path of python while importing project (use which python3 to know the path of installation  Let...
Post a Comment
Read more

AI Agents & Codeless Automation

 Limitations of LLM's Can't perform real time operations no memory or context of previous conversations Can't perform live operations like connecting to database etc. Task automation not possible. Results might be biased due to dataset that we are training Not upto date with data, most of the LLM's are trained till 2022, they are not real time AI Agents Above all limitations can be addressed using AI agent, we can book train tickets, flight, even ask to create ticket by providing information etc. test rigor is a tool which helps in doing it (Generative AI based test automation tool) add test case / edit test case parameterize data from test data like stored value "email" make sure create email in test data resusable rules (sub routines) you can add resusable code like login, logout etc
Post a Comment
Read more

Postman AI features

Image
1. For all the Request in a Postman Collection, we can create tests by clicking on 'Generate Tests' which generate scripts for each request that validates request response and other parameters which can be custommized 2.  Using Postbot we can do a lot with test cases like "adding tests", "fixing tests", "add documentation"
Post a Comment
Read more

React Js and Redux

Image
Objective: To understand React and redux Prerequisite: Use Visual studio code editor install Node.js --> which helps in running javascript code on your server node -v, npm -v --> to check the versions ES6 (Javascript) Use this console for practice - https://es6console.com/ var variables are function scoped not block scoped (like if block). let variables are block scoped (prefer let over var, as var allows duplicate names, which causes confusion) const is also block scoped like let, the only difference is let allows you to update whereas const doesn't. const person = {   fname: 'Vinay',   lname: 'Raghumanda' } person = {   fname: 'Vinay',   lname: 'Raghumanda' } console.log(person.fname); console.log(person.lname); person is an object with properties fname and lname, if we assign person with different values, it fails, if let is used no error, as it allows update. Arrow functions without  and with arrow function const integers = [1,2,3]; cons...
Post a Comment
Read more