AI Agents & Codeless Automation

 Limitations of LLM's

  1. Can't perform real time operations
  2. no memory or context of previous conversations
  3. Can't perform live operations like connecting to database etc.
  4. Task automation not possible.
  5. Results might be biased due to dataset that we are training
  6. Not upto date with data, most of the LLM's are trained till 2022, they are not real time

AI Agents

  1. Above all limitations can be addressed using AI agent, we can book train tickets, flight, even ask to create ticket by providing information etc.
  2. test rigor is a tool which helps in doing it (Generative AI based test automation tool)
    1. add test case / edit test case
    2. parameterize data from test data like stored value "email"
      1. make sure create email in test data
    3. resusable rules (sub routines) you can add resusable code like login, logout etc


Comments

Post a Comment

Popular posts from this blog

Evaluate RAG - LLM's using RAGAS Python Pytest Framework

Image
 Data will be fed to embedded model which stores the data into vector database based on semantic understanding. LLM(like chatgpt, gemini, anthropic) interacts with this vector database and replies based on the user prompts RAG (Retrieval Augmented Generation) data retrieved from vector database articulation of whole question with necessary context is called augmentation Generation is about giving the answer In traditional software testing, we assert on the system responses, but in LLM's we evaluate quality of the response using benchmark metrics. Here we make use of RAGAS framework Benchmark metrics for document retrieval system context precision --> no of relavant docs retrieved / total number of docs retrieved => 3/6 50% context recall =>  no of relavent docs retrieved / total number of relavent docs retrieved Install Python Install Pycharm IDE make sure to configure path of python while importing project (use which python3 to know the path of installation  Let...
Read more

React Js and Redux

Image
Objective: To understand React and redux Prerequisite: Use Visual studio code editor install Node.js --> which helps in running javascript code on your server node -v, npm -v --> to check the versions ES6 (Javascript) Use this console for practice - https://es6console.com/ var variables are function scoped not block scoped (like if block). let variables are block scoped (prefer let over var, as var allows duplicate names, which causes confusion) const is also block scoped like let, the only difference is let allows you to update whereas const doesn't. const person = {   fname: 'Vinay',   lname: 'Raghumanda' } person = {   fname: 'Vinay',   lname: 'Raghumanda' } console.log(person.fname); console.log(person.lname); person is an object with properties fname and lname, if we assign person with different values, it fails, if let is used no error, as it allows update. Arrow functions without  and with arrow function const integers = [1,2,3]; cons...
Read more

Appium 7 - Android Test Automation

Image
Agenda: To understand Appium and explore concepts that helps us to achieve mobile test automation. Introduction: Open source tool that works for native, hybrid and mobile apps Supports selenium webdriver API Platform support for iOS, Android and FirefoxOS Architecture: Appium Client Code => Json (Request) ==> Appium Server ==> UIAutomator2 ==> Android                                                                                                  ==> XCUITest        ==> iOS Appium client code is the code that is written by user using any language that is supported by selenium like Java, C#, python etc The request will be sent to Appium server in the form of JSON, which is interpreted by server and executes ac...
Read more