SlideShare a Scribd company logo
Add AI to Your SDLC, presented by Applitools and Curiosity
© 2023
Objective
Faster Delivery Of Quality Software From
Idea To Consumer
@BagmarAnand
© 2023
Build quality in
Preventing Defects Finding Defects
Preventing Defects
Finding Defects
@BagmarAnand
© 2023
Everyone wants fast feedback
QUICK
RESPONSE
@BagmarAnand

Recommended for you

[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure

I am an instructor of the MLOps workshop for some anonymous startup incubation program where the objectives are (1) to orchestrate and deploy updates to the application and the deep learning model in a unified way. (2) To design a DevOps pipeline to coordinate retrieving the latest best model from the model registry, packaging the web application, deploying the web application and inferencing web service.

mlopsaiazure
Machine Learning with Amazon SageMaker
Machine Learning with Amazon SageMakerMachine Learning with Amazon SageMaker
Machine Learning with Amazon SageMaker

The document discusses Amazon SageMaker, a fully managed machine learning service. It provides an overview of SageMaker's capabilities for preparing, building, training and deploying machine learning models. Key features highlighted include SageMaker Studio for an integrated development environment, Autopilot for automatic model creation, JumpStart for pre-built solutions, and Data Wrangler for preparing data. Use cases and demos are presented to illustrate how customers can use SageMaker's services and features to develop machine learning applications.

awsmachine learningsagemaker
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner

This document discusses continuous testing and provides an overview of key concepts. It defines continuous testing as executing automated tests as part of the software delivery pipeline to rapidly obtain feedback on release candidates. The benefits of continuous testing discussed include fast feedback, continuous visibility, and testing that matches different skill levels. It also covers topics like test authoring best practices, key performance indicators for continuous testing, and the potential future role of machine learning. Continuous testing is presented as a way to mature an organization's path toward DevOps practices.

qaoth2019
© 2023
Requirements
Test Design
Test
Implementation
Test Execution
Test Analysis
Testing Life-Cycle
@BagmarAnand
© 2023
Can AI help?
@BagmarAnand
Requirements
Test Design
Test
Implementation
Test Execution
Test Analysis
How can we use AI for quality at speed?
© Curiosity Software 2023
Challenges to solve before/as you implement AI
Garbage in/Garbage out
Foundational LLMs do not “know” your org. and
systems, but you lack structured, up-to-date and
accurate data to feed them.
Transparency & Coverage
What are you testing? Have you tested enough?
AI test generation is often a black box, without
explainability or coverage control.
Security
How can you set-up a private Large Language
Model on-premise when you lack the data to
feed it?
Agile best practice
Unintegrated, “point solutions” silo teams and
toolchains. They damage comms, prevent
parallelisation, and push quality later.

Recommended for you

DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019 DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019

"In this workshop, you practice running an environment with a test and production deployment pipeline. Along the way, we cover topics such as static code analysis, dynamic infrastructure review, and workflow types. You also learn how to update your process in response to security events. We write new AWS Lambda functions and incorporate them into the pipeline, and we consider capabilities such as AWS Systems Manager Parameter Store and AWS Secrets Manager.

awssecurity deep divesdd310
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...

AgileChennai.com AI-Powered Agile : Transforming How We Deliver Extraordinary Impact Gayathri Pandian General Manager, Thoughtworks & Kalarani Lakshmanan Engineering Director, Thoughtworks

agilechennaiai
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...

The document discusses approaches for determining when to stop testing based on three dimensions of test coverage: system logic, device mix, and system tiers. It advocates targeting tests based on changes across the software development lifecycle to focus testing on at-risk areas. Maintaining a single source of truth and using coverage algorithms can help generate targeted automated tests across user interfaces, APIs and backends in a way that avoids wasteful over-testing or risky under-testing. The presentation concludes with a question and answer section and a call to action to learn more about test modeling and automation approaches.

agile software deliveryagile testingautomated testing
© Curiosity Software 2023
AI for ideation, design and requirements
Incomplete, ambiguous RQMTs
Problems worth solving:
Miscommunications
Most bugs start here
Technical debt / out-of-date
Have to manually derive tests
“3 amigos”
Prompt, critique,
enhance
AI
feedback
Generate unambiguous, complete flows & stories
Generative AI
SMEs in the loop
With AI and Modelling
AI finds & fixes gaps/ambiguity
Clear, concise, collaborative & complete
Developers build the right system
Structure data for LLMs
Demo
© Curiosity Software Ireland Ltd. 2023
© Curiosity Software 2023
LLM
Assistants answer questions based on models & stories
AI-assisted development – building the RQMTs
RQMTs-created bugs
Problems worth solving:
Missing knowledge
Technical debt
Overwhelming complexity
“3 amigos”
Models
Generative AI
With AI and Modelling
… ?
Copilot & ChatOps
LLM
training
SDLC Data /
Artifacts
Knowledge for accurate dev
Navigate complexity Avoid technical debt
Dev
</>
Check-
in
Demo
© Curiosity Software Ireland Ltd. 2023

Recommended for you

Applitools - Visual AI
Applitools - Visual AIApplitools - Visual AI
Applitools - Visual AI

Deliver Visually Perfect Digital Experiences across every screen with Test Automation powered by Visual AI

software testingsoftware qualitytest automation
Five reasons to model during QA
Five reasons to model during QAFive reasons to model during QA
Five reasons to model during QA

Model-based testing offers several advantages over traditional documentation-based approaches to quality assurance. It allows testers to create executable models that can automatically generate test cases and scripts, focusing testing on high-risk areas. When the software changes, the model can automatically update dependent tests. Using the same models across teams provides a central point of reference that brings business and development groups into alignment. Modeling catches design flaws earlier in the development process compared to traditional testing approaches.

softwaresoftware testingsoftware development
CloudOne Continuous Engineering for IoT
CloudOne Continuous Engineering for IoTCloudOne Continuous Engineering for IoT
CloudOne Continuous Engineering for IoT

This document introduces CloudOne as a company that provides managed continuous engineering services for companies developing Internet of Things (IoT) products and solutions. It discusses how CloudOne integrates infrastructure, tools, and support across continuous engineering and DevOps, enterprise asset management, analytics, and devices and applications. The document emphasizes that continuous engineering is a core capability needed for successful IoT strategies and outlines benefits of CloudOne's services such as enterprise-class security, ability to reuse existing tools and processes, and enabling global collaboration. Examples are given of major companies that use CloudOne's services for their IoT initiatives.

cloudone iot ibm
© Curiosity Software 2023
Repetitive & manual
Problems :
Low test coverage
Brittle & maintenance
Test Design & Script Creation
“3 amigos”
Models
Generative AI
…
LLM
AI assistants – know what to test
?
Dev
</>
Data, Scripts, Tests
AI Generated
Verify
With AI and Modelling
Autogenerate tests & data
Optimal coverage Self-healing & maintenance
Demo
© Curiosity Software Ireland Ltd. 2023
Demo
© Curiosity Software Ireland Ltd. 2023
Requirements
Test Design
Test
Implementation
Test Execution
Test Analysis
@BagmarAnand
Demo
© Curiosity Software Ireland Ltd. 2023

Recommended for you

Applitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdfApplitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdf

Deliver Visually Perfect Digital Experiences across every screen with Test Automation powered by Visual AI

test automationvisual aisoftware quality
The quality assurance checklist for progressive testing
The quality assurance checklist for progressive testingThe quality assurance checklist for progressive testing
The quality assurance checklist for progressive testing

Quality assurance (QA) is a strategic way of preventing mistakes and defects in developed products and avoiding problems when delivering products or services to customers. This defect prevention in quality assurance differs subtly from defect detection and rejection in quality control and has been referred to as a shift left since it focuses on quality earlier in the process

qualityassuranceservicesperformancetestingtestautomation
The Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive TestingThe Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive Testing

This document discusses quality assurance testing for progressive applications. It defines quality assurance as preventing defects through early testing. Progressive testing tests application modules incrementally in a top-down, bottom-up, or hybrid approach. A quality assurance checklist should include unit, regression, performance, security, and installation testing to validate the application and ensure long-term functionality. Comprehensive testing provides benefits like reduced costs, improved customer satisfaction, and increased profits.

testingtesting servicesprogressive testing
© 2023
• Have a holistic Quality Strategy for your product
• Shift-Left to get quick feedback
• Include Visual Testing in your Automation Strategy
@BagmarAnand
Summary
© 2023
• Applitools Visual AI adds AI-power to your functional automation
• Less code + greater test coverage + stable code = Less defects in production
• Applitools Visual AI + Ultrafast Cloud = AI-powered Cross-
Browser Testing
• Less test data, Less load on environment, Less flakiness, Super-Fast
• Applitools Execution Cloud
• Self-heal your tests, parallel execution, test local applications
@BagmarAnand
Summary
© Curiosity Software 2023
An accelerator throughout design, dev, test
Design Test
Monitor Develop
Collaboratively model and
refine requirements
✓ AI model generation
✓ AI feedback & refinement
✓ Human in the loop
Generate AI-
augmented tests
✓ Coverage
✓ Explainability
✓ Visibility
Develop the RQMTs using
ChatOps & Co-pilots
✓ Knowledge to dev accurately
✓ Perfect RQMTs
Data for your
LLM
© Curiosity Software 2023
© Curiosity Software 2023
Shift left to fix QA & AI
Test Cases
Test Automation
Test Data
Perfect RQMTs
Coverage
AI Readiness
✓ Collaborative ✓ Quality
✓ AI-Assisted ✓ Rapid

Recommended for you

Integrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirementsIntegrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirements

Software quality reflects degree of excellence with which a product is developed and performs. At Software Quality Days Vienna 2020, Nagarro QA Experts, Rajni Singh and Khimanand Upreti discuss how well defined and structured requirements acts as foundation stones for ensuring success of any software development process. They also speak about the need for the development of a framework that would contribute in combining various AI techniques along with their drivers for requirements phase.

software testingsoftware qualityartificial intelligence
BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!

This presentation explores how busting software bugs does more than ensure the reliability and performance of your software—it helps ensure application security. Topics covered include: How AppSec processes are really quality processes How software bugs are really security vulnerabilities How to apply coding standards as part of a continuous testing process to prevent defects from affecting the safety, security, and reliability of your applications

appsecsoftware qualitysoftware development
How Automation Reveals Technical Debt
How Automation Reveals Technical DebtHow Automation Reveals Technical Debt
How Automation Reveals Technical Debt

This document discusses how automation can help reveal technical debt. It explains that technical debt is accumulated to deliver features faster but often goes unpaid. Automation provides a "safety net" to identify debt through continuous integration, code inspection, and trend analysis. Implementing automation unexpectedly uncovered unknown issues and improved understanding of problems like dependencies, testing gaps, and deployment challenges. Both direct and indirect benefits occur at the team and enterprise levels by standardizing processes and providing visibility into issues.

continuous integrationurbancodecontinuous delivery
Thank you

More Related Content

Similar to Add AI to Your SDLC, presented by Applitools and Curiosity

AIM102-S_Cognizant_CognizantCognitive
AIM102-S_Cognizant_CognizantCognitiveAIM102-S_Cognizant_CognizantCognitive
AIM102-S_Cognizant_CognizantCognitive
PhilipBasford
 
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Applitools
 
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
Curiosity Software Ireland
 
[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure
Korkrid Akepanidtaworn
 
Machine Learning with Amazon SageMaker
Machine Learning with Amazon SageMakerMachine Learning with Amazon SageMaker
Machine Learning with Amazon SageMaker
Vladimir Simek
 
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner
QA or the Highway
 
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019 DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
Amazon Web Services
 
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
AgileNetwork
 
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity Software Ireland
 
Applitools - Visual AI
Applitools - Visual AIApplitools - Visual AI
Applitools - Visual AI
Applitools
 
Five reasons to model during QA
Five reasons to model during QAFive reasons to model during QA
Five reasons to model during QA
Curiosity Software Ireland
 
CloudOne Continuous Engineering for IoT
CloudOne Continuous Engineering for IoTCloudOne Continuous Engineering for IoT
CloudOne Continuous Engineering for IoT
Benjamin Chodroff
 
Applitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdfApplitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdf
Applitools
 
The quality assurance checklist for progressive testing
The quality assurance checklist for progressive testingThe quality assurance checklist for progressive testing
The quality assurance checklist for progressive testing
Maitrikpaida
 
The Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive TestingThe Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive Testing
Cygnet Infotech
 
Integrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirementsIntegrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirements
Nagarro
 
BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!
Parasoft
 
How Automation Reveals Technical Debt
How Automation Reveals Technical DebtHow Automation Reveals Technical Debt
How Automation Reveals Technical Debt
IBM UrbanCode Products
 
InTTrust -IBM Artificial Intelligence Event
InTTrust -IBM Artificial Intelligence  EventInTTrust -IBM Artificial Intelligence  Event
InTTrust -IBM Artificial Intelligence Event
Michail Pagiatakis
 
Hyf azure ml_1
Hyf azure ml_1Hyf azure ml_1
Hyf azure ml_1
KatoK1
 

Similar to Add AI to Your SDLC, presented by Applitools and Curiosity (20)

AIM102-S_Cognizant_CognizantCognitive
AIM102-S_Cognizant_CognizantCognitiveAIM102-S_Cognizant_CognizantCognitive
AIM102-S_Cognizant_CognizantCognitive
 
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
Top 5 Features To Look for in a Codeless Automation Solution -- Presentation ...
 
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
 
[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure[AI] ML Operationalization with Microsoft Azure
[AI] ML Operationalization with Microsoft Azure
 
Machine Learning with Amazon SageMaker
Machine Learning with Amazon SageMakerMachine Learning with Amazon SageMaker
Machine Learning with Amazon SageMaker
 
Creating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran KinsbrunerCreating a successful continuous testing environment by Eran Kinsbruner
Creating a successful continuous testing environment by Eran Kinsbruner
 
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019 DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
DevSecOps: Integrating security into pipelines - SDD310 - AWS re:Inforce 2019
 
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
Agile Chennai 2023 | AI-Powered Agile : Transforming How We Deliver Extraordi...
 
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
Curiosity and Sauce Labs present - When to stop testing: 3 dimensions of test...
 
Applitools - Visual AI
Applitools - Visual AIApplitools - Visual AI
Applitools - Visual AI
 
Five reasons to model during QA
Five reasons to model during QAFive reasons to model during QA
Five reasons to model during QA
 
CloudOne Continuous Engineering for IoT
CloudOne Continuous Engineering for IoTCloudOne Continuous Engineering for IoT
CloudOne Continuous Engineering for IoT
 
Applitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdfApplitools Visual AI Overview.pdf
Applitools Visual AI Overview.pdf
 
The quality assurance checklist for progressive testing
The quality assurance checklist for progressive testingThe quality assurance checklist for progressive testing
The quality assurance checklist for progressive testing
 
The Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive TestingThe Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive Testing
 
Integrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirementsIntegrating AI in software quality in absence of a well-defined requirements
Integrating AI in software quality in absence of a well-defined requirements
 
BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!
 
How Automation Reveals Technical Debt
How Automation Reveals Technical DebtHow Automation Reveals Technical Debt
How Automation Reveals Technical Debt
 
InTTrust -IBM Artificial Intelligence Event
InTTrust -IBM Artificial Intelligence  EventInTTrust -IBM Artificial Intelligence  Event
InTTrust -IBM Artificial Intelligence Event
 
Hyf azure ml_1
Hyf azure ml_1Hyf azure ml_1
Hyf azure ml_1
 

More from Applitools

Building the Ideal CI-CD Pipeline_ Achieving Visual Perfection
Building the Ideal CI-CD Pipeline_ Achieving Visual PerfectionBuilding the Ideal CI-CD Pipeline_ Achieving Visual Perfection
Building the Ideal CI-CD Pipeline_ Achieving Visual Perfection
Applitools
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Applitools
 
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Applitools
 
Visual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UIVisual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UI
Applitools
 
A Test Automation Platform Designed for the Future
A Test Automation Platform Designed for the FutureA Test Automation Platform Designed for the Future
A Test Automation Platform Designed for the Future
Applitools
 
The Future of AI-Based Test Automation
The Future of AI-Based Test AutomationThe Future of AI-Based Test Automation
The Future of AI-Based Test Automation
Applitools
 
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed TeamsTest Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
Applitools
 
Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?
Applitools
 
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and FunctionalityTriple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
Applitools
 
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing TeamsNavigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Applitools
 
Introducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdfIntroducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdf
Applitools
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Applitools
 
Collaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing CentraCollaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing Centra
Applitools
 
What the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the FutureWhat the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the Future
Applitools
 
Getting Started with Visual Testing
Getting Started with Visual TestingGetting Started with Visual Testing
Getting Started with Visual Testing
Applitools
 
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with CypressWorkshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
Applitools
 
From Washing Cars To Automating Test Applications
From Washing Cars To Automating Test ApplicationsFrom Washing Cars To Automating Test Applications
From Washing Cars To Automating Test Applications
Applitools
 
A Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous DeliveryA Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous Delivery
Applitools
 
AI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser TestingAI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser Testing
Applitools
 
Workshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with JavascriptWorkshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with Javascript
Applitools
 

More from Applitools (20)

Building the Ideal CI-CD Pipeline_ Achieving Visual Perfection
Building the Ideal CI-CD Pipeline_ Achieving Visual PerfectionBuilding the Ideal CI-CD Pipeline_ Achieving Visual Perfection
Building the Ideal CI-CD Pipeline_ Achieving Visual Perfection
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
 
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
Streamlining Your Tech Stack: A Blueprint for Enhanced Efficiency and Coverag...
 
Visual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UIVisual AI for eCommerce: Improving Conversions with a Flawless UI
Visual AI for eCommerce: Improving Conversions with a Flawless UI
 
A Test Automation Platform Designed for the Future
A Test Automation Platform Designed for the FutureA Test Automation Platform Designed for the Future
A Test Automation Platform Designed for the Future
 
The Future of AI-Based Test Automation
The Future of AI-Based Test AutomationThe Future of AI-Based Test Automation
The Future of AI-Based Test Automation
 
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed TeamsTest Automation at Scale: Lessons from Top-Performing Distributed Teams
Test Automation at Scale: Lessons from Top-Performing Distributed Teams
 
Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?Can AI Autogenerate and Run Automated Tests?
Can AI Autogenerate and Run Automated Tests?
 
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and FunctionalityTriple Assurance: AI-Powered Test Automation in UI Design and Functionality
Triple Assurance: AI-Powered Test Automation in UI Design and Functionality
 
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing TeamsNavigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
Navigating the Challenges of Testing at Scale: Lessons from Top-Performing Teams
 
Introducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdfIntroducing the Applitools Self Healing Execution Cloud.pdf
Introducing the Applitools Self Healing Execution Cloud.pdf
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
 
Collaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing CentraCollaborating From Design To Experience: Introducing Centra
Collaborating From Design To Experience: Introducing Centra
 
What the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the FutureWhat the QA Position Will Look Like in the Future
What the QA Position Will Look Like in the Future
 
Getting Started with Visual Testing
Getting Started with Visual TestingGetting Started with Visual Testing
Getting Started with Visual Testing
 
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with CypressWorkshop: Head-to-Head Web Testing: Part 1 with Cypress
Workshop: Head-to-Head Web Testing: Part 1 with Cypress
 
From Washing Cars To Automating Test Applications
From Washing Cars To Automating Test ApplicationsFrom Washing Cars To Automating Test Applications
From Washing Cars To Automating Test Applications
 
A Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous DeliveryA Holistic Approach to Testing in Continuous Delivery
A Holistic Approach to Testing in Continuous Delivery
 
AI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser TestingAI-Powered-Cross-Browser Testing
AI-Powered-Cross-Browser Testing
 
Workshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with JavascriptWorkshop: An Introduction to API Automation with Javascript
Workshop: An Introduction to API Automation with Javascript
 

Recently uploaded

Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...
Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...
Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...
Asher Sterkin
 
Migrate your Infrastructure to the AWS Cloud
Migrate your Infrastructure to the AWS CloudMigrate your Infrastructure to the AWS Cloud
Migrate your Infrastructure to the AWS Cloud
Ortus Solutions, Corp
 
FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)
FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)
FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)
Roshan Dwivedi
 
Overview of ERP - Mechlin Technologies.pptx
Overview of ERP - Mechlin Technologies.pptxOverview of ERP - Mechlin Technologies.pptx
Overview of ERP - Mechlin Technologies.pptx
Mitchell Marsh
 
React Native vs Flutter - SSTech System
React Native vs Flutter  - SSTech SystemReact Native vs Flutter  - SSTech System
React Native vs Flutter - SSTech System
SSTech System
 
dachnug51 - All you ever wanted to know about domino licensing.pdf
dachnug51 - All you ever wanted to know about domino licensing.pdfdachnug51 - All you ever wanted to know about domino licensing.pdf
dachnug51 - All you ever wanted to know about domino licensing.pdf
DNUG e.V.
 
Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.
shivamt017
 
Intro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AIIntro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AI
Ortus Solutions, Corp
 
AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf
AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdfAWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf
AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf
karim wahed
 
CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.
CViewSurvey Digitech Pvt Ltd that  works on a proven C.A.A.G. model.CViewSurvey Digitech Pvt Ltd that  works on a proven C.A.A.G. model.
CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.
bhatinidhi2001
 
Addressing the Top 9 User Pain Points with Visual Design Elements.pptx
Addressing the Top 9 User Pain Points with Visual Design Elements.pptxAddressing the Top 9 User Pain Points with Visual Design Elements.pptx
Addressing the Top 9 User Pain Points with Visual Design Elements.pptx
Sparity1
 
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
Hironori Washizaki
 
What is OCR Technology and How to Extract Text from Any Image for Free
What is OCR Technology and How to Extract Text from Any Image for FreeWhat is OCR Technology and How to Extract Text from Any Image for Free
What is OCR Technology and How to Extract Text from Any Image for Free
TwisterTools
 
一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理
一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理
一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理
avufu
 
Leading Project Management Tool Taskruop.pptx
Leading Project Management Tool Taskruop.pptxLeading Project Management Tool Taskruop.pptx
Leading Project Management Tool Taskruop.pptx
taskroupseo
 
Wired_2.0_Create_AmsterdamJUG_09072024.pptx
Wired_2.0_Create_AmsterdamJUG_09072024.pptxWired_2.0_Create_AmsterdamJUG_09072024.pptx
Wired_2.0_Create_AmsterdamJUG_09072024.pptx
SimonedeGijt
 
ANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdfANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdf
sachin chaurasia
 
Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...
Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...
Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...
Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg
 
Attendance Tracking From Paper To Digital
Attendance Tracking From Paper To DigitalAttendance Tracking From Paper To Digital
Attendance Tracking From Paper To Digital
Task Tracker
 
dachnug51 - HCL Sametime 12 as a Software Appliance.pdf
dachnug51 - HCL Sametime 12 as a Software Appliance.pdfdachnug51 - HCL Sametime 12 as a Software Appliance.pdf
dachnug51 - HCL Sametime 12 as a Software Appliance.pdf
DNUG e.V.
 

Recently uploaded (20)

Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...
Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...
Ported to Cloud with Wing_ Blue ZnZone app from _Hexagonal Architecture Expla...
 
Migrate your Infrastructure to the AWS Cloud
Migrate your Infrastructure to the AWS CloudMigrate your Infrastructure to the AWS Cloud
Migrate your Infrastructure to the AWS Cloud
 
FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)
FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)
FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)
 
Overview of ERP - Mechlin Technologies.pptx
Overview of ERP - Mechlin Technologies.pptxOverview of ERP - Mechlin Technologies.pptx
Overview of ERP - Mechlin Technologies.pptx
 
React Native vs Flutter - SSTech System
React Native vs Flutter  - SSTech SystemReact Native vs Flutter  - SSTech System
React Native vs Flutter - SSTech System
 
dachnug51 - All you ever wanted to know about domino licensing.pdf
dachnug51 - All you ever wanted to know about domino licensing.pdfdachnug51 - All you ever wanted to know about domino licensing.pdf
dachnug51 - All you ever wanted to know about domino licensing.pdf
 
Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.Shivam Pandit working on Php Web Developer.
Shivam Pandit working on Php Web Developer.
 
Intro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AIIntro to Amazon Web Services (AWS) and Gen AI
Intro to Amazon Web Services (AWS) and Gen AI
 
AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf
AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdfAWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf
AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf
 
CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.
CViewSurvey Digitech Pvt Ltd that  works on a proven C.A.A.G. model.CViewSurvey Digitech Pvt Ltd that  works on a proven C.A.A.G. model.
CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.
 
Addressing the Top 9 User Pain Points with Visual Design Elements.pptx
Addressing the Top 9 User Pain Points with Visual Design Elements.pptxAddressing the Top 9 User Pain Points with Visual Design Elements.pptx
Addressing the Top 9 User Pain Points with Visual Design Elements.pptx
 
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
COMPSAC 2024 D&I Panel: Charting a Course for Equity: Strategies for Overcomi...
 
What is OCR Technology and How to Extract Text from Any Image for Free
What is OCR Technology and How to Extract Text from Any Image for FreeWhat is OCR Technology and How to Extract Text from Any Image for Free
What is OCR Technology and How to Extract Text from Any Image for Free
 
一比一原版英国牛���大学毕业证(oxon毕业证书)如何办理
一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理
一比一原版英国牛津大学毕业证(oxon毕业证书)如何办理
 
Leading Project Management Tool Taskruop.pptx
Leading Project Management Tool Taskruop.pptxLeading Project Management Tool Taskruop.pptx
Leading Project Management Tool Taskruop.pptx
 
Wired_2.0_Create_AmsterdamJUG_09072024.pptx
Wired_2.0_Create_AmsterdamJUG_09072024.pptxWired_2.0_Create_AmsterdamJUG_09072024.pptx
Wired_2.0_Create_AmsterdamJUG_09072024.pptx
 
ANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdfANSYS Mechanical APDL Introductory Tutorials.pdf
ANSYS Mechanical APDL Introductory Tutorials.pdf
 
Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...
Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...
Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...
 
Attendance Tracking From Paper To Digital
Attendance Tracking From Paper To DigitalAttendance Tracking From Paper To Digital
Attendance Tracking From Paper To Digital
 
dachnug51 - HCL Sametime 12 as a Software Appliance.pdf
dachnug51 - HCL Sametime 12 as a Software Appliance.pdfdachnug51 - HCL Sametime 12 as a Software Appliance.pdf
dachnug51 - HCL Sametime 12 as a Software Appliance.pdf
 

Add AI to Your SDLC, presented by Applitools and Curiosity

  • 2. © 2023 Objective Faster Delivery Of Quality Software From Idea To Consumer @BagmarAnand
  • 3. © 2023 Build quality in Preventing Defects Finding Defects Preventing Defects Finding Defects @BagmarAnand
  • 4. © 2023 Everyone wants fast feedback QUICK RESPONSE @BagmarAnand
  • 5. © 2023 Requirements Test Design Test Implementation Test Execution Test Analysis Testing Life-Cycle @BagmarAnand
  • 6. © 2023 Can AI help? @BagmarAnand Requirements Test Design Test Implementation Test Execution Test Analysis
  • 7. How can we use AI for quality at speed?
  • 8. © Curiosity Software 2023 Challenges to solve before/as you implement AI Garbage in/Garbage out Foundational LLMs do not “know” your org. and systems, but you lack structured, up-to-date and accurate data to feed them. Transparency & Coverage What are you testing? Have you tested enough? AI test generation is often a black box, without explainability or coverage control. Security How can you set-up a private Large Language Model on-premise when you lack the data to feed it? Agile best practice Unintegrated, “point solutions” silo teams and toolchains. They damage comms, prevent parallelisation, and push quality later.
  • 9. © Curiosity Software 2023 AI for ideation, design and requirements Incomplete, ambiguous RQMTs Problems worth solving: Miscommunications Most bugs start here Technical debt / out-of-date Have to manually derive tests “3 amigos” Prompt, critique, enhance AI feedback Generate unambiguous, complete flows & stories Generative AI SMEs in the loop With AI and Modelling AI finds & fixes gaps/ambiguity Clear, concise, collaborative & complete Developers build the right system Structure data for LLMs
  • 10. Demo © Curiosity Software Ireland Ltd. 2023
  • 11. © Curiosity Software 2023 LLM Assistants answer questions based on models & stories AI-assisted development – building the RQMTs RQMTs-created bugs Problems worth solving: Missing knowledge Technical debt Overwhelming complexity “3 amigos” Models Generative AI With AI and Modelling … ? Copilot & ChatOps LLM training SDLC Data / Artifacts Knowledge for accurate dev Navigate complexity Avoid technical debt Dev </> Check- in
  • 12. Demo © Curiosity Software Ireland Ltd. 2023
  • 13. © Curiosity Software 2023 Repetitive & manual Problems : Low test coverage Brittle & maintenance Test Design & Script Creation “3 amigos” Models Generative AI … LLM AI assistants – know what to test ? Dev </> Data, Scripts, Tests AI Generated Verify With AI and Modelling Autogenerate tests & data Optimal coverage Self-healing & maintenance
  • 14. Demo © Curiosity Software Ireland Ltd. 2023
  • 15. Demo © Curiosity Software Ireland Ltd. 2023 Requirements Test Design Test Implementation Test Execution Test Analysis @BagmarAnand
  • 16. Demo © Curiosity Software Ireland Ltd. 2023
  • 17. © 2023 • Have a holistic Quality Strategy for your product • Shift-Left to get quick feedback • Include Visual Testing in your Automation Strategy @BagmarAnand Summary
  • 18. © 2023 • Applitools Visual AI adds AI-power to your functional automation • Less code + greater test coverage + stable code = Less defects in production • Applitools Visual AI + Ultrafast Cloud = AI-powered Cross- Browser Testing • Less test data, Less load on environment, Less flakiness, Super-Fast • Applitools Execution Cloud • Self-heal your tests, parallel execution, test local applications @BagmarAnand Summary
  • 19. © Curiosity Software 2023 An accelerator throughout design, dev, test Design Test Monitor Develop Collaboratively model and refine requirements ✓ AI model generation ✓ AI feedback & refinement ✓ Human in the loop Generate AI- augmented tests ✓ Coverage ✓ Explainability ✓ Visibility Develop the RQMTs using ChatOps & Co-pilots ✓ Knowledge to dev accurately ✓ Perfect RQMTs Data for your LLM © Curiosity Software 2023
  • 20. © Curiosity Software 2023 Shift left to fix QA & AI Test Cases Test Automation Test Data Perfect RQMTs Coverage AI Readiness ✓ Collaborative ✓ Quality ✓ AI-Assisted ✓ Rapid