The Future of AI-Based Test Automation
•
0 likes•198 views
Explore the capabilities of AI in software test automation and see a demonstration of how AI can be used today to significantly expand end-to-end test coverage in this session with Applitools CTO Adam Carmi. Plus, see a special sneak peek of the next great wave in test automation—autonomous testing. More info and session materials at http://applitools.info/xe6
Report
Share
More Related Content
Similar to The Future of AI-Based Test Automation
Similar to The Future of AI-Based Test Automation (20)
More from Applitools
More from Applitools (20)
Recently uploaded
Recently uploaded (20)
The Future of AI-Based Test Automation
- 1. 1 The future of AI based E2E test automation Adam Carmi CTO & Co-Founder @ Applitools Sep 2023 AI Powered Testing & Monitoring
- 2. 2 Agenda • Why E2E testing? • Challenges with automated E2E testing • How can AI assist today? • What role will AI play (in the very near) future? • Q&A
- 3. 4 E2E (UI based) test automation • Verify the correctness of a system through its UI • Simulating user interactions as input • Asserting the output rendered in the UI • Supported by dozens of tools and frameworks • Selenium, Cypress, Playwright, WDIO, Appium, …
- 4. 5 E2E testing is critically important!
- 5. 6 What’s wrong with traditional E2E test automation?
- 6. 7 Example UI test: required login details
- 7. 8 A traditional UI test Need to write a lot of code Code will break when the UI changes
- 8. 9 When the UI changes…
- 9. 10 Can’t catch unexpected visual bugs! A visual bug
- 10. 11 Can’t catch unexpected functional bugs! A functional bug
- 11. 12 Automated E2E testing challenges • Thousands of tests required to cover a modern app • Low coverage • High maintenance overhead • Skill set dependent
- 12. 14 How can AI assist with E2E testing today?
- 13. 15 How can AI assist with E2E testing today? • Replace your traditional assertions with visual validations • Stabilize your builds with self-healing locators
- 14. 16 Replace assertions with visual checkpoints
- 15. 17
- 16. 18
- 17. 19
- 18. 20 Visual checkpoints advantages • Enhances existing tests and reduces the amount of test code by up to 80% • A single visual checkpoint for complete visual and functional coverage • Catches unexpected defects • Does not break when the UI changes • No coding skills required to maintain validation logic
- 19. 21 Ultrafast cross device and browser testing ✓ Innovative ✓ Fast ✓ Stable ✓ Secure ✓ Simple
- 20. 22 Demo E2E testing with Cypress and Applitools Eyes
- 21. 23 AI can stabilize your builds with self-healing locators
- 22. 24 Element locators are the root of all evil Element locators break following UI changes
- 23. 25 Element locators breaking is the primary cause for delayed test feedback and for high test maintenance overhead following UI changes
- 24. 26 Self healing applies AI to find an element even if its locator is broken using information learned from previous successful runs
- 25. 27 How does self-healing work? • Every time we find an element • Capture hundreds of data points about the element • All attributes, location in hierarchy, details of ancestor and neighbor elements • Store data in a DB using the locator as key • When we can’t locate an element using a given locator • Retrieve information from the DB using the failed locator • Use proprietary algorithms to find the element based on that information • If successful, update the DB and suggest a new locator in our dashboard • Return the found element
- 26. 28 What can be healed? • Self-healing can find an element even if simultaneously • Element properties change (e.g., ID, class, tag name, custom, etc) • Text changes (clickable text, input value, label, placeholder) • DOM position changes (hierarchy, position in list) • Size and location changes • Adaptive • Implicitly wait for elements
- 27. 29 The huge benefits of self-healing • Tests don’t crash and don’t delay feedback to developers • Release faster and avoid dev context switching • No need to fix broken locators following UI changes • Although we report them and suggest how to fix them • Save hours reviewing failed test reports and fixing broken locators • Can double the efficiency of each team member
- 28. 30 When is self healing useful? • Avoid test failures and test maintenance following UI changes • Poor locator authoring skills • Apps with weak locators • Apps with dynamically generated UI (dynamic ids)
- 29. 31 Demo Self healing locators with the Applitools Execution Cloud
- 30. 32 How can AI assist with E2E testing today? • Drastically increase test coverage • Reduce the amount of test code to author and maintain • Eliminate repetitive maintenance work • Lower required skill set • Improve build stability • Shorten feedback loops and increase team velocity
- 31. 33 What role will AI play in the future?
- 32. 34 Autonomous testing platforms • Create an entire test suite for your app out of the box • Automatic app exploration • Automatic validations (regressions, benchmarks, generic test flows) • Doesn’t have to provide 100% coverage to be valuable • The more generic your app is, the better it will work • Guide the AI where it needs help • Training • Test code • Record interactions with the UI • In plain English: “Click the link below the blue button at the bottom of the page”
- 33. 35 How to evaluate an autonomous tool? • What coverage are you getting? • Discovery, validation, coverage changes • Ongoing maintenance overhead • How well will the tool adapt to application changes? • How does the tool facilitate large scale test maintenance? • What skills are required to operate the tool? • Testing, coding, element locators, ML, Devops, etc. • How easy is it to guide the AI where it needs help?
- 34. 36
- 35. 37 Demo Prompt based test execution + ChatGPT
- 36. 38 ChatGPT Give me step by step instructions for ordering the Dune book in amazon.com for Kindle using my default payment details. Include only mandatory steps assuming I'm already logged in and in amazon.com. Each step should consist of a single line and should start with an action such as "click" or "type" and followed by a description of the target element. include only interaction steps and skip validation steps. Include only a single option in each step.
- 37. 40 What role will testers play in the future?
- 38. 41 What role will human testers play? • Testing will become more important than ever • AI is not 100% accurate and so will the app code it will generate! • Less skilled developers • Much more (AI generated) code to test • Human testers will need to • Decide on the testing strategy and tools • Guide and fine tune the AI • Determine if a change is a bug or a feature • Test everything the AI won’t be able to
- 39. 42 Questions? Adam Carmi (@carmiadam) Co-Founder and CTO at Applitools