This document provides an overview of a presentation on agile test planning. It discusses the challenges of agile requirements and how test strategies serve a purpose beyond a single sprint. It also examines how the agile manifesto relates to planning and the value of test plans in agile. The presentation outlines four testing phases in agile - requirements and design, story/feature verification, system verification, and acceptance. It provides examples of what should be included in a test plan for each phase such as scenarios, automation approach, dependencies, and acceptance criteria.
Hey You Got Your TDD in my SQL DB by Jeff McKenzie
TDD involves writing tests before writing code to satisfy requirements. The document discusses TDD, providing:
1. An overview of the TDD process and definitions of its key steps - make a test, make it fail, make it pass.
2. An example walking through writing a test for an "easy button" and implementing the code to pass the test.
3. Reasons for using TDD, including improved code quality, design, discipline, and documentation from maintaining an automated test suite.
I believe that our existing models of testing are not fit for purpose – they are inconsistent, controversial, partial, proprietary and stuck in the past. They are not going to support us in the rapidly emerging technologies and approaches. The certification schemes that should represent the interests and integrity of our profession don’t, and we are left with schemes that are popular, but have low value, lower esteem and attract harsh criticism. My goal in proposing the New Model is to stimulate new thinking in this area.
eurostarconferences.com
testhuddle.com
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
Learn about the new partnership between QASymphony and TestPlant. TestPlant’s functional automation tool, eggPlant, will be integrated with QASymphony’s qTest platform, providing a seamless solution for automated and manual testers. This partnership will help testing teams of all types get the visibility and traceability needed to understand their coverage and risk. In this webinar, Kevin Dunne, QASymphony's VP of Strategy and Business Development and Antony Edwards, TestPlant's CTO will answer the following questions:
What is qTest?
What is eggPlant?
How does the integration between qTest and eggPlant work?
How will the integration help me and/or my team?
This document discusses the speaker's background and experiences with software engineering practices. It covers his education in computational mathematics and computer science, past roles at Universal Instruments developing machine software and at Google and Etsy implementing DevOps practices. Key topics covered include the benefits of continuous integration, deployment and delivery; the importance of testing including test-driven development; and embracing interdependence between developers and other IT roles. Best practices are noted to be situational and relationships must be respected.
- Understand the principles behind the agile approach to software development
- Differentiate between the testing role in agile projects compared with the role of testers in non-agile projects
- Positively contribute as an agile team member focused on testing
- Appreciate the challenges and difficulties associated with the non-testing activities performed in an agile team
- Demonstrate a range of soft skills required by agile team members
Looking to move to Continuous Delivery? Worried about the quality of your the code? Helping your developers understand clean-code practices and getting the right testing strategy in place can take a while. What should you do to control the quality of the incoming code till then? This talk shares our experience of using PRRiskAdvisor to gradually educate and influence developers to write better code and also help the code reviewer to be more effective at their reviews.
Every time a developer raises a pull-request, PRRiskAdvisor analyzes the files that were changed and publishes a report on the pull request itself with the overall risk associated with this pull request and also risk associated with each file. It also runs static code analysis using SonarQube and publishes the configured violations as comments on the pull request. This way the reviewer just has to look at the pull request to get a decent idea of what it means to review this pull request. If there are too many violations, then PRRiskAdvisor can also automatically reject the pull request.
By doing this, we saw our developers starting paying more attention to clean code practices and hence the overall quality of the incoming code improved, while we worked on putting the right engineering practices and testing strategy in place.
More details: https://confengine.com/last-conference-canberra-2018/proposal/7294/improving-the-quality-of-incoming-code
Conference Link: https://2019.agileindia.org
Tackling software testing challenges in the agile era
This document provides an overview of testing challenges in the Agile development era and discusses different testing methodologies. It contains introductions to four chapters that will be included in the eBook. The chapters are written by Vu Lam, CEO of QASymphony, and Sellers Smith, Director of Quality Assurance and Agile Evangelist for Silverpop.
The first chapter discusses how testers need to be reimagined for the Agile age. Testers must adopt an Agile mindset and be involved earlier in the development process. They also need tools designed specifically for Agile testing. The second chapter explores different testing methods including automated, exploratory, and user acceptance testing. It advises using
In this webinar, Hans goes through a number of solutions a team can do to diminish this problem, and what actions to take when it happens. Hans discussed the following solutions on how one can apply better test design to drive better automation, a number of technical strategies, what developers and product owners can do to help, and how to handle the testing and automation work that is still left after a sprint has finished. A key item in handling the test automation work that is left over is that QA’s need to own the testing from the beginning, and should not get stuck in the work of previous sprints, since that will inhibit good cooperation with other team members, making matters worse.
Key Takeaways:
- Get more tests created and automated.
- Make automation manageable and maintainable.
- Keep the QA people in sync with their fellow team members.
View webinar recording - https://testhuddle.com/resource/how-to-get-automated-testing-done/
The New Agile Testing Quadrants: Bringing Skilled Testers and Developers Toge...
You want to integrate skilled testing and development work. But how do you accomplish this without developers accidentally subverting the testing process or testers becoming an obstruction? Efficient, deep testing requires “critical distance” from the development process, commitment and planning to build a testable product, dedication to uncovering the truth, responsiveness among team members, and often a skill set that developers alone—or testers alone—do not ordinarily possess. James Bach presents a model—a redesign of the famous Agile Testing Quadrants that distinguished between business vs. technical facing tests and supporting vs. critiquing―that frames these dynamics and helps teams think through the nature of development and testing roles and how they might blend, conflict, or support each other on an Agile project. James includes a brief discussion of the original Agile Testing Quadrants model, which the presenters believe has created much confusion about the role of testing in Agile.
The document discusses moving to a behavior-driven development (BDD) approach. It outlines challenges with traditional software development processes, such as requirements getting lost in handoffs. BDD aims to address these by shifting testing to the beginning through acceptance tests written in a "Given-When-Then" format. This allows teams to build testable code, catch issues earlier, and deploy features incrementally. Adopting BDD requires training, champion support, and patience. Metrics should track success, and teams can start small before a full rollout.
Test Estimation Hacks: Tips, Tricks and Tools Webinar
In this webinar, Matt Heusser explains how not only how to deal with tough questions, but how to prepare and defend estimates that stand up to scrutiny. The conversation includes six estimating models - comparison, functional decomposition, timeboxed, and prediction, along the Guru Method and, perhaps, a little on #NoEstimates.
Don’t miss this opportunity to learn:
Learn the common mistakes in software test estimation
How Testing is different than linear tasks like development (and how to talk about it)
Learn what goes wrong in discussions about schedule
An explanation of ways to estimate for test - by comparison, functional decomposition, timeboxing, prediction and the guru method
How to recognize when you are actually in test negotiation, not test estimation...and what to do about it
Matt Heusser will discusses these topics and much, much more! Watch now: http://pi.qasymphony.com/test-estimation-hacks-webinar-lp057
Agile tour ncr test360_degree - agile testing on steroids
This document discusses challenges with product testing in agile environments and introduces an approach called "Agile Testing on Steroids" to address these challenges. It presents the philosophy behind Agile Testing on Steroids which is to take a pragmatic approach using integrated toolsets and practices to remove subjectivity from decision making. Key aspects include test automation, continuous integration, requirement and test case management, defect tracking, and metrics collection to enable fact-based prioritization, decisions and traceability between requirements, code, tests and defects. The benefits outlined are more streamlined, systematic and comprehensive testing that acts as an informal collaboration platform.
This document discusses agile testing methodology. It begins with general concepts of agile testing such as testing from the customer perspective as early as possible. It then discusses agile testing methodology, challenges, test levels from first to third view perspectives involving extreme testing, exploratory testing, and collaboration between development and testing. The document also covers benefits of being an agile tester such as working as one team towards a common goal. In conclusion, it states that agile testing is useful, less time consuming and effective from the customer's point of view when automated testing is performed and developers, testers and customers work together as a team.
Chicago Code Camp 2014 - Agile Testing in a waterfall world
The document provides information about Angela Dugan, an ALM Practice Manager with over 15 years of experience in the software industry. It discusses her background working with Microsoft and Polaris Solutions. The rest of the document covers topics related to adopting agile practices for testing, including comparing waterfall and agile approaches, challenges in transitioning to agile testing, and recommendations for collaboration between testers and developers.
Exploratory Testing with JIRA | QASymphony Webinar
Kyle McMeekin presented on using JIRA for exploratory testing. He discussed problems with traditional scripted testing approaches and explained exploratory testing as a more flexible parallel process. Exploratory testing allows testers to investigate opportunities, share knowledge, and keep testing engaging. Session-based testing provides structure for exploratory testing by tracking test charters, notes, issues and more. Tools like JIRA Capture and qTest Explorer help capture evidence from exploratory testing sessions.
Let's explore what is agile testing, how agile testing is different than traditional testing. What practices team has to adopt to have parallel testing and how to create your own test automation framework. Test automation frameworks using cucumber, selenium, junit, nunit, rspec, coded UI etc.
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
- The document outlines Polarion's test management software capabilities including creating and managing test cases, defects, requirements and specifications with Polarion LiveDocs. It allows defining and running test runs with the Polarion Testing Framework.
- It discusses how Polarion can help integrate requirements, testing and defect management and manage activities with all stakeholders.
- The presentation then demonstrates Polarion's abilities like requirements and test traceability, test planning and execution, impact analysis and reporting across projects.
Lean Solutions – Agile Transformation at the United States Postal Service
The postal business is changing at a rapid pace and the Postal Service must continue to change quickly to remain relevant and competitive in the marketplace. The Postal Service implemented the Agile methodology, replacing the traditional waterfall methodology to improve project communication, increase customer satisfaction, realize business benefits quickly, and improve overall quality. Please join us as Mark outlines the challenges Postal faced before using Agile, how Agile has been implemented across the enterprise, lessons learned, benefits and where they are headed next with Agile Transformation.
Ten steps to test automation success are outlined. The key steps are to improve testing processes, define requirements, prove automation concepts, design products for testability, create sustainable test designs, plan deployments, and address challenges. Test automation can significantly reduce testing effort and increase coverage, but requires careful test selection, design, and addressing common problems like lack of goals, experience, and understanding of new technologies.
This is a practical guide for sprint development based on the OutSystems Delivery Method.
It helps you focus some of the main challenges found when using Agile in the field:
- Your sprints often start not being ready?
- Delivering at sprint end is always struggle?
Then you should take a look!
Target audience: Agile Project Managers (including Engagement and Delivery Managers)
This document summarizes an Agile Testing Analytics presentation given at STARWEST 2016. The presenter, Jonathan Alexander from QASymphony, discussed how to leverage testing data through analytics to improve test coverage, forecast completion dates, efficiency, test case quality, and productivity. He outlined different types of analytics including quality, coverage, velocity, and test case optimization analytics. Examples of metrics included test result percentages, defects by priority and status, requirements test coverage, and test case execution times. The presentation provided tips on visualizing data and recommended starting with requirements, test results, and defect data to build initial analytics reports.
This document discusses agile test automation and addresses whether it is an essential truth, oxymoron, or lie. It notes that agile emphasizes parallel teamwork between development, testing, and business. While test automation may initially require extensive ramp-up time and skills acquisition, building a library of automated scripts and using programmatic test tools can help achieve faster feedback, consistency, and avoid technical debt. The document advocates automating tests in parallel with development in each sprint to allow for easy, flexible regression testing. It argues that with an evolving approach to automation and a focus on reusing test data, process knowledge, and results, agile test automation can be an essential part of the agile process.
Evolve or Die: Healthcare IT Testing | QASymphony WebinarQASymphony
Modern software testing for Healthcare Organizations. Learn about best practices for software testing in the healthcare industry featuring Mike Cooper, Chief Quality Officer of Healthcare IT Leaders and Kevin Dunne, VP of Business Development at QASymphony
TDD involves writing tests before writing code to satisfy requirements. The document discusses TDD, providing:
1. An overview of the TDD process and definitions of its key steps - make a test, make it fail, make it pass.
2. An example walking through writing a test for an "easy button" and implementing the code to pass the test.
3. Reasons for using TDD, including improved code quality, design, discipline, and documentation from maintaining an automated test suite.
I believe that our existing models of testing are not fit for purpose – they are inconsistent, controversial, partial, proprietary and stuck in the past. They are not going to support us in the rapidly emerging technologies and approaches. The certification schemes that should represent the interests and integrity of our profession don’t, and we are left with schemes that are popular, but have low value, lower esteem and attract harsh criticism. My goal in proposing the New Model is to stimulate new thinking in this area.
eurostarconferences.com
testhuddle.com
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...QASymphony
Learn about the new partnership between QASymphony and TestPlant. TestPlant’s functional automation tool, eggPlant, will be integrated with QASymphony’s qTest platform, providing a seamless solution for automated and manual testers. This partnership will help testing teams of all types get the visibility and traceability needed to understand their coverage and risk. In this webinar, Kevin Dunne, QASymphony's VP of Strategy and Business Development and Antony Edwards, TestPlant's CTO will answer the following questions:
What is qTest?
What is eggPlant?
How does the integration between qTest and eggPlant work?
How will the integration help me and/or my team?
Testing and DevOps Culture: Lessons LearnedLB Denker
This document discusses the speaker's background and experiences with software engineering practices. It covers his education in computational mathematics and computer science, past roles at Universal Instruments developing machine software and at Google and Etsy implementing DevOps practices. Key topics covered include the benefits of continuous integration, deployment and delivery; the importance of testing including test-driven development; and embracing interdependence between developers and other IT roles. Best practices are noted to be situational and relationships must be respected.
- Understand the principles behind the agile approach to software development
- Differentiate between the testing role in agile projects compared with the role of testers in non-agile projects
- Positively contribute as an agile team member focused on testing
- Appreciate the challenges and difficulties associated with the non-testing activities performed in an agile team
- Demonstrate a range of soft skills required by agile team members
Looking to move to Continuous Delivery? Worried about the quality of your the code? Helping your developers understand clean-code practices and getting the right testing strategy in place can take a while. What should you do to control the quality of the incoming code till then? This talk shares our experience of using PRRiskAdvisor to gradually educate and influence developers to write better code and also help the code reviewer to be more effective at their reviews.
Every time a developer raises a pull-request, PRRiskAdvisor analyzes the files that were changed and publishes a report on the pull request itself with the overall risk associated with this pull request and also risk associated with each file. It also runs static code analysis using SonarQube and publishes the configured violations as comments on the pull request. This way the reviewer just has to look at the pull request to get a decent idea of what it means to review this pull request. If there are too many violations, then PRRiskAdvisor can also automatically reject the pull request.
By doing this, we saw our developers starting paying more attention to clean code practices and hence the overall quality of the incoming code improved, while we worked on putting the right engineering practices and testing strategy in place.
More details: https://confengine.com/last-conference-canberra-2018/proposal/7294/improving-the-quality-of-incoming-code
Conference Link: https://2019.agileindia.org
Tackling software testing challenges in the agile eraQASymphony
This document provides an overview of testing challenges in the Agile development era and discusses different testing methodologies. It contains introductions to four chapters that will be included in the eBook. The chapters are written by Vu Lam, CEO of QASymphony, and Sellers Smith, Director of Quality Assurance and Agile Evangelist for Silverpop.
The first chapter discusses how testers need to be reimagined for the Agile age. Testers must adopt an Agile mindset and be involved earlier in the development process. They also need tools designed specifically for Agile testing. The second chapter explores different testing methods including automated, exploratory, and user acceptance testing. It advises using
In this webinar, Hans goes through a number of solutions a team can do to diminish this problem, and what actions to take when it happens. Hans discussed the following solutions on how one can apply better test design to drive better automation, a number of technical strategies, what developers and product owners can do to help, and how to handle the testing and automation work that is still left after a sprint has finished. A key item in handling the test automation work that is left over is that QA’s need to own the testing from the beginning, and should not get stuck in the work of previous sprints, since that will inhibit good cooperation with other team members, making matters worse.
Key Takeaways:
- Get more tests created and automated.
- Make automation manageable and maintainable.
- Keep the QA people in sync with their fellow team members.
View webinar recording - https://testhuddle.com/resource/how-to-get-automated-testing-done/
You want to integrate skilled testing and development work. But how do you accomplish this without developers accidentally subverting the testing process or testers becoming an obstruction? Efficient, deep testing requires “critical distance” from the development process, commitment and planning to build a testable product, dedication to uncovering the truth, responsiveness among team members, and often a skill set that developers alone—or testers alone—do not ordinarily possess. James Bach presents a model—a redesign of the famous Agile Testing Quadrants that distinguished between business vs. technical facing tests and supporting vs. critiquing―that frames these dynamics and helps teams think through the nature of development and testing roles and how they might blend, conflict, or support each other on an Agile project. James includes a brief discussion of the original Agile Testing Quadrants model, which the presenters believe has created much confusion about the role of testing in Agile.
Making the Move to Behavior Driven DevelopmentQASymphony
The document discusses moving to a behavior-driven development (BDD) approach. It outlines challenges with traditional software development processes, such as requirements getting lost in handoffs. BDD aims to address these by shifting testing to the beginning through acceptance tests written in a "Given-When-Then" format. This allows teams to build testable code, catch issues earlier, and deploy features incrementally. Adopting BDD requires training, champion support, and patience. Metrics should track success, and teams can start small before a full rollout.
Test Estimation Hacks: Tips, Tricks and Tools WebinarQASymphony
In this webinar, Matt Heusser explains how not only how to deal with tough questions, but how to prepare and defend estimates that stand up to scrutiny. The conversation includes six estimating models - comparison, functional decomposition, timeboxed, and prediction, along the Guru Method and, perhaps, a little on #NoEstimates.
Don’t miss this opportunity to learn:
Learn the common mistakes in software test estimation
How Testing is different than linear tasks like development (and how to talk about it)
Learn what goes wrong in discussions about schedule
An explanation of ways to estimate for test - by comparison, functional decomposition, timeboxing, prediction and the guru method
How to recognize when you are actually in test negotiation, not test estimation...and what to do about it
Matt Heusser will discusses these topics and much, much more! Watch now: http://pi.qasymphony.com/test-estimation-hacks-webinar-lp057
Agile tour ncr test360_degree - agile testing on steroidsVipul Gupta
This document discusses challenges with product testing in agile environments and introduces an approach called "Agile Testing on Steroids" to address these challenges. It presents the philosophy behind Agile Testing on Steroids which is to take a pragmatic approach using integrated toolsets and practices to remove subjectivity from decision making. Key aspects include test automation, continuous integration, requirement and test case management, defect tracking, and metrics collection to enable fact-based prioritization, decisions and traceability between requirements, code, tests and defects. The benefits outlined are more streamlined, systematic and comprehensive testing that acts as an informal collaboration platform.
This document discusses agile testing methodology. It begins with general concepts of agile testing such as testing from the customer perspective as early as possible. It then discusses agile testing methodology, challenges, test levels from first to third view perspectives involving extreme testing, exploratory testing, and collaboration between development and testing. The document also covers benefits of being an agile tester such as working as one team towards a common goal. In conclusion, it states that agile testing is useful, less time consuming and effective from the customer's point of view when automated testing is performed and developers, testers and customers work together as a team.
Chicago Code Camp 2014 - Agile Testing in a waterfall worldAngela Dugan
The document provides information about Angela Dugan, an ALM Practice Manager with over 15 years of experience in the software industry. It discusses her background working with Microsoft and Polaris Solutions. The rest of the document covers topics related to adopting agile practices for testing, including comparing waterfall and agile approaches, challenges in transitioning to agile testing, and recommendations for collaboration between testers and developers.
Exploratory Testing with JIRA | QASymphony WebinarQASymphony
Kyle McMeekin presented on using JIRA for exploratory testing. He discussed problems with traditional scripted testing approaches and explained exploratory testing as a more flexible parallel process. Exploratory testing allows testers to investigate opportunities, share knowledge, and keep testing engaging. Session-based testing provides structure for exploratory testing by tracking test charters, notes, issues and more. Tools like JIRA Capture and qTest Explorer help capture evidence from exploratory testing sessions.
Let's explore what is agile testing, how agile testing is different than traditional testing. What practices team has to adopt to have parallel testing and how to create your own test automation framework. Test automation frameworks using cucumber, selenium, junit, nunit, rspec, coded UI etc.
- The document outlines Polarion's test management software capabilities including creating and managing test cases, defects, requirements and specifications with Polarion LiveDocs. It allows defining and running test runs with the Polarion Testing Framework.
- It discusses how Polarion can help integrate requirements, testing and defect management and manage activities with all stakeholders.
- The presentation then demonstrates Polarion's abilities like requirements and test traceability, test planning and execution, impact analysis and reporting across projects.
Lean Solutions – Agile Transformation at the United States Postal ServiceITSM Academy, Inc.
The postal business is changing at a rapid pace and the Postal Service must continue to change quickly to remain relevant and competitive in the marketplace. The Postal Service implemented the Agile methodology, replacing the traditional waterfall methodology to improve project communication, increase customer satisfaction, realize business benefits quickly, and improve overall quality. Please join us as Mark outlines the challenges Postal faced before using Agile, how Agile has been implemented across the enterprise, lessons learned, benefits and where they are headed next with Agile Transformation.
Ten steps to test automation success are outlined. The key steps are to improve testing processes, define requirements, prove automation concepts, design products for testability, create sustainable test designs, plan deployments, and address challenges. Test automation can significantly reduce testing effort and increase coverage, but requires careful test selection, design, and addressing common problems like lack of goals, experience, and understanding of new technologies.
This is a practical guide for sprint development based on the OutSystems Delivery Method.
It helps you focus some of the main challenges found when using Agile in the field:
- Your sprints often start not being ready?
- Delivering at sprint end is always struggle?
Then you should take a look!
Target audience: Agile Project Managers (including Engagement and Delivery Managers)
This document discusses acceptance testing, which is formal testing conducted by end users to determine if a system meets requirements and business processes before it is accepted. The document outlines what acceptance testing is, different types including user acceptance testing and operational acceptance testing, common application areas, how it fits into software development lifecycles, challenges, and guidelines for success. It also briefly discusses outsourcing acceptance testing.
7 Tips from Siemens Energy for Success with AutomationWorksoft
Nathan Sharp of Siemens Energy recently spoke at the SAP Project Management in Atlanta and shared 7 important elements for the successful adoption of automated business process validation in their organization.
Originally presented by Nathan Sharp of Siemens Energy at SAPinsider’s Project Management conference.
Test Planning and Test Estimation TechniquesMurageppa-QA
In this Quality Assurance Training session, you will learn about Types of Testing , Test Strategy and Planning, and Test Estimation Techniques. Topic covered in this session are:
• Test Planning,
• Test Estimation Techniques
For more information, about this quality assurance training, visit this link: https://www.mindsmapped.com/courses/quality-assurance/software-testing-training-with-hands-on-project-on-e-commerce-application/
Microsoft Dynamics AX Implementation Stabilization Case Studiesmeritweb
Learn about the risks, challenges, and best practices for implementing Microsoft Dynamics AX in enterprise manufacturing and supply chain environments. Hear about a couple of our Microsoft Dynamics AX implementation stabilization case studies.
Learn how to establish a greater sense of confidence in your release cycle, along with the practices and processes to create a high-performing engineering culture within your team.
like Google, Improve your Test perception & practices and learn how Test might be a key lever to improve your business.
- Understand the different types of Test
- Best & Worst practices of Test
The document discusses agile adoption and whether it leads to success or failure. It defines agile and compares it to the waterfall model, noting problems with waterfall like lack of flexibility. It also discusses reasons why agile projects may fail, such as not having the right tools, culture, or collaboration. The document provides a case study example and ways to measure agility of a team.
Strategy vs. Tactical Testing: Actions for Today, Plans for TomorrowEggplant
In his STAREAST Virtual+ presentation, Chuck Schneider from Cerner Corporation shared his 6 pillars for strategic planning in testing and offered guidance to navigate the necessary pivot towards tactical execution when faced with a survival situation. Chuck provided a clear, 4-step guide on how to quickly develop and implement a tactical testing plan to avoid the pitfalls of a delayed response. In this presentation you will discover how to harness your strengths, achieve focus, and deliver results in times of incredible change.
Top Ten Tips for Tackling Test Automation Webinar Presentation.pptxInflectra
Inflectra and Checkpoint Technologies co-hosted the webinar: Top Ten Tips for Tackling Test Automation. In this webinar, Adam Sandman (Inflectra) and Bob Crews (Checkpoint Technologies) explored the challenges surrounding test automation and offered their tips on overcoming them.
Find the recording of the Webinar on our YouTube channel: https://www.youtube.com/watch?v=vY1MbW4qWnQ
Webinar Agenda:
-Top 10 challenges of test automation with impact and solutions
-Impacts: potential risks if challenges are not overcome
-Solutions: tips to overcoming the challenges
-Automated functional testing
-Criteria of an Automation Assessment
-Addressing several challenges with Inflectra's Spira and Rapise
Webinar Presenters:
Adam Sandman is the Founder and CEO of Inflectra. He has been working in the IT industry for the past 25+ years. His areas of expertise span software architecture to agile development, software testing, test automation, and project management. He is interested in technology, business, and enabling people to follow their passions. At Inflectra, Adam is responsible for researching the tools, technologies, and processes in the software testing and quality assurance space. Adam is a prolific speaker whose speaking engagements range from StarEast, and Eurostar to STPcons, DevGeekWeek, Swiss Testing Day, NDIA, STARCanada, TestingMind, Agile DevOps West, StarWest, testCon, JFTL, and many more.
Bob Crews, Co-Founder and CEO of Checkpoint Technologies, is a consultant with 34 years of IT experience in full life-cycle development and software testing. Bob and his organization provide services and solutions focused on QA with a concentration in functional, performance and application security testing. He’s assisted organizations such as Harvard University, Raymond James, the FBI, and the Department of Veterans Affairs in developing teams, processes, and solutions to help organizations deliver higher quality software faster. He’s consulted for over 290 organizations on QA, effective software testing, strategic test planning, enhanced test automation, and risk-based testing. He’s exceptionally enthusiastic about the future of IT and software testing and believes “The best is yet ahead!”
This document discusses continuous testing in an agile environment. It defines continuous testing as testing throughout the development process to identify bugs early. It explains that continuous testing helps control side effects, avoid defects, support multiple environments, get fast results, anticipate risks, and create reliable processes. The document provides an overview of how continuous testing works, including test environments, data management, automatic deployment, and test automation. It also discusses creating a continuous testing project, the agile test process, and how to implement effective continuous testing to improve quality and business value.
The document discusses benchmarking and function points as metrics for software projects. It defines benchmarking as comparing business processes and performance metrics to industry best practices. It outlines the benchmarking process which includes identifying what to benchmark, creating a team, collecting data from other organizations, analyzing gaps, and implementing an action plan. The document also discusses function points as a standardized software metric that measures functionality rather than lines of code. It notes the strengths and weaknesses of using function points for economic and quality analyses in software projects.
The main objective of this talk is to highlight the key Quality contamination and challenges that impact the Agile Scrum Teams and the remedies. It also mentions how scrum teams struggles for Quality assurance while implementing scrum and how defining Quality strategies helps.
Quality contamination:
• No QA strategy/Plan or checklist or milestones defined for Project
• No Gates/Checkpoints defined
• No Metrics defined, measured and tracked.
• No Defect guidelines for Defect severity/priority clearly defined.
• No Defect RCA and Quality Improvement Plan (QIP) prepared.
• Not able to fit QA in same sprint as Development
• Don’t think before Test- No upfront test planning or defining/understanding of Test cases/scenarios
• QA part of Development Team- QA efforts not estimated, QA resource considered separate hanging entity in scrum team only responsible for QA
• No Technical Debt assessment and Reduction Plan
This document provides a summary of Deepti Debnath's professional experience. She has over 7 years of experience in software quality assurance. She is currently working as a Manager at Citi Corp since June 2015. Previously, she worked as an Associate QA at Principal Financial Group from May 2008 to May 2015. She has extensive experience in testing using tools like Jira, Quality Centre, and Mantis. She has worked on projects in the banking and insurance domains using agile and waterfall methodologies.
The document discusses principles and methods of agile testing. It describes various agile testing techniques like behavior driven development, acceptance test driven development, and exploratory testing. The benefits of agile testing are outlined as well as considerations for test planning, risk-based testing, and communicating test results in an agile environment. Automated testing is discussed including what to automate and tools to use for test automation in agile projects.
Lessons learnt Integrating Test into the Agile LifecycleTEST Huddle
Despite extensive uptake in Agile and more recently Lean approaches, many teams and organisations still struggle to achieve a required level of software quality. This presentation will highlight a number of the key real world mistakes being make by organisations and their development teams in relation to integrating test into the agile lifecycle and suggest ways to improve.
This webinar explores issues relating to:
- The perceived value of testing in agile teams and organisations
- The meaning of cross-functional and how this impacts on testers and testing
- Integrating test competency into an agile team – team and organisational issues.
- How to cope without the traditional independent test manager/lead roles
- Release and feature level thinking – planning for optimum integration of test
- Avoiding the mini waterfall in Sprints/iterations where testing is squeezed at the end of the timebox
- Stories, acceptance criteria and ‘Acceptance’ level TDD
- What ‘done’ looks like from a test perspective
Similar to Is Test Planning a lost art in Agile? by Michelle Williams (20)
The document compares four automation tools: Selenium, Playwright, Cypress, and TestCafe. It provides a detailed comparison matrix covering aspects like supported languages, browsers, speed, APIs, fault tolerance, CI/CD integration, communities, learning curves, and ecosystems. The conclusion is that Playwright is a solid pick for end-to-end testing due to its flexibility, auto waits features, large and active community. Cypress can be easily adopted but has some limitations. While Selenium is widely used, newer tools like Playwright are faster and more reliable. The best tool depends on an application, team and test requirements.
The 2022 World Quality Report surveyed 1,750 professionals from 32 countries and 10 sectors to identify key trends in quality assurance. The report found that while agile adoption has improved delivery times and costs for many organizations, some still struggle with quality in agile projects. It provides recommendations for organizations to improve quality practices like implementing agile quality orchestration, focusing on test automation and data strategies, integrating quality into sustainable IT initiatives, and defining quality metrics aligned with business value. The report suggests quality teams will play an important role in emerging technologies and should develop new skills to ensure seamless user experiences.
1) The document discusses different types of testing "buckets" and argues that overcategorizing tests can be counterproductive. It advocates combining ideas from different buckets to improve testing.
2) Several examples of "semi-automated" testing are provided, where scripts automate parts of a test that are repetitive or complex, but humans still provide some input.
3) The document questions strict definitions of "end-to-end" testing, arguing that tests can focus on parts of a system rather than every component from start to finish. The goal should be to test behaviors, interactions and risks specific to different areas.
Thomas Haver is an ex-scientist and ex-baker who hates sand. M&T Bank needed a better way to test their mobile banking apps and ensure a good user experience. They lacked centralized testing practices and resources. Perfecto was selected as their primary mobile testing tool to help standardize practices and provide metrics. The manual testing features would help train teams, but automation capabilities were also important for maturity.
The document describes an example mapping group activity to help clarify acceptance criteria and examples for a user story. The group is provided a sample user story about adding and editing contact details in an Amazon mobile app. Participants will generate rules and examples for the story, which will be reviewed by the group. Example mapping is presented as a way to facilitate collaboration and ensure a shared understanding of user stories before development begins.
Sarah Geisinger - Continious Testing Metrics That Matter.pdfQA or the Highway
The document discusses the importance of tracking the right metrics in continuous testing to improve collaboration, efficiency, and impact. It recommends measuring factors that cause pain for the QA, development, and user teams, as well as metrics focused on by leadership like deployment frequency, lead time, change failure rates, restore time, and reliability. The document advocates integrating QA metrics into the development pipeline for continuous improvement, and using dashboards for transparency.
This document outlines Jeff Sing's approach to establishing a quality roadmap through quarterly service delivery reviews. It discusses collecting the right data to understand quality trends, showcasing data during reviews to facilitate discussions, and iterating on initiatives based on review outcomes. The goal is to use a data-driven approach and collaborative discussions to continuously measure and improve how well an organization fulfills its customers' needs.
- The document discusses using small "Chihuahua-sized" load tests versus large "Big Ass Load Tests (BALT)" and argues that smaller load tests are better for continuous integration pipelines.
- Chihuahua-sized load tests are described as small, lightweight, manageable, and easy to include in pipelines without disrupting environments or requiring many resources.
- In contrast, BALTs are characterized as heavy, disruptive, resource-intensive, and only suitable when needed outside of pipelines. The document recommends focusing on small, lean, and friendly load tests that can be run continuously.
The document discusses the importance of effective incident management processes when technical issues arise. It emphasizes the need to properly determine if an actual problem exists, communicate the incident to relevant parties, assign roles to responders, document all actions and decisions, provide updates to stakeholders, conduct a post-mortem analysis to identify root causes and preventative measures, and ensure lessons are learned to improve processes. The goal is to resolve incidents quickly while establishing practices that reduce the likelihood of future occurrences and build trust through transparency.
The document discusses using ChatGPT as a testing tool. It outlines the author's assumptions and research using ChatGPT to generate code, improvements, and unit tests for Angular applications and APIs. The author notes positives include ChatGPT's ability to suggest code improvements and generate unit tests over 50% of the time. However, the author cautions that evaluating ChatGPT's responses requires knowledge and experience to determine usefulness.
This document discusses extra-functional testing and how testers can improve their ability to observe non-functional aspects of a system during functional testing. It covers key concepts like observability, and how to incorporate testing of performance, security, and accessibility. Specific tools are recommended for each quality factor, and ways to automate extra-functional tests are described. The presentation aims to help testers expand their skills and collaborate more with other testing teams.
Andrew Knight - Managing the Test Data Nightmare.pptxQA or the Highway
The document discusses strategies for managing test data, including static and dynamic data preparation approaches. Static data preparation involves creating test data before tests run, which can make tests faster but also more brittle. Dynamic data preparation creates test data during test execution, avoiding brittleness but slowing down tests. The document recommends considering both approaches and their tradeoffs when setting up a test data management strategy.
Melissa Tondi - Automation We_re Doing it Wrong.pdfQA or the Highway
The document discusses common mistakes made in test automation and provides recommendations to improve practices. It notes that automation should not replace humans but make them more efficient. Common errors include creating large test suites that run overnight and are vetted by few people, focusing only on automation metrics without consideration of test landscape, and treating automation as the sole responsibility of test teams rather than involving developers. The document recommends breaking suites into smaller focused runs, prioritizing types of tests, using standards aligned with development, and providing self-service tests maintained by cross-functional teams. The goal is to apply learnings from failures to drive innovation through a collaborative approach.
Jeff Van Fleet and John Townsend - Transition from Testing to Leadership.pdfQA or the Highway
This presentation discusses transitioning from testing roles to leadership roles. It provides an overview of common career paths from manual tester to positions like test lead, test automation engineer, test manager, and quality assurance analyst. It encourages attendees to learn, apply, and share knowledge; look for opportunities to contribute and suggest improvements; and work with their manager to create a development plan. The presentation emphasizes that leadership opportunities exist in everyday work and recommends books on leadership and culture improvement.
DesiradhaRam Gadde - Testers _ Testing in ChatGPT-AI world.pptxQA or the Highway
The document discusses testers and testing in the context of ChatGPT. It provides an introduction to ChatGPT and discusses how it can be useful for software testers. The document outlines the typical roles and skills of testers, both currently and how they may evolve in the future. It suggests that artificial intelligence like ChatGPT will help enhance how testers do their jobs rather than replace testing roles. The conclusion emphasizes the importance for testers to increase their technical skills and learn how to work with AI tools to help improve testing performance.
This document discusses semantics and word choice in testing. It explores the phrase "Testers [do|don't] (help) [prevent|detect] 'problems'" through deconstruction and analysis of the individual words. Key points made include: the definition of words like "testing", "problems", and the verbs used can impact meaning; problems are subjective and relative; and word choice around prevention versus detection reflects different perspectives. Consideration of context, definitions, and subjective views of different stakeholders is important to understanding the full meaning of statements involving testing.
Lee Barnes - What Successful Test Automation is.pdfQA or the Highway
The document discusses effective test automation and dispels common myths. It argues that test automation is a process, not just a tool, and should support business goals by automating high-value, reliable tests. Effective test automation provides fast feedback and allows testers to focus on critical tasks rather than repetitive work. The document broadens the definition of test automation to include activities beyond just automating user actions, like creating test environments and data.
This document discusses API testing with Cypress. It includes an agenda that covers a quick intro to Cypress and API testing. Cypress is a test runner that allows for API testing and has features like time travel debugging, automatic waiting, and screenshots/videos on failures that make testing easier. The presenter then demonstrates API testing with Cypress.
Carlos Kidman - Exploring AI Applications in Testing.pptxQA or the Highway
This document discusses how AI can be applied to testing in multiple ways, either with hands-on or hands-off approaches. It explores various tools that use AI for UI testing, API testing, code analysis, test data generation, and test integration. For UI testing, tools that use record and script, describe and NLP, or hands-off capabilities are listed. Similarly for API testing and code, specific tools are outlined. The document also discusses companies that provide test data solutions as well as ways to generate synthetic test data. It concludes by mentioning the potential to identify duplicate tests and automatically add data identifiers.
The Rise of Supernetwork Data Intensive ComputingLarry Smarr
Invited Remote Lecture to SC21
The International Conference for High Performance Computing, Networking, Storage, and Analysis
St. Louis, Missouri
November 18, 2021
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
An invited talk given by Mark Billinghurst on Research Directions for Cross Reality Interfaces. This was given on July 2nd 2024 as part of the 2024 Summer School on Cross Reality in Hagenberg, Austria (July 1st - 7th)
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxSynapseIndia
Your comprehensive guide to RPA in healthcare for 2024. Explore the benefits, use cases, and emerging trends of robotic process automation. Understand the challenges and prepare for the future of healthcare automation
Best Practices for Effectively Running dbt in Airflow.pdfTatiana Al-Chueyr
As a popular open-source library for analytics engineering, dbt is often used in combination with Airflow. Orchestrating and executing dbt models as DAGs ensures an additional layer of control over tasks, observability, and provides a reliable, scalable environment to run dbt models.
This webinar will cover a step-by-step guide to Cosmos, an open source package from Astronomer that helps you easily run your dbt Core projects as Airflow DAGs and Task Groups, all with just a few lines of code. We’ll walk through:
- Standard ways of running dbt (and when to utilize other methods)
- How Cosmos can be used to run and visualize your dbt projects in Airflow
- Common challenges and how to address them, including performance, dependency conflicts, and more
- How running dbt projects in Airflow helps with cost optimization
Webinar given on 9 July 2024
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfNeo4j
Presented at Gartner Data & Analytics, London Maty 2024. BT Group has used the Neo4j Graph Database to enable impressive digital transformation programs over the last 6 years. By re-imagining their operational support systems to adopt self-serve and data lead principles they have substantially reduced the number of applications and complexity of their operations. The result has been a substantial reduction in risk and costs while improving time to value, innovation, and process automation. Join this session to hear their story, the lessons they learned along the way and how their future innovation plans include the exploration of uses of EKG + Generative AI.
Support en anglais diffusé lors de l'événement 100% IA organisé dans les locaux parisiens d'Iguane Solutions, le mardi 2 juillet 2024 :
- Présentation de notre plateforme IA plug and play : ses fonctionnalités avancées, telles que son interface utilisateur intuitive, son copilot puissant et des outils de monitoring performants.
- REX client : Cyril Janssens, CTO d’ easybourse, partage son expérience d’utilisation de notre plateforme IA plug & play.
How Social Media Hackers Help You to See Your Wife's Message.pdfHackersList
In the modern digital era, social media platforms have become integral to our daily lives. These platforms, including Facebook, Instagram, WhatsApp, and Snapchat, offer countless ways to connect, share, and communicate.
Implementations of Fused Deposition Modeling in real worldEmerging Tech
The presentation showcases the diverse real-world applications of Fused Deposition Modeling (FDM) across multiple industries:
1. **Manufacturing**: FDM is utilized in manufacturing for rapid prototyping, creating custom tools and fixtures, and producing functional end-use parts. Companies leverage its cost-effectiveness and flexibility to streamline production processes.
2. **Medical**: In the medical field, FDM is used to create patient-specific anatomical models, surgical guides, and prosthetics. Its ability to produce precise and biocompatible parts supports advancements in personalized healthcare solutions.
3. **Education**: FDM plays a crucial role in education by enabling students to learn about design and engineering through hands-on 3D printing projects. It promotes innovation and practical skill development in STEM disciplines.
4. **Science**: Researchers use FDM to prototype equipment for scientific experiments, build custom laboratory tools, and create models for visualization and testing purposes. It facilitates rapid iteration and customization in scientific endeavors.
5. **Automotive**: Automotive manufacturers employ FDM for prototyping vehicle components, tooling for assembly lines, and customized parts. It speeds up the design validation process and enhances efficiency in automotive engineering.
6. **Consumer Electronics**: FDM is utilized in consumer electronics for designing and prototyping product enclosures, casings, and internal components. It enables rapid iteration and customization to meet evolving consumer demands.
7. **Robotics**: Robotics engineers leverage FDM to prototype robot parts, create lightweight and durable components, and customize robot designs for specific applications. It supports innovation and optimization in robotic systems.
8. **Aerospace**: In aerospace, FDM is used to manufacture lightweight parts, complex geometries, and prototypes of aircraft components. It contributes to cost reduction, faster production cycles, and weight savings in aerospace engineering.
9. **Architecture**: Architects utilize FDM for creating detailed architectural models, prototypes of building components, and intricate designs. It aids in visualizing concepts, testing structural integrity, and communicating design ideas effectively.
Each industry example demonstrates how FDM enhances innovation, accelerates product development, and addresses specific challenges through advanced manufacturing capabilities.
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc
Six months into 2024, and it is clear the privacy ecosystem takes no days off!! Regulators continue to implement and enforce new regulations, businesses strive to meet requirements, and technology advances like AI have privacy professionals scratching their heads about managing risk.
What can we learn about the first six months of data privacy trends and events in 2024? How should this inform your privacy program management for the rest of the year?
Join TrustArc, Goodwin, and Snyk privacy experts as they discuss the changes we’ve seen in the first half of 2024 and gain insight into the concrete, actionable steps you can take to up-level your privacy program in the second half of the year.
This webinar will review:
- Key changes to privacy regulations in 2024
- Key themes in privacy and data governance in 2024
- How to maximize your privacy program in the second half of 2024
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsMydbops
This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization.
Key Takeaways:
* Understand why connection pooling is essential for high-traffic applications
* Explore various connection poolers available for PostgreSQL, including pgbouncer
* Learn the configuration options and functionalities of pgbouncer
* Discover best practices for monitoring and troubleshooting connection pooling setups
* Gain insights into real-world use cases and considerations for production environments
This presentation is ideal for:
* Database administrators (DBAs)
* Developers working with PostgreSQL
* DevOps engineers
* Anyone interested in optimizing PostgreSQL performance
Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services
7 Most Powerful Solar Storms in the History of Earth.pdfEnterprise Wired
Solar Storms (Geo Magnetic Storms) are the motion of accelerated charged particles in the solar environment with high velocities due to the coronal mass ejection (CME).
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionBert Blevins
Cybersecurity is a major concern in today's connected digital world. Threats to organizations are constantly evolving and have the potential to compromise sensitive information, disrupt operations, and lead to significant financial losses. Traditional cybersecurity techniques often fall short against modern attackers. Therefore, advanced techniques for cyber security analysis and anomaly detection are essential for protecting digital assets. This blog explores these cutting-edge methods, providing a comprehensive overview of their application and importance.
UiPath Community Day Kraków: Devs4Devs ConferenceUiPathCommunity
We are honored to launch and host this event for our UiPath Polish Community, with the help of our partners - Proservartner!
We certainly hope we have managed to spike your interest in the subjects to be presented and the incredible networking opportunities at hand, too!
Check out our proposed agenda below 👇👇
08:30 ☕ Welcome coffee (30')
09:00 Opening note/ Intro to UiPath Community (10')
Cristina Vidu, Global Manager, Marketing Community @UiPath
Dawid Kot, Digital Transformation Lead @Proservartner
09:10 Cloud migration - Proservartner & DOVISTA case study (30')
Marcin Drozdowski, Automation CoE Manager @DOVISTA
Pawel Kamiński, RPA developer @DOVISTA
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
09:40 From bottlenecks to breakthroughs: Citizen Development in action (25')
Pawel Poplawski, Director, Improvement and Automation @McCormick & Company
Michał Cieślak, Senior Manager, Automation Programs @McCormick & Company
10:05 Next-level bots: API integration in UiPath Studio (30')
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
10:35 ☕ Coffee Break (15')
10:50 Document Understanding with my RPA Companion (45')
Ewa Gruszka, Enterprise Sales Specialist, AI & ML @UiPath
11:35 Power up your Robots: GenAI and GPT in REFramework (45')
Krzysztof Karaszewski, Global RPA Product Manager
12:20 🍕 Lunch Break (1hr)
13:20 From Concept to Quality: UiPath Test Suite for AI-powered Knowledge Bots (30')
Kamil Miśko, UiPath MVP, Senior RPA Developer @Zurich Insurance
13:50 Communications Mining - focus on AI capabilities (30')
Thomasz Wierzbicki, Business Analyst @Office Samurai
14:20 Polish MVP panel: Insights on MVP award achievements and career profiling
The DealBook is our annual overview of the Ukrainian tech investment industry. This edition comprehensively covers the full year 2023 and the first deals of 2024.
2. About me
•Consultant for Centric Consulting, LLC
•Over 20 Years in IT industry
•10 + Years QA management
•Provided QA Leadership for many large scale projects at
Nationwide, Grange and currently CAS
•Mom/Grandmother
•Cat lover?
•Enthusiastic about:
•Music/concerts
•Movies
2
3. Today’s Discussion
•Take away today – importance and value of using a test plan
to support agile
•Agile requirements challenges
•Agile Manifesto
•Examination of Manifesto as it relates to planning
•Test strategy purpose
•Test plan value in agile
•Testing phases within agile
•Brief wrap up/conclusion
•Questions
3
4. Agile Requirement Challenges
•Sprint focus is story specific and time boxed which may limit thinking
•Even focusing just on the sprint, the requirements can be
misunderstood – user stories are too BIG
•QA are often seen as the SME and should be seen as key
individuals in this process, but that knowledge should not remain in
our heads only
•Do you have your own set of challenges you’d like to share
4
5. Agile Manifesto
•Individuals and interactions over processes and tools
•Working software over comprehensive documentation
•Customer collaboration over contract negotiation
•Responding to change over following a plan
•That is, while there is value in the items on the right, we value
the items on the left more
5
6. Further Examination
•By all means Individuals and interactions are important, let’s talk to
each other
•Nothing in this statement says don’t document
•What does working software mean
•How do we know
•Working and perfect are not equal
•Customer collaboration is very different in Agile
•Combine this with “responding to change” and this aspect is
critical to creating working software that meet expectations
•Responding to change is key as well
•When we follow the collaboration model, we’ll discover a lot of
changes because the customer will change
•Those changes will be facilitated by working software
6
Following the manifesto in the literal sense would create problems
8. Test Strategies serve a purpose,
but don’t focus on ‘the’ sprint
•Big picture
•Drives behavior and sets boundaries
•Outlines Automation Approach
•Test Data Management
•Defect/bug management
•Identifies large risks
8
Strategies are
9. Test Plan Value
• A agile test plan will solidify what the customer and the team
agreed upon
• Helps to easily identify gaps in thoughts and expectations
• Provides details that will help to clarify the acceptance of
working software
Note: Customer collaboration is throughout and continues at
demo’s and reviews. If something changes, make your
updates and move on, you can refer back to the updated
plan.
Remember: The goal is for working software, the idea of
that has now changed, so your plan will probably change.
9
Testing Scope
10. Quality Over Velocity
•Help the team think quality first
•Many think Agile is all about velocity
•Building quality in will improve velocity and efficiency and drive
down cost
•It doesn’t work the other way around
Creating a test plan encourages focus on quality
10
11. Agile Testing “Phases”
•Requirements and Design Phase
•Stories/Features Verification Phase
•System Verification Phase
•Acceptance Phase
A test plan should have components that help facilitate all these phases
11
12. Phase 1: Requirements and Design
•Scenarios to be tested
•Separation of testing activities (unit vs. functional?)
•Automation selection & plan
•Manual selection & plan
•Out of scope items
•Dependencies & Assumptions
•Test data needs
•Stubbing/Technical debt
•Acceptance section
Plan now and update throughout – Plan elements include:
12
13. Facilitated Discussion
•What tests does the Product Owner want to see to confirm
working software?
•What tests do the team feel are most important to run (based
on knowledge of the system)?
•What negative cases are necessary?
•What tests will be automated and with which tools (i.e. what
cases as the unit level, what at the UI level etc.)?
•What tests can I only manually test due to complexity?
•Where do we expect to find the most issues?
•What parts need exploratory testing?
•Does anyone have an example of questions they might ask?
13
Some questions to ask during the discussion
14. Document the Scenario Details
• List your high level test scenarios
• Should include individual unit level components (easy to
get buy in?)
• Should include functional tests/E2E scenarios
• Identify whether you will manually test or automate the test
(unit implies automation)
• Are we manually testing due to complexity/challenges
• Summarize why you are manually testing a specific
scenario(s)
• Are we automating for ease of use and repeatability
Start closing gaps and clarifying what is to be tested
14
15. Automation/Manual Testing
•Add a summary within your plan noting why you chose to
manually test
•Hopefully automation first and foremost whenever possible
•Consider this automation decision criteria:
•Reuse
•Complexity
•Overlap
•Information Value
•Stability and Coupling
•Dependencies
Summary Format
15
16. Out of Scope Items
• What won’t be tested
• Why you won’t test it (a specific function for example that isn’t
changing)
• If not listed, can end up with scope creep and scrambling to
test items at the end that didn’t get identified
Table Format
16
17. Dependencies and/or Assumptions
•Is there something the team needs to be successful in
accomplishing the testing ‘or’ obtaining acceptance
•For example:
•Are there multiple pods/teams developing and you need
another part to your solution in order to validate
•Needing an updated software version is a good example
•Needing test data from another area
•Maybe you are dependent on another team outside of your
space to provide service or support
•Would anyone like to share an example of a dependency?
•What about an example of an assumption?
List/Table Format :
17
Dependency – I need a test environment
Assumption – I assume the environment will be stable
18. Test Data
•Call out specific types of data you need in order to complete
the testing in the sprint for the scenarios
•Mocked data would be called out here if being used
Summary Format
18
Technical Debt
Summary Format
•Indicate anything in this section that will need to be updated or
changed later such as:
•Stubbing an interface
•Mocking test data
Note: Choose technical debt wisely. Postponing items until later can become costly.
If you manually test to get done now, will you ever have time to automate it later?
19. Acceptance Criteria
Table Format
19
•Input under Document Control History
•Sign off of this sprint plan indicates acceptance of the plan.
Each sprint will have acceptance defined by the team
(Including BA or Product Owner, Tech Lead and QA.)
•Things the team should consider when signing off: have we
identified the right scenarios, have we created the appropriate
test coverage to satisfy the acceptance. This document should
be part of the conversation and included in acceptance.
•Securing approval helps to ensure alignment and increase
effectiveness of acceptance.
20. Acceptance Criteria
20
• Microsoft Press defines Acceptance Criteria as “Conditions that a software product must
satisfy to be accepted by a user, customer or other stakeholder.” Google defines them as
“Pre-established standards or requirements a product or project must meet.”
• Acceptance Criteria are a set of statements, each with a clear pass/fail result, that specify
both functional (e.g., minimal marketable functionality) and non-functional (e.g., minimal
quality) requirements applicable at the current stage of project integration. These
requirements represent “conditions of satisfaction.” There is no partial acceptance: either a
criterion is met or it is not.
• These criteria define the boundaries and parameters of a User Story/feature and determine
when a story is completed and working as expected. They add certainty to what the team is
building.
• Acceptance Criteria must be expressed clearly, in simple language the customer would use,
just like the User Story, without ambiguity as to what the expected outcome is: what is
acceptable and what is not acceptable. They must be testable: easily translated into one or
more manual/automated test cases.
21. •Start your test execution based on the scenarios and
readiness of code
•Refer back to your plan
•Team will be creating unit tests
•Testing will be staggered based on development
•Write Automation tests
•Update test data sets
•Conduct manual validation
•Create stubs
•Ensure the features are working
•Validate component interactions
•Discover defects and correct
Start test execution
21
Phase 2: Story/Feature Verification
22. Phase 3: System Verification
•Wrap up any end to end testing of features
•Run regression to validate prior features are not broken
•Ensure regression sets are updated if needed
•Remove stubbing if possible
•Continue to correct and fix defects (critical)
•Update the plan with any additions or changes and socialize to
team
Shift focus to prepare for acceptance
22
23. Phase 4: Acceptance
Shift focus finalizing tests and securing acceptance
23
•Agree upon defects not making the release
•Conduct exploratory testing once the code/system is stable
•Run a final set of regression or smoke tests
•Conduct the demo or show & tells using the test plan as a
guide
24. Retrospective, Feedback and
change
•Team should provide feedback on the plan’s effectiveness
•Discuss challenges with features or components so it can be
considered if there are changes around that feature in the
future?
Reflection
24
25. Close the Loop - Technical Debt
•Ensure you capture it in a ticketing system
•Make sure you plan for technical debt in future sprints and
work it
•Groom this debt along with any other debt on the project
•Don’t let it sit too long, the longer it sits, the harder it is to work
it in
25
26. Conclusion
• Quality First
• Requirements and design work
• Create a plan
• Secure acceptance of the plan
• Use the plan as a guideline for demos to the product owner
• Seek feedback on the effectiveness of the plan and make
improvements
• Ensure you track your technical debt and understand costs
around postponing something in the sprint
26
28. QUESTIONS?
Contact Centric
To learn more about Centric Consulting Solutions:
CentricConsulting.com
Presenters Name: Michelle Williams
Email: michelle.williams@centricconsulting.com
Phone: 614-886-9930
28
Editor's Notes
Factors to Consider
Reuse
Tests that will be run repeatedly should be considered for automation. Typically, the threshold is 7 executions. If a test is going to be executed less than 7 times, it generally is not a candidate for automation.
Complexity
Complex tests are generally multiplicatively more expensive than simpler tests. Both in terms of initial establishment as well as in terms of ongoing maintenance.
Overlap
Tests that effectively overlap other tests, e.g. multiple negative condition boundary tests, should not be automated unless there is enough incremental value in doing so.
Information Value
The test should provide value in the feedback of both passing and failing. For example, a passing test around processing an eCommerce monetary transaction provides business actionable information. We can collect money. Inversely, the same test failing shows a business can’t collect money. That test is a candidate for consideration. As a second example, consider a test that includes actions on adding an item to a cart through payment processing. A failure to add to cart represents actionable information. However, the act of adding an item to cart is only implicity tested and therefore, a pass does not necessarily mean the function works. In this case, the test should be re-designed to provide information on both passing and failing. A test that only provides feedback in one or the other is likely incomplete and/or unnecessary.
Stability and Coupling
The test needs to be flexible enough to withstand some modifications to the system under test without having to refactor a test or suite of tests. Tests should not be dependent on the configuration or environment of the target system. At times this may mean a deferral of automation efforts.
Dependencies
Tests and test suites should not be constructed with dependencies. Consider re-designing tests to avoid dependencies before considering for automation.
Ever have those items that start to bleed outside of what you thought was the scope of the story
Maybe you didn’t remember to discuss with the team
Maybe you didn’t realize them until later
Best to document and review
One is true, one is thought to be true. One is a constraint, one is helper in order to make a decision.
I find that the technical debt in projects especially Agile, gets lost very easily or buried in a Jira ticket you never come back to
Make sure you create cards to track it (even though it’s here), this is point in time socialization
Documenting it allows it to be visible when planning future work