SlideShare a Scribd company logo
Preparing for the Pipeline
By Stephen Townshend
Shout-out
Dave Matheson Jay Sisley
What we will cover
• Value stream mapping
• Automating performance testing
• JMeter demonstration
• Wrap-up (taking it further)
Value StreamMapping
• Remove
• Simplify
• Automate

Recommended for you

Load Testing & Apache JMeter
Load Testing & Apache JMeterLoad Testing & Apache JMeter
Load Testing & Apache JMeter

This document discusses load testing using Apache JMeter. It covers planning a load test including time, tools, equipment and data needed. It describes JMeter components like thread groups, samplers and listeners. It discusses parameterizing tests for different environments and scenarios. The document also addresses recording tests, adding delays to mimic reality, handling Ajax requests, running data driven tests and evaluating results using JMeter reporters and Java monitoring tools. It emphasizes planning effectively, using Selenium tests as a base, parameterizing tests, and creating readable tests.

jmeterwebobjectsjava
Load Testing and JMeter Presentation
Load Testing and JMeter PresentationLoad Testing and JMeter Presentation
Load Testing and JMeter Presentation

Load testing simulates multiple users accessing an application simultaneously to evaluate performance under different load scenarios. There are three main types of load testing: 1. Performance testing gradually increases load to determine the maximum number of users/requests per second an application can handle. 2. Stress testing pushes load beyond normal limits to identify the breaking point and ensure error handling. 3. Soak testing subjects an application to high load over an extended period to check for resource allocation problems, memory leaks, and server overloading. The tool JMeter is commonly used for load testing and allows simulating many users and transactions. It can test HTTP, databases, and other components. Plugins extend its functionality and distributed testing improves load

load testingapachejmeter
Jmeter From Scratch
Jmeter From ScratchJmeter From Scratch
Jmeter From Scratch

It gives you an basic over view to start up with Jmeter. This slide encourage you to start from basic terminology in the Performance Testing field. It contains information about Different subcategory of Performance Testing. The main focus is to connect performance testing with Jmeter.

jmeterspike testingendurance testing
Value StreamMapping
ExecutionPre-test Tasks Post-test Tasks
Refresh Test Data
Configure
System
System
Monitoring
Check-out of
Version control
Smoke-test
Environment
Gather Results
Process Results
Analyse Results +
Monitoring
Deep-dive
Analysis
Coordinate
Diagnosis
3 min
10 min
1 min
1 min
5 min
< 1 min
5 min
3 min
3 min
5 min
15 min+
2+ hours
Days (elapsed)
Configure Test
Suite
Verify Test
Suite
Execute Test
Ambiguous
Monitor Test
Progress
Value StreamMapping
ExecutionPre-test Tasks Post-test Tasks
Refresh Test Data
Configure
System
System
Monitoring
Check-out of
Version control
Smoke-test
Environment
Verify Test
Suite
Gather Results
Process Results
3 min
10 min
1 min
1 min
5 min 5 min
Ambiguous
3 min
5 min
Configure Test
Suite
Execute Test
< 1 min
StartSmall
Refresh
Test Data
Configure
SUT
Start
Monitoring
Check out
Test suite
Smoke Test
Environment
Execute
Test
Gather
Results
Process
Results
Script Script Script Script Script Script Script Script
Orchestrator
Job 1 Job 2
Our Example
Refresh
Test Data
Configure
SUT
Start
Monitoring
Check out
Test suite
Smoke Test
Environment
Execute
Test
Gather
Results
Process
Results
Script Script Script Script Script Script
Jenkins
Job 1 Job 2 Job 3

Recommended for you

Performance testing and j meter
Performance testing and j meterPerformance testing and j meter
Performance testing and j meter

The document provides an overview of performance testing and the JMeter load testing tool. It defines performance testing as testing to determine how a system performs under workload. The main types of performance testing are described as load/capacity testing, stress testing, volume testing, endurance/soak testing, and spike testing. Load testing is the simplest form and aims to understand system behavior under expected load. Bottlenecks can be identified through load testing. Stress testing finds a system's capacity limit. Volume testing checks efficiency processing large data amounts. Endurance testing checks withstanding load over long periods. Spike testing observes behavior under sudden load increases. JMeter is introduced as an open source load testing tool that can test various system types and has user

best jmeter online training
Qtp training session V
Qtp training session VQtp training session V
Qtp training session V

This document summarizes the topics covered in the QTP Training Session V, including: - Conditional statements like If/Then/Else and Case statements for controlling script flow. - Error handling using recovery scenarios and On Error Resume Next. - Inserting transaction points to measure execution time. - Scheduling script execution using a .vbs file and the Windows Task Scheduler. - Best practices for writing scripts that can be executed by others, like including instructions, comments, and readable formatting.

scedule execution of qtp scriptserror handlingtransaction points
Iasi code camp 12 october 2013 performance testing for web applications with...
Iasi code camp 12 october 2013  performance testing for web applications with...Iasi code camp 12 october 2013  performance testing for web applications with...
Iasi code camp 12 october 2013 performance testing for web applications with...

The document discusses performance testing a web application using JMeter. It describes registering a login scenario with JMeter by recording HTTP requests in the browser. Issues discovered include the login not succeeding and fewer than 100 concurrent users achieved. Modifications are made like adding a transaction controller and cache manager. Results are analyzed in reports showing response times increase with load and peak throughput of 6 requests/second. Server resources are monitored and best practices like validating actions and transaction data are discussed.

The hardest part
• The hardest bit is preparing your load test assets to automate, e.g.
• The specifics depend on the tool – each have their challenges
• Today I am going to use JMeter as the example, but the principles can be
applied to other tools
Tool
Controller/
Agents
Environment
Workload
Duration
JMeterDemo
We will cover six tips:
1. JMeter project as a solution
2. Flexible File Writer
3. Separate out script files (Groovy/BeanShell)
4. Dynamic run ID
5. Simple Table Server
6. Test Fragments
Key Takeaways
1. Analyse your own process
2. Identify tasks you can remove, simplify, or automate
3. Automation provides multiple benefits:
1. Reduced elapsed time
2. Specialists can focus on higher value work
3. Enable/empower others to run their own tests
4. When automating, start small
5. Change the ways you are using your tools for simplicity
The BiggerPicture…
• There is a bigger opportunity here…
• We saved half an hour per execution by automating all of this
• What about the 0-8 weeks of test suite development in my value stream?
• Automation is not a silver bullet. Think about it as a subset of simplification.
• Some ideas to get started:
• UI automation to generate load – more reusability & leverage test team assets
• Reduce the scope of test suites

Recommended for you

JMeter & ColdFusion
JMeter & ColdFusion JMeter & ColdFusion
JMeter & ColdFusion

JMeter is an open-source load testing tool that can test various server types including web servers. It allows performance testing by simulating a heavy load on a system and stress testing to push a system to its limits. Key benefits of JMeter include its ability to test HTTP, database, JMS, mail protocols and more. It also has a full multithreading framework and customizable plugins. Creating a test plan in JMeter involves adding thread groups to simulate users, HTTP request samplers, listeners to view results, and other elements like timers, assertions and post-processors. JMeter also supports recording tests from a browser and distributed testing across multiple machines.

Automation - Apache JMeter
Automation - Apache JMeterAutomation - Apache JMeter
Automation - Apache JMeter

JMeter is a tool for load testing web applications. It allows users to simulate heavy loads on servers to test performance. The document discusses how to automate testing using JMeter by creating test plans with thread groups representing users, HTTP requests to test web pages, and listeners to view results. Key steps include using the HTTP Proxy Server to record browser navigation and create test samples, configuring default request properties, and running tests with multiple threads over many iterations to simulate load.

jmeterapache
Resilience testing! Why should you
Resilience testing! Why should youResilience testing! Why should you
Resilience testing! Why should you

The document discusses the importance of resilience testing systems and applications. It notes that demands on systems have increased with expectations of higher uptime. Resilience testing involves performing load testing, introducing failures, and monitoring systems to analyze how well they can withstand disruptions and recover. The document provides an overview of resilience testing techniques and recommends starting with brainstorming potential failures, implementing resilience patterns, and testing a sample application setup.

resilienceresilience testing

More Related Content

What's hot

Continuous Performance Testing
Continuous Performance TestingContinuous Performance Testing
Continuous Performance Testing
Mark Price
 
Jmeter introduction
Jmeter introductionJmeter introduction
Jmeter introduction
Ramakrishna kapa
 
Performance testing
Performance testingPerformance testing
Performance testing
Nalini Kanth
 
Load Testing & Apache JMeter
Load Testing & Apache JMeterLoad Testing & Apache JMeter
Load Testing & Apache JMeter
WO Community
 
Load Testing and JMeter Presentation
Load Testing and JMeter PresentationLoad Testing and JMeter Presentation
Load Testing and JMeter Presentation
Neill Lima
 
Jmeter From Scratch
Jmeter From ScratchJmeter From Scratch
Jmeter From Scratch
ChinmayBrahma22
 
Performance testing and j meter
Performance testing and j meterPerformance testing and j meter
Performance testing and j meter
Purna Chandar
 
Qtp training session V
Qtp training session VQtp training session V
Qtp training session V
Aisha Mazhar
 
Iasi code camp 12 october 2013 performance testing for web applications with...
Iasi code camp 12 october 2013  performance testing for web applications with...Iasi code camp 12 october 2013  performance testing for web applications with...
Iasi code camp 12 october 2013 performance testing for web applications with...
Codecamp Romania
 
JMeter & ColdFusion
JMeter & ColdFusion JMeter & ColdFusion
JMeter & ColdFusion
isummation
 
Automation - Apache JMeter
Automation - Apache JMeterAutomation - Apache JMeter
Automation - Apache JMeter
Wira Santos
 
Resilience testing! Why should you
Resilience testing! Why should youResilience testing! Why should you
Resilience testing! Why should you
Geoffrey van der Tas
 
Apache jMeter
Apache jMeterApache jMeter
COMPUTER ARCHITECTURE BASIC CONCEPT
COMPUTER ARCHITECTURE BASIC CONCEPTCOMPUTER ARCHITECTURE BASIC CONCEPT
COMPUTER ARCHITECTURE BASIC CONCEPT
Azizul Mamun
 
SP_Homework_3
SP_Homework_3SP_Homework_3
SP_Homework_3
adios
 
Automated Regression Testing for Embedded Systems in Action
Automated Regression Testing for Embedded Systems in ActionAutomated Regression Testing for Embedded Systems in Action
Automated Regression Testing for Embedded Systems in Action
AANDTech
 
JMeter workshop
JMeter workshopJMeter workshop
JMeter workshop
Raman Kansal
 
JMETER-SKILLWISE
JMETER-SKILLWISEJMETER-SKILLWISE
JMETER-SKILLWISE
Skillwise Consulting
 
Getting Started with Apache Jmeter
Getting Started with Apache JmeterGetting Started with Apache Jmeter
Getting Started with Apache Jmeter
Mindfire Solutions
 
JMeter - Performance testing your webapp
JMeter - Performance testing your webappJMeter - Performance testing your webapp
JMeter - Performance testing your webapp
Amit Solanki
 

What's hot (20)

Continuous Performance Testing
Continuous Performance TestingContinuous Performance Testing
Continuous Performance Testing
 
Jmeter introduction
Jmeter introductionJmeter introduction
Jmeter introduction
 
Performance testing
Performance testingPerformance testing
Performance testing
 
Load Testing & Apache JMeter
Load Testing & Apache JMeterLoad Testing & Apache JMeter
Load Testing & Apache JMeter
 
Load Testing and JMeter Presentation
Load Testing and JMeter PresentationLoad Testing and JMeter Presentation
Load Testing and JMeter Presentation
 
Jmeter From Scratch
Jmeter From ScratchJmeter From Scratch
Jmeter From Scratch
 
Performance testing and j meter
Performance testing and j meterPerformance testing and j meter
Performance testing and j meter
 
Qtp training session V
Qtp training session VQtp training session V
Qtp training session V
 
Iasi code camp 12 october 2013 performance testing for web applications with...
Iasi code camp 12 october 2013  performance testing for web applications with...Iasi code camp 12 october 2013  performance testing for web applications with...
Iasi code camp 12 october 2013 performance testing for web applications with...
 
JMeter & ColdFusion
JMeter & ColdFusion JMeter & ColdFusion
JMeter & ColdFusion
 
Automation - Apache JMeter
Automation - Apache JMeterAutomation - Apache JMeter
Automation - Apache JMeter
 
Resilience testing! Why should you
Resilience testing! Why should youResilience testing! Why should you
Resilience testing! Why should you
 
Apache jMeter
Apache jMeterApache jMeter
Apache jMeter
 
COMPUTER ARCHITECTURE BASIC CONCEPT
COMPUTER ARCHITECTURE BASIC CONCEPTCOMPUTER ARCHITECTURE BASIC CONCEPT
COMPUTER ARCHITECTURE BASIC CONCEPT
 
SP_Homework_3
SP_Homework_3SP_Homework_3
SP_Homework_3
 
Automated Regression Testing for Embedded Systems in Action
Automated Regression Testing for Embedded Systems in ActionAutomated Regression Testing for Embedded Systems in Action
Automated Regression Testing for Embedded Systems in Action
 
JMeter workshop
JMeter workshopJMeter workshop
JMeter workshop
 
JMETER-SKILLWISE
JMETER-SKILLWISEJMETER-SKILLWISE
JMETER-SKILLWISE
 
Getting Started with Apache Jmeter
Getting Started with Apache JmeterGetting Started with Apache Jmeter
Getting Started with Apache Jmeter
 
JMeter - Performance testing your webapp
JMeter - Performance testing your webappJMeter - Performance testing your webapp
JMeter - Performance testing your webapp
 

Similar to PAC 2019 virtual Stephen Townshend

Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
ClareMcLennan
 
ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2
Chandukar
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
Yogindernath Gupta
 
ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2
onsoftwaretest
 
Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter
Prashanth Kumar
 
Test automation
Test automationTest automation
Test automation
Jitendra Malviya
 
"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session
Tharinda Liyanage
 
Tests antipatterns
Tests antipatternsTests antipatterns
Tests antipatterns
Maciej Przewoznik
 
Software Testing - Tool support for testing (CAST) - Mazenet Solution
Software Testing - Tool support for testing (CAST) - Mazenet SolutionSoftware Testing - Tool support for testing (CAST) - Mazenet Solution
Software Testing - Tool support for testing (CAST) - Mazenet Solution
Mazenetsolution
 
Performance testing and_reporting_with_j_meter by Le Van Nghi
Performance testing and_reporting_with_j_meter by  Le Van NghiPerformance testing and_reporting_with_j_meter by  Le Van Nghi
Performance testing and_reporting_with_j_meter by Le Van Nghi
eXo Platform
 
Performance testing jmeter
Performance testing jmeterPerformance testing jmeter
Performance testing jmeter
Bhojan Rajan
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
Moataz Nabil
 
Automated testing overview
Automated testing overviewAutomated testing overview
Automated testing overview
Alex Pop
 
Performance Testing and OBIEE by QuontraSolutions
Performance Testing and OBIEE by QuontraSolutionsPerformance Testing and OBIEE by QuontraSolutions
Performance Testing and OBIEE by QuontraSolutions
QUONTRASOLUTIONS
 
Test Automation
Test AutomationTest Automation
Test Automation
rockoder
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.ppt
RppsKumar1
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.ppt
ghkadous
 
ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1
Yogindernath Gupta
 
Context Driven Automation Gtac 2008
Context Driven Automation Gtac 2008Context Driven Automation Gtac 2008
Context Driven Automation Gtac 2008
Pete Schneider
 
QTP 9.2
QTP 9.2QTP 9.2

Similar to PAC 2019 virtual Stephen Townshend (20)

Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
 
ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2ISTQB Foundation - Chapter 2
ISTQB Foundation - Chapter 2
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
 
ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2
 
Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter
 
Test automation
Test automationTest automation
Test automation
 
"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session
 
Tests antipatterns
Tests antipatternsTests antipatterns
Tests antipatterns
 
Software Testing - Tool support for testing (CAST) - Mazenet Solution
Software Testing - Tool support for testing (CAST) - Mazenet SolutionSoftware Testing - Tool support for testing (CAST) - Mazenet Solution
Software Testing - Tool support for testing (CAST) - Mazenet Solution
 
Performance testing and_reporting_with_j_meter by Le Van Nghi
Performance testing and_reporting_with_j_meter by  Le Van NghiPerformance testing and_reporting_with_j_meter by  Le Van Nghi
Performance testing and_reporting_with_j_meter by Le Van Nghi
 
Performance testing jmeter
Performance testing jmeterPerformance testing jmeter
Performance testing jmeter
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
 
Automated testing overview
Automated testing overviewAutomated testing overview
Automated testing overview
 
Performance Testing and OBIEE by QuontraSolutions
Performance Testing and OBIEE by QuontraSolutionsPerformance Testing and OBIEE by QuontraSolutions
Performance Testing and OBIEE by QuontraSolutions
 
Test Automation
Test AutomationTest Automation
Test Automation
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.ppt
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.ppt
 
ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1
 
Context Driven Automation Gtac 2008
Context Driven Automation Gtac 2008Context Driven Automation Gtac 2008
Context Driven Automation Gtac 2008
 
QTP 9.2
QTP 9.2QTP 9.2
QTP 9.2
 

More from Neotys

PAC 2020 Santorin - Giovanni Paolo Gibilisco
PAC 2020 Santorin - Giovanni Paolo GibiliscoPAC 2020 Santorin - Giovanni Paolo Gibilisco
PAC 2020 Santorin - Giovanni Paolo Gibilisco
Neotys
 
PAC 2020 Santorin - Stijn Schepers
PAC 2020 Santorin - Stijn SchepersPAC 2020 Santorin - Stijn Schepers
PAC 2020 Santorin - Stijn Schepers
Neotys
 
PAC 2020 Santorin - Edoardo Varani
PAC 2020 Santorin - Edoardo VaraniPAC 2020 Santorin - Edoardo Varani
PAC 2020 Santorin - Edoardo Varani
Neotys
 
PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner
Neotys
 
PAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis ChatzinasiosPAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis Chatzinasios
Neotys
 
PAC 2020 Santorin - Gopalkrishnan Yadav
PAC 2020 Santorin - Gopalkrishnan YadavPAC 2020 Santorin - Gopalkrishnan Yadav
PAC 2020 Santorin - Gopalkrishnan Yadav
Neotys
 
PAC 2020 Santorin - Hari Krishnan Ramachandran
PAC 2020 Santorin - Hari Krishnan RamachandranPAC 2020 Santorin - Hari Krishnan Ramachandran
PAC 2020 Santorin - Hari Krishnan Ramachandran
Neotys
 
PAC 2020 Santorin - Joerek Van Gaalen
PAC 2020 Santorin - Joerek Van GaalenPAC 2020 Santorin - Joerek Van Gaalen
PAC 2020 Santorin - Joerek Van Gaalen
Neotys
 
PAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur JainPAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur Jain
Neotys
 
PAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen TownshendPAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen Townshend
Neotys
 
PAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro MelendezPAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro Melendez
Neotys
 
PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo   PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo
Neotys
 
PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez
Neotys
 
PAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark TomlinsonPAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark Tomlinson
Neotys
 
PAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli AparnaPAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli Aparna
Neotys
 
PAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan GeorgePAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan George
Neotys
 
PAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van GaalenPAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van Gaalen
Neotys
 
PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan  PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan
Neotys
 
PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux
Neotys
 
PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg  PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg
Neotys
 

More from Neotys (20)

PAC 2020 Santorin - Giovanni Paolo Gibilisco
PAC 2020 Santorin - Giovanni Paolo GibiliscoPAC 2020 Santorin - Giovanni Paolo Gibilisco
PAC 2020 Santorin - Giovanni Paolo Gibilisco
 
PAC 2020 Santorin - Stijn Schepers
PAC 2020 Santorin - Stijn SchepersPAC 2020 Santorin - Stijn Schepers
PAC 2020 Santorin - Stijn Schepers
 
PAC 2020 Santorin - Edoardo Varani
PAC 2020 Santorin - Edoardo VaraniPAC 2020 Santorin - Edoardo Varani
PAC 2020 Santorin - Edoardo Varani
 
PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner
 
PAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis ChatzinasiosPAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis Chatzinasios
 
PAC 2020 Santorin - Gopalkrishnan Yadav
PAC 2020 Santorin - Gopalkrishnan YadavPAC 2020 Santorin - Gopalkrishnan Yadav
PAC 2020 Santorin - Gopalkrishnan Yadav
 
PAC 2020 Santorin - Hari Krishnan Ramachandran
PAC 2020 Santorin - Hari Krishnan RamachandranPAC 2020 Santorin - Hari Krishnan Ramachandran
PAC 2020 Santorin - Hari Krishnan Ramachandran
 
PAC 2020 Santorin - Joerek Van Gaalen
PAC 2020 Santorin - Joerek Van GaalenPAC 2020 Santorin - Joerek Van Gaalen
PAC 2020 Santorin - Joerek Van Gaalen
 
PAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur JainPAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur Jain
 
PAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen TownshendPAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen Townshend
 
PAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro MelendezPAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro Melendez
 
PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo   PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo
 
PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez
 
PAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark TomlinsonPAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark Tomlinson
 
PAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli AparnaPAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli Aparna
 
PAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan GeorgePAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan George
 
PAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van GaalenPAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van Gaalen
 
PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan  PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan
 
PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux
 
PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg  PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg
 

Recently uploaded

Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and PreventionUnderstanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Bert Blevins
 
1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT
1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT
1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT
Mani Krishna Sarkar
 
Rohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model Safe
Rohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model SafeRohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model Safe
Rohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model Safe
binna singh$A17
 
Quadcopter Dynamics, Stability and Control
Quadcopter Dynamics, Stability and ControlQuadcopter Dynamics, Stability and Control
Quadcopter Dynamics, Stability and Control
Blesson Easo Varghese
 
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdfGUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
ProexportColombia1
 
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.docCCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
Dss
 
Germany Offshore Wind 010724 RE (1) 2 test.pptx
Germany Offshore Wind 010724 RE (1) 2 test.pptxGermany Offshore Wind 010724 RE (1) 2 test.pptx
Germany Offshore Wind 010724 RE (1) 2 test.pptx
rebecca841358
 
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-IDUNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
GOWSIKRAJA PALANISAMY
 
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...
YanKing2
 
Trends in Computer Aided Design and MFG.
Trends in Computer Aided Design and MFG.Trends in Computer Aided Design and MFG.
Trends in Computer Aided Design and MFG.
Tool and Die Tech
 
Lecture 6 - The effect of Corona effect in Power systems.pdf
Lecture 6 - The effect of Corona effect in Power systems.pdfLecture 6 - The effect of Corona effect in Power systems.pdf
Lecture 6 - The effect of Corona effect in Power systems.pdf
peacekipu
 
Press Tool and It's Primary Components.pdf
Press Tool and It's Primary Components.pdfPress Tool and It's Primary Components.pdf
Press Tool and It's Primary Components.pdf
Tool and Die Tech
 
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model SafeBangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
bookhotbebes1
 
Rotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptxRotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptx
surekha1287
 
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
VICTOR MAESTRE RAMIREZ
 
Exploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative ReviewExploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative Review
sipij
 
L-3536-Cost Benifit Analysis in ESIA.pptx
L-3536-Cost Benifit Analysis in ESIA.pptxL-3536-Cost Benifit Analysis in ESIA.pptx
L-3536-Cost Benifit Analysis in ESIA.pptx
naseki5964
 
Software Engineering and Project Management - Introduction to Project Management
Software Engineering and Project Management - Introduction to Project ManagementSoftware Engineering and Project Management - Introduction to Project Management
Software Engineering and Project Management - Introduction to Project Management
Prakhyath Rai
 
Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...
Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...
Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...
IJAEMSJORNAL
 
Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...
Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...
Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...
IJAEMSJORNAL
 

Recently uploaded (20)

Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and PreventionUnderstanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
 
1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT
1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT
1239_2.pdf IS CODE FOR GI PIPE FOR PROCUREMENT
 
Rohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model Safe
Rohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model SafeRohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model Safe
Rohini @ℂall @Girls ꧁❤ 9873777170 ❤꧂VIP Yogita Mehra Top Model Safe
 
Quadcopter Dynamics, Stability and Control
Quadcopter Dynamics, Stability and ControlQuadcopter Dynamics, Stability and Control
Quadcopter Dynamics, Stability and Control
 
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdfGUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
 
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.docCCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
 
Germany Offshore Wind 010724 RE (1) 2 test.pptx
Germany Offshore Wind 010724 RE (1) 2 test.pptxGermany Offshore Wind 010724 RE (1) 2 test.pptx
Germany Offshore Wind 010724 RE (1) 2 test.pptx
 
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-IDUNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
 
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...
Natural Is The Best: Model-Agnostic Code Simplification for Pre-trained Large...
 
Trends in Computer Aided Design and MFG.
Trends in Computer Aided Design and MFG.Trends in Computer Aided Design and MFG.
Trends in Computer Aided Design and MFG.
 
Lecture 6 - The effect of Corona effect in Power systems.pdf
Lecture 6 - The effect of Corona effect in Power systems.pdfLecture 6 - The effect of Corona effect in Power systems.pdf
Lecture 6 - The effect of Corona effect in Power systems.pdf
 
Press Tool and It's Primary Components.pdf
Press Tool and It's Primary Components.pdfPress Tool and It's Primary Components.pdf
Press Tool and It's Primary Components.pdf
 
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model SafeBangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
 
Rotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptxRotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptx
 
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
 
Exploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative ReviewExploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative Review
 
L-3536-Cost Benifit Analysis in ESIA.pptx
L-3536-Cost Benifit Analysis in ESIA.pptxL-3536-Cost Benifit Analysis in ESIA.pptx
L-3536-Cost Benifit Analysis in ESIA.pptx
 
Software Engineering and Project Management - Introduction to Project Management
Software Engineering and Project Management - Introduction to Project ManagementSoftware Engineering and Project Management - Introduction to Project Management
Software Engineering and Project Management - Introduction to Project Management
 
Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...
Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...
Profiling of Cafe Business in Talavera, Nueva Ecija: A Basis for Development ...
 
Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...
Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...
Best Practices of Clothing Businesses in Talavera, Nueva Ecija, A Foundation ...
 

PAC 2019 virtual Stephen Townshend

  • 1. Preparing for the Pipeline By Stephen Townshend
  • 3. What we will cover • Value stream mapping • Automating performance testing • JMeter demonstration • Wrap-up (taking it further)
  • 4. Value StreamMapping • Remove • Simplify • Automate
  • 5. Value StreamMapping ExecutionPre-test Tasks Post-test Tasks Refresh Test Data Configure System System Monitoring Check-out of Version control Smoke-test Environment Gather Results Process Results Analyse Results + Monitoring Deep-dive Analysis Coordinate Diagnosis 3 min 10 min 1 min 1 min 5 min < 1 min 5 min 3 min 3 min 5 min 15 min+ 2+ hours Days (elapsed) Configure Test Suite Verify Test Suite Execute Test Ambiguous Monitor Test Progress
  • 6. Value StreamMapping ExecutionPre-test Tasks Post-test Tasks Refresh Test Data Configure System System Monitoring Check-out of Version control Smoke-test Environment Verify Test Suite Gather Results Process Results 3 min 10 min 1 min 1 min 5 min 5 min Ambiguous 3 min 5 min Configure Test Suite Execute Test < 1 min
  • 7. StartSmall Refresh Test Data Configure SUT Start Monitoring Check out Test suite Smoke Test Environment Execute Test Gather Results Process Results Script Script Script Script Script Script Script Script Orchestrator Job 1 Job 2
  • 8. Our Example Refresh Test Data Configure SUT Start Monitoring Check out Test suite Smoke Test Environment Execute Test Gather Results Process Results Script Script Script Script Script Script Jenkins Job 1 Job 2 Job 3
  • 9. The hardest part • The hardest bit is preparing your load test assets to automate, e.g. • The specifics depend on the tool – each have their challenges • Today I am going to use JMeter as the example, but the principles can be applied to other tools Tool Controller/ Agents Environment Workload Duration
  • 10. JMeterDemo We will cover six tips: 1. JMeter project as a solution 2. Flexible File Writer 3. Separate out script files (Groovy/BeanShell) 4. Dynamic run ID 5. Simple Table Server 6. Test Fragments
  • 11. Key Takeaways 1. Analyse your own process 2. Identify tasks you can remove, simplify, or automate 3. Automation provides multiple benefits: 1. Reduced elapsed time 2. Specialists can focus on higher value work 3. Enable/empower others to run their own tests 4. When automating, start small 5. Change the ways you are using your tools for simplicity
  • 12. The BiggerPicture… • There is a bigger opportunity here… • We saved half an hour per execution by automating all of this • What about the 0-8 weeks of test suite development in my value stream? • Automation is not a silver bullet. Think about it as a subset of simplification. • Some ideas to get started: • UI automation to generate load – more reusability & leverage test team assets • Reduce the scope of test suites

Editor's Notes

  1. On the surface, today I’m going to demonstrate some tips for using JMeter in a way which facilitates automating your load testing But the bigger topic I’m really touching on is the concept of simplification. Asking yourself the question – what am I doing now? And how can I do it more efficiently? Questions: How do we do more with less? How do we move faster? How can we free ourselves up to do higher value work?
  2. Acknowledge Came from their ideas What I will show is a very primitive step towards what they’ve achieved They have taken the concepts I discuss here much further
  3. First step in simplification is to take the time to understand what you are doing now Recently attended workshop – came back and applied it to my work Purpose – track process beginning to end, look for optimisation (CLICK) The fastest activity is one you don’t do at all – look for tasks that could be removed Other options – simplify or automate What makes a task suitable for automation? Mechanical in nature, often repeated What tasks are mechanical above? Those under Pre-test, execution, and post-test tasks Before we move on: Where is all the time taken? Test suite development… which can’t be automated, but there’s other things we could do there to save a lot of time and complexity. But for this talk I’m focusing on automation, and the wider simplification is a topic for another time. Improvement to VSM – add in information gathering
  4. (Run through each activity) Individually each thing doesn’t take too long Collectively they add up, plus we could be executed multiple times every day Not just elapsed duration - but the concentration required taking us away from other work But what can actually be automated? The analysis can’t be, I need to do that, it takes time but I don’t mind because it adds a lot of value
  5. There are also two tasks we can completely remove by adding in automation – configuring and verifying the test suite is not required if we can automate the execution process - Approximately 30 minutes of my time could potentially be saved by automating everything above - Benefit – enabling others who are not perf specialists? No longer need to understand load test tools, just hit a button. - Or schedule tests
  6. Start simple. You don’t need a build/pipeline tool, just write scripts to automate some activities. Whatever script language suits you, but you might want to think about what your orchestration or build tools support for later on. Example – my test data refresh PowerShell script. Just connects to SQL and Oracle, runs queries, moves files. Start by wrapping some automation around specific tasks – then groups those into bigger jobs that can be run. Organically build them up, modularised. When you get to the bigger jobs and orchestration, lean on a DevOps or CD engineer – but you can do the hard work yourself by automating the individual tasks yourself.
  7. Here’s what we have currently built at IAG – and we are improving this over time. We can actually smoke test the environment via a pipeline, but it’s not an automated process that occurs before we execute a regular test, we have to run a standalone smoke test via the pipeline. Another benefit to building load test assets in a runnable pipeline is you can share it with other teams so they can run their own tests. You empower the delivery teams.
  8. How can we change the way we use our load test tools to enable automation?
  9. In this demo there is a mix of preparing your test suite for automation, plus some general useful tips for working with JMeter. Go to the website manually, show the steps Structure your project as a solution Properties files Property Display User Defined Variables Tip 1: Flexible File Writer – explain the power, ease of use, Run ID Tip 2: Separate out script files (Git corruption, syntax highlighting) Tip 3: Dynamic Run ID’s Tip 4: Simple Table Server & limitations of CSV Data Set Config Tip 5: Test Fragments Hopefully you can start to see by re-structure and adjusting the way you work with your load testing tool you’re in a better position to start automating it
  10. Lots of lost opportunity if we focus solely on automation.
  11. The first two jobs – execution, and then process results (Animate the flow?) (Jenkins Logo, JMeter logo)
  12. The third job is simpler - server monitoring Mention the JMeter pushing aggregated results to Influx/Grafana as well to monitor the tests