SlideShare a Scribd company logo

Get Ready for Changes To Load Testing

•Download as PPTX, PDF•
•
SOASTA
SOASTA

This document outlines a webinar presentation on performance testing. It discusses how performance testing needs to change to keep up with trends like increased application development, continuous delivery, and more demanding users. Traditional approaches using siloed teams and infrequent testing are outdated. The presentation provides tips on breaking the status quo by increasing test frequency, embracing mobile applications, and integrating performance testing into agile development teams throughout the software lifecycle. Distributed, collaborative performance testing driven by real user data is presented as the new modern approach.

Related slideshows

5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
Real User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for QualityReal User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for Quality
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
 
1 of 27
April 16, 2015 1© 2015 SOASTA. All rights reserved. Webinar
April 16, 2015 2© 2015 SOASTA. All rights reserved. Today’s Presenters Mark Tomlinson Independent Performance Coach F1000 Companies Microsoft HP (former LoadRunner PM) Brad Johnson Performance Product “Lifer” SOASTA Borland Mercury Interactive Compuware
April 16, 2015 3© 2015 SOASTA. All rights reserved.
April 16, 2015 4© 2015 SOASTA. All rights reserved. Agenda Changes are upon us 1. Breaking the Status Quo 2. Apps are Eating the World 3. What about the Center of Excellence?
User ExpectationsUnpredictable Demand Continuous DeliveryMultiple Devices P Performance Is Complicated Speed Quality
April 16, 2015 6© 2015 SOASTA. All rights reserved. Models are inaccurate
April 16, 2015 7© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile
April 16, 2015 8© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile Production scale tests are rare
April 16, 2015 9© 2015 SOASTA. All rights reserved. RetestTest Development Infra setup RepeatFix Tes t Analyze TIME Breaking the Status Quo The Legacy Approach
April 16, 2015 10© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency
April 16, 2015 11© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams
April 16, 2015 12© 2015 SOASTA. All rights reserved. o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency Breaking the Status Quo Everything has changed…
April 16, 2015 13© 2015 SOASTA. All rights reserved. Tips for Breaking the Status Quo Taking your first steps into a larger world… o Calculate the ROI of increased feedback on performance o Calculate the KPI trends on repeated release candidates o Invade the sprint planning and add performance to the stories o Replace your test plans with continuous feedback from APM
April 16, 2015 14© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously)
April 16, 2015 15© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
April 16, 2015 16© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
April 16, 2015 17© 2015 SOASTA. All rights reserved. Tips for the Explosion of Apps Less is more… o Investigate performance sooner & faster, in smaller scope o Trust external dependencies, until proven otherwise o Know your competitors’ performance - leverage that knowledge o Calculate your impact on time-to-market or project schedules
April 16, 2015 18© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo
April 16, 2015 19© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck
April 16, 2015 20© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
April 16, 2015 21© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
April 16, 2015 22© 2015 SOASTA. All rights reserved. The Modern Approach TIME The Legacy Approach Run more tests in less time. Start earlier. Cover more ground.repeat / Test Analyz e Fix Test Dev Test Development Infra setup Tes t Analyze Retest RepeatFix Distributed Performance
April 16, 2015 23© 2015 SOASTA. All rights reserved. Distributed Perforamance Component scalability Performance baseline Integration testing End to End w/ Service Virtualization Unit scalability Database testing 3rd party services Live E2E tests Stress testing Soak test (reliability) Failover Capacity Latency Performance Regression (smoke tests) Network Testing (staging) Operations (prod)Development (sandbox) Define Tests with Real User Data
April 16, 2015 24© 2015 SOASTA. All rights reserved. Tips for Distributed Excellence Measure yourself by the impact on others… o Find project champions - create institutionalized excellence there o Start an inclusive, collaborative working group - not exclusive silo o Integrate with open-source tools across the lifecycle - enable them o Abandon the questionnaire - assign full-time facilitators
April 16, 2015 25© 2015 SOASTA. All rights reserved. • Rapidly collect accurate test specifications • Collaborate with all teams • Integrate testing processes • Try new approaches….
April 16, 2015 26© 2015 SOASTA. All rights reserved. 1. Break the Status Quo 2. Embrace the “App” culture of change 3. Reconsider centalized approches in an agile world
April 16, 2015 27© 2015 SOASTA. All rights reserved. o Read up on Performance Engineering o Try a free product o Get certified for FREE (SOASTA University) o Test Now and see! NEW WHITEPAPER! www.soasta.com

More Related Content

Get Ready for Changes To Load Testing

  • 1. April 16, 2015 1© 2015 SOASTA. All rights reserved. Webinar
  • 2. April 16, 2015 2© 2015 SOASTA. All rights reserved. Today’s Presenters Mark Tomlinson Independent Performance Coach F1000 Companies Microsoft HP (former LoadRunner PM) Brad Johnson Performance Product “Lifer” SOASTA Borland Mercury Interactive Compuware
  • 3. April 16, 2015 3© 2015 SOASTA. All rights reserved.
  • 4. April 16, 2015 4© 2015 SOASTA. All rights reserved. Agenda Changes are upon us 1. Breaking the Status Quo 2. Apps are Eating the World 3. What about the Center of Excellence?
  • 5. User ExpectationsUnpredictable Demand Continuous DeliveryMultiple Devices P Performance Is Complicated Speed Quality
  • 6. April 16, 2015 6© 2015 SOASTA. All rights reserved. Models are inaccurate
  • 7. April 16, 2015 7© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile
  • 8. April 16, 2015 8© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile Production scale tests are rare
  • 9. April 16, 2015 9© 2015 SOASTA. All rights reserved. RetestTest Development Infra setup RepeatFix Tes t Analyze TIME Breaking the Status Quo The Legacy Approach
  • 10. April 16, 2015 10© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency
  • 11. April 16, 2015 11© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams
  • 12. April 16, 2015 12© 2015 SOASTA. All rights reserved. o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency Breaking the Status Quo Everything has changed…
  • 13. April 16, 2015 13© 2015 SOASTA. All rights reserved. Tips for Breaking the Status Quo Taking your first steps into a larger world… o Calculate the ROI of increased feedback on performance o Calculate the KPI trends on repeated release candidates o Invade the sprint planning and add performance to the stories o Replace your test plans with continuous feedback from APM
  • 14. April 16, 2015 14© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously)
  • 15. April 16, 2015 15© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
  • 16. April 16, 2015 16© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
  • 17. April 16, 2015 17© 2015 SOASTA. All rights reserved. Tips for the Explosion of Apps Less is more… o Investigate performance sooner & faster, in smaller scope o Trust external dependencies, until proven otherwise o Know your competitors’ performance - leverage that knowledge o Calculate your impact on time-to-market or project schedules
  • 18. April 16, 2015 18© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo
  • 19. April 16, 2015 19© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck
  • 20. April 16, 2015 20© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
  • 21. April 16, 2015 21© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
  • 22. April 16, 2015 22© 2015 SOASTA. All rights reserved. The Modern Approach TIME The Legacy Approach Run more tests in less time. Start earlier. Cover more ground.repeat / Test Analyz e Fix Test Dev Test Development Infra setup Tes t Analyze Retest RepeatFix Distributed Performance
  • 23. April 16, 2015 23© 2015 SOASTA. All rights reserved. Distributed Perforamance Component scalability Performance baseline Integration testing End to End w/ Service Virtualization Unit scalability Database testing 3rd party services Live E2E tests Stress testing Soak test (reliability) Failover Capacity Latency Performance Regression (smoke tests) Network Testing (staging) Operations (prod)Development (sandbox) Define Tests with Real User Data
  • 24. April 16, 2015 24© 2015 SOASTA. All rights reserved. Tips for Distributed Excellence Measure yourself by the impact on others… o Find project champions - create institutionalized excellence there o Start an inclusive, collaborative working group - not exclusive silo o Integrate with open-source tools across the lifecycle - enable them o Abandon the questionnaire - assign full-time facilitators
  • 25. April 16, 2015 25© 2015 SOASTA. All rights reserved. • Rapidly collect accurate test specifications • Collaborate with all teams • Integrate testing processes • Try new approaches….
  • 26. April 16, 2015 26© 2015 SOASTA. All rights reserved. 1. Break the Status Quo 2. Embrace the “App” culture of change 3. Reconsider centalized approches in an agile world
  • 27. April 16, 2015 27© 2015 SOASTA. All rights reserved. o Read up on Performance Engineering o Try a free product o Get certified for FREE (SOASTA University) o Test Now and see! NEW WHITEPAPER! www.soasta.com