SlideShare a Scribd company logo
0© 2014 SOASTA CONFIDENTIAL - All rights reserved.
1© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Introductions
o Audience Poll
o The SOASTA Platform
o Introduction to Real User Measurement
o Using mPulse and CloudTest together
o Customer case study
o mPulse Demo
2© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Buddy Brewer
o VP mPulse Business Development
o Cliff Crocker
o VP mPulse Product Management
4© 2014 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Core DNA
Contextual & Actionable
IntelligenceSOASTA Analytic Engine
In-Memory Performance Analytics
(Patent Filed)
SOASTA Global Test Cloud
Largest Test Automation Platform in The world
SOASTA Command & Control
Test & Measurement Automation Grid
(Patent)
mPulse
Real User
Measurement
Production
Dev/Test Feedback Loop
CloudTest
Performance
(Patent)
Pre-Production
Test Build & Editing
TouchTest
Functionality
(Patent Filed)
5© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Frequent testing from development through production
o Realism and accuracy from the user’s view to the last server
o Real time analytics and integrated monitoring
o End to end optimization from app to infrastructure
o Test cycle acceleration and optimization
6© 2014 SOASTA CONFIDENTIAL - All rights reserved.
mPulse
7© 2014 SOASTA CONFIDENTIAL - All rights reserved.
RUM 101
Real User Measurement (RUM) is a technology for collecting
performance metrics directly from the browser of an end user.
• Involves instrumentation of the page with JavaScript
• Measurements are fired across the network to a collection point
through a small request object (beacon)
<JS> MySite.com
<beacon>
Before During After
Increase test
accuracy and
relevance
Gain operational
visibility, feedback
Decrease
production risk
When is mPulse Useful?
Applications before, during, and after testing
9© 2014 SOASTA CONFIDENTIAL - All rights reserved.
10© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Safely test production
Watch performance
Watch key metrics
11© 2014 SOASTA CONFIDENTIAL - All rights reserved.
After: Find Real-world Performance Issues
Find areas of focus for next round of development/testing
+ = 2 seconds
= 8 seconds
+
Home +
Product +
= 5 seconds
= 2.5 seconds
12© 2014 SOASTA CONFIDENTIAL - All rights reserved.
After: Set Meaningful Performance Goals
Derive web performance goals from business targets
3.5
sec
Instrument what you want to manage:
Business Target: 30% Bounce Rate
Performance Goal: 3.5 Second Load Time
• Conversion Rate
• Items Sold
• Comments
• Signups
13© 2014 SOASTA CONFIDENTIAL - All rights reserved.
14© 2014 SOASTA CONFIDENTIAL - All rights reserved.
2014 Winter Olympics
o World wide traffic
o Regional browsers
o Event-driven traffic
o Feb 7-23, 2014
o 414 Million Page Views
o 124.3 Million Unique Visits
15© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Impact of Speed on Visitor Loss
11% @ 1.35 sec
33% @ 5.4 sec
Thank You
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
650.390.6700
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Case studies: soasta.com/customers
Upcoming webinars: soasta.com/knowledge-center
- “Getting Started with mPulse” – April 4th 10am
- “Agile Load Testing in the Real World” – March
Need a test, fast? CloudTest On-Demand.
- email info@soasta.com
www.SOASTA.com

More Related Content

Real User Measurement: The Secret Weapon for Quality

  • 1. 0© 2014 SOASTA CONFIDENTIAL - All rights reserved.
  • 2. 1© 2014 SOASTA CONFIDENTIAL - All rights reserved. o Introductions o Audience Poll o The SOASTA Platform o Introduction to Real User Measurement o Using mPulse and CloudTest together o Customer case study o mPulse Demo
  • 3. 2© 2014 SOASTA CONFIDENTIAL - All rights reserved. o Buddy Brewer o VP mPulse Business Development o Cliff Crocker o VP mPulse Product Management
  • 4. 4© 2014 SOASTA CONFIDENTIAL - All rights reserved. SOASTA Core DNA Contextual & Actionable IntelligenceSOASTA Analytic Engine In-Memory Performance Analytics (Patent Filed) SOASTA Global Test Cloud Largest Test Automation Platform in The world SOASTA Command & Control Test & Measurement Automation Grid (Patent) mPulse Real User Measurement Production Dev/Test Feedback Loop CloudTest Performance (Patent) Pre-Production Test Build & Editing TouchTest Functionality (Patent Filed)
  • 5. 5© 2014 SOASTA CONFIDENTIAL - All rights reserved. o Frequent testing from development through production o Realism and accuracy from the user’s view to the last server o Real time analytics and integrated monitoring o End to end optimization from app to infrastructure o Test cycle acceleration and optimization
  • 6. 6© 2014 SOASTA CONFIDENTIAL - All rights reserved. mPulse
  • 7. 7© 2014 SOASTA CONFIDENTIAL - All rights reserved. RUM 101 Real User Measurement (RUM) is a technology for collecting performance metrics directly from the browser of an end user. • Involves instrumentation of the page with JavaScript • Measurements are fired across the network to a collection point through a small request object (beacon) <JS> MySite.com <beacon>
  • 8. Before During After Increase test accuracy and relevance Gain operational visibility, feedback Decrease production risk When is mPulse Useful? Applications before, during, and after testing
  • 9. 9© 2014 SOASTA CONFIDENTIAL - All rights reserved.
  • 10. 10© 2014 SOASTA CONFIDENTIAL - All rights reserved. Safely test production Watch performance Watch key metrics
  • 11. 11© 2014 SOASTA CONFIDENTIAL - All rights reserved. After: Find Real-world Performance Issues Find areas of focus for next round of development/testing + = 2 seconds = 8 seconds + Home + Product + = 5 seconds = 2.5 seconds
  • 12. 12© 2014 SOASTA CONFIDENTIAL - All rights reserved. After: Set Meaningful Performance Goals Derive web performance goals from business targets 3.5 sec Instrument what you want to manage: Business Target: 30% Bounce Rate Performance Goal: 3.5 Second Load Time • Conversion Rate • Items Sold • Comments • Signups
  • 13. 13© 2014 SOASTA CONFIDENTIAL - All rights reserved.
  • 14. 14© 2014 SOASTA CONFIDENTIAL - All rights reserved. 2014 Winter Olympics o World wide traffic o Regional browsers o Event-driven traffic o Feb 7-23, 2014 o 414 Million Page Views o 124.3 Million Unique Visits
  • 15. 15© 2014 SOASTA CONFIDENTIAL - All rights reserved. Impact of Speed on Visitor Loss 11% @ 1.35 sec 33% @ 5.4 sec
  • 16. Thank You Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 650.390.6700 Follow us: twitter.com/cloudtest facebook.com/cloudtest RESOURCES Case studies: soasta.com/customers Upcoming webinars: soasta.com/knowledge-center - “Getting Started with mPulse” – April 4th 10am - “Agile Load Testing in the Real World” – March Need a test, fast? CloudTest On-Demand. - email info@soasta.com