Real User Measurement: The Secret Weapon for Quality
- 2. 1© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Introductions
o Audience Poll
o The SOASTA Platform
o Introduction to Real User Measurement
o Using mPulse and CloudTest together
o Customer case study
o mPulse Demo
- 3. 2© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Buddy Brewer
o VP mPulse Business Development
o Cliff Crocker
o VP mPulse Product Management
- 4. 4© 2014 SOASTA CONFIDENTIAL - All rights reserved.
SOASTA Core DNA
Contextual & Actionable
IntelligenceSOASTA Analytic Engine
In-Memory Performance Analytics
(Patent Filed)
SOASTA Global Test Cloud
Largest Test Automation Platform in The world
SOASTA Command & Control
Test & Measurement Automation Grid
(Patent)
mPulse
Real User
Measurement
Production
Dev/Test Feedback Loop
CloudTest
Performance
(Patent)
Pre-Production
Test Build & Editing
TouchTest
Functionality
(Patent Filed)
- 5. 5© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Frequent testing from development through production
o Realism and accuracy from the user’s view to the last server
o Real time analytics and integrated monitoring
o End to end optimization from app to infrastructure
o Test cycle acceleration and optimization
- 7. 7© 2014 SOASTA CONFIDENTIAL - All rights reserved.
RUM 101
Real User Measurement (RUM) is a technology for collecting
performance metrics directly from the browser of an end user.
• Involves instrumentation of the page with JavaScript
• Measurements are fired across the network to a collection point
through a small request object (beacon)
<JS> MySite.com
<beacon>
- 8. Before During After
Increase test
accuracy and
relevance
Gain operational
visibility, feedback
Decrease
production risk
When is mPulse Useful?
Applications before, during, and after testing
- 10. 10© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Safely test production
Watch performance
Watch key metrics
- 11. 11© 2014 SOASTA CONFIDENTIAL - All rights reserved.
After: Find Real-world Performance Issues
Find areas of focus for next round of development/testing
+ = 2 seconds
= 8 seconds
+
Home +
Product +
= 5 seconds
= 2.5 seconds
- 12. 12© 2014 SOASTA CONFIDENTIAL - All rights reserved.
After: Set Meaningful Performance Goals
Derive web performance goals from business targets
3.5
sec
Instrument what you want to manage:
Business Target: 30% Bounce Rate
Performance Goal: 3.5 Second Load Time
• Conversion Rate
• Items Sold
• Comments
• Signups
- 14. 14© 2014 SOASTA CONFIDENTIAL - All rights reserved.
2014 Winter Olympics
o World wide traffic
o Regional browsers
o Event-driven traffic
o Feb 7-23, 2014
o 414 Million Page Views
o 124.3 Million Unique Visits
- 15. 15© 2014 SOASTA CONFIDENTIAL - All rights reserved.
Impact of Speed on Visitor Loss
11% @ 1.35 sec
33% @ 5.4 sec