SlideShare a Scribd company logo
© 2014 SOASTA. All rights reserved. 1
© 2014 SOASTA. All rights reserved. 2
© 2014 SOASTA. All rights reserved. 3
Agenda:
• The need for “Continuous”
• CI with mobile and performance testing
• SOASTA CloudTest and TouchTest with Jenkins (demo)
Questions:
Submit in chat box during event
© 2014 SOASTA. All rights reserved. 4
User Experience
Unpredictability Continuous
Mobile
100’s to millions
Local to global
100% availability
Agile development
Continuous delivery
DevOps principles
Fast
Seamless
Disposable
Online everything
Mobile commerce
Legacy modernization
© 2014 SOASTA. All rights reserved. 5
Does it work as
designed?
Does it perform
under extreme
circumstances?
Approve materials Real Drivers
What happens
in actual
conditions?
Assembly Line
© 2014 SOASTA. All rights reserved. 6
Functional validation
Performance,
reliability,
scalability tests
Real Users
Build
What happens
in actual
conditions?
Unit-tested code
© 2014 SOASTA. All rights reserved. 7
o Small Batch Sizes
o Comprehensive Version Control
o Simple Branch Strategies
o Automation
o Continuous Feedback
o Emphasis on working builds
o Consistent environments
o Developer – Tester Collaboration
© 2014 SOASTA. All rights reserved. 8CONFIDENTIAL – Not for Distribution
© 2014 SOASTA. All rights reserved. 9
© 2014 SOASTA. All rights reserved. 10CONFIDENTIAL – Not for Distribution
Ut
Unit Testing
Pe
Performance
Testing
Fu
Functional
Testing
Development Testing Operations
TIME
Traditional Linear Approach
© 2014 SOASTA. All rights reserved. 11CONFIDENTIAL – Not for Distribution
Ut
Unit Testing
Pe
Performance
Testing
Fu
Functional
Testing
Development Testing Operations
TIME
Test
Dev Ops
Traditional Linear Approach
Continuous Testing Approach
© 2014 SOASTA. All rights reserved. 12
Mobile Test
Automation
Performanc
e Testing
Real Test
Devices
Solid
Integration
© 2014 SOASTA. All rights reserved. 13
o Fully managed private device cloud
installed behind the firewall
o Real-time device inventory, status and
availability
o Online access for all your teams
o 24x7, secure, remote access to devices
o Mobile functional test automation
software
o Remotely access to selected mobile
device and any mobile app
• Use devices for manual testing and monitoring
• Remote screen-share devices for collaboration on
design or issues
© 2014 SOASTA. All rights reserved. 14
o Dedicated Public Device Cloud
o Access to the latest market leading
devices (iOS/Android)
o Automatic installation,
maintenance and upgrade
o Hosted devices in a secure data
center
o Stock devices, not jail
broken/rooted
o Seamless integration with
TouchTest and CI environments
o API available to install apps,
reboot/wake-up devices, launch
tests
Perfect for 24x7 Automated Mobile Regression Testing
© 2014 SOASTA. All rights reserved. 15
s
Memory leaks
Test Scale
Stage/Team
Dev
& Test
Release
& Deploy
Network
& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Load Testing at All Stages
Performance validation from development to production
Continuous tuning for full-scale…and well beyond
© 2014 SOASTA. All rights reserved. 16
Use real user data to
iterate dev & test plans
Run iterative load
tests via Jenkins
Daily (or more frequent) updates
keep teams quality focused
Embedded failure
details & bottleneck
data isolate issues
Manage to a
performance
baseline
Mobile? Run functional
automation on real devices
for functional & performance
validation
Spin up suitable, consistent
test environments in the
cloud or the lab
Jenkins runs any
unit tests as usual
© 2014 SOASTA. All rights reserved. 17
© 2014 SOASTA. All rights reserved. 18
Expertise
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Next Webinar: November 5, 2014
“How to Measure the Business Impact of Web Performance”
Register:
Webinars future and past: http://www.soasta.com/knowledge-
center/webinars/
Want to evaluate any SOASTA product or service?
- email info@soasta.com
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com

More Related Content

Accelerate Web and Mobile Testing for Continuous Integration and Delivery

  • 1. © 2014 SOASTA. All rights reserved. 1
  • 2. © 2014 SOASTA. All rights reserved. 2
  • 3. © 2014 SOASTA. All rights reserved. 3 Agenda: • The need for “Continuous” • CI with mobile and performance testing • SOASTA CloudTest and TouchTest with Jenkins (demo) Questions: Submit in chat box during event
  • 4. © 2014 SOASTA. All rights reserved. 4 User Experience Unpredictability Continuous Mobile 100’s to millions Local to global 100% availability Agile development Continuous delivery DevOps principles Fast Seamless Disposable Online everything Mobile commerce Legacy modernization
  • 5. © 2014 SOASTA. All rights reserved. 5 Does it work as designed? Does it perform under extreme circumstances? Approve materials Real Drivers What happens in actual conditions? Assembly Line
  • 6. © 2014 SOASTA. All rights reserved. 6 Functional validation Performance, reliability, scalability tests Real Users Build What happens in actual conditions? Unit-tested code
  • 7. © 2014 SOASTA. All rights reserved. 7 o Small Batch Sizes o Comprehensive Version Control o Simple Branch Strategies o Automation o Continuous Feedback o Emphasis on working builds o Consistent environments o Developer – Tester Collaboration
  • 8. © 2014 SOASTA. All rights reserved. 8CONFIDENTIAL – Not for Distribution
  • 9. © 2014 SOASTA. All rights reserved. 9
  • 10. © 2014 SOASTA. All rights reserved. 10CONFIDENTIAL – Not for Distribution Ut Unit Testing Pe Performance Testing Fu Functional Testing Development Testing Operations TIME Traditional Linear Approach
  • 11. © 2014 SOASTA. All rights reserved. 11CONFIDENTIAL – Not for Distribution Ut Unit Testing Pe Performance Testing Fu Functional Testing Development Testing Operations TIME Test Dev Ops Traditional Linear Approach Continuous Testing Approach
  • 12. © 2014 SOASTA. All rights reserved. 12 Mobile Test Automation Performanc e Testing Real Test Devices Solid Integration
  • 13. © 2014 SOASTA. All rights reserved. 13 o Fully managed private device cloud installed behind the firewall o Real-time device inventory, status and availability o Online access for all your teams o 24x7, secure, remote access to devices o Mobile functional test automation software o Remotely access to selected mobile device and any mobile app • Use devices for manual testing and monitoring • Remote screen-share devices for collaboration on design or issues
  • 14. © 2014 SOASTA. All rights reserved. 14 o Dedicated Public Device Cloud o Access to the latest market leading devices (iOS/Android) o Automatic installation, maintenance and upgrade o Hosted devices in a secure data center o Stock devices, not jail broken/rooted o Seamless integration with TouchTest and CI environments o API available to install apps, reboot/wake-up devices, launch tests Perfect for 24x7 Automated Mobile Regression Testing
  • 15. © 2014 SOASTA. All rights reserved. 15 s Memory leaks Test Scale Stage/Team Dev & Test Release & Deploy Network & Ops CDN file placement Load Balancer configuration Network bandwidth Network configuration DNS routing Inadequate server resources Default configuration settings Unbalanced web serversAuto-scaling failures Latency between systems Slow third-party plug-ins Garbage collection Database thread counts Inefficient database queriesSlow pages Conflict with other apps Test Lab Staging Production (100% +++) Search technology limits Method-level tuning Max sockets exceeded Firewall max capacity Global latency variance Security bottlenecks Load Testing at All Stages Performance validation from development to production Continuous tuning for full-scale…and well beyond
  • 16. © 2014 SOASTA. All rights reserved. 16 Use real user data to iterate dev & test plans Run iterative load tests via Jenkins Daily (or more frequent) updates keep teams quality focused Embedded failure details & bottleneck data isolate issues Manage to a performance baseline Mobile? Run functional automation on real devices for functional & performance validation Spin up suitable, consistent test environments in the cloud or the lab Jenkins runs any unit tests as usual
  • 17. © 2014 SOASTA. All rights reserved. 17
  • 18. © 2014 SOASTA. All rights reserved. 18 Expertise
  • 19. Thanks Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest RESOURCES Next Webinar: November 5, 2014 “How to Measure the Business Impact of Web Performance” Register: Webinars future and past: http://www.soasta.com/knowledge- center/webinars/ Want to evaluate any SOASTA product or service? - email info@soasta.com - You’ll hear from us tomorrow (maybe today)