The Mobile Testing Checklist
•Download as PPTX, PDF•
9 likes•4,443 views
Testing mobile apps is different. There are more form factors, more combinations, more complexity and more users. You need a checklist to be sure you don't overbuild or under test. SOASTA and Utopia have the experience and technology you need to be successful. Join this free webinar and learn: The most common mobile app issues Missed areas like app interrupts, poor connections and device settings When to automate for functionality and performance Technology for end-to-end mobile testing How to collect mobile user information for continuous improvement Utopia Solutions Founder and CTO, Lee Barnes and the SOASTA team will share customer experiences and demonstrations that will help you cross off every critical element of your mobile testing checklist.
Report
Share
The Mobile Testing Checklist
- 1. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 0
- 2. Mike Ostenberg Director Solutions Engineering SOASTA Moderator: Brad Johnson VP of Product Marketing SOASTA © 2014 SOASTA CONFIDENTIAL - All rights reserved. 1 Lee Barnes Founder and CTO Utopia Solutions If you have questions during the webinar, submit in chat box during event
- 3. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 2 1. Introduction 2. The Landscape of Mobile Testing 1. Why is Mobile Testing Different 2. Checklist for Mobile Testing 3. Mobile Testing Framework 3. SOASTA Solutions 1. TouchTest Key Capabilities 2. CloudTest for Mobile Load Testing 3. mPulse RUM for Mobile Monitoring 4. Resources and Conclusion
- 4. Source: “Mobile In the Enterprise”, Zendesk 2014 © 2014 SOASTA CONFIDENTIAL - All rights reserved. 3
- 5. Spring 2013 Fall 2013 Spring 2014 25 attendees 28 attendees 21 attendees “Do you currently have a mobile initiative” © 2014 SOASTA CONFIDENTIAL - All rights reserved. 4 56% 44%
- 6. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 5 CHALLENGES o Most traditional dev practices don’t work with mobile o Apps require constant refinement to tune the user experience o Rapid change requires rapid development & deployment Source: Gartner “Traditional Development Practices Will Fail for Mobile Apps” April 15, 2014
- 7. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 6 CHALLENGES o Most traditional dev practices don’t work with mobile o Apps require constant refinement to tune the user experience o Rapid change requires rapid development & deployment RECOMMENDATIONS o Collaborate with business, users, devs…and observe work practices o Use all test types: functional, performance & load, and user experience o Analyze how apps are used in production by real users o Adopt agile development and deployment Source: Gartner “Traditional Development Practices Will Fail for Mobile Apps” April 15, 2014
- 8. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 7
- 9. Lee Barnes Founder and CTO © 2014 SOASTA CONFIDENTIAL - All rights reserved. 8
- 10. Mobile testing is… …different 9 www.motivationalmemo.com
- 11. Source: OpenSignal Android Fragmentation Report August 2014 © 2014 SOASTA CONFIDENTIAL - All rights reserved. 10 iOS 8 iOS 7 Earlier 4.4 4.3 4.2 4.1 4.03 - 4.04 2.3.3 - 2.3.7 2.2 & earlier
- 12. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 11
- 13. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 12
- 14. App Functionality Mobile Testing Iceberg © 2014 SOASTA CONFIDENTIAL - All rights reserved. 13
- 15. App Functionality Mobile Specific Test Conditions © 2014 SOASTA CONFIDENTIAL - All rights reserved. 14
- 16. App Functionality Mobile Specific Test Conditions © 2014 SOASTA CONFIDENTIAL - All rights reserved. 15
- 17. App Functionality Mobile Specific Test Conditions © 2014 SOASTA CONFIDENTIAL - All rights reserved. 16
- 18. Performance © 2014 SOASTA CONFIDENTIAL - All rights reserved. 17 Installation Interrupt Network Device Integration
- 19. Incoming / Outgoing Calls Popup Alerts (Calendar, Alarm, SMS, etc.) © 2014 SOASTA CONFIDENTIAL - All rights reserved. 18 Power Cycle Extended Background
- 20. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 19 Install Uninstall Reinstall Update
- 21. Network Type (Mobile variations and WiFi) Network Quality © 2014 SOASTA CONFIDENTIAL - All rights reserved. 20 Network Loss Network Transition
- 22. Speed / Responsiveness CPU and Memory Usage © 2014 SOASTA CONFIDENTIAL - All rights reserved. 21 Battery Drain On-Device / Memory Card Storage
- 23. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 22 Location / GPS Video / Still Camera Screen Size, Resolution, Orientation Accelerometer
- 24. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 23 App Type App Usage App/Device Integration
- 25. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 24 App Functionality & Technology User Profile Business Objectives • Deployment platforms & versions • App interaction with device • Integrated systems • Prevalent Devices • Preferred Browser • Concurrent usage / load profile • Application value to the business • Risk of application failure
- 26. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 25 Mobile Testing
- 27. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 26
- 28. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 27
- 29. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 28 Execute test cases across a set of diverse devices
- 30. Mike Ostenberg Director Solutions Engineering © 2014 SOASTA CONFIDENTIAL - All rights reserved. 29
- 31. Expertise © 2014 SOASTA CONFIDENTIAL - All rights reserved. 30
- 32. Expertise © 2014 SOASTA CONFIDENTIAL - All rights reserved. 31 Run local and remote private device clouds. Compress testing from weeks to overnight.
- 33. Expertise Performance test the mobile backend to any scale or global distribution. Continuously. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 32
- 34. Expertise © 2014 SOASTA CONFIDENTIAL - All rights reserved. 33 Measure real mobile users in production to determine scale and usage patterns. Test better.
- 35. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 34 Lee Barnes Founder and CTO Utopia Solutions Email: lee.barnes@utopiasolutions.com Twitter: twitter.com/USI_LeeBarnes LinkedIn: linkedin.com/in/leebarnes Blog: www.RaiseYourMQ.com Mike Ostenberg Director Solutions Engineering SOASTA Email: mostenberg@soasta.com
- 36. © 2014 SOASTA CONFIDENTIAL - All rights reserved. 35
- 37. Thanks RESOURCES Next Webinar: Oct. 22, 2014 “’Accelerating Web and Mobile Testing for Continuous Delivery” Register: Webinars future and past: http://www.soasta.com/knowledge-center/ webinars/ Want to evaluate any SOASTA product or service? - email info@soasta.com - You’ll hear from us tomorrow (maybe today) Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest