SlideShare a Scribd company logo
TOP BEST PRACTICES FOR

SUCCESSFUL MOBILE TEST AUTOMATION

@fredberinger
SOMETHING FOR YOU TO TAKE BACK HOME
Top Best Practices for Successful Mobile Test Automation
MOBILE TEST AUTOMATION IS HARD

Recommended for you

Appium - test automation for mobile apps
Appium - test automation for mobile appsAppium - test automation for mobile apps
Appium - test automation for mobile apps

This document provides an overview of Appium, an open-source test automation tool for mobile applications. It allows testing of native, hybrid, and mobile web apps across iOS and Android platforms. Appium uses the Selenium WebDriver API and supports many programming languages. It can test on both simulators/emulators and real devices. While it has some limitations like no image comparison, its benefits include easy setup, cross-platform capability, and integration with continuous integration and device farms.

mobileiosappium
Automation Testing With Appium
Automation Testing With AppiumAutomation Testing With Appium
Automation Testing With Appium

The slides cover the introduction to Appium, why is Appium used, Basic concepts, and terminologies used in Appium, Drivers supported by Appium.

appiumautomation with appiumknolx
Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?

The document compares three mobile automation testing tools: Appium, Calabash, and Robotium. Appium provides a cross-platform solution that supports Android, iOS, and FirefoxOS. It uses the Selenium WebDriver JSON protocol and can run tests written in various languages. Calabash consists of Android and iOS libraries for interacting with mobile apps via gestures and assertions. It also supports testing HTML5 parts of hybrid apps. Robotium is an Android testing framework that simplifies writing functional tests using minimal app knowledge. It handles multiple app activities and integrates with build tools.

robotiummobile automationcalabash
EXPECTATION
• 
• 
• 
• 

It is as difficult as developing a good mobile app
It is a software project by itself
It is not optional in mobile
You will probably fail before you succeed
#1 - SET THE RIGHT GOALS
AUTOMATION OBJECTIVES
• 
• 
• 
• 
• 

Continuous feedback to fix bugs faster 
Enable new activities
Increase test coverage
Raise confidence
Better customer support
#2 – TRACK YOUR OBJECTIVES

IF IT IS NOT MEASURED, IT DOESN’T EXIST

Recommended for you

Appium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriverAppium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriver

Appium is a cross-platform solution for automating native and hybrid mobile app testing on iOS and Android using the WebDriver protocol. It allows tests to run on simulators, emulators, and real devices for both native and hybrid apps. Appium uses UIAutomation for iOS and UIAutomator or Selendroid for Android to drive tests by mapping WebDriver commands to platform-specific APIs.

software testingappiumtest automation
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team

Speaker: Karim Fanadka, HPE Software Session Slides: http://www.srijan.net/webinar/building-high-performance-qa-team/ Karim is a DevTest manager at HPE Software and his team is responsible for testing their new SaaS product, the StormRunner Load. In this webinar, Karim shares his experience of building a QA team that is agile, efficient, and uses the latest testing frameworks. He will also talk about continuous testing, automation, test based analytics and hotfixes. Karim start's off the challenges in agile QA and then moves on to solving these challenges. The best part is when he shares the trick to delivering to production every 1.5 months, even for a high pressure enterprise product. The Q/A session also brings out some very interesting topics, going into greater details and various suggestions that you can implement for your own QA teams.

test analyticsqateamhotfixes
Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)

This document discusses automating tests for native mobile applications. It begins by describing the challenges of testing iOS applications using Apple's UI Automation and Instruments tools. It then reviews two attempted approaches for automation that were brittle and difficult to use at scale. The document advocates for using Appium, an open source test automation tool that allows controlling native and hybrid applications using the WebDriver protocol. It provides an example of using Appium to automate tests for a native iOS application and discusses the tool's benefits and limitations. In closing, it outlines opportunities to further enhance Appium's capabilities and integrations.

selenium testingautomationmobile
SET YOUR OWN METRICS
• 
• 
• 
• 


Turnaround time for fixes
Customer satisfaction on app store
Lower number of bugs on production
EMET (Equivalent Manual Execution Test)
ACTIONABLE TEST INTELLIGENCE
• 
• 
• 
• 
• 
• 


Part of the automation framework
Available and highly visible to everyone
Establish a baseline and track ROI
Take costs into account (Value=Benefit-cost)
Too many metrics can hurt
Rinse and repeat until you get it right
#4

BUT NOT ALL THE TESTS!
MISTER JENKINS IN YOUR FRIEND
• 
• 
• 
• 
• 
• 
• 
• 



Automate your build
Automate your app deployment
Automate your environment deployment
Automate your tear down
Automate your test execution
Automate your reporting
Automate your metrics tracking
Automate your communication

Recommended for you

Selenium training
Selenium trainingSelenium training
Selenium training

Selenium is an open source tool used for automating web application testing. It was created in 2004 by Jason Huggins and supports recording and playback of test cases in browsers like Firefox. Selenium has four main components - Selenium IDE for recording and playback of tests, Selenium Remote Control for running tests on multiple browsers, Selenium WebDriver for direct browser control, and Selenium Grid for parallel testing on different machines. The latest version of Selenium is 3.0.

software developmentsoftware testingselenium
Everything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and SeleniumEverything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and Selenium

This document provides an overview and demo of Perfecto Mobile's Continuous Quality Lab (CQ Lab) automation testing capabilities using Selenium and Appium. It discusses the CQ Lab architecture, how to set up automation tests using the desired capabilities, different mobile application types, and object identification. It then demonstrates creating a sample automation project and script in Eclipse, running the test, and reviewing the execution report in the Perfecto Mobile cloud platform.

Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium

Appium is a tool for automating native and hybrid mobile apps. This document discusses how to set up an Appium project to test Android apps. It covers installing Appium and related tools on Windows, setting desired capabilities, locating elements, performing actions, validating results, and running tests. The goal is to create an IntelliJ project that uses Appium to test a sample Android app by interacting with app elements and verifying the app's behavior.

mobile application developmentautomationjava
#5 – AUTOMATE ASAP

BUT BUILD THE FOUNDATION FIRST
Careful planning
•  Plan your Automation infrastructure

•  Cloud, on-premise, devices connectivity, app deployment, data
aggregation, reporting, etc.

•  Pick your automation tool wisely
•  Start small and grow
•  Don’t hesitate to pause tests building activity
#6 – PICK THE RIGHT TESTS TO AUTOMATE

AND I CLEARLY DON’T HAVE A GOOD PICTURE FOR THIS SLIDE
ANALYZE THE RISK OF FAILURE
R(c)=P(c) * I(c)
Probability
•  Code Complexity
•  Changed Areas
•  Affected Interfaces
•  New Technology
•  Component Maturity

Impact
•  Financial
•  Reputation
•  Legal
•  Security
•  Loss of Customers

Recommended for you

Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka

Mobile application testing focuses on testing the functionality and features of mobile applications. It is performed by application vendors. Mobile testing focuses on testing the native features of mobile devices like calls, SMS, Bluetooth, etc. It is performed by handset makers. A simulator mimics the outward behavior of a target but not its internal state, while a simulation accurately models both the outward behavior and underlying internal state of a target. Types of mobile application testing include usability, compatibility, interface, services, low-level resource, performance, and operational testing. The general structure of a mobile testing framework includes application packages, instrumentation, test runners, and test packages. Common bugs in mobile applications include critical bugs, block bugs, major bugs, and minor

appium interview questions and answersappium interview questionsmobile testing interview questions
Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)

Appium is an open source test automation framework for testing native and hybrid mobile apps. It allows writing tests in any language and on any platform to test the same app submitted to app stores. Appium uses the WebDriver protocol to remotely control apps using UIAutomator on Android and Instruments on iOS. This allows testing apps on real devices and emulators with a single test script. Appium supports platforms include Android, iOS, and mobile web apps and can test apps on a local device or cloud-based services like SauceLabs.

appiummobiletesting
Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps

The document discusses automation testing for mobile apps using Appium. Appium allows for cross-platform mobile app testing by using the same tests across iOS and Android platforms. It functions by proxying commands to the devices to run tests using technologies like UIAutomation for iOS and UiAutomator for Android. While useful for local testing, Appium has limitations for scaling tests in continuous integration environments, where services like Sauce Labs are better suited.

appiumbrowser testingsauce labs
#7 – WHERE TO RUN TESTS

HINT: 0% USERS RUN YOUR APP ON A SIMULATOR
SIMULATOR VS REAL DEVICES

•  Pros
•  Cheap
•  Integrated with IDE
•  Cons
•  Not testing on actual platform.
What if the test pass? What’s
next?
•  Network is different
•  OS is different (stock)
•  Can’t simulate real hardware
(CPU, Memory, etc.) Not fit for
mobile performance

•  Pros
•  Reproduce real gestures
•  Real results, no false negative
•  Can test under OEM
customization
•  Fit for mobile performance
•  Cons
•  Need to be managed (device
Cloud helps!)
UNDERSTAND YOUR MARKET

74% iOS7
HAVING TROUBLE WITH ANDROID

Recommended for you

Appium tutorial| Appium Training
Appium tutorial| Appium Training Appium tutorial| Appium Training
Appium tutorial| Appium Training

This tutorial explains in detail How to install Appium with step by step procedure and How to Write Appium Program using Real Device and Emulator.

appium selenium trainingmobile automation using appiumlearn appium online
Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions		Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions

To celebrate the recent launch of version 1.0 earlier this month, join us for a panel discussion with Appium's Chief Architect Jonathan Lipps, Core Appium Contributor Matthew Edwards, and Appium creator Dan Cuellar.

appiumtestingselenium testing
Appium solution
Appium solutionAppium solution
Appium solution

This document provides information about Appium, an open source test automation framework for use with native, hybrid and mobile web apps. It discusses Appium's architecture and features, how to set up Appium for testing iOS and Android apps, different language clients available and requirements for writing tests in Java. The document also covers new capabilities and strategies introduced in Appium, such as TouchActions and MultiTouchActions.

automationmobile application developmentselenium
#8 – BUILD EFFICIENT TESTS

SIZE MATTERS!!
S.F.I.R.S.T.R
• 
• 
• 
• 
• 
• 
• 

Small – Easier to understand & Fix
Fast – Parallel execution for faster feedback
Independent – Can run any subsets in any order
Repeatable – Tests get the same result every time
Self-Checking – No human checking
Timely – Should be written in parallel with dev
Reusable – To avoid maintenance nightmares
#8 – BUILD TESTABILITY

ASK KINDLY …
WHICH IS BETTER?
//TiUIScrollView[@touchTestId='mfaSiteKeysignOn_securityPhraseWindow_ScrollView']/
TiUIScrollViewImpl/UIView/TiUIView[.//UILabel[@text='If
you don't recognize your personalized security image,
don't enter your password.']]/TiUITextField/TiTextField

XPATH

text=blah

TEXT
classname=TiTextField[1]

INDEXED OBJECT
id=mfaSiteKey-siteKey_Password_Input

UNIQUE ID

• 
• 
• 
• 

Build more reliable tests with unique IDs
Lower maintenance cost
Test early
A non-optional investment

Recommended for you

Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium

Android UI Testing with Appium This presentation covers: - how appium works - setting up test development environment with AndroidStudio - running tests - UI automation best practices - common problems with automation

androidappiumui testing
Cross platform test automation using Appium
Cross platform test automation using AppiumCross platform test automation using Appium
Cross platform test automation using Appium

We develop almost identical apps for both Android and iOS. Maintaining separate test suites becomes an overhead over a period of time as the test suites begin to grow. We hare now gradually moving our test infrastructure to Appium so that we can have a single test repo which is easy to maintain.

cross-platformmobilebdd
Best Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App TestingBest Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App Testing

Watch a live presentation at http://offer.bitbar.com/best-practices-for-devops-in-mobile-app-testing In essence, the core of DevOps methodology aims to speed up the app development delivery and process by getting devs and operation specialists to collaborate throughout the end-to-end app development and deployment process. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

android testingin-housetestdroid
# 9 - DATA IS YOUR FRIEND
BE DATA-DRIVEN
• 
• 
• 
• 

Increase test coverage FAST
Easy to add, remove and configure tests
Reduce the number of tests to maintain
Separation of Tests and Datas
#10 – USE RELIABLE WAITS

FORGET ABOUT TIME DELAYS!
USE RELIABLE AND INTELLIGENT WAITS
•  Use object visibility to manage the flow of the test
•  Never use time delays to manage back-end variability
•  Never use time delays to account for device
performance
•  Spend time finding the right locator to wait on
•  Run your test 100 times before claiming success

Recommended for you

Use Jenkins For Continuous Load Testing And Mobile Test Automation
Use Jenkins For Continuous Load Testing And Mobile Test AutomationUse Jenkins For Continuous Load Testing And Mobile Test Automation
Use Jenkins For Continuous Load Testing And Mobile Test Automation

The document discusses using Jenkins for continuous load testing and mobile test automation. It describes how Jenkins can be used to automate testing across sprints in an agile methodology. Specifically, it outlines how to leverage Jenkins to run functional tests continuously and repurpose those tests for performance and load testing. This helps ensure applications are thoroughly tested before each release.

appvanjmeterjenkins
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test AutomationSTARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation

Frank Cohen's session from the STARWest (Software Test Automation) conference, October 2014. Building mobile apps and Ajax apps effectively requires a blended approach to test automation. 

Frank Cohen, CTO/Founder at Appvance, shows how to leverage the best application performance test methodology with test tools to deliver excellent Ajax, iOS and Android apps. 

Learn how to: 
* Effectively choose a mobile testing method for Agile shops 
* Reduce costs by choosing the best tools (Appium, Jenkins, Appvance PerformanceCloud) 
* Scale-up your mobile testing to thousands of test suites automatically 
* The mix-and-match mobile testing methodology for just-in-time performance testing

mobile
load testingajax
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...

The Container Store uses AppDynamics in their development lifecycle to: 1) Install AppDynamics in test environments and build automated functional and performance test suites to baseline metrics and alert on deviations. 2) Empower their development and QA teams by giving them insights into the test environment and custom reports on any metrics. 3) Establish best practices like monitoring all applications, testing continuously, and performance testing early to detect issues before production and expedite remediation.

#11 – LEVERAGE FUNCTIONAL TESTS FOR PERFORMANCE

YOU GET THE PICTURE
COVER ALL YOUR BASES
No backend connection
Native Apps
CPU
Battery
Memory
Transaction timing

Web
browser
users

CPU

Stress tests
Endurance tests
Load test

Battery
Memory
Transaction timing

Mobile
browser
users

Native app
users

Response time

Mobile Web Apps
Load
Balancer

Data traffic
HTTP(S)
UDP
WebSocket

Cache

Web
Server
Web
Server

Shared web &
mobile infrastructure

App
Server
App
Server
Database
#12 – BUILD THE RIGHT TEAM
LEAN AND EFFICIENT
•  Quality Software Engineers

•  Automation Framework ie. CI, Cloud, Pyton, Perl, Web, everything

•  Automation Architect

•  What tests to automate? Identify reusable components,
Metrics, ROI, everything

•  Automation Engineer

•  Build automated tests, everything
•  Expert in automation and knowledge of mobile apps dev

•  Test Engineer

•  Build tests, everything

Recommended for you

Continuous Integration, Deploy, Test From Beginning To End 2014
Continuous Integration, Deploy, Test From Beginning To End 2014Continuous Integration, Deploy, Test From Beginning To End 2014
Continuous Integration, Deploy, Test From Beginning To End 2014

Frank Cohen, CTO/Founder at Appvance, teaches developers and testers how to become more closely aligned with easily deployable and configurable tools such as Jenkins CI and performance testing platforms. 

Learn how to: 
* Merge Agile SDLC and Performance Testing 
* Speed-up test operations by configuring Jenkins for automatic build, deploy, and tests 
* Instantly identify functional and performance issues using Jenkins as a performance dashboard 
* Use effective choices in Jenkins deployment – in the cloud, hosted, or in your datacenter

devopstestingci
Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)

Developers have embraced Continuous Integration for years and it has proven their value for accelerating software production for Web environments. However, for mobile developers, it’s been a slow road to adopting many of these same practices. In this webinar, Kevin Rohling (Emberlight, Ship.io) and Kristian Meier (Sauce Labs) will cover best practices in implementing a mobile CI system and demonstrate how you can easily build, test and deploy mobile apps.

mobile webmobile testingcross browser testing
SHESHANK_DASARI
SHESHANK_DASARISHESHANK_DASARI
SHESHANK_DASARI

Shesank Dasari is a test engineer with over 4 years of experience in software testing. He has expertise in testing mobile and web applications using Selenium and Appium, as well as SAP testing using Worksoft Certify. Some of the projects he has worked on include testing SAP applications for Weill Cornell Medical College, mobile apps for MIRI Systems, and spend analytics reporting for Whirlpool. He is proficient in various testing tools and techniques including test automation, defect management, and performance testing.

o  First End-to-End Mobile App Test Platform
•  First Cloud-Based Load Testing Solution
•  First Global Test Cloud (17 Countries, 100 Cities)
•  First Mobile Test Automation “Platform”
•  First real time RUM for web and mobile

o  Over 350 Global Corporate Customers
•  10,000 Mobile Developers and Testers use TouchTest
•  Over 1,000 Mobile and Web Apps are Tested with TouchTest 

o  Award Winning & Patented Technology 
•  Named by Wall Street Journal Top 50 Hottest Companies three years running
•  Gartner Visionary Leader 

© 2012 SOASTA. All rights reserved.

May 22, 2012

33
ü 
ü 
ü 
ü 
ü 

Precision record and Playback
iOS, Android, Native/Hybrid/Mobile Web
100+ Built-in components
Jenkins integration
Free forever for 1 device

TouchTest Lite

Download it FREE today!
http://www.soasta.com/free
TOP BEST PRACTICES FOR

SUCCESSFUL MOBILE TEST AUTOMATION
QUESTIONS?

twitter.com/fredberinger
fberinger@soasta.com
http://www.fredberinger.com

More Related Content

What's hot

Appium meet up noida
Appium meet up noidaAppium meet up noida
Appium meet up noida
Amit Rawat
 
Mobile Test Automation - Appium
Mobile Test Automation - AppiumMobile Test Automation - Appium
Mobile Test Automation - Appium
Maria Machlowska
 
Automated UI Testing Frameworks
Automated UI Testing FrameworksAutomated UI Testing Frameworks
Automated UI Testing Frameworks
TestObject - Mobile Testing
 
Appium - test automation for mobile apps
Appium - test automation for mobile appsAppium - test automation for mobile apps
Appium - test automation for mobile apps
Aleksejs Trescalins
 
Automation Testing With Appium
Automation Testing With AppiumAutomation Testing With Appium
Automation Testing With Appium
Knoldus Inc.
 
Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?
Zado Technologies
 
Appium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriverAppium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriver
Andrii Dzynia
 
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team
Srijan Technologies
 
Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)
Sauce Labs
 
Selenium training
Selenium trainingSelenium training
Selenium training
Shivaraj R
 
Everything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and SeleniumEverything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and Selenium
Lizzy Guido (she/her)
 
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
Pratik Patel
 
Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka
Edureka!
 
Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)
danielputerman
 
Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps
Sauce Labs
 
Appium tutorial| Appium Training
Appium tutorial| Appium Training Appium tutorial| Appium Training
Appium tutorial| Appium Training
QA Masters
 
Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions		Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions
Sauce Labs
 
Appium solution
Appium solutionAppium solution
Appium solution
Nael Abd Eljawad
 
Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium
Luke Maung
 
Cross platform test automation using Appium
Cross platform test automation using AppiumCross platform test automation using Appium
Cross platform test automation using Appium
Jatin Bhasin
 

What's hot (20)

Appium meet up noida
Appium meet up noidaAppium meet up noida
Appium meet up noida
 
Mobile Test Automation - Appium
Mobile Test Automation - AppiumMobile Test Automation - Appium
Mobile Test Automation - Appium
 
Automated UI Testing Frameworks
Automated UI Testing FrameworksAutomated UI Testing Frameworks
Automated UI Testing Frameworks
 
Appium - test automation for mobile apps
Appium - test automation for mobile appsAppium - test automation for mobile apps
Appium - test automation for mobile apps
 
Automation Testing With Appium
Automation Testing With AppiumAutomation Testing With Appium
Automation Testing With Appium
 
Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?
 
Appium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriverAppium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriver
 
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team
 
Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)
 
Selenium training
Selenium trainingSelenium training
Selenium training
 
Everything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and SeleniumEverything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and Selenium
 
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
 
Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka
 
Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)
 
Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps
 
Appium tutorial| Appium Training
Appium tutorial| Appium Training Appium tutorial| Appium Training
Appium tutorial| Appium Training
 
Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions		Live Panel: Appium Core Committers Answer Your Questions
Live Panel: Appium Core Committers Answer Your Questions
 
Appium solution
Appium solutionAppium solution
Appium solution
 
Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium
 
Cross platform test automation using Appium
Cross platform test automation using AppiumCross platform test automation using Appium
Cross platform test automation using Appium
 

Similar to Top Best Practices for Successful Mobile Test Automation

Best Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App TestingBest Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App Testing
Bitbar
 
Use Jenkins For Continuous Load Testing And Mobile Test Automation
Use Jenkins For Continuous Load Testing And Mobile Test AutomationUse Jenkins For Continuous Load Testing And Mobile Test Automation
Use Jenkins For Continuous Load Testing And Mobile Test Automation
Clever Moe
 
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test AutomationSTARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
Clever Moe
 
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppDynamics
 
Continuous Integration, Deploy, Test From Beginning To End 2014
Continuous Integration, Deploy, Test From Beginning To End 2014Continuous Integration, Deploy, Test From Beginning To End 2014
Continuous Integration, Deploy, Test From Beginning To End 2014
Clever Moe
 
Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)
Sauce Labs
 
SHESHANK_DASARI
SHESHANK_DASARISHESHANK_DASARI
SHESHANK_DASARI
Sheshank Dasari
 
Zen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application TestingZen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application Testing
Zen Test Labs
 
Agile Mobile Testing Workshop
Agile Mobile Testing WorkshopAgile Mobile Testing Workshop
Agile Mobile Testing Workshop
Naresh Jain
 
Mobile Application Testing
Mobile Application TestingMobile Application Testing
Mobile Application Testing
Sun Technlogies
 
Mobile Application Testing
Mobile Application Testing Mobile Application Testing
Mobile Application Testing
Shivaraj R
 
Mobile apps that win
Mobile apps that winMobile apps that win
Mobile apps that win
DellFoglight
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
Rakesh Jha
 
Automated Testing Using Selenium
Automated Testing Using SeleniumAutomated Testing Using Selenium
Automated Testing Using Selenium
TechWell
 
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest
 
Mobile test automation perfecto star east
Mobile test automation perfecto star eastMobile test automation perfecto star east
Mobile test automation perfecto star east
Perfecto Mobile
 
Bugday bkk-2014 nitisak-auto_perf
Bugday bkk-2014 nitisak-auto_perfBugday bkk-2014 nitisak-auto_perf
Bugday bkk-2014 nitisak-auto_perf
Nitisak Mooltreesri
 
Launch High Performing Mobile Apps with Appurify
Launch High Performing Mobile Apps with AppurifyLaunch High Performing Mobile Apps with Appurify
Launch High Performing Mobile Apps with Appurify
Manish Lachwani
 
Performance testing
Performance testingPerformance testing
Performance testing
Ranpreet kaur
 
How to make your app successful with mobile app testing?
How to make your app successful with mobile app testing?How to make your app successful with mobile app testing?
How to make your app successful with mobile app testing?
MobilePundits
 

Similar to Top Best Practices for Successful Mobile Test Automation (20)

Best Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App TestingBest Practices for DevOps in Mobile App Testing
Best Practices for DevOps in Mobile App Testing
 
Use Jenkins For Continuous Load Testing And Mobile Test Automation
Use Jenkins For Continuous Load Testing And Mobile Test AutomationUse Jenkins For Continuous Load Testing And Mobile Test Automation
Use Jenkins For Continuous Load Testing And Mobile Test Automation
 
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test AutomationSTARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
STARWest: Use Jenkins For Continuous 
Load Testing And Mobile Test Automation
 
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
AppSphere 15 - How The Container Store Uses AppDynamics in their Development ...
 
Continuous Integration, Deploy, Test From Beginning To End 2014
Continuous Integration, Deploy, Test From Beginning To End 2014Continuous Integration, Deploy, Test From Beginning To End 2014
Continuous Integration, Deploy, Test From Beginning To End 2014
 
Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)
 
SHESHANK_DASARI
SHESHANK_DASARISHESHANK_DASARI
SHESHANK_DASARI
 
Zen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application TestingZen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application Testing
 
Agile Mobile Testing Workshop
Agile Mobile Testing WorkshopAgile Mobile Testing Workshop
Agile Mobile Testing Workshop
 
Mobile Application Testing
Mobile Application TestingMobile Application Testing
Mobile Application Testing
 
Mobile Application Testing
Mobile Application Testing Mobile Application Testing
Mobile Application Testing
 
Mobile apps that win
Mobile apps that winMobile apps that win
Mobile apps that win
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Automated Testing Using Selenium
Automated Testing Using SeleniumAutomated Testing Using Selenium
Automated Testing Using Selenium
 
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
 
Mobile test automation perfecto star east
Mobile test automation perfecto star eastMobile test automation perfecto star east
Mobile test automation perfecto star east
 
Bugday bkk-2014 nitisak-auto_perf
Bugday bkk-2014 nitisak-auto_perfBugday bkk-2014 nitisak-auto_perf
Bugday bkk-2014 nitisak-auto_perf
 
Launch High Performing Mobile Apps with Appurify
Launch High Performing Mobile Apps with AppurifyLaunch High Performing Mobile Apps with Appurify
Launch High Performing Mobile Apps with Appurify
 
Performance testing
Performance testingPerformance testing
Performance testing
 
How to make your app successful with mobile app testing?
How to make your app successful with mobile app testing?How to make your app successful with mobile app testing?
How to make your app successful with mobile app testing?
 

More from Fred Beringer

The PerfOps revolution - Shutterfly's journey to faster performance
The PerfOps revolution - Shutterfly's journey to faster performanceThe PerfOps revolution - Shutterfly's journey to faster performance
The PerfOps revolution - Shutterfly's journey to faster performance
Fred Beringer
 
My Web Performance Dirty Secrets
My Web Performance Dirty SecretsMy Web Performance Dirty Secrets
My Web Performance Dirty Secrets
Fred Beringer
 
SOASTA CloudTest Lite
SOASTA CloudTest LiteSOASTA CloudTest Lite
SOASTA CloudTest Lite
Fred Beringer
 
Soasta on demand brochure Francaise
Soasta on demand brochure FrancaiseSoasta on demand brochure Francaise
Soasta on demand brochure Francaise
Fred Beringer
 
Soasta on demand
Soasta on demandSoasta on demand
Soasta on demand
Fred Beringer
 
The Cloud: A game changer to test, at scale and in production, SOA based web...
The Cloud: A game changer to test, at scale and in production,  SOA based web...The Cloud: A game changer to test, at scale and in production,  SOA based web...
The Cloud: A game changer to test, at scale and in production, SOA based web...
Fred Beringer
 
The Cloud: A Game-Changer for Web Performance Testing
The Cloud: A Game-Changer for Web Performance TestingThe Cloud: A Game-Changer for Web Performance Testing
The Cloud: A Game-Changer for Web Performance Testing
Fred Beringer
 

More from Fred Beringer (7)

The PerfOps revolution - Shutterfly's journey to faster performance
The PerfOps revolution - Shutterfly's journey to faster performanceThe PerfOps revolution - Shutterfly's journey to faster performance
The PerfOps revolution - Shutterfly's journey to faster performance
 
My Web Performance Dirty Secrets
My Web Performance Dirty SecretsMy Web Performance Dirty Secrets
My Web Performance Dirty Secrets
 
SOASTA CloudTest Lite
SOASTA CloudTest LiteSOASTA CloudTest Lite
SOASTA CloudTest Lite
 
Soasta on demand brochure Francaise
Soasta on demand brochure FrancaiseSoasta on demand brochure Francaise
Soasta on demand brochure Francaise
 
Soasta on demand
Soasta on demandSoasta on demand
Soasta on demand
 
The Cloud: A game changer to test, at scale and in production, SOA based web...
The Cloud: A game changer to test, at scale and in production,  SOA based web...The Cloud: A game changer to test, at scale and in production,  SOA based web...
The Cloud: A game changer to test, at scale and in production, SOA based web...
 
The Cloud: A Game-Changer for Web Performance Testing
The Cloud: A Game-Changer for Web Performance TestingThe Cloud: A Game-Changer for Web Performance Testing
The Cloud: A Game-Changer for Web Performance Testing
 

Recently uploaded

Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
BookNet Canada
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
huseindihon
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
rajancomputerfbd
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
shanthidl1
 
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALLBLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
Liveplex
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
Stephanie Beckett
 
20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf
Sally Laouacheria
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
Stephanie Beckett
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
Mark Billinghurst
 
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdfPigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
UiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs ConferenceUiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs Conference
UiPathCommunity
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
Toru Tamaki
 
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Erasmo Purificato
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Bert Blevins
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
welrejdoall
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
Kief Morris
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 

Recently uploaded (20)

Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
 
Choose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presenceChoose our Linux Web Hosting for a seamless and successful online presence
Choose our Linux Web Hosting for a seamless and successful online presence
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
 
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALLBLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
 
20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf20240702 Présentation Plateforme GenAI.pdf
20240702 Présentation Plateforme GenAI.pdf
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
 
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdfPigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdf
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
UiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs ConferenceUiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs Conference
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
 
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 

Top Best Practices for Successful Mobile Test Automation

  • 1. TOP BEST PRACTICES FOR SUCCESSFUL MOBILE TEST AUTOMATION @fredberinger
  • 2. SOMETHING FOR YOU TO TAKE BACK HOME
  • 5. EXPECTATION •  •  •  •  It is as difficult as developing a good mobile app It is a software project by itself It is not optional in mobile You will probably fail before you succeed
  • 6. #1 - SET THE RIGHT GOALS
  • 7. AUTOMATION OBJECTIVES •  •  •  •  •  Continuous feedback to fix bugs faster Enable new activities Increase test coverage Raise confidence Better customer support
  • 8. #2 – TRACK YOUR OBJECTIVES IF IT IS NOT MEASURED, IT DOESN’T EXIST
  • 9. SET YOUR OWN METRICS •  •  •  •  Turnaround time for fixes Customer satisfaction on app store Lower number of bugs on production EMET (Equivalent Manual Execution Test)
  • 10. ACTIONABLE TEST INTELLIGENCE •  •  •  •  •  •  Part of the automation framework Available and highly visible to everyone Establish a baseline and track ROI Take costs into account (Value=Benefit-cost) Too many metrics can hurt Rinse and repeat until you get it right
  • 11. #4 BUT NOT ALL THE TESTS!
  • 12. MISTER JENKINS IN YOUR FRIEND •  •  •  •  •  •  •  •  Automate your build Automate your app deployment Automate your environment deployment Automate your tear down Automate your test execution Automate your reporting Automate your metrics tracking Automate your communication
  • 13. #5 – AUTOMATE ASAP BUT BUILD THE FOUNDATION FIRST
  • 14. Careful planning •  Plan your Automation infrastructure •  Cloud, on-premise, devices connectivity, app deployment, data aggregation, reporting, etc. •  Pick your automation tool wisely •  Start small and grow •  Don’t hesitate to pause tests building activity
  • 15. #6 – PICK THE RIGHT TESTS TO AUTOMATE AND I CLEARLY DON’T HAVE A GOOD PICTURE FOR THIS SLIDE
  • 16. ANALYZE THE RISK OF FAILURE R(c)=P(c) * I(c) Probability •  Code Complexity •  Changed Areas •  Affected Interfaces •  New Technology •  Component Maturity Impact •  Financial •  Reputation •  Legal •  Security •  Loss of Customers
  • 17. #7 – WHERE TO RUN TESTS HINT: 0% USERS RUN YOUR APP ON A SIMULATOR
  • 18. SIMULATOR VS REAL DEVICES •  Pros •  Cheap •  Integrated with IDE •  Cons •  Not testing on actual platform. What if the test pass? What’s next? •  Network is different •  OS is different (stock) •  Can’t simulate real hardware (CPU, Memory, etc.) Not fit for mobile performance •  Pros •  Reproduce real gestures •  Real results, no false negative •  Can test under OEM customization •  Fit for mobile performance •  Cons •  Need to be managed (device Cloud helps!)
  • 21. #8 – BUILD EFFICIENT TESTS SIZE MATTERS!!
  • 22. S.F.I.R.S.T.R •  •  •  •  •  •  •  Small – Easier to understand & Fix Fast – Parallel execution for faster feedback Independent – Can run any subsets in any order Repeatable – Tests get the same result every time Self-Checking – No human checking Timely – Should be written in parallel with dev Reusable – To avoid maintenance nightmares
  • 23. #8 – BUILD TESTABILITY ASK KINDLY …
  • 24. WHICH IS BETTER? //TiUIScrollView[@touchTestId='mfaSiteKeysignOn_securityPhraseWindow_ScrollView']/ TiUIScrollViewImpl/UIView/TiUIView[.//UILabel[@text='If you don't recognize your personalized security image, don't enter your password.']]/TiUITextField/TiTextField XPATH text=blah TEXT classname=TiTextField[1] INDEXED OBJECT id=mfaSiteKey-siteKey_Password_Input UNIQUE ID •  •  •  •�� Build more reliable tests with unique IDs Lower maintenance cost Test early A non-optional investment
  • 25. # 9 - DATA IS YOUR FRIEND
  • 26. BE DATA-DRIVEN •  •  •  •  Increase test coverage FAST Easy to add, remove and configure tests Reduce the number of tests to maintain Separation of Tests and Datas
  • 27. #10 – USE RELIABLE WAITS FORGET ABOUT TIME DELAYS!
  • 28. USE RELIABLE AND INTELLIGENT WAITS •  Use object visibility to manage the flow of the test •  Never use time delays to manage back-end variability •  Never use time delays to account for device performance •  Spend time finding the right locator to wait on •  Run your test 100 times before claiming success
  • 29. #11 – LEVERAGE FUNCTIONAL TESTS FOR PERFORMANCE YOU GET THE PICTURE
  • 30. COVER ALL YOUR BASES No backend connection Native Apps CPU Battery Memory Transaction timing Web browser users CPU Stress tests Endurance tests Load test Battery Memory Transaction timing Mobile browser users Native app users Response time Mobile Web Apps Load Balancer Data traffic HTTP(S) UDP WebSocket Cache Web Server Web Server Shared web & mobile infrastructure App Server App Server Database
  • 31. #12 – BUILD THE RIGHT TEAM
  • 32. LEAN AND EFFICIENT •  Quality Software Engineers •  Automation Framework ie. CI, Cloud, Pyton, Perl, Web, everything •  Automation Architect •  What tests to automate? Identify reusable components, Metrics, ROI, everything •  Automation Engineer •  Build automated tests, everything •  Expert in automation and knowledge of mobile apps dev •  Test Engineer •  Build tests, everything
  • 33. o  First End-to-End Mobile App Test Platform •  First Cloud-Based Load Testing Solution •  First Global Test Cloud (17 Countries, 100 Cities) •  First Mobile Test Automation “Platform” •  First real time RUM for web and mobile o  Over 350 Global Corporate Customers •  10,000 Mobile Developers and Testers use TouchTest •  Over 1,000 Mobile and Web Apps are Tested with TouchTest o  Award Winning & Patented Technology •  Named by Wall Street Journal Top 50 Hottest Companies three years running •  Gartner Visionary Leader © 2012 SOASTA. All rights reserved. May 22, 2012 33
  • 34. ü  ü  ü  ü  ü  Precision record and Playback iOS, Android, Native/Hybrid/Mobile Web 100+ Built-in components Jenkins integration Free forever for 1 device TouchTest Lite Download it FREE today! http://www.soasta.com/free
  • 35. TOP BEST PRACTICES FOR SUCCESSFUL MOBILE TEST AUTOMATION QUESTIONS? twitter.com/fredberinger fberinger@soasta.com http://www.fredberinger.com