SlideShare a Scribd company logo
Mobile Test Automation
Andreas Jakl
@andijakl
andreas.jakl@tieto.com
Mobile Developer After-Work #7 – Xamarin: April 9th, 2015
Andreas Jakl
Mobility Evangelist, Tieto
– @andijakl
– andreas.jakl@tieto.com
History
– Mopius: Startup-Founder (NFC & Mobile Apps)
– Nokia, Finland: Technology Wizard
– FH Hagenberg: Assistant Professor Mobile Computing
– Siemens / BenQ Mobile, Germany: Augmented Reality-Apps
Mobile Test Automation - Andreas Jakl2
TESTING – WHY?
Versions & More
Mobile Test Automation - Andreas Jakl3
Slow uptake of new
versions
Manufacturer-
modified UIs
Countless screen
sizes & densities
Mobile Test Automation - Andreas Jakl4
https://developer.android.com/about/dashboards/index.html
http://stats.unity3d.com/mobile/os-android.html

Recommended for you

Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka

Mobile application testing focuses on testing the functionality and features of mobile applications. It is performed by application vendors. Mobile testing focuses on testing the native features of mobile devices like calls, SMS, Bluetooth, etc. It is performed by handset makers. A simulator mimics the outward behavior of a target but not its internal state, while a simulation accurately models both the outward behavior and underlying internal state of a target. Types of mobile application testing include usability, compatibility, interface, services, low-level resource, performance, and operational testing. The general structure of a mobile testing framework includes application packages, instrumentation, test runners, and test packages. Common bugs in mobile applications include critical bugs, block bugs, major bugs, and minor

appium interview questions and answersappium interview questionsmobile testing interview questions
Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?

The document compares three mobile automation testing tools: Appium, Calabash, and Robotium. Appium provides a cross-platform solution that supports Android, iOS, and FirefoxOS. It uses the Selenium WebDriver JSON protocol and can run tests written in various languages. Calabash consists of Android and iOS libraries for interacting with mobile apps via gestures and assertions. It also supports testing HTML5 parts of hybrid apps. Robotium is an Android testing framework that simplifies writing functional tests using minimal app knowledge. It handles multiple app activities and integrates with build tools.

robotiummobile automationcalabash
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017

The document discusses open source testing tools for mobile applications. It begins by explaining that mobile testing requires automating both the application and the full user environment. It then reviews five popular open source test frameworks - Selenium, Appium, Calabash, Espresso, and XCTest UI - comparing their suitability for different uses like web, native, and hybrid apps. Key criteria that organizations should consider when choosing a framework include supporting multiple frameworks, flexibility, autonomy, full end-to-end coverage, and unattended reliable testing. The document concludes with a demonstration of a test automation tool called Quantum that integrates various open source frameworks.

blazemeterappiumselenium
Fast adoption of new OS
– Design updates
– API & architecture changes
(e.g., 64 bit enforcement)
Quick update of apps required
Same OS version, but many iOS
devices in use
Mobile Test Automation - Andreas Jakl5
https://developer.apple.com/support/appstore/
http://stats.unity3d.com/mobile/device-ios.html
Similar hardware & software base
– 512 MB vs 1+ GB memory
– Processor speed
– 4 supported screen resolutions
Relevant: v8(.1) > 90%
– But: Windows 10 upcoming
• More resolutions, etc.
Mobile Test Automation - Andreas Jakl6
http://blogs.windows.com/buildingapps/2014/12/22/windows-and-windows-phone-store-trends-december-2014-update/
http://blog.adduplex.com/2015/03/adduplex-windows-phone-statistics.html
IMPACT OF TESTING
Successful?
Mobile Test Automation - Andreas Jakl7
Reviews vs Downloads
Review count & rating correlate to downloads
Mobile Test Automation - Andreas Jakl8
Bin Lu, et al.: Why People Hate Your App – Making Sense of User Feedback in a Mobile App Store.
Carnegie Mellon University, 2013
Data from 13 million user reviews, 171,439 apps
Average rating: 3.9
(standard deviation: 1.48)
0
2 000 000
4 000 000
6 000 000
8 000 000

Recommended for you

Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar

Watch a live presentation at http://offer.bitbar.com/parallel-test-runs-with-appium-on-real-mobile-devices Appium is an open source test automation framework and currently one of the hottest framework for mobile app, game and web testing. In this webinar, we’ll discuss about the best practices, how to use Appium for different types of apps, games and web apps, and how to use all new features around it – the parallel test runs, image recognition and more! Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

testdroidtest automationmobile testing strategy
Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)

Appium is an open source test automation framework for testing native and hybrid mobile apps. It allows writing tests in any language and on any platform to test the same app submitted to app stores. Appium uses the WebDriver protocol to remotely control apps using UIAutomator on Android and Instruments on iOS. This allows testing apps on real devices and emulators with a single test script. Appium supports platforms include Android, iOS, and mobile web apps and can test apps on a local device or cloud-based services like SauceLabs.

appiummobiletesting
Appium - test automation for mobile apps
Appium - test automation for mobile appsAppium - test automation for mobile apps
Appium - test automation for mobile apps

This document provides an overview of Appium, an open-source test automation tool for mobile applications. It allows testing of native, hybrid, and mobile web apps across iOS and Android platforms. Appium uses the Selenium WebDriver API and supports many programming languages. It can test on both simulators/emulators and real devices. While it has some limitations like no image comparison, its benefits include easy setup, cross-platform capability, and integration with continuous integration and device farms.

mobileiosappium
Review Analysis
Analysis
– Most frequent complaints
• Functional errors
• Feature requests
• App crashes
Mobile Test Automation - Andreas Jakl9
Claudia Iacob, Rachel Harrison: “Retrieving and Analysing Mobile Apps Feature Requests from Online Reviews”, Oxford Brookes University, 2013
Kahlid. H, et al.: “What Do Mobile App Users Complain About? A Study on Free iOS Apps”, Queen’s University, Kingston, 2014
Gunwoong Leea, T. S. Raghua: “Determinants of Mobile Apps' Success: Evidence from the App Store Market”, 2014
Review Analysis
Analysis
– Most negative impact
• Privacy and ethical issues
• Hidden app costs
Mobile Test Automation - Andreas Jakl10
Claudia Iacob, Rachel Harrison: “Retrieving and Analysing Mobile Apps Feature Requests from Online Reviews”, Oxford Brookes University, 2013
Kahlid. H, et al.: “What Do Mobile App Users Complain About? A Study on Free iOS Apps”, Queen’s University, Kingston, 2014
Gunwoong Leea, T. S. Raghua: “Determinants of Mobile Apps' Success: Evidence from the App Store Market”, 2014
Customer Retention
Quality (feature)
upgrades
– Up to 3x
improvement in
survival rates
Mobile Test Automation - Andreas Jakl11
0%
5%
10%
15%
20%
25%
30%
35%
40%
45%
1 Month after Download 6 Months after Download 1 Year after Download
Customer Retention in Mobile Apps
TESTING STRATEGIES
Manual
Mobile Test Automation - Andreas Jakl12

Recommended for you

Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!

Selenium is an industry standard for web testing. Most of test automation engineers are well versed with this tool, and even use its broad capabilities to execute some mobile tests. Inspired by Selenium and built based on testing approach Appium was created. It is an open-source tool for automating native, mobile web, and hybrid applications on iOS and Android platforms. In this how-to webinar, we will show you how you can utilize your Selenium skills to scale your mobile testing with Appium. Join Giovanni Rago, Customer Success Manager at Sauce Labs, in this event that will give you new insights into the way you approach mobile testing. Here are the main takeaways: -- Difference between Selenium and Appium -- Which Selenium skills can be used when testing in Appium -- What’s the best testing strategy for mobile -- How much more there is to learn about Appium

appiumseleniumsauce labs
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team

Speaker: Karim Fanadka, HPE Software Session Slides: http://www.srijan.net/webinar/building-high-performance-qa-team/ Karim is a DevTest manager at HPE Software and his team is responsible for testing their new SaaS product, the StormRunner Load. In this webinar, Karim shares his experience of building a QA team that is agile, efficient, and uses the latest testing frameworks. He will also talk about continuous testing, automation, test based analytics and hotfixes. Karim start's off the challenges in agile QA and then moves on to solving these challenges. The best part is when he shares the trick to delivering to production every 1.5 months, even for a high pressure enterprise product. The Q/A session also brings out some very interesting topics, going into greater details and various suggestions that you can implement for your own QA teams.

test analyticsqateamhotfixes
Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014

This document summarizes a mobile app dev-test meetup kickoff event. The meetup aimed to discuss increasing development velocity challenges, real devices vs emulators, real-life examples, and challenges for development and testing. The agenda also included an open discussion and planning for the next quarterly meetup. Key trends like mobile payments, wearables, and expectations for iOS 8 adoption were briefly highlighted. Challenges around balancing velocity and quality with growing app complexity and evolving test matrices were also noted.

mobile test automationmobile appsmobile testing
Capturing Crash Data
Mobile Test Automation - Andreas Jakl13
Monitoring User Reviews
Mobile Test Automation - Andreas Jakl14
Bin Lu, et al.: Why People Hate Your App – Making Sense of User Feedback in a Mobile App Store.
Carnegie Mellon University, 2013
Static Code Analysis
Mobile Test Automation - Andreas Jakl15
Emulator / Simulator
Mobile Test Automation - Andreas Jakl16
Emulator
Emulates real
hardware
+ more accurate
– slow
Android
Simulator
Simulates device
behavior
+ faster
– less accurate
iOS / Windows

Recommended for you

Continuous testing on emulators using the espresso test automation framework
Continuous testing on emulators using the espresso test automation frameworkContinuous testing on emulators using the espresso test automation framework
Continuous testing on emulators using the espresso test automation framework

Continuous testing for mobile requires that dev teams have an environment that can easily scale. Although real device testing is a must, using emulators early in the development cycle gives teams a cost-effective and quick alternative for test automation in the cloud. This webinar will explore how to implement the Espresso, a widely used framework for testing mobile apps for the Android OS, on emulators. Espresso provides APIs for writing UI tests to simulate user interactions within a single target app.

android app testingespressomobile testing with emulators
Everything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and SeleniumEverything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and Selenium

This document provides an overview and demo of Perfecto Mobile's Continuous Quality Lab (CQ Lab) automation testing capabilities using Selenium and Appium. It discusses the CQ Lab architecture, how to set up automation tests using the desired capabilities, different mobile application types, and object identification. It then demonstrates creating a sample automation project and script in Eclipse, running the test, and reviewing the execution report in the Perfecto Mobile cloud platform.

Achieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobileAchieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobile

This document provides an agenda and introduction for a webinar on achieving 100% test coverage for mobile applications. The webinar will discuss mobile testing challenges, optimizing the mobile app lifecycle through planning, definition, execution and automation. It will also cover how Perfecto Mobile's cloud platform can help solve these challenges. Panelists from InfoStretch and Perfecto Mobile will introduce their companies and solutions. They will then take questions from webinar participants.

mobile test automationorasiperfecto mobile
Reliable?
Mobile Test Automation - Andreas Jakl17
0%of your users will run your app on an emulator
Own Devices
Mobile Test Automation - Andreas Jakl18
How many test devices do you have?
Open Device Lab Vienna
Mobile Test Automation - Andreas Jakl19
Free testing on real devices
http://www.open-device-lab-vienna.at/
Automated UI Tests
Mobile Test Automation - Andreas Jakl20
How many tests can you run per hour / build / release?
Number of builds
Cost
Automated tests
Manual tests

Recommended for you

10 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.510 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.5

Dan Cuellar - the creator of the Appium: the leading open-source test automation framework for mobile testing - shared 10 secrets about Appium that you may have never heard before. Dan also talked about what’s new in Appium 1.5 and what’s on the Appium road map for the rest of 2016.

mobile testingappium testingmobile application development
Appium training online|Mobile automation testing with appium
Appium training online|Mobile automation testing with appiumAppium training online|Mobile automation testing with appium
Appium training online|Mobile automation testing with appium

This appium tutorial covers Basics of appium,installation steps,Appium working architecture,Strengths of appium over other tools,limitations. For more details visit http://qa-masters.com/trainings/mobile-testing-trainings/appium

mobile automation testing with appiumappium training onlineappium tutorial
Appium solution artizone
Appium solution   artizoneAppium solution   artizone
Appium solution artizone

Appium is an open source test automation framework for use with native, hybrid and mobile web apps. It drives iOS and Android apps using the WebDriver protocol. Appium uses a client-server architecture with the Appium server executing commands on a mobile device. Tests are written using various client libraries that communicate with the Appium server via the JSON wire protocol over HTTP.

TEST CLOUD
Automated Testing on 1000s of Devices
Mobile Test Automation - Andreas Jakl21
Xamarin Test Cloud
Automated tests
– UI interaction
– Device features (GPS, etc)
– Performance
1,300+ devices
– Android & iOS
– testcloud.xamarin.com/devices
Mobile Test Automation - Andreas Jakl22
Workflow
Mobile Test Automation - Andreas Jakl23
+ Continuous Integration
Mobile Test Automation - Andreas Jakl24

Recommended for you

Appium testing api
Appium testing apiAppium testing api
Appium testing api

Appium Philosophy and Design Appium Philosophy Appium Design Appium Client-Server Architecture Appium Session Appium Desired Capabilities Appium Server - Appium Client - Appium Desktop Advantages of the CSA Setup Android Project

appium testing apiappiumapi testing
Appium overview session final
Appium overview session finalAppium overview session final
Appium overview session final

This document provides an overview of mobile automation testing using Appium. It discusses Appium's capabilities for testing native and hybrid mobile apps across Android, iOS, and Windows platforms. It covers topics like installing Appium and the Android emulator, writing tests for mobile web and app automation, different locator strategies for Android and iOS, and best practices for creating an Appium test framework with tools like Maven and TestNG. Live demonstrations of testing mobile apps like Twitter and Facebook using Appium are also proposed.

androidautomation testingmaven
Mobile Testing Service Desk_Own.ppt
Mobile Testing Service Desk_Own.pptMobile Testing Service Desk_Own.ppt
Mobile Testing Service Desk_Own.ppt

Mobile users have high expectations for apps, with nearly 80% deleting apps after first use due to bad design, slow loading, or crashes. Testing mobile apps is challenging due to a variety of devices, platforms, and user expectations. An effective mobile testing strategy uses a combination of emulators, physical devices, cloud/mobile testing tools, and both automated and manual testing methods across the application lifecycle to ensure quality, performance, and reliability.

Calabash Xamarin.UiTest
Test Frameworks
Mobile Test Automation - Andreas Jakl25
Write tests in Ruby C#
Run with Gherkin NUnit
Executing Tests
Mobile Test Automation - Andreas Jakl26
Process
1. Write Tests
2. Setup Project for Testing
3. Test Locally
4. Create app on Xamarin Test Cloud
5. Upload & Run on Cloud via Command Line
Mobile Test Automation - Andreas Jakl27
Writing Tests: NUnit
Mobile Test Automation - Andreas Jakl28
Generic tests possible
with Xamarin.Forms

Recommended for you

6.android introduccion
6.android   introduccion   6.android   introduccion
6.android introduccion

Este documento proporciona información sobre Android, una plataforma de software para dispositivos móviles que incluye sistema operativo, framework y aplicaciones. Se desarrolló como una plataforma de código abierto y permite distribuir aplicaciones libremente. Está basado en Linux y usa Java para la interfaz de usuario.

androidmobile programing
Xamarin ui test
Xamarin ui testXamarin ui test
Xamarin ui test

El documento proporciona información sobre los servicios de desarrollo de aplicaciones móviles nativas con Xamarin de HJR, incluyendo su experiencia en Xamarin, marcos de prueba como Xamarin UI Test, y una demostración de las capacidades de Xamarin.

xamarin testcloudxamarinui test
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices

This document discusses mobile application testing. It begins with an introduction to the author's experience in mobile development and quality assurance. It then covers trends in mobile technology and applications. The main sections discuss approaches to testing mobile applications, including requirement analysis, challenges for different mobile platforms, and focus areas for testing like performance, security and compatibility. Automated and manual testing strategies are also outlined.

testingmobileandroid
Test Setup
Mobile Test Automation - Andreas Jakl29
Platform-specific
initialization & test
differences
Setup Project
Mobile Test Automation - Andreas Jakl30
Disable shared
Mono runtime
API Key
Mobile Test Automation - Andreas Jakl31
Create team & app to
get unique API key
Run Tests
Locally
Mobile Test Automation - Andreas Jakl32
Test on your
devices first

Recommended for you

Cloud Mobile Testing
Cloud Mobile TestingCloud Mobile Testing
Cloud Mobile Testing

El documento resume una presentación sobre pruebas avanzadas en granjas de dispositivos. Explica que los Centros Expertos de Testing & QA y Movilidad de atSistemas colaboran para ofrecer servicios de testing automatizado multiplataforma en la nube. Se detalla cómo la solución utiliza Selenium, Appium, AWS Device Farm y Jenkins para ejecutar pruebas funcionales en la aplicación iMemento de forma automatizada y obtener resultados.

cloud computingatsistemassoftware development
Gestión de Pruebas con Atlassian, una parte más de su ALM
Gestión de Pruebas con Atlassian, una parte más de su ALM Gestión de Pruebas con Atlassian, una parte más de su ALM
Gestión de Pruebas con Atlassian, una parte más de su ALM

¿Te gustaría tener toda la documentación de tu proceso de pruebas en una sola solución? ¿Inviertes mucho tiempo gestionando la trazabilidad de los resultados? ¿Tienes elementos suficientes para medir el avance de las pruebas? Te presentamos Zephyr y Zapi, los add-ons para JIRA.

atsistemaszapisoftware
Appium
AppiumAppium
Appium

How to start with Appium on Android Devices. Basics of Appium. How to setup appium on Windows? Advantages of Appium

mobile app testingsoftware testingapps
Mobile Test Automation - Andreas Jakl33
Cloud Setup
Choose devices
Mobile Test Automation - Andreas Jakl34
Cloud Setup
System settings
Mobile Test Automation - Andreas Jakl35
Running Tests
in the cloud
Command line
only
Mobile Test Automation - Andreas Jakl36
Test results
Dashboard

Recommended for you

Xamarin Test Cloud Presentation
Xamarin Test Cloud PresentationXamarin Test Cloud Presentation
Xamarin Test Cloud Presentation

This is a presentation that overviews Xamarin Test Cloud's ability to test hundreds of cross-platform mobiles devices.

xamarin.formsxamarintest cloud
Barber Osgerby Project Stories for the Design Museum
Barber Osgerby Project Stories for the Design Museum Barber Osgerby Project Stories for the Design Museum
Barber Osgerby Project Stories for the Design Museum

Edward Barber and Jay Osgerby established BarberOsgerby in 1996 after studying architecture together. Since then, they have designed furniture, lighting, and other products for many international companies. They are known for their innovative and award-winning designs. Some of their most notable projects include designing tables with colorful segmented aluminum tops for Established & Sons gallery and architectural designs for several H&M stores around the world.

Capilla 12 09-08
Capilla 12 09-08Capilla 12 09-08
Capilla 12 09-08

El documento invita repetidamente a las personas a venir ante Dios y adorarle. Resalta que al escoger el amor de Dios, se doblarán las rodillas y se tendrá un tesoro eterno. Celebra a Jesús como la única razón de adoración y esperanza, y agradece que vino a salvar y ayudar. Finalmente, alaba el nombre de Dios por dejar su trono para mostrar la luz, pagar la deuda humana muriendo en la cruz y levantarse de entre los muertos.

Mobile Test Automation - Andreas Jakl37
Test results
Screenshots
Custom Screenshots
Take & describe screenshots
Enable local screenshots
Mobile Test Automation - Andreas Jakl38
[TestCase (TestName = "Click button and show success message")]
public void TestCaseSuccess ()
{
AppResult[] result = _app.Query(InitialMessage);
Assert.IsTrue(result.Any(), "The initial message string isn't correct");
_app.Screenshot ("Initial screen");
_app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY").
EnableLocalScreenshots().StartApp();
Custom Screenshots
Take & describe screenshots
Enable local screenshots
Mobile Test Automation - Andreas Jakl39
[TestCase (TestName = "Click button and show success message")]
public void TestCaseSuccess ()
{
AppResult[] result = _app.Query(InitialMessage);
Assert.IsTrue(result.Any(), "The initial message string isn't correct");
_app.Screenshot ("Initial screen");
_app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY").
EnableLocalScreenshots().StartApp();
Testing Finished App Packages
Find IDs of UI elements
Mobile Test Automation - Andreas Jakl40
if (TestEnvironment.Platform.Equals(TestPlatform.Local))
{
_app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY").
EnableLocalScreenshots().StartApp();
_app.Repl ();
// In Bash, enter app.Query(c=>c.Button()) or c.All()
}

Recommended for you

Cientifico 1
Cientifico 1Cientifico 1
Cientifico 1

Este documento describe los conceptos fundamentales de la visión binocular, incluyendo la fusión de imágenes retinianas, el horóptero empírico, el área de Panum y la diplopía fisiológica. También explica posibles alteraciones de la visión binocular como el síndrome de monofijación, la correspondencia retiniana anómala y las adaptaciones sensoriales que ocurren cuando se rompe la binocularidad durante el desarrollo visual. Finalmente, analiza las pruebas diagnósticas necesarias para comprender la etiolog

Hướng dẫn sử dụng tin học văn phòng rất chi tiết
Hướng dẫn sử dụng tin học văn phòng rất chi tiếtHướng dẫn sử dụng tin học văn phòng rất chi tiết
Hướng dẫn sử dụng tin học văn phòng rất chi tiết

Tài liệu hướng dẫn sử dụng tin học văn phòng, cách sử dung tin học văn phòng cơ bản, trung tâm dạy tin học văn phòng

huong dan su dung tin hoc van phonghoc tin hoc van phongsach tin hoc van phong
Rakesh mishra star samachar rewa3
Rakesh mishra star samachar rewa3Rakesh mishra star samachar rewa3
Rakesh mishra star samachar rewa3

nrega me hera pheri

Testing Finished App Packages
Find IDs of UI elements
Mobile Test Automation - Andreas Jakl41
if (TestEnvironment.Platform.Equals(TestPlatform.Local))
{
_app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY").
EnableLocalScreenshots().StartApp();
_app.Repl ();
// In Bash, enter app.Query(c=>c.All())
}
Alternatives
Testdroid
– testdroid.com/
Perfecto Mobile
– perfectomobile.com/solution/test-automation
Mobile Test Automation - Andreas Jakl42
Thank You!
Andreas Jakl
@andijakl
andreas.jakl@tieto.com
Mobile Test Automation - Andreas Jakl43

More Related Content

What's hot

Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps
Sauce Labs
 
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Perfecto Mobile
 
Mobile Test Automation - Appium
Mobile Test Automation - AppiumMobile Test Automation - Appium
Mobile Test Automation - Appium
Maria Machlowska
 
Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka
Edureka!
 
Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?
Zado Technologies
 
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017
Perfecto Mobile
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Bitbar
 
Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)
danielputerman
 
Appium - test automation for mobile apps
Appium - test automation for mobile appsAppium - test automation for mobile apps
Appium - test automation for mobile apps
Aleksejs Trescalins
 
Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!
Sauce Labs
 
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team
Srijan Technologies
 
Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014
Perfecto Mobile
 
Continuous testing on emulators using the espresso test automation framework
Continuous testing on emulators using the espresso test automation frameworkContinuous testing on emulators using the espresso test automation framework
Continuous testing on emulators using the espresso test automation framework
Sauce Labs
 
Everything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and SeleniumEverything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and Selenium
Lizzy Guido (she/her)
 
Achieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobileAchieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobile
Perfecto Mobile
 
10 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.510 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.5
Sauce Labs
 
Appium training online|Mobile automation testing with appium
Appium training online|Mobile automation testing with appiumAppium training online|Mobile automation testing with appium
Appium training online|Mobile automation testing with appium
QA Masters
 
Appium solution artizone
Appium solution   artizoneAppium solution   artizone
Appium solution artizone
Nael Abd Eljawad
 
Appium testing api
Appium testing apiAppium testing api
Appium testing api
b4usolution .
 
Appium overview session final
Appium overview session finalAppium overview session final
Appium overview session final
Abhishek Yadav
 

What's hot (20)

Appium: Automation for Mobile Apps
Appium: Automation for Mobile AppsAppium: Automation for Mobile Apps
Appium: Automation for Mobile Apps
 
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
 
Mobile Test Automation - Appium
Mobile Test Automation - AppiumMobile Test Automation - Appium
Mobile Test Automation - Appium
 
Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka
 
Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?Mobile automation – should I use robotium or calabash or appium?
Mobile automation – should I use robotium or calabash or appium?
 
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
 
Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)Appium overview (Selenium Israel #2, Feb. 2014)
Appium overview (Selenium Israel #2, Feb. 2014)
 
Appium - test automation for mobile apps
Appium - test automation for mobile appsAppium - test automation for mobile apps
Appium - test automation for mobile apps
 
Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!Using Selenium To Test Mobile? Meet Appium!
Using Selenium To Test Mobile? Meet Appium!
 
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team
 
Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014Meetup kickoff slides - Perfecto Mobile, September 2014
Meetup kickoff slides - Perfecto Mobile, September 2014
 
Continuous testing on emulators using the espresso test automation framework
Continuous testing on emulators using the espresso test automation frameworkContinuous testing on emulators using the espresso test automation framework
Continuous testing on emulators using the espresso test automation framework
 
Everything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and SeleniumEverything You Need To Know about Appium and Selenium
Everything You Need To Know about Appium and Selenium
 
Achieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobileAchieving 100% mobile test coverage perfecto mobile
Achieving 100% mobile test coverage perfecto mobile
 
10 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.510 things you didnt know about appium + whats new in appium 1.5
10 things you didnt know about appium + whats new in appium 1.5
 
Appium training online|Mobile automation testing with appium
Appium training online|Mobile automation testing with appiumAppium training online|Mobile automation testing with appium
Appium training online|Mobile automation testing with appium
 
Appium solution artizone
Appium solution   artizoneAppium solution   artizone
Appium solution artizone
 
Appium testing api
Appium testing apiAppium testing api
Appium testing api
 
Appium overview session final
Appium overview session finalAppium overview session final
Appium overview session final
 

Viewers also liked

Mobile Testing Service Desk_Own.ppt
Mobile Testing Service Desk_Own.pptMobile Testing Service Desk_Own.ppt
Mobile Testing Service Desk_Own.ppt
QA Programmer
 
6.android introduccion
6.android   introduccion   6.android   introduccion
6.android introduccion
guidotic
 
Xamarin ui test
Xamarin ui testXamarin ui test
Xamarin ui test
Humberto Jaimes
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
Rakesh Jha
 
Cloud Mobile Testing
Cloud Mobile TestingCloud Mobile Testing
Cloud Mobile Testing
atSistemas
 
Gestión de Pruebas con Atlassian, una parte más de su ALM
Gestión de Pruebas con Atlassian, una parte más de su ALM Gestión de Pruebas con Atlassian, una parte más de su ALM
Gestión de Pruebas con Atlassian, una parte más de su ALM
atSistemas
 
Appium
AppiumAppium
Xamarin Test Cloud Presentation
Xamarin Test Cloud PresentationXamarin Test Cloud Presentation
Xamarin Test Cloud Presentation
Catapult New Business
 
Barber Osgerby Project Stories for the Design Museum
Barber Osgerby Project Stories for the Design Museum Barber Osgerby Project Stories for the Design Museum
Barber Osgerby Project Stories for the Design Museum
DesignMuseum1
 
Capilla 12 09-08
Capilla 12 09-08Capilla 12 09-08
Capilla 12 09-08
Colegio Cristiano Logos
 
Cientifico 1
Cientifico 1Cientifico 1
Hướng dẫn sử dụng tin học văn phòng rất chi tiết
Hướng dẫn sử dụng tin học văn phòng rất chi tiếtHướng dẫn sử dụng tin học văn phòng rất chi tiết
Hướng dẫn sử dụng tin học văn phòng rất chi tiết
Ke Toan Ha Noi
 
Rakesh mishra star samachar rewa3
Rakesh mishra star samachar rewa3Rakesh mishra star samachar rewa3
Rakesh mishra star samachar rewa3
yograj tiwari India
 
We love Dance Blog ppt
We love Dance Blog pptWe love Dance Blog ppt
We love Dance Blog ppt
Maria_Sayrach
 
Desperately seeking purpose sample
Desperately seeking purpose sampleDesperately seeking purpose sample
Desperately seeking purpose sample
Maxine Jones
 
The CMO Imperative - Data Driven Results
The CMO Imperative -  Data Driven ResultsThe CMO Imperative -  Data Driven Results
The CMO Imperative - Data Driven Results
Scribe Software Corp.
 
Folleto Corporativo ILG Logistics S.A.
Folleto Corporativo ILG Logistics S.A.Folleto Corporativo ILG Logistics S.A.
Folleto Corporativo ILG Logistics S.A.
Ricardo Arias
 
#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...
#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...
#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...
Technical Centre for Agricultural and Rural Cooperation ACP-EU (CTA)
 
Trabajo antropologã a
Trabajo antropologã aTrabajo antropologã a
Trabajo antropologã a
AngieSandoval12
 
The cardiac cycle
The cardiac cycleThe cardiac cycle
The cardiac cycle
Dnyanesh Patil
 

Viewers also liked (20)

Mobile Testing Service Desk_Own.ppt
Mobile Testing Service Desk_Own.pptMobile Testing Service Desk_Own.ppt
Mobile Testing Service Desk_Own.ppt
 
6.android introduccion
6.android   introduccion   6.android   introduccion
6.android introduccion
 
Xamarin ui test
Xamarin ui testXamarin ui test
Xamarin ui test
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Cloud Mobile Testing
Cloud Mobile TestingCloud Mobile Testing
Cloud Mobile Testing
 
Gestión de Pruebas con Atlassian, una parte más de su ALM
Gestión de Pruebas con Atlassian, una parte más de su ALM Gestión de Pruebas con Atlassian, una parte más de su ALM
Gestión de Pruebas con Atlassian, una parte más de su ALM
 
Appium
AppiumAppium
Appium
 
Xamarin Test Cloud Presentation
Xamarin Test Cloud PresentationXamarin Test Cloud Presentation
Xamarin Test Cloud Presentation
 
Barber Osgerby Project Stories for the Design Museum
Barber Osgerby Project Stories for the Design Museum Barber Osgerby Project Stories for the Design Museum
Barber Osgerby Project Stories for the Design Museum
 
Capilla 12 09-08
Capilla 12 09-08Capilla 12 09-08
Capilla 12 09-08
 
Cientifico 1
Cientifico 1Cientifico 1
Cientifico 1
 
Hướng dẫn sử dụng tin học văn phòng rất chi tiết
Hướng dẫn sử dụng tin học văn phòng rất chi tiếtHướng dẫn sử dụng tin học văn phòng rất chi tiết
Hướng dẫn sử dụng tin học văn phòng rất chi tiết
 
Rakesh mishra star samachar rewa3
Rakesh mishra star samachar rewa3Rakesh mishra star samachar rewa3
Rakesh mishra star samachar rewa3
 
We love Dance Blog ppt
We love Dance Blog pptWe love Dance Blog ppt
We love Dance Blog ppt
 
Desperately seeking purpose sample
Desperately seeking purpose sampleDesperately seeking purpose sample
Desperately seeking purpose sample
 
The CMO Imperative - Data Driven Results
The CMO Imperative -  Data Driven ResultsThe CMO Imperative -  Data Driven Results
The CMO Imperative - Data Driven Results
 
Folleto Corporativo ILG Logistics S.A.
Folleto Corporativo ILG Logistics S.A.Folleto Corporativo ILG Logistics S.A.
Folleto Corporativo ILG Logistics S.A.
 
#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...
#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...
#CPAF15 WS7: Addressing climate change issues in fisheries and aquaculture in...
 
Trabajo antropologã a
Trabajo antropologã aTrabajo antropologã a
Trabajo antropologã a
 
The cardiac cycle
The cardiac cycleThe cardiac cycle
The cardiac cycle
 

Similar to Mobile Test Automation

Velocity Conference: Increasing Speed To Market In Mobile Development Through...
Velocity Conference: Increasing Speed To Market In Mobile Development Through...Velocity Conference: Increasing Speed To Market In Mobile Development Through...
Velocity Conference: Increasing Speed To Market In Mobile Development Through...
Intuit Inc.
 
What Are Virtual Devices And How To Use Them For Testing.pdf
What Are Virtual Devices And How To Use Them For Testing.pdfWhat Are Virtual Devices And How To Use Them For Testing.pdf
What Are Virtual Devices And How To Use Them For Testing.pdf
pCloudy
 
Velocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuitVelocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuit
Tina Su
 
Velocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuitVelocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuit
Tina Su
 
Speed to Market in Mobile Development
Speed to Market in Mobile DevelopmentSpeed to Market in Mobile Development
Speed to Market in Mobile Development
Tina Su
 
The Essentials of Mobile App Testing and Monitoring
The Essentials of Mobile App Testing and MonitoringThe Essentials of Mobile App Testing and Monitoring
The Essentials of Mobile App Testing and Monitoring
MobilePundits
 
Mobile Testing in the Cloud
Mobile Testing in the CloudMobile Testing in the Cloud
Mobile Testing in the Cloud
Keynote Mobile Testing
 
Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?
Dan Waters
 
HienVo_Mobile Testing_v.1.2
HienVo_Mobile Testing_v.1.2HienVo_Mobile Testing_v.1.2
HienVo_Mobile Testing_v.1.2
Hien Vo
 
Mobile application testing
Mobile application testingMobile application testing
Mobile application testing
Tharindra Jayamaha
 
Appium overview
Appium overviewAppium overview
Appium overview
Abhishek Yadav
 
Mobile Application Testing af Frederik Carlier, Jamo Solutions
Mobile Application Testing af Frederik Carlier, Jamo SolutionsMobile Application Testing af Frederik Carlier, Jamo Solutions
Mobile Application Testing af Frederik Carlier, Jamo Solutions
InfinIT - Innovationsnetværket for it
 
Mobile testing
Mobile testingMobile testing
Mobile testing
Hrushikesh Wakhle
 
Understanding public Cloud Cloud Real Devices vs. physical devices, VMs and ...
Understanding public Cloud  Cloud Real Devices vs. physical devices, VMs and ...Understanding public Cloud  Cloud Real Devices vs. physical devices, VMs and ...
Understanding public Cloud Cloud Real Devices vs. physical devices, VMs and ...
pCloudy
 
Mobile App Security Testing -2
Mobile App Security Testing -2Mobile App Security Testing -2
Mobile App Security Testing -2
Krisshhna Daasaarii
 
DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...
DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...
DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...
Journal For Research
 
A Complete Guide to Mobile App Testing Types.pdf
A Complete Guide to Mobile App Testing Types.pdfA Complete Guide to Mobile App Testing Types.pdf
A Complete Guide to Mobile App Testing Types.pdf
pCloudy
 
Android Apps Testing in 2019
Android Apps Testing in 2019Android Apps Testing in 2019
Android Apps Testing in 2019
Ivan Katunou
 
Mobile App Testing: Methods and Benefits
Mobile App Testing: Methods and BenefitsMobile App Testing: Methods and Benefits
Mobile App Testing: Methods and Benefits
ForceBolt
 
Mobile applications and automation testing
Mobile applications and automation testingMobile applications and automation testing
Mobile applications and automation testing
Dipesh Bhatewara
 

Similar to Mobile Test Automation (20)

Velocity Conference: Increasing Speed To Market In Mobile Development Through...
Velocity Conference: Increasing Speed To Market In Mobile Development Through...Velocity Conference: Increasing Speed To Market In Mobile Development Through...
Velocity Conference: Increasing Speed To Market In Mobile Development Through...
 
What Are Virtual Devices And How To Use Them For Testing.pdf
What Are Virtual Devices And How To Use Them For Testing.pdfWhat Are Virtual Devices And How To Use Them For Testing.pdf
What Are Virtual Devices And How To Use Them For Testing.pdf
 
Velocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuitVelocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuit
 
Velocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuitVelocity2013 mobile ci_intuit
Velocity2013 mobile ci_intuit
 
Speed to Market in Mobile Development
Speed to Market in Mobile DevelopmentSpeed to Market in Mobile Development
Speed to Market in Mobile Development
 
The Essentials of Mobile App Testing and Monitoring
The Essentials of Mobile App Testing and MonitoringThe Essentials of Mobile App Testing and Monitoring
The Essentials of Mobile App Testing and Monitoring
 
Mobile Testing in the Cloud
Mobile Testing in the CloudMobile Testing in the Cloud
Mobile Testing in the Cloud
 
Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?Can We Deliver Mobile Apps Continuously?
Can We Deliver Mobile Apps Continuously?
 
HienVo_Mobile Testing_v.1.2
HienVo_Mobile Testing_v.1.2HienVo_Mobile Testing_v.1.2
HienVo_Mobile Testing_v.1.2
 
Mobile application testing
Mobile application testingMobile application testing
Mobile application testing
 
Appium overview
Appium overviewAppium overview
Appium overview
 
Mobile Application Testing af Frederik Carlier, Jamo Solutions
Mobile Application Testing af Frederik Carlier, Jamo SolutionsMobile Application Testing af Frederik Carlier, Jamo Solutions
Mobile Application Testing af Frederik Carlier, Jamo Solutions
 
Mobile testing
Mobile testingMobile testing
Mobile testing
 
Understanding public Cloud Cloud Real Devices vs. physical devices, VMs and ...
Understanding public Cloud  Cloud Real Devices vs. physical devices, VMs and ...Understanding public Cloud  Cloud Real Devices vs. physical devices, VMs and ...
Understanding public Cloud Cloud Real Devices vs. physical devices, VMs and ...
 
Mobile App Security Testing -2
Mobile App Security Testing -2Mobile App Security Testing -2
Mobile App Security Testing -2
 
DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...
DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...
DEPLOYMENT OF CALABASH AUTOMATION FRAMEWORK TO ANALYZE THE PERFORMANCE OF AN ...
 
A Complete Guide to Mobile App Testing Types.pdf
A Complete Guide to Mobile App Testing Types.pdfA Complete Guide to Mobile App Testing Types.pdf
A Complete Guide to Mobile App Testing Types.pdf
 
Android Apps Testing in 2019
Android Apps Testing in 2019Android Apps Testing in 2019
Android Apps Testing in 2019
 
Mobile App Testing: Methods and Benefits
Mobile App Testing: Methods and BenefitsMobile App Testing: Methods and Benefits
Mobile App Testing: Methods and Benefits
 
Mobile applications and automation testing
Mobile applications and automation testingMobile applications and automation testing
Mobile applications and automation testing
 

More from Andreas Jakl

Create Engaging Healthcare Experiences with Augmented Reality
Create Engaging Healthcare Experiences with Augmented RealityCreate Engaging Healthcare Experiences with Augmented Reality
Create Engaging Healthcare Experiences with Augmented Reality
Andreas Jakl
 
AR / VR Interaction Development with Unity
AR / VR Interaction Development with UnityAR / VR Interaction Development with Unity
AR / VR Interaction Development with Unity
Andreas Jakl
 
Android Development with Kotlin, Part 3 - Code and App Management
Android Development with Kotlin, Part 3 - Code and App ManagementAndroid Development with Kotlin, Part 3 - Code and App Management
Android Development with Kotlin, Part 3 - Code and App Management
Andreas Jakl
 
Android Development with Kotlin, Part 2 - Internet Services and JSON
Android Development with Kotlin, Part 2 - Internet Services and JSONAndroid Development with Kotlin, Part 2 - Internet Services and JSON
Android Development with Kotlin, Part 2 - Internet Services and JSON
Andreas Jakl
 
Android Development with Kotlin, Part 1 - Introduction
Android Development with Kotlin, Part 1 - IntroductionAndroid Development with Kotlin, Part 1 - Introduction
Android Development with Kotlin, Part 1 - Introduction
Andreas Jakl
 
Android and NFC / NDEF (with Kotlin)
Android and NFC / NDEF (with Kotlin)Android and NFC / NDEF (with Kotlin)
Android and NFC / NDEF (with Kotlin)
Andreas Jakl
 
Basics of Web Technologies
Basics of Web TechnologiesBasics of Web Technologies
Basics of Web Technologies
Andreas Jakl
 
Bluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & More
Bluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & MoreBluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & More
Bluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & More
Andreas Jakl
 
Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?
Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?
Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?
Andreas Jakl
 
Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...
Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...
Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...
Andreas Jakl
 
WinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows Phone
WinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows PhoneWinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows Phone
WinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows Phone
Andreas Jakl
 
Nokia New Asha Platform Developer Training
Nokia New Asha Platform Developer TrainingNokia New Asha Platform Developer Training
Nokia New Asha Platform Developer Training
Andreas Jakl
 
Windows Phone 8 NFC Quickstart
Windows Phone 8 NFC QuickstartWindows Phone 8 NFC Quickstart
Windows Phone 8 NFC Quickstart
Andreas Jakl
 
Windows (Phone) 8 NFC App Scenarios
Windows (Phone) 8 NFC App ScenariosWindows (Phone) 8 NFC App Scenarios
Windows (Phone) 8 NFC App Scenarios
Andreas Jakl
 
Windows 8 Platform NFC Development
Windows 8 Platform NFC DevelopmentWindows 8 Platform NFC Development
Windows 8 Platform NFC Development
Andreas Jakl
 
NFC Development with Qt - v2.2.0 (5. November 2012)
NFC Development with Qt - v2.2.0 (5. November 2012)NFC Development with Qt - v2.2.0 (5. November 2012)
NFC Development with Qt - v2.2.0 (5. November 2012)
Andreas Jakl
 
06 - Qt Communication
06 - Qt Communication06 - Qt Communication
06 - Qt Communication
Andreas Jakl
 
05 - Qt External Interaction and Graphics
05 - Qt External Interaction and Graphics05 - Qt External Interaction and Graphics
05 - Qt External Interaction and Graphics
Andreas Jakl
 
04 - Qt Data
04 - Qt Data04 - Qt Data
04 - Qt Data
Andreas Jakl
 
03 - Qt UI Development
03 - Qt UI Development03 - Qt UI Development
03 - Qt UI Development
Andreas Jakl
 

More from Andreas Jakl (20)

Create Engaging Healthcare Experiences with Augmented Reality
Create Engaging Healthcare Experiences with Augmented RealityCreate Engaging Healthcare Experiences with Augmented Reality
Create Engaging Healthcare Experiences with Augmented Reality
 
AR / VR Interaction Development with Unity
AR / VR Interaction Development with UnityAR / VR Interaction Development with Unity
AR / VR Interaction Development with Unity
 
Android Development with Kotlin, Part 3 - Code and App Management
Android Development with Kotlin, Part 3 - Code and App ManagementAndroid Development with Kotlin, Part 3 - Code and App Management
Android Development with Kotlin, Part 3 - Code and App Management
 
Android Development with Kotlin, Part 2 - Internet Services and JSON
Android Development with Kotlin, Part 2 - Internet Services and JSONAndroid Development with Kotlin, Part 2 - Internet Services and JSON
Android Development with Kotlin, Part 2 - Internet Services and JSON
 
Android Development with Kotlin, Part 1 - Introduction
Android Development with Kotlin, Part 1 - IntroductionAndroid Development with Kotlin, Part 1 - Introduction
Android Development with Kotlin, Part 1 - Introduction
 
Android and NFC / NDEF (with Kotlin)
Android and NFC / NDEF (with Kotlin)Android and NFC / NDEF (with Kotlin)
Android and NFC / NDEF (with Kotlin)
 
Basics of Web Technologies
Basics of Web TechnologiesBasics of Web Technologies
Basics of Web Technologies
 
Bluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & More
Bluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & MoreBluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & More
Bluetooth Beacons - Bluetooth 5, iBeacon, Eddystone, Arduino, Windows 10 & More
 
Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?
Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?
Which new scenarios are enabled by Windows 10 for NFC, Bluetooth LE & Beacons?
 
Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...
Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...
Qt App Development - Cross-Platform Development for Android, iOS, Windows Pho...
 
WinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows Phone
WinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows PhoneWinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows Phone
WinJS, Apache Cordova & NFC - HTML5 apps for Android and Windows Phone
 
Nokia New Asha Platform Developer Training
Nokia New Asha Platform Developer TrainingNokia New Asha Platform Developer Training
Nokia New Asha Platform Developer Training
 
Windows Phone 8 NFC Quickstart
Windows Phone 8 NFC QuickstartWindows Phone 8 NFC Quickstart
Windows Phone 8 NFC Quickstart
 
Windows (Phone) 8 NFC App Scenarios
Windows (Phone) 8 NFC App ScenariosWindows (Phone) 8 NFC App Scenarios
Windows (Phone) 8 NFC App Scenarios
 
Windows 8 Platform NFC Development
Windows 8 Platform NFC DevelopmentWindows 8 Platform NFC Development
Windows 8 Platform NFC Development
 
NFC Development with Qt - v2.2.0 (5. November 2012)
NFC Development with Qt - v2.2.0 (5. November 2012)NFC Development with Qt - v2.2.0 (5. November 2012)
NFC Development with Qt - v2.2.0 (5. November 2012)
 
06 - Qt Communication
06 - Qt Communication06 - Qt Communication
06 - Qt Communication
 
05 - Qt External Interaction and Graphics
05 - Qt External Interaction and Graphics05 - Qt External Interaction and Graphics
05 - Qt External Interaction and Graphics
 
04 - Qt Data
04 - Qt Data04 - Qt Data
04 - Qt Data
 
03 - Qt UI Development
03 - Qt UI Development03 - Qt UI Development
03 - Qt UI Development
 

Mobile Test Automation

  • 1. Mobile Test Automation Andreas Jakl @andijakl andreas.jakl@tieto.com Mobile Developer After-Work #7 – Xamarin: April 9th, 2015
  • 2. Andreas Jakl Mobility Evangelist, Tieto – @andijakl – andreas.jakl@tieto.com History – Mopius: Startup-Founder (NFC & Mobile Apps) – Nokia, Finland: Technology Wizard – FH Hagenberg: Assistant Professor Mobile Computing – Siemens / BenQ Mobile, Germany: Augmented Reality-Apps Mobile Test Automation - Andreas Jakl2
  • 3. TESTING – WHY? Versions & More Mobile Test Automation - Andreas Jakl3
  • 4. Slow uptake of new versions Manufacturer- modified UIs Countless screen sizes & densities Mobile Test Automation - Andreas Jakl4 https://developer.android.com/about/dashboards/index.html http://stats.unity3d.com/mobile/os-android.html
  • 5. Fast adoption of new OS – Design updates – API & architecture changes (e.g., 64 bit enforcement) Quick update of apps required Same OS version, but many iOS devices in use Mobile Test Automation - Andreas Jakl5 https://developer.apple.com/support/appstore/ http://stats.unity3d.com/mobile/device-ios.html
  • 6. Similar hardware & software base – 512 MB vs 1+ GB memory – Processor speed – 4 supported screen resolutions Relevant: v8(.1) > 90% – But: Windows 10 upcoming • More resolutions, etc. Mobile Test Automation - Andreas Jakl6 http://blogs.windows.com/buildingapps/2014/12/22/windows-and-windows-phone-store-trends-december-2014-update/ http://blog.adduplex.com/2015/03/adduplex-windows-phone-statistics.html
  • 7. IMPACT OF TESTING Successful? Mobile Test Automation - Andreas Jakl7
  • 8. Reviews vs Downloads Review count & rating correlate to downloads Mobile Test Automation - Andreas Jakl8 Bin Lu, et al.: Why People Hate Your App – Making Sense of User Feedback in a Mobile App Store. Carnegie Mellon University, 2013 Data from 13 million user reviews, 171,439 apps Average rating: 3.9 (standard deviation: 1.48) 0 2 000 000 4 000 000 6 000 000 8 000 000
  • 9. Review Analysis Analysis – Most frequent complaints • Functional errors • Feature requests • App crashes Mobile Test Automation - Andreas Jakl9 Claudia Iacob, Rachel Harrison: “Retrieving and Analysing Mobile Apps Feature Requests from Online Reviews”, Oxford Brookes University, 2013 Kahlid. H, et al.: “What Do Mobile App Users Complain About? A Study on Free iOS Apps”, Queen’s University, Kingston, 2014 Gunwoong Leea, T. S. Raghua: “Determinants of Mobile Apps' Success: Evidence from the App Store Market”, 2014
  • 10. Review Analysis Analysis – Most negative impact • Privacy and ethical issues • Hidden app costs Mobile Test Automation - Andreas Jakl10 Claudia Iacob, Rachel Harrison: “Retrieving and Analysing Mobile Apps Feature Requests from Online Reviews”, Oxford Brookes University, 2013 Kahlid. H, et al.: “What Do Mobile App Users Complain About? A Study on Free iOS Apps”, Queen’s University, Kingston, 2014 Gunwoong Leea, T. S. Raghua: “Determinants of Mobile Apps' Success: Evidence from the App Store Market”, 2014
  • 11. Customer Retention Quality (feature) upgrades – Up to 3x improvement in survival rates Mobile Test Automation - Andreas Jakl11 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 1 Month after Download 6 Months after Download 1 Year after Download Customer Retention in Mobile Apps
  • 12. TESTING STRATEGIES Manual Mobile Test Automation - Andreas Jakl12
  • 13. Capturing Crash Data Mobile Test Automation - Andreas Jakl13
  • 14. Monitoring User Reviews Mobile Test Automation - Andreas Jakl14 Bin Lu, et al.: Why People Hate Your App – Making Sense of User Feedback in a Mobile App Store. Carnegie Mellon University, 2013
  • 15. Static Code Analysis Mobile Test Automation - Andreas Jakl15
  • 16. Emulator / Simulator Mobile Test Automation - Andreas Jakl16 Emulator Emulates real hardware + more accurate – slow Android Simulator Simulates device behavior + faster – less accurate iOS / Windows
  • 17. Reliable? Mobile Test Automation - Andreas Jakl17 0%of your users will run your app on an emulator
  • 18. Own Devices Mobile Test Automation - Andreas Jakl18 How many test devices do you have?
  • 19. Open Device Lab Vienna Mobile Test Automation - Andreas Jakl19 Free testing on real devices http://www.open-device-lab-vienna.at/
  • 20. Automated UI Tests Mobile Test Automation - Andreas Jakl20 How many tests can you run per hour / build / release? Number of builds Cost Automated tests Manual tests
  • 21. TEST CLOUD Automated Testing on 1000s of Devices Mobile Test Automation - Andreas Jakl21
  • 22. Xamarin Test Cloud Automated tests – UI interaction – Device features (GPS, etc) – Performance 1,300+ devices – Android & iOS – testcloud.xamarin.com/devices Mobile Test Automation - Andreas Jakl22
  • 24. + Continuous Integration Mobile Test Automation - Andreas Jakl24
  • 25. Calabash Xamarin.UiTest Test Frameworks Mobile Test Automation - Andreas Jakl25 Write tests in Ruby C# Run with Gherkin NUnit
  • 26. Executing Tests Mobile Test Automation - Andreas Jakl26
  • 27. Process 1. Write Tests 2. Setup Project for Testing 3. Test Locally 4. Create app on Xamarin Test Cloud 5. Upload & Run on Cloud via Command Line Mobile Test Automation - Andreas Jakl27
  • 28. Writing Tests: NUnit Mobile Test Automation - Andreas Jakl28 Generic tests possible with Xamarin.Forms
  • 29. Test Setup Mobile Test Automation - Andreas Jakl29 Platform-specific initialization & test differences
  • 30. Setup Project Mobile Test Automation - Andreas Jakl30 Disable shared Mono runtime
  • 31. API Key Mobile Test Automation - Andreas Jakl31 Create team & app to get unique API key
  • 32. Run Tests Locally Mobile Test Automation - Andreas Jakl32 Test on your devices first
  • 33. Mobile Test Automation - Andreas Jakl33 Cloud Setup Choose devices
  • 34. Mobile Test Automation - Andreas Jakl34 Cloud Setup System settings
  • 35. Mobile Test Automation - Andreas Jakl35 Running Tests in the cloud Command line only
  • 36. Mobile Test Automation - Andreas Jakl36 Test results Dashboard
  • 37. Mobile Test Automation - Andreas Jakl37 Test results Screenshots
  • 38. Custom Screenshots Take & describe screenshots Enable local screenshots Mobile Test Automation - Andreas Jakl38 [TestCase (TestName = "Click button and show success message")] public void TestCaseSuccess () { AppResult[] result = _app.Query(InitialMessage); Assert.IsTrue(result.Any(), "The initial message string isn't correct"); _app.Screenshot ("Initial screen"); _app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY"). EnableLocalScreenshots().StartApp();
  • 39. Custom Screenshots Take & describe screenshots Enable local screenshots Mobile Test Automation - Andreas Jakl39 [TestCase (TestName = "Click button and show success message")] public void TestCaseSuccess () { AppResult[] result = _app.Query(InitialMessage); Assert.IsTrue(result.Any(), "The initial message string isn't correct"); _app.Screenshot ("Initial screen"); _app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY"). EnableLocalScreenshots().StartApp();
  • 40. Testing Finished App Packages Find IDs of UI elements Mobile Test Automation - Andreas Jakl40 if (TestEnvironment.Platform.Equals(TestPlatform.Local)) { _app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY"). EnableLocalScreenshots().StartApp(); _app.Repl (); // In Bash, enter app.Query(c=>c.Button()) or c.All() }
  • 41. Testing Finished App Packages Find IDs of UI elements Mobile Test Automation - Andreas Jakl41 if (TestEnvironment.Platform.Equals(TestPlatform.Local)) { _app = ConfigureApp.Android.ApkFile(PathToAPK).ApiKey("YOUR_API_KEY"). EnableLocalScreenshots().StartApp(); _app.Repl (); // In Bash, enter app.Query(c=>c.All()) }
  • 42. Alternatives Testdroid – testdroid.com/ Perfecto Mobile – perfectomobile.com/solution/test-automation Mobile Test Automation - Andreas Jakl42