SlideShare a Scribd company logo
Building a Large-Scale
In-House Test Lab for
Mobile Apps
4 June 2014
Ville-Veikko Helppi
Technical Product Manager
ville-veikko.helppi@bitbar.com
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
2
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
3
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
4
Manual vs. Automation
Smaller coverage, More money
burnt & time wasted, Error-
prone
Large coverage,
quickly
completed, Less
money & time
wasted, Exact
results.

Recommended for you

Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development Environment

Watch a live presentation at http://offer.bitbar.com/which-one-works-you-the-best-in-house-or-cloud-based-development-environment The best and the most suitable development environment whether it is a full in-house solution with your own devices, servers and other infrastructure – or development infrastructure environment fully hosted for you, depends on various aspects. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

mobile testing strategyandroid testingios testing
Hassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device TestingHassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device Testing

Watch a live presentation at http://offer.bitbar.com/hassle-free-continuous-integration-combined-with-a-real-device-testing Thousands of mobile apps are developed and released every day. The fierce competition for attention of end-users has changed the way mobile developers build and test their apps – and how they utilize today’s mobile devops tools to gain advantage of productivity, effectiveness and speed. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

real device testingdevopsmobile app testing
Exercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the EnterpriseExercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the Enterprise

Adopting the mobile devops culture, processes and practices in any organization may not happen overnight. The transformation from agile to true mobile devops requires identification of inefficiencies and understanding of how process, practice and infrastructure can be scaled up. Stay tuned and join our upcoming webinars at bitbar.com/testing/webinars/

agilemobile app testingdevops
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
5
Prerequisites
• Testing environment as authentic as possible
– Real devices <-> emulators/simulators
• Test coverage needs to be adequate
– Software is not identical in all Android/iOS devices
– Hardware is even more fragmented landscape
• Surrounding testing conditions (e.g. network)
• Try not to build in repetitive, manual processes
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
6
In-House Mobile App Testing
• Continuous Testing with real devices
• Cloud/Out-of-Premises vs. In-House
• Improve app ratings & your brand reputation
• Operational costs vs. Lost revenue?
• Consequences of not-being-tested-enough?
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
7
Reasons to Build In-House Labs
• Pre-Market devices or other hardware
• Corporate security policies
• Availability and usage level
• Special setups
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
8
Core Benefits of CI and Testing
• Version control and build revision
• Build automation, instant execution & testing
• All types of testing & integrations enabled
• Frequent commits, Code consolidation -> Fast builds
• CI/Testing is the best fit for mobile agile process

Recommended for you

Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?

Watch a live presentation at http://offer.bitbar.com/different-android-testing-frameworks-what-works-you-the-best Implementing the test automation as part of your daily activities can provide you an enormous value: coverage to detect bugs and errors, early and later during the development, reducing the costs of failure, save time through its repeatability and earlier verification. Today, there are bunch of different options available for testing frameworks on Android – what would work the best for you? Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

appsios testingtestdroid
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-Automation

Sitam Jana presents on mobile automation. The document discusses challenges in mobile testing like compatibility and regression testing. It then covers mobile automation tools like Appium, Robotium and MonkeyRunner that can automate testing on Android and iOS. The last sections provide steps to set up the environment and demonstrate MonkeyRunner through sample code and configuration in Eclipse.

appiumautomationmindfire solutions
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...

Game testing nowadays requires the right understanding of the gaming industry, title publishing, mass server loading, level architecture and advanced user experience. If you do not know what skills and tools to test your mobile game, check out this guide.

software testingsoftware developmentmobile game testing
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
9
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
10
Why Apps Fail?
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
11
EXAMPLE: Android devices
Picture by OpenSignal 2013 - http://opensignal.com/reports/fragmentation-2013/
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
12
EXAMPLE: Android OEMs
Picture by OpenSignal 2013 - http://opensignal.com/reports/fragmentation-2013/

Recommended for you

Parallel testing with appium
Parallel testing with appiumParallel testing with appium
Parallel testing with appium

Slides that I presented at appium meetup in San Fransisco, has details about setting appium with selenium grid.

appium parallel selenium-grid
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar

Watch a live presentation at http://offer.bitbar.com/parallel-test-runs-with-appium-on-real-mobile-devices Appium is an open source test automation framework and currently one of the hottest framework for mobile app, game and web testing. In this webinar, we’ll discuss about the best practices, how to use Appium for different types of apps, games and web apps, and how to use all new features around it – the parallel test runs, image recognition and more! Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

testdroidtest automationmobile testing strategy
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)

This slide deck presents how to use Appium and test automation for mobile web testing on real devices at Testdroid Cloud.

androidtest automationappium
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
13
EXAMPLE: Android OS
Picture by OpenSignal 2013 - http://opensignal.com/reports/fragmentation-2013/
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
14
OS Versions
ICS JB KK
17.7M test runs, 288 unique
Android devices, 50+
configurations
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
15
Display Resolution
17.7M test runs, 288 unique
Android devices, 50+
configurations
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
16
Memory

Recommended for you

Selenium training
Selenium trainingSelenium training
Selenium training

Selenium is an open source tool used for automating web application testing. It was created in 2004 by Jason Huggins and supports recording and playback of test cases in browsers like Firefox. Selenium has four main components - Selenium IDE for recording and playback of tests, Selenium Remote Control for running tests on multiple browsers, Selenium WebDriver for direct browser control, and Selenium Grid for parallel testing on different machines. The latest version of Selenium is 3.0.

software developmentsoftware testingselenium
Top Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test AutomationTop Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test Automation

Mobile apps have brought a whole new set of challenges when it comes to testing: Fast paced development cycles with multiple releases per week, multiple app technologies and development platforms to support, tons of devices and form factors, and additional pressure from enterprise and consumers less patient with low quality apps. With these new challenges, come a new set of mistakes testers can make! Fred has worked with dozens of mobile test teams to help them avoid common traps when building test automation for mobile apps and would like to share some best practices that could be useful to a lot of developers and testers starting with mobile test automation. Best practices such as: • When, what and where to automate? • Picking the right wait to handle unreliable back-end calls or device performance • Building testability in a mobile app • Automating the automation (!) • Mix and match performance testing and functional testing In this talk, Fred will bring some real stories (struggles!) and how small changes in process made these mobile apps 10x more reliable!

software testingmobile automationautomation
Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium

Android UI Testing with Appium This presentation covers: - how appium works - setting up test development environment with AndroidStudio - running tests - UI automation best practices - common problems with automation

androidappiumui testing
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
17
Coverage? IS THAT ALL YOU NEED?
Picture by Double Encore - http://www.doubleencore.com/2014/05/android-user-data-2014/
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
18
Data, results & setup
information were gather
between 1 January – 31
March 2014 (Q1’2014)
- 17.7M test/device runs
- 288 unique devices
- Thousands of userswww.testdroid.com
Research
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
19
Global Coverage
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
20
Robust/Unstable – Q1’14
The Most Robust Devices
Samsung Infuse 4G SGH-I997
Lenovo A60
Dell Streak 7 M02M001
HTC ChaCha A810e
Coolpad 7295
Samsung Galaxy Europa GT-I5500
Samsung Acclaim SCH-R880
Motorola Motosmart XT389
Sharp Aquos Phone Zeta SH-02E
Samsung Galaxy mini GT-S5570
The Most Unstable Devices
Samsung Galaxy S IV Active SGH-I537
Sony Xperia J ST26i
Samsung Galaxy S IV Altius SCH-R970
Samsung Galaxy S IV Altius SGH-M919
Samsung Galaxy Note 8.0 GT-N5110
Samsung Galaxy S IV Altius SGH-I337
Samsung Galaxy Mega GT-I9205
HTC One M7 4.3
Asus Transformer Pad TF300TL
Sony Xperia Acro S LT26w
99.805 %
99.797%
99.794%
99.785%
99.783%
99.780%
99.778%
99.775%
99.771%
99.770%
29.722%
36.376%
39.007%
41.455%
43.284%
44.737%
45.536%
45.794%
47.689%
50.576 %

Recommended for you

Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test Automation

The explosion of multi-platform mobile application development has created an extensive testing burden for quality organizations – and a huge opportunity for test automation ROI. Factoring in the idiosyncrasies of individual device models and carriers magnifies both the challenge and opportunity. Attend this session to learn how to extend test automation to the mobile platform and realize significant ROI. You will come away with best practices for implementing test automation effectively and efficiently across multiple mobile platforms and devices utilizing various types of mobile test automation tools. Specifically, tool independent techniques for creating a single test suite capable of executing across multiple platforms and devices will be discussed.

mobiletest automationmobile testing
Appium vs Appium with Perfecto
Appium vs Appium with PerfectoAppium vs Appium with Perfecto
Appium vs Appium with Perfecto

This document provides an agenda and overview of a tech talk comparing Appium and Appium with Perfecto for automation testing. The summary introduces Perfecto as a cloud-based quality lab for testing applications on real devices, describes how Perfecto extends Selenium and Appium to support additional capabilities, and previews a demo of creating a sample project and script using the Perfecto plugin in IntelliJ.

Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible

Cloud testing has never been easier with Perfecto. We’ve rolled out new features and new public cloud packages that make testing in the cloud more accessible than ever before. Come and see how others are leveraging the platform to scale automation, unite global and remote teams, and release faster. If you’re no longer in the office due to COVID-19, our platform is tailored to help you get through it successfully. Join this webinar, led by Perfecto’s Director Global Engineering, Nico Kruger, to see the top five use cases for Perfecto’s public cloud, and learn how to successfully automate testing, no matter where you’re currently at. Attend this webinar to: - Learn how testing clouds can extend test coverage, accelerate testing, and unite global teams. - Learn how other teams are addressing app testing challenges to help accelerate their release cycles. - Get a guided tour of the Perfecto public cloud and watch a live demo.

cloudtestingtest automation
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
21
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
22
Hardware – Top 3 Things
• Device Control Servers
– Hard disks
– RAM
– Energy Efficiency
• USB Hubs
• WiFi Infrastructure
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
23
Software – Top 3 Things
• Testdroid
Enterprise
• Continuous
Integration – e.g.
Jenkins CI
• Other agile tools
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
24
How Testdroid Helps?
• Speed up dev &
testing cycles
significantly
• Agile development
& integration with
mobile practices
• Continuous Testing

Recommended for you

Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!

The document discusses different strategies for testing mobile apps, including testing functionality, usability, performance, and more extensively than just functionality. It addresses testing on real devices versus emulators, the need for accessibility testing, and tools for testing areas like contrast, text-to-speech, location services and network bandwidth. The document also discusses visual testing strategies like using AI to detect visual differences and validating user interfaces.

mobile testingmobile test automationmobile app testing
Testing Strategy for Progressive Web Apps
Testing Strategy for Progressive Web AppsTesting Strategy for Progressive Web Apps
Testing Strategy for Progressive Web Apps

As the digital space continues to evolve, Progressive Web Apps (PWA) are gaining momentum. PWAs aim to improve user experience and are about to become a game changer – will you be ready? Join us for this live webinar & learn: * What Progressive Web Apps are and why they're gaining momentum * Key differences between Progressive Web Apps, responsive web design, hybrid and native apps * Best practices and tools for testing Progressive Web Apps And see a live demo of a Progressive Web App in action

progressive web appweb app testingapp testing
Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation Investment

Watch a live presentation at http://offer.bitbar.com/maximize-the-benefits-from-your-test-automation-investment Test automation can actually turn your development to super agile, enable you to start making revenue sooner, improve the overall quality of your applications and process. This new, superior way of development and testing can make you very cost-effective, increase significantly your developer productivity and speed up time-to-market. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

ios testingappstestdroid
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
25
Simple Setup
Device clusters
Device Control
Server(s)
Cluster #1 Cluster #2 Cluster #3
USB Hubs,
Cables
Cluster #4 Cluster #5
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
26
Developers
Source
code
Repository
Build
failed
Successful
build
QA & Testers
Error reporting
Test Cases
Application
Commit
Users / Consumers
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
27
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
28
1

Recommended for you

Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with Appium

Appium is the leading open source and de facto framework for cross-platform iOS and Android mobile functional test automation. That’s nothing new. With constant changes in the mobile space, and together with the ongoing DevOps transformation, teams are challenged with the objective of enhancing test automation coverage, stability, and delivering valuable feedback to the mobile app developers as quickly as possible. Additionally, quite often app developers and testers naïvely approach testing by following test steps, rather than testing from the end-user perspective. Lastly, the testing ecosystem is divided into various practitioners with different skillsets following different methodologies. In this webinar led by Perfecto’s CTO Uzi Eilon, and Chief Evangelist and Author Eran Kinsbruner to uncover the following: -Get a baseline on where Appium framework stands as we begin 2019. -Realize the importance of advanced Appium testing approach from an end-user flow perspective. -Learn about the toolset you need to make your Appium success complete. -Learn how to match the skillset and methodology while using the Appium framework. -Behavior-driven development (BDD) based testing with Appium and Perfecto’s Quantum framework. -Testing at scale in the cloud via Appium Studio, with the Perfecto cloud connecting to the community. -See how AI-driven reporting in Perfecto’s DigitalZoom can reduce the time to analyze, resolve issues, and eliminate noise in your pipeline.

appiumtest automationcontinuous quality
Cutting Through the Disruption
Cutting Through the DisruptionCutting Through the Disruption
Cutting Through the Disruption

The pace of change in business is faster than we could have ever imagined, and in this day and age you must either disrupt, or be disrupted. This presentation aims to explain the changes we are seeing in the business technology world, the struggles many organizations are facing to keep up, and present the audience with solutions to these difficulties. The presentation was originally presented by OSSCube CEO Lavanya Rastogi.

solutionstechnologyinformation technology
Are You Ready for Android L?
Are You Ready for Android L?Are You Ready for Android L?
Are You Ready for Android L?

Keynote mobile testing and performance experts walk through the latest beta version of Android L to help developers and QA teams ensure optimal performance.

© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
29
2
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
30
3
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
31
4
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
32
5

Recommended for you

Mike Siegler at INCOSE Minneapolis, 2014
Mike Siegler at INCOSE Minneapolis, 2014Mike Siegler at INCOSE Minneapolis, 2014
Mike Siegler at INCOSE Minneapolis, 2014

Etherios is a division of Digi International that provides wireless design, cloud, and advisory consulting services. It has over 600 employees globally and a proven track record of successful projects. Etherios uses a systems thinking approach and its Device Cloud platform to help customers connect, control, and engage assets through wireless technologies and cloud services. This reduces risks and costs for customers and helps bring products to market faster through Etherios' wireless and requirements management expertise.

wirelessengineeringinternet of things
TiConf US 2014
TiConf US 2014TiConf US 2014
TiConf US 2014

This document summarizes Olivier Morandi's talk on debugging and profiling Titanium apps. The talk introduces Ti Inspector, a tool that allows debugging Titanium apps using Chrome DevTools. It also discusses Node Inspector for debugging on Android and prototypes for profiling apps using Chrome's timeline and tracing features. Future work is planned to integrate these capabilities into a unified debugging and profiling tool.

titanium mobiledebuggingtiscope
Measuring and improving your app's network performance oredev
Measuring and improving your app's network performance   oredevMeasuring and improving your app's network performance   oredev
Measuring and improving your app's network performance oredev

Tips and Tricks to build Android apps that run on ANY speed cellular network "Flexibly Network Aware" applications

© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
33
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
34
Testdroid Update
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
35
Testdroid Update
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
36
Stay tuned!
A Step-by-step guide
how to build an in-
house test lab for
mobile apps.
Will be available at
www.testdroid.com
Coming Soon!

Recommended for you

Technology and Digital Platform | 2019 partner summit
Technology and Digital Platform | 2019 partner summitTechnology and Digital Platform | 2019 partner summit
Technology and Digital Platform | 2019 partner summit

Technology: Andrew Kumar will share a refresher of our technology standards, documentation while highlighting what is changing in 2019 in the reference architecture and starter kits. Digital Platform: Andrew Kumar will follow tech and design updates with a refresher on why the digital platform matters, what exists in the digital platform, what is being worked on, and what is coming next as we co-create value, save team member effort, and improve speed to market with investments in the digital platform.

technologydigitalplatform thinking
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing

Join analyst David Gehringer of Dimensional Research and Sauce Labs in a Webinar that covers their recent research into how QA and dev engineers choose to test across emulators and real devices. Also, we’ll show you a demo of the Sauce Labs Real Device Cloud and how you can implement best practices of testing on both emulators and real devices to optimize your time and money.

continuous deliverymobile cimobile
The impact of IOT - exchange cala - 2015
The impact of IOT - exchange cala - 2015The impact of IOT - exchange cala - 2015
The impact of IOT - exchange cala - 2015

A presentation at Progress Exchange 2015, in Sao Paulo. What is IOT Why you Should YOU care Examples of IOT Apps IOT and Progress

iot
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
37
Deployment Options
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
38
Only $999!
For Trial Purpose!
We’re giving a 30-day trial license with Mac Mini.
In worst case, you got a Mac Mini with $999 – and it the best scenario you’ll have a
product that will save you a lot of money, time and results as a better application!
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
39
Agenda
• Intro & Benefits: In-House Mobile App Testing
• Challenges w/Apps, Devices, Testing & Market
• Infrastructure – both Hardware & Software
• Tips & Tricks for Building In-House Lab
• Testdroid Update
• Q&A
Agenda
© Copyrights by Bitbar Technologies Ltd. 2014
All rights reserved.
40

Recommended for you

JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost ComputersJavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers

By Jorge Hidalgo & Julio Palma. San Francisco Oct 27th, 2015. Single-board computers such as the Raspberry Pi are cheap, small, and cute, but they have also shown that they are powerful enough to drive interesting ideas at a fraction of the cost of other, more “traditional” hardware solutions. This session covers how Java ME and Java SE technologies can power solutions for managing open spaces (such as museums, department stores, hypermarkets, airports, train stations, and offices) in a cost-effective manner. Combining Java, the Raspberry Pi, and Bluetooth LE and other sensors makes it easy to build a platform to track personal devices as they are carried through an area and analyze movement patterns, hot zones, and real-time 3-D information to help drive better visitor/customer/user interactions.

trackingdevicesraspberry pi
Steps to Scale Internet of Things (IoT)
Steps to Scale Internet of Things (IoT)Steps to Scale Internet of Things (IoT)
Steps to Scale Internet of Things (IoT)

Cisco Tech Advantage Webinar. June 4th, 2014 Video: http://youtu.be/RkmMi9qea5Y IoT is everywhere, from smart meters on houses to parking sensors in the ground – all devices are connected to the Internet. Internet engineers are helping traditional industries solve new industrial world challenges by connecting billions of new devices. An exciting part of the IoT journey is the integration between both worlds: Information Technology (IT) and Operation Technology (OT). For that a systems approach is required to scale the existing Internet infrastructure to accommodate IoT use cases, while making IT technology easy to adopt for OT operators. In this session you will learn: IoT infrastructure challenges and the need for open standards and partner ecosystem Key elements to build large-scale IoT systems as IPv6, access control, plug and play, distributed intelligence and contextual awareness Introduction to fog computing and advantages of extending cloud computing and services Looking ahead to the future

service providerm2mtransportation
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...

The document discusses build infrastructure and how it helps software development processes. It describes the five pillars of build infrastructure as one-click builds, build automation, continuous integration, automated testing, and automated deployment. It provides examples of how Unity Technologies implemented these pillars over time to improve their development cycles and scale their team. Python is highlighted as an excellent language for writing development tools to support build infrastructure.

More Related Content

What's hot

Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game Testing
Bitbar
 
Mobile performance metrics and performance monitoring meetup 2017 05 10
Mobile performance metrics and performance monitoring meetup 2017 05 10Mobile performance metrics and performance monitoring meetup 2017 05 10
Mobile performance metrics and performance monitoring meetup 2017 05 10
Bitbar
 
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and Testing
Bitbar
 
Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development Environment
Bitbar
 
Hassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device TestingHassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device Testing
Bitbar
 
Exercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the EnterpriseExercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the Enterprise
Bitbar
 
Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?
Bitbar
 
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-Automation
Mindfire Solutions
 
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Carl Alston
 
Parallel testing with appium
Parallel testing with appiumParallel testing with appium
Parallel testing with appium
moizjv
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Bitbar
 
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
Bitbar
 
Selenium training
Selenium trainingSelenium training
Selenium training
Shivaraj R
 
Top Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test AutomationTop Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test Automation
Fred Beringer
 
Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium
Luke Maung
 
Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test Automation
Lee Barnes
 
Appium vs Appium with Perfecto
Appium vs Appium with PerfectoAppium vs Appium with Perfecto
Appium vs Appium with Perfecto
Lizzy Guido (she/her)
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
Perfecto by Perforce
 
Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!
Applitools
 
Testing Strategy for Progressive Web Apps
Testing Strategy for Progressive Web AppsTesting Strategy for Progressive Web Apps
Testing Strategy for Progressive Web Apps
Perfecto by Perforce
 

What's hot (20)

Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game Testing
 
Mobile performance metrics and performance monitoring meetup 2017 05 10
Mobile performance metrics and performance monitoring meetup 2017 05 10Mobile performance metrics and performance monitoring meetup 2017 05 10
Mobile performance metrics and performance monitoring meetup 2017 05 10
 
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and Testing
 
Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development Environment
 
Hassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device TestingHassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device Testing
 
Exercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the EnterpriseExercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the Enterprise
 
Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?
 
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-Automation
 
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
Beginner’s Guide to Game Testing | What Skills and Tools You Should Know To T...
 
Parallel testing with appium
Parallel testing with appiumParallel testing with appium
Parallel testing with appium
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
 
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
 
Selenium training
Selenium trainingSelenium training
Selenium training
 
Top Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test AutomationTop Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test Automation
 
Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium
 
Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test Automation
 
Appium vs Appium with Perfecto
Appium vs Appium with PerfectoAppium vs Appium with Perfecto
Appium vs Appium with Perfecto
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
 
Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!Stop Testing (Only) The Functionality of Your Mobile Apps!
Stop Testing (Only) The Functionality of Your Mobile Apps!
 
Testing Strategy for Progressive Web Apps
Testing Strategy for Progressive Web AppsTesting Strategy for Progressive Web Apps
Testing Strategy for Progressive Web Apps
 

Similar to Build a Large Scale In-House Test Lab for Mobile Apps

Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation Investment
Bitbar
 
Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with Appium
Perfecto by Perforce
 
Cutting Through the Disruption
Cutting Through the DisruptionCutting Through the Disruption
Cutting Through the Disruption
OSSCube
 
Are You Ready for Android L?
Are You Ready for Android L?Are You Ready for Android L?
Are You Ready for Android L?
Keynote Mobile Testing
 
Mike Siegler at INCOSE Minneapolis, 2014
Mike Siegler at INCOSE Minneapolis, 2014Mike Siegler at INCOSE Minneapolis, 2014
Mike Siegler at INCOSE Minneapolis, 2014
Etherios
 
TiConf US 2014
TiConf US 2014TiConf US 2014
TiConf US 2014
omorandi
 
Measuring and improving your app's network performance oredev
Measuring and improving your app's network performance   oredevMeasuring and improving your app's network performance   oredev
Measuring and improving your app's network performance oredev
Doug Sillars
 
Technology and Digital Platform | 2019 partner summit
Technology and Digital Platform | 2019 partner summitTechnology and Digital Platform | 2019 partner summit
Technology and Digital Platform | 2019 partner summit
Andrew Kumar
 
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing
Sauce Labs
 
The impact of IOT - exchange cala - 2015
The impact of IOT - exchange cala - 2015The impact of IOT - exchange cala - 2015
The impact of IOT - exchange cala - 2015
Eduardo Pelegri-Llopart
 
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost ComputersJavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
Jorge Hidalgo
 
Steps to Scale Internet of Things (IoT)
Steps to Scale Internet of Things (IoT)Steps to Scale Internet of Things (IoT)
Steps to Scale Internet of Things (IoT)
Rafael Maranon
 
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Na'Tosha Bard
 
Building an aruba proof of concept lab javier urtubia
Building an aruba proof of concept lab javier urtubiaBuilding an aruba proof of concept lab javier urtubia
Building an aruba proof of concept lab javier urtubia
Aruba, a Hewlett Packard Enterprise company
 
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
Eduardo Pelegri-Llopart
 
Reduce Test Automation Execution Time by 80%
Reduce Test Automation Execution Time by 80%Reduce Test Automation Execution Time by 80%
Reduce Test Automation Execution Time by 80%
TechWell
 
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsAhead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Inside Analysis
 
Inforln.com ERP LN 10.3 & 10.4 Project Peg Audit History Differences
Inforln.com ERP LN 10.3 & 10.4 Project Peg Audit History DifferencesInforln.com ERP LN 10.3 & 10.4 Project Peg Audit History Differences
Inforln.com ERP LN 10.3 & 10.4 Project Peg Audit History Differences
Dan Aldridge, ERP Software Evangelist, LION
 
Sbs overview r4
Sbs overview r4Sbs overview r4
Sbs overview r4
Rubin Dhillon
 
Tech planet 2014 Samsung Gear S Web Application
Tech planet 2014 Samsung Gear S Web ApplicationTech planet 2014 Samsung Gear S Web Application
Tech planet 2014 Samsung Gear S Web Application
Ryo Jin
 

Similar to Build a Large Scale In-House Test Lab for Mobile Apps (20)

Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation Investment
 
Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with Appium
 
Cutting Through the Disruption
Cutting Through the DisruptionCutting Through the Disruption
Cutting Through the Disruption
 
Are You Ready for Android L?
Are You Ready for Android L?Are You Ready for Android L?
Are You Ready for Android L?
 
Mike Siegler at INCOSE Minneapolis, 2014
Mike Siegler at INCOSE Minneapolis, 2014Mike Siegler at INCOSE Minneapolis, 2014
Mike Siegler at INCOSE Minneapolis, 2014
 
TiConf US 2014
TiConf US 2014TiConf US 2014
TiConf US 2014
 
Measuring and improving your app's network performance oredev
Measuring and improving your app's network performance   oredevMeasuring and improving your app's network performance   oredev
Measuring and improving your app's network performance oredev
 
Technology and Digital Platform | 2019 partner summit
Technology and Digital Platform | 2019 partner summitTechnology and Digital Platform | 2019 partner summit
Technology and Digital Platform | 2019 partner summit
 
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing
 
The impact of IOT - exchange cala - 2015
The impact of IOT - exchange cala - 2015The impact of IOT - exchange cala - 2015
The impact of IOT - exchange cala - 2015
 
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost ComputersJavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
JavaOne 2015 - CON6489 - Smart Open Spaces Powered by Low Cost Computers
 
Steps to Scale Internet of Things (IoT)
Steps to Scale Internet of Things (IoT)Steps to Scale Internet of Things (IoT)
Steps to Scale Internet of Things (IoT)
 
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
Build Infrastructure: What It Is, Why You Need It, and How to Use Python to F...
 
Building an aruba proof of concept lab javier urtubia
Building an aruba proof of concept lab javier urtubiaBuilding an aruba proof of concept lab javier urtubia
Building an aruba proof of concept lab javier urtubia
 
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
What is IoT and how Modulus and Pacific can Help - Featuring Node.js and Roll...
 
Reduce Test Automation Execution Time by 80%
Reduce Test Automation Execution Time by 80%Reduce Test Automation Execution Time by 80%
Reduce Test Automation Execution Time by 80%
 
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsAhead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time Analytics
 
Inforln.com ERP LN 10.3 & 10.4 Project Peg Audit History Differences
Inforln.com ERP LN 10.3 & 10.4 Project Peg Audit History DifferencesInforln.com ERP LN 10.3 & 10.4 Project Peg Audit History Differences
Inforln.com ERP LN 10.3 & 10.4 Project Peg Audit History Differences
 
Sbs overview r4
Sbs overview r4Sbs overview r4
Sbs overview r4
 
Tech planet 2014 Samsung Gear S Web Application
Tech planet 2014 Samsung Gear S Web ApplicationTech planet 2014 Samsung Gear S Web Application
Tech planet 2014 Samsung Gear S Web Application
 

Recently uploaded

Pigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdfPigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdf
Pigging Solutions
 
7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf
Enterprise Wired
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
huseindihon
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
Yevgen Sysoyev
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
welrejdoall
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsScaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Mydbops
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
Aurora Consulting
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
shanthidl1
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
The Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU CampusesThe Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU Campuses
Larry Smarr
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Bert Blevins
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
Bert Blevins
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
Stephanie Beckett
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
Eric D. Schabell
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
BookNet Canada
 
Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
KAMAL CHOUDHARY
 

Recently uploaded (20)

Pigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdfPigging Solutions Sustainability brochure.pdf
Pigging Solutions Sustainability brochure.pdf
 
7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsScaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
The Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU CampusesThe Increasing Use of the National Research Platform by the CSU Campuses
The Increasing Use of the National Research Platform by the CSU Campuses
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
 
Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
 

Build a Large Scale In-House Test Lab for Mobile Apps

  • 1. Building a Large-Scale In-House Test Lab for Mobile Apps 4 June 2014 Ville-Veikko Helppi Technical Product Manager ville-veikko.helppi@bitbar.com
  • 2. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 2 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 3. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 3 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 4. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 4 Manual vs. Automation Smaller coverage, More money burnt & time wasted, Error- prone Large coverage, quickly completed, Less money & time wasted, Exact results.
  • 5. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 5 Prerequisites • Testing environment as authentic as possible – Real devices <-> emulators/simulators • Test coverage needs to be adequate – Software is not identical in all Android/iOS devices – Hardware is even more fragmented landscape • Surrounding testing conditions (e.g. network) • Try not to build in repetitive, manual processes
  • 6. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 6 In-House Mobile App Testing • Continuous Testing with real devices • Cloud/Out-of-Premises vs. In-House • Improve app ratings & your brand reputation • Operational costs vs. Lost revenue? • Consequences of not-being-tested-enough?
  • 7. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 7 Reasons to Build In-House Labs • Pre-Market devices or other hardware • Corporate security policies • Availability and usage level • Special setups
  • 8. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 8 Core Benefits of CI and Testing • Version control and build revision • Build automation, instant execution & testing • All types of testing & integrations enabled • Frequent commits, Code consolidation -> Fast builds • CI/Testing is the best fit for mobile agile process
  • 9. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 9 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 10. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 10 Why Apps Fail?
  • 11. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 11 EXAMPLE: Android devices Picture by OpenSignal 2013 - http://opensignal.com/reports/fragmentation-2013/
  • 12. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 12 EXAMPLE: Android OEMs Picture by OpenSignal 2013 - http://opensignal.com/reports/fragmentation-2013/
  • 13. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 13 EXAMPLE: Android OS Picture by OpenSignal 2013 - http://opensignal.com/reports/fragmentation-2013/
  • 14. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 14 OS Versions ICS JB KK 17.7M test runs, 288 unique Android devices, 50+ configurations
  • 15. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 15 Display Resolution 17.7M test runs, 288 unique Android devices, 50+ configurations
  • 16. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 16 Memory
  • 17. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 17 Coverage? IS THAT ALL YOU NEED? Picture by Double Encore - http://www.doubleencore.com/2014/05/android-user-data-2014/
  • 18. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 18 Data, results & setup information were gather between 1 January – 31 March 2014 (Q1’2014) - 17.7M test/device runs - 288 unique devices - Thousands of userswww.testdroid.com Research
  • 19. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 19 Global Coverage
  • 20. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 20 Robust/Unstable – Q1’14 The Most Robust Devices Samsung Infuse 4G SGH-I997 Lenovo A60 Dell Streak 7 M02M001 HTC ChaCha A810e Coolpad 7295 Samsung Galaxy Europa GT-I5500 Samsung Acclaim SCH-R880 Motorola Motosmart XT389 Sharp Aquos Phone Zeta SH-02E Samsung Galaxy mini GT-S5570 The Most Unstable Devices Samsung Galaxy S IV Active SGH-I537 Sony Xperia J ST26i Samsung Galaxy S IV Altius SCH-R970 Samsung Galaxy S IV Altius SGH-M919 Samsung Galaxy Note 8.0 GT-N5110 Samsung Galaxy S IV Altius SGH-I337 Samsung Galaxy Mega GT-I9205 HTC One M7 4.3 Asus Transformer Pad TF300TL Sony Xperia Acro S LT26w 99.805 % 99.797% 99.794% 99.785% 99.783% 99.780% 99.778% 99.775% 99.771% 99.770% 29.722% 36.376% 39.007% 41.455% 43.284% 44.737% 45.536% 45.794% 47.689% 50.576 %
  • 21. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 21 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 22. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 22 Hardware – Top 3 Things • Device Control Servers – Hard disks – RAM – Energy Efficiency • USB Hubs • WiFi Infrastructure
  • 23. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 23 Software – Top 3 Things • Testdroid Enterprise • Continuous Integration – e.g. Jenkins CI • Other agile tools
  • 24. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 24 How Testdroid Helps? • Speed up dev & testing cycles significantly • Agile development & integration with mobile practices • Continuous Testing
  • 25. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 25 Simple Setup Device clusters Device Control Server(s) Cluster #1 Cluster #2 Cluster #3 USB Hubs, Cables Cluster #4 Cluster #5
  • 26. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 26 Developers Source code Repository Build failed Successful build QA & Testers Error reporting Test Cases Application Commit Users / Consumers
  • 27. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 27 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 28. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 28 1
  • 29. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 29 2
  • 30. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 30 3
  • 31. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 31 4
  • 32. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 32 5
  • 33. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 33 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 34. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 34 Testdroid Update
  • 35. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 35 Testdroid Update
  • 36. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 36 Stay tuned! A Step-by-step guide how to build an in- house test lab for mobile apps. Will be available at www.testdroid.com Coming Soon!
  • 37. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 37 Deployment Options
  • 38. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 38 Only $999! For Trial Purpose! We’re giving a 30-day trial license with Mac Mini. In worst case, you got a Mac Mini with $999 – and it the best scenario you’ll have a product that will save you a lot of money, time and results as a better application!
  • 39. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 39 Agenda • Intro & Benefits: In-House Mobile App Testing • Challenges w/Apps, Devices, Testing & Market • Infrastructure – both Hardware & Software • Tips & Tricks for Building In-House Lab • Testdroid Update • Q&A Agenda
  • 40. © Copyrights by Bitbar Technologies Ltd. 2014 All rights reserved. 40