SlideShare a Scribd company logo
The Mobile DevOps Company
Ville-Veikko Helppi
Head of Demand Generation
ville-veikko.helppi@bitbar.com
Exercising and Scaling Up
Mobile DevOps in the Enterprise
WEBINAR
Mobile DevOps
•  The ‘Mobile DevOps’,
Process and Tools
•  Infrastructure & Architecture
•  Tips & Tricks for Scaling Up
•  Troubleshooting Device Lab
•  Demo
•  Summary – Q&A
Agenda
More information
about Mobile DevOps
can be found at
bitbar.com
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
The Mobile DevOps
•  On-Demand Mobile Device Infrastructure
•  Support Any Development & Testing Framework
•  Automate, Automate, Automate – To Save Time, Money and Hassle
•  Provide Unprecedented Scale and Throughput
•  Allow For Creative Use (Open API, Customizable Integrations)
•  Adopt Mobile Development Thought Leadership and Expertise
Support all development stages:
Prototyping Development Testing Production Monitoring
Successful Adoption of Mobile DevOps

Recommended for you

Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise

Enabling CI / CD in your mobile development process means understanding the different solutions, overcoming unique challenges and ensuring the right ownership of the processes. In this webinar, you will learn the steps required to enable Continuous Delivery of Mobile Application Platforms.

continuous integrationcross browser testingselenium testing
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...

Build, Test, Deploy Mobile Apps with a fully automated Continuous Intergration solution..in the Cloud...for free... Kohsuke Kawaguchi, Jenkins creator, and Mark Prichard of CloudBees join SOASTA for a demos and discussion of CI for mobile in the cloud. From Nov. 15, 2012 webinar. (a repeat of Sept 27, 2012 webinar)

kohsuke kawaguchijenkinsmobile
How to Test Security and Vulnerability of Your Android and iOS Apps
How to Test Security and Vulnerability of Your Android and iOS AppsHow to Test Security and Vulnerability of Your Android and iOS Apps
How to Test Security and Vulnerability of Your Android and iOS Apps

Watch a live presentation at http://offer.bitbar.com/how-to-test-security-and-vulnerability-of-your-android-and-ios-apps Majority of today’s mobile apps consist of third-party code/libraries. This is a prudent and well-accepted development practice that offloads the task of developing code for non-core functions of your mobile app – or game. Identifying third-party code, its vulnerabilities and its license restrictions, is highly critical in order to understand your security exposure and your liability. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

appsios testingtestdroid
•  Modern mobile app development is Agile, but
infrastructure does not support Agility well
•  DevOps practices are emerging in to the
intersection of Development, QA and Operations
•  DevOps practice emphasizes the collaboration
and communication of both software developers
and operations while automating the process of
software delivery and infrastructure changes
•  DevOps practice establishes a culture and
environment where building, testing, and
releasing software, can happen rapidly,
frequently, and more reliably.
Mobile DevOps and Agile
Development QA
Operations
Dev
Ops
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
SPEED WINS
It’s a simple fact. The faster you can deliver new applications, features and
upgrades to market, and collect feedback, the better your business
performs. For that you need higher development pace. And a lot of
automation.
THERE IS A DEMAND FOR MOBILE DEVOPS
DevOps practices and tools have revolutionized the pace and quality of
service delivery – but only for traditional server-based apps.
FRAGMENTATION WITH TOOLS
In mobile the delivery pipelines are more complex – in terms of tools and
used methods. Cohesive and well-integrated development tool flow
derives from Mobile DevOps practices.
MANUAL DOING IS NOT EFFECTIVE
Every stage requires a lot of manual work and silo’ed solutions from
various vendors and/or open source tools.
Why Mobile DevOps
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Delivery Pipeline for Mobile Apps
Development
Source Code
Management
SCM
Build Test Deploy Production
Dev Tools:
•  IDEs
•  JIRA
•  Slack
•  etc.
SCM:
•  Git/GitHub/
GitLab
•  Bitbucket
•  MSFT
•  etc.
Continuous
Integration
and Build
Automated
Testing
Automation
for app store
deployment,
beta testers
& enterprise
app stores
Production
Monitoring
and feedback
to Dev
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Delivery Pipeline with Mobile DevOps
Development
Source Code
Management
SCM
Build Test Deploy Production
Dev Tools:
•  IDEs
•  JIRA
•  Slack
•  etc.
SCM:
•  Git/GitHub/
GitLab
•  Bitbucket
•  MSFT
•  etc.
Continuous
Integration and
Build
Automated Testing Automation for app
store deployment,
beta testers
& enterprise app
stores
Production
Monitoring and
feedback to Dev
The	Scope	of	Mobile	DevOps	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Fight back android fragmentation
Fight back android fragmentationFight back android fragmentation
Fight back android fragmentation

These are the slides for the presentation that Bitbar experts gave at Droidcon Berlin 2012 (http://de.droidcon.com/content/testing-device-compatibility-not-hard-you-think). The presentation included also a live demo of Recording tests with Testdroid Recorder 2.0 and running the same use cases with one click on all 100+ real Android devices in Testdroid Cloud.

testdroidrobotiumtesting on real devices
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and Testing

Watch a live presentation at http://offer.bitbar.com/the-powerful-and-comprehensive-api-for-mobile-app-development-and-testing Testdroid provides a very powerful and useful API for its users to manage all aspects of mobile development and testing automatically. This powerful API caters your needs to instantly access our device farm, manage your projects, your test runs and results, plus many other things that will make your mobile app, game and web testing smoother, faster and less stressful on real Android and iOS devices. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

Continuous delivery mobile application development
Continuous delivery mobile application developmentContinuous delivery mobile application development
Continuous delivery mobile application development

This document discusses continuous delivery for mobile application development. It describes how a team previously spent 9 months developing a mobile app before releasing it live, with another 2 months spent fixing bugs. The document then outlines a continuous delivery process involving continuous integration, implementing a full production pipeline with testing at each stage, configuration management, and enabling push button releases. This approach aims to minimize lead time from idea to live release by keeping software always production ready and releasing tied to business needs rather than IT constraints.

mobile application developmentcontinuous deliveryhari b
Mobile DevOps - User Experience
Development
/IDE SCM
Build
Automated
Testing
Deploy
/ Release
“Production”
Automated builds
for every code
change
Built binaries
automatically tested
Tested applications,
Screenshots for various devices
and languages, certificates,
metadata ready to push to App stores
Deploy
To Devices
Test apps in
real world
(Synthetic)
Apps Used by Users
•  Synthetic Monitoring
•  Real User Monitoring
Beta Testing
(Humans)
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Exercising Mobile DevOps
Test
Deploy
Monitoring
SCM
Development
Build
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Continuous Integration
CONTINUOUS
INTEGRATION
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
The ‘Shift-Left’ – What People Think It Is
Shi>-Le>	TesAng	
(happens	earlier)	
TradiAonal	TesAng	
(happens	before	release)	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Implementing Test Automation in Agile Projects
Implementing Test Automation in Agile ProjectsImplementing Test Automation in Agile Projects
Implementing Test Automation in Agile Projects

All new features at eBay Europe are developed using SCRUM. One key success factor for those projects is to have a reliable end-to-end test automation safety net. This presentation illustrates how in addition to a robust automation toolset it is essential to have an integrated approach to test automation design: Test Aspects - Test Aspects are used to do the functional design of the end-to-end automation test cases. Since this is done upfront, the tester is able to focus on the what rather than the how. Modeling of the Biz Domain Layer - The Biz Domain Layer is an abstraction layer above the user interface that is implemented in the test code. This layer is divided into pages and flows which are then used in the tests. Test Implementation - Tests are written in Java, stored in SVN and are executed using the WebDriver Grid (Selenium2). Tests execution can be triggered by all team members via a continuous integration server (Hudson). Lean Test Automation – it is important to retain and maintain the quality of the tests. Key success factors for this are: Code Reviews, Software Craftsmanship, Test Aspect Reviews and the “Definition of Done”. Following an integrated approach to test automation ensures high efficiency, low overhead and easier maintenance.

ebaydutch testing conference 2012test automation
CI/CD for mobile at HERE
CI/CD for mobile at HERECI/CD for mobile at HERE
CI/CD for mobile at HERE

This talk describes how we use a scaled approach for CI/CD. The system is set up for iOS and Android Apps but many of the concepts presented are applicable for any type of application. We will cover the different pipeline stages a change goes through, how we automate many levels of testing, treat our CI infrastructure as code, which key metrics we use and we track them on dashboards. All this demonstrates how we can get close to Continuous Delivery for platforms still ruled by App stores.

mobiledevopscontinuous delivery
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing

Join analyst David Gehringer of Dimensional Research and Sauce Labs in a Webinar that covers their recent research into how QA and dev engineers choose to test across emulators and real devices. Also, we’ll show you a demo of the Sauce Labs Real Device Cloud and how you can implement best practices of testing on both emulators and real devices to optimize your time and money.

continuous deliverymobile cimobile
The ‘Shift-Horizontal’ Is The Way Forward
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Hardware & Software for
Efficient and Scalable
Mobile DevOps
•  Parallelism, and Lots of Real Mobile Devices (Plug-and-Play)
•  Mobile Test Automation Frameworks and Appropriate Use of Those
•  Easy to Adopt, Deploy and Use Admin Configurability
•  Use of Virtual Machines & Containers (Cloud, On-Premise)
•  Open API and Ability to Integrate with Any Tools
•  Efficient Use of Resources
Support all development stages:
Prototyping Development Testing Production Monitoring
What Enables Scalability?
Three Deployment Options for
Test Automation with Devices
Public	Cloud	 Private	Cloud	
On-Premise	
Reserved	&	
User-Specific	
Devices	
Shared	&	Publicly	
Available	Devices	
Hosted	by	Vendor	
Hosted	Locally	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Agile Testing at eBay
Agile Testing at eBayAgile Testing at eBay
Agile Testing at eBay

This document summarizes an agile testing presentation at eBay. It discusses how eBay uses agile testing practices like: 1. Designing automated tests with test aspects to provide clear test coverage and enable early testing. 2. Modeling the business domain layer to enable modular, reusable, and data-driven end-to-end tests. 3. Implementing tests using Selenium to test eBay's European websites, mobile apps, and desktop applications in parallel across multiple platforms and languages. It also emphasizes the importance of both automated and exploratory manual testing, speaking the same language as developers, and applying agile principles like continuous feedback to customers.

DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile UsersDevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users

In today’s mobile app economy, providing the best user experience is critical to building customer loyalty. We have one chance to provide a great user experience and deliver value. How can we ensure a great mobile app experience that elevates our offering above the thousands of other choices our customers have? Discover how DevOps for Mobile from CA Technologies provides your business analysts, developers, IT operations and support teams with accelerated speed-to-market, complete visibility and the insights needed to achieve user loyalty and maximize potential value to customers. For more information on DevOps solutions from CA Technologies, please visit: http://bit.ly/1wbjjqX

continuous deliveryapplication economycaworld14
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...

How to use Jenkins for Continuous Load Testing and Mobile Automation Today’s rapid development pace demands continuous testing, and Jenkins, the leading open source automation platform, has emerged as the hub of continuous delivery. SOASTA and CloudBees have tapped Jenkins to enable more test types and approaches that utilize cloud and agile processes for higher quality apps. Join this free webinar and learn: How to use Jenkins for continuous delivery and load testing of mobile applications How to incorporate cloud resources into your development and test environments Using the largest global test cloud for load generation CloudBees’ on premise, in the cloud and hybrid solutions for continuous delivery with Jenkins SOASTA’s Jenkins plugins for testing with real mobile devices and tracking performance baselines Experts from both companies will share stories and demonstrations that will help you implement a continuous approach to quality.

jenkinscontinuous integrationload testing
UNPRECEDENTED SCALE
By automating the creation, validation and deployment of the containers we
are able to deploy large number of identical device servers in matter of
minutes.
ALWAYS CLEAN EXECUTION ENVIRONMENT
New pristine container is started for each test session so that the environment
is always identical from one session to another.
FAST AND EASY TO UPDATE AND MAINTAIN
Any updates need to be made only to the scripts that create the container
images and the changes are orchestrated to all device servers
ALLOWS RUN TIME CUSTOMIZATION OF THE ENVIRONMENT
Because the tests are executed inside the container we can allow users to
customize the environment any way they like during the test session.
Why Containers
Host	
Container	1	
Container	2	
Container	3	
Container	n	
…	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Because the tests are executed inside the container we can allow
users to customize the environment any way they like during the
test session.
This is done by using the run.sh script that is used to launch the
the container session.
Any shell command or tool that is installed on the container can be
called from run.sh script. For instance you can build anything with
Maven:
mvn clean test –DexecutionType=serverside
or install some library or tool with Brew
brew install python
Customizing The Environment
Host	
Container	1	
Container	2	
Container	3	
Container	n	
…	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
#!/bin/bash
startAppium(){
if [ "$(uname)" == "Darwin" ]; then
startAppiumOSX
elif [ "$(expr substr $(uname -s) 1 5)" == "Linux" ]; then
startAppiumLinux
else
echo "Unknown OS system, exiting..."
exit 1
fi
}
executeTests(){
echo "Extracting tests.zip..."
unzip tests.zip
if [ "$(uname)" == "Darwin" ]; then
echo "Running iOS Tests..."
mvn clean test -Dtest=IosAppiumExampleTest -DexecutionType=serverside
elif [ "$(expr substr $(uname -s) 1 5)" == "Linux" ]; then
echo "Running Android Tests..."
mvn clean test -Dtest=AndroidAppiumExampleTest -DexecutionType=serverside
fi
echo "Finished Running Tests!"
cp target/surefire-reports/junitreports/TEST-*.xml TEST-all.xml
}
startAppium
executeTests
Example of run.sh Script
Host	
Container	1	
Container	2	
Container	3	
Container	n	
…	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Example: iOS Virtual Machine Components
1.3.6,	1.4.3,	1.4.13,	
1.4.16,	1.6.0,	1.6.3	
+	Appium_Helper:	
1.3.6,	1.4.3,	1.4.13	
	 0.20.4	
	
	
Test	AutomaAon	Frameworks	
Dependencies	and	‘Middleware’	
iTunes	
Programming	Languages	Core	Tools	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game Testing

Watch a live presentation at http://offer.bitbar.com/learn-the-best-practices-of-mobile-game-testing To get the best start for your mobile game - or just to improve the existing game's possibility to get in front of hundreds of millions of gamers - we'll be sharing our insights, best practices and lots of tips&tricks how to gain advantage in this race. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

mobile testingios testingtest automation
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team

Speaker: Karim Fanadka, HPE Software Session Slides: http://www.srijan.net/webinar/building-high-performance-qa-team/ Karim is a DevTest manager at HPE Software and his team is responsible for testing their new SaaS product, the StormRunner Load. In this webinar, Karim shares his experience of building a QA team that is agile, efficient, and uses the latest testing frameworks. He will also talk about continuous testing, automation, test based analytics and hotfixes. Karim start's off the challenges in agile QA and then moves on to solving these challenges. The best part is when he shares the trick to delivering to production every 1.5 months, even for a high pressure enterprise product. The Q/A session also brings out some very interesting topics, going into greater details and various suggestions that you can implement for your own QA teams.

test analyticsqateamhotfixes
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins

Slides from Silicon Valley Cloud Computing Group Meetup at Yahoo! Campus 09/30/12 Presented by Kohsuke Kawaguchi and Mark Prichard (CloudBees), with Matt Solnit (SOASTA)

jenkins cloudbees soasta paas continuous deploymen
Example: iOS Virtual Machine Components
1.3.6,	1.4.3,	1.4.13,	
1.4.16,	1.6.0,	1.6.3	
+	Appium_Helper:	
1.3.6,	1.4.3,	1.4.13	
	
WGET	
ideviceinstaller	
Ios-webkit-debug-proxy	
usbmuxd/iproxy	
0.20.4	
AddiAonal	
frameworks	
2.4.9	
8.x	/	7.x	
Settings & Config to VM
•  Disable software updates,
Disable screensaver, Disable
sleeping, Disable Spotlight
mds agent, Remove dock
items, Disable hibernation,
Remove sleepimage
•  Remove swap files, Zero out
free space, Shrink disk
•  Set up /etc/hosts, Remove old
Keychains, Import keychain
•  Create ~/Library/MobileDevice
directory, Create ~/Library/
MobileDevice/Provisioning
Profiles directory
•  Import mobileprovision
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Mobile Test Automation Frameworks
XCTEST/
XCUITEST
UIAUTOMATOR ESPRESSO APPIUM CALABASH
ANDROID No Yes Yes Yes Yes
IOS Yes No No Yes Yes
MOBILE WEB Yes Limited to x.y clicks No Yes No
LANGUAGE Obj-C/Swift Java Java Almost any Ruby
TOOL FOR TEST
CREATION
Xcode UIAutomator
viewer
Hierarchy
viewer
Appium.app CLI
(Human-Readable syntax)
COMMUNITY Apple Google Google Community Community
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
•  Easy to setup & easily extendable
•  Time-independent
•  Backward compatibility (supporting
various API levels)
•  A custom Instrumentation TestRunner
with special privileges
•  Works on any API levels
•  Thin layer on top of Android
Instrumentation Framework
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days

Watch a live presentation at http://offer.bitbar.com/ensure-your-mobile-channels-generate-revenue-on-holiday-peak-days Are you – and especially your mobile apps and web channels – ready to make the most of the upcoming holiday season? Being unplugged few minutes or mobile app not being able to deliver means instant loss in revenue. To succeed in this critical time of the year, ‘Sorry, not available’ is not an option for a second during that hectic 6 weeks. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

testdroidautomated app testingmobile channels
Mobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CDMobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CD

This document discusses Test Driven Development (TDD), Continuous Integration (CI), and Continuous Delivery (CD) for mobile development. It defines TDD, CI, and CD and provides examples of implementing each for both Android and iOS development. For TDD, it demonstrates writing tests first and then code to pass the tests. For CI, it recommends automating the build and test process. And for CD, it suggests using services like TestFlight to automatically deliver new builds to testers.

iosandroidbest practice
Getting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App TestingGetting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App Testing

Watch a live presentation at http://offer.bitbar.com/getting-started-with-xctest-and-xcuitest-for-ios-app-testing XCTest has been part of Xcode for few years already, but it is finally catching up and more developers are getting on the bandwagon. XCTest and XCUITest provide feature-rich capabilities for iOS developers and test automation folks to implement different levels of tests using Xcode features and supported programming languages, Objective-C and Swift. Stay tuned and join our upcoming webinars at http://bitbar.com/testing/webinars/

ios developmentmobile app testingxcuitest
•  Integral part of Xcode, works with both
real devices and simulator
•  XCTest allows developers to write tests
for components at any level
•  XCUITest provides rich UI testing
capabilities for apps
•  Objective-C / Swift
•  Nearly all frameworks (Appium, EarlGrey)
are working in conjuction with XCTest
•  Bitbar Testing products support XCTest +
XCUITest with all deployment options
XCTest /
XCUITest
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
•  Different Deployment Options
o  Hosted in various locations (data centers)
o  Co-location
o  On-premise
•  Infrastructure Support
o  Wireless carrier support
o  Rooted devices (optional)
o  Support for hardware add-ons (i.e. Bluetooth,
Wearables, etc)
•  Security (seriously!)
o  Isolated network
o  Dedicated hardware resources
o  VPN Support
o  OAuth/SSO
What Also Helps
Scaling Up?
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Private
Cloud /
Enterprise
Support
•  Network Test Support
o  Network Performance Optimization
o  Charles Proxy
o  Fiddler
•  Performance
o  Built-in CPU / Memory tracking
•  Graphics Benchmarking Integration
o  FPS, GPU utilization, battery usage, etc
•  Value-Added Services
o  API Implementations
o  On-demand scripting
o  Video recording
o  Custom reporting / formatting
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
iOS Device Cluster Server
Mac OS 1.9 or later, i5 or greater CPU, 4GB RAM
or 16GM Minimum for Parallel Device Runs,
256GB Hard Disk Minimum
Android Device Cluster Server
Ubuntu Linux 12.04, i5 or Greater CPU, 4GB RAM
Minimum, 500MB Hard Disk, 10 Port USB 3.0 Hub
or 1USB 3.0 Port per Device, Motherboard with
BIOS that supports turning off USB Power Saving.
Up to 10 Android devices per Machine.
Web Front End Server
Ubuntu Server 12.04 LTS 64-Bit (Virtual or
Physical), 4-Core CPU Minimum, 16GB of RAM
Minimum, 500GB Hard Disk Space, 1GBit
Ethernet Connectivity
Database Server
Ubuntu Server 12.04 LTS 64-Bit (Virtual or
Physical), 4-Core CPU Minimum, 8GB of RAM
Minimum, 2TB Minimum of Hard Disk, Storage in
RAID Array, 1GBit Ethernet Connectivity
Other Equipment To Consider
Server Racks, USB Cables, PDUs, WiFi Routers,
UPS
Hardware Infrastructure
n	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017

The document discusses open source testing tools for mobile applications. It begins by explaining that mobile testing requires automating both the application and the full user environment. It then reviews five popular open source test frameworks - Selenium, Appium, Calabash, Espresso, and XCTest UI - comparing their suitability for different uses like web, native, and hybrid apps. Key criteria that organizations should consider when choosing a framework include supporting multiple frameworks, flexibility, autonomy, full end-to-end coverage, and unattended reliable testing. The document concludes with a demonstration of a test automation tool called Quantum that integrates various open source frameworks.

blazemeterappiumselenium
Deploy your app with one Slack command
Deploy your app with one Slack commandDeploy your app with one Slack command
Deploy your app with one Slack command

See how I created a setup that allows developers to create and upload builds with one Slack command. I will introduce Fastlane and share how I created an advanced setup from starting from scratch.

rubydeveloper portalosx
Geekit -Testing Services
Geekit -Testing ServicesGeekit -Testing Services
Geekit -Testing Services

“All code is guilty, until proven innocent.”, that's why we're providing great testing services not only functional testing but also performance and security testing.

softwaretestingsecurity
Troubleshooting A Device Lab
•  Devices
o  So many things can go wrong …
•  Infrastructural Hardware
o  Device Control Hardware
•  ADB and Instruments/Tools
•  Hard Disks/Storage
•  RAM
o  USB
•  Hubs
•  Cables
•  Network
o  WiFi
o  Cellular
•  Software
o  Jenkins/CI
o  SCM
o  Test Automation Frameworks
80%	
The Most Typical Problems
10%	
5%	
5%	
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
The most typical problems
•  Device doesn’t show up
o  CI/On-Premise Solution/etc
•  Device doesn’t react
•  Device doesn’t start tests/run
•  Device is out of battery/battery level low
•  Device shows notifications
Troubleshooting Mobile Devices
Daily Check-Ups for Mobile Devices
In order to maintain device farm, environment and all
aspects of SW & HW, the following daily checks are
recommended:
•  Are devices powered up?
•  Are all devices WiFi connected?
•  Do all devices have an active USB connection?
•  Are battery levels at least 50% (for every
device)?
•  Are there any pop-ups, system notifications, or
other system dialogs open on device screen?
•  Are screens unlocked?
We recommend checking every device 3 times/day.
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Too Many Devices Connected /
Device Server
•  Too large device cluster
•  Maximum of ...
o  3 iOS devices per Mac Mini
o  10 Android devices per Linux server
•  Enough harddisk/storage for all servers
We recommend checking & cleaning
harddisks (with a shell script) every day.
Typical Mistakes (and How To Tackle)
Device Server Check-Ups
In addition to checking logs on server machines, it’s
highly recommended to check following things:
•  Diskspace on all machines (script)
•  Available RAM (script)
•  Do all devices have an active USB connection?
•  Available and consumption of CPU for peaks
•  Network conditions
We recommend automated scripts for checking
above-listed items every day.
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

Travis and fastlane
Travis and fastlaneTravis and fastlane
Travis and fastlane

The document discusses Travis CI, a continuous integration service that builds and tests code changes from GitHub repositories. It can automatically build iOS code, run tests, and deploy builds. Setup involves adding a .travis.yml file to enable builds on commits and pull requests. The document also provides examples of using Fastlane in the Travis CI configuration to automate tasks like running tests, generating reports, and deploying builds to TestFlight.

fastlanexcodeios
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...

What leaves visibility gaps and demands higher levels of time and expertise from IT professionals? Having different consoles for application code visibility vs. IT infrastructure management. The convergence of application and infrastructure monitoring offers significant opportunities to drive IT transformation using IT service management, DevOps and/or a combination of both. View these slides from our webinar, ‘Closing the Visibility Gap | How to Combine Application & Infrastructure Monitoring to Accelerate IT Transformation ‘, the first of a ‘shift-left’ series that will highlight how you can meet the emerging requirements across both the ITSM and DevOps lifecycles. In them John Worthington, Director of Product Marketing for eG Innovations, will help you discover how to: • Get a baseline of monitoring in an IT transformational context based on ITSM and DevOps • Find out how converged application and infrastructure visibility can help accelerate IT transformation efforts with ITSM, DevOps or both • Understand how monitoring can accelerate cultural change and accelerate IT value delivery to the business without flying blind

infrastructure monitoringdevopsitsm
Análisis lectura ¿qué es una constitución?
Análisis lectura   ¿qué es una constitución?Análisis lectura   ¿qué es una constitución?
Análisis lectura ¿qué es una constitución?

Análisis del libro ¿Qué es una constitución? de Ferdinand Lassalle Presentado al docente CARLOS ALBERTO MARTINEZ CABAL Facultad de Derecho - Universidad Santiago de Cali Por: JAIRO ASCENCIO GUEVARA

constitucionalderechoconstitución
Network Not Working Properly
•  Need to check if network is working
•  Network for ALL connected devices
•  Take WiFi down and up – try connection
with your browser
We recommend checking network connection
6-9 times every day.
Typical Mistakes (and How To Tackle)
Other Software Not Working Properly
Again, check all logs, that contain important
information about the system and health of the
environment:
•  Syslog (on all server machines)
•  Catalina out (on application server)
•  Jenkins logs (on device servers)
•  MySQL errors (and their logs)
We recommend checking these items every day.
In addition, it’s recommended to implement alarm
script to notify about any occurring problems.
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
PROBLEM: If none of the devices connected to one device server are running
tests (and you can’t initiate any manual session)
SOLUTION: Majority of issues seen with non-running tests are related to Jenkins
•  Check Jenkins log (https://hostname:8080/log/all)
•  Restart Jenkins – https://hostname:8080/safeRestart
•  Restart the device server
Troubleshooting - Mobile Devices
PROBLEM: Device is not running any tests.
SOLUTION: First, try if you can establish a manual test session with any of your
devices. If not, follow these steps:
•  Check that device is powered and visible on Jenkins
o  https://hostname:8080/android-devices or http://hostname:8080/ios-devices
•  Check that device is available in Bitbar On-Premise
o  https://cloudservername:9080/#service/admin/configuration
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
PROBLEM: Tests fail without running the test script successfully. Fail can happen
at init or any phase of the script execution.
SOLUTION: Find the exact error and follow these steps:
•  Retrying test run is a good idea to see if the error is random or reproducable
•  Check test run and device run views for logs and errors
•  Check console.log for the test run
•  Common failures: 1) app installation failed, 2) test zip structure is invalid, 3) Xcode didn’t start (iOS)
Troubleshooting - Mobile Devices
PROBLEM: None of devices are running any tests.
SOLUTION: Start with logs. In all cases, the logs contain information about errors,
wrong behavior and root cause of issues can be found in those. Start with these:
•  First check application server log (catalina.out)
•  Check available diskspace
•  Then restart Application server (sudo reboot now)
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Troubleshooting – Mobile Devices
©	Bitbar	Technologies	2017	–	h7p://bitbar.com

Recommended for you

A Research Study into DevOps Bottlenecks
A Research Study into DevOps BottlenecksA Research Study into DevOps Bottlenecks
A Research Study into DevOps Bottlenecks

We asked the Fortune 500 software delivery leaders what holds them back. This talk is the analysis of their insights on what bottlenecks they encountered in their DevOps journey.

devopsautomation
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTreeThe Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree

Fastlane is a tool that automates beta deployments and releases for iOS & Android apps. It generates screenshots, takes care of code signing, and uses simple commands. To install Fastlane, use Homebrew to install and then run fastlane init in your project directory. This will create a Fastfile and other files in a fastlane folder to configure build scripts. Typical Fastlane scripts contain lanes for different build processes, like incrementing build numbers, building with gym, uploading to Testflight with testflight, and uploading screenshots to iTunes Connect with deliver. These scripts can be run with commands like fastlane beta or fastlane appstore to streamline the deployment process compared to using Xcode alone.

devopsbuildstesting
Fastlane - Automation and Continuous Delivery for iOS Apps
Fastlane - Automation and Continuous Delivery for iOS AppsFastlane - Automation and Continuous Delivery for iOS Apps
Fastlane - Automation and Continuous Delivery for iOS Apps

Automation and Continuous Delivery for iOS Apps using Fastlane tools. This was presented at FAYA, Technopark, Trivandrum on 01-Jun-2016. Fastlane is a collection of utilities that work beautifully together without friction. It's now part of Fabric, Twitter's developer tools and development lead by Felix Krause (Twitter: @krausefx) and many other amazing developers. iOS developers typically spend several times managing provision files, certificates and so many mundane and boring stuffs they've to do with Apple Developer portal and tools. Fastlane tools can help you to right from creating a project to deploy your app to AppStore. Fastlane has an amazing ability to pass the result of data around each of the utilities in your pipeline. Also the actions helps you to customize and extend your fastlane utilities. Fastlane often come pre-installed with popular continuous integration servers like CricleCI. Utilities like match can help you a lot to manage your certificates and provision files by securely shari across computers. This works quite handy with with CI servers as well.

automationiosdevelopment
Test On Real Devices Automation -
Quickly and Efficiently
Use Existing Assets Now
and Future Tools
Platform Designed For
Agile Development
•  Test real world scenarios
on real, non-emulated
devices with 100%
certainty
•  See exactly what the user
experiences
•  Reduce time and
headache of device
acquisition and
management
The Key Things to Boost Mobile DevOps
•  Use any automation
framework or test
exercisers (e.g. Testdroid
App Crawler) to get instant
reports and results
•  Hit the ground running and
get actionable results on a
wide range of devices
•  Run more tests across
more devices in less time,
with fewer resources
•  Bring your own hardware,
tools and frameworks and
the Bitbar team will
integrate them into the
cloud
•  Bitbar solutions will not
lock you in to any tool or
automation framework
•  No vendor lock-in means
that you have a long term
and future proof platform
for all of your mobile
development and testing
needs
•  Bitbar integrates
seamlessly to your
development tools and CI
process
•  Instant results give
immediate feedback to the
development team
•  Faster iterations mean
more efficient
development, faster time
to market and more
satisfied users
©	Bitbar	Technologies	2017	–	h7p://bitbar.com
Demonstration
Summary – Q&A
More information about mobile app testing,
mobile monitoring and mobile devops at
bitbar.com

More Related Content

What's hot

Build a Large Scale In-House Test Lab for Mobile Apps
Build a Large Scale In-House Test Lab for Mobile AppsBuild a Large Scale In-House Test Lab for Mobile Apps
Build a Large Scale In-House Test Lab for Mobile Apps
Bitbar
 
Top 10 Automation Testing Tools in 2020
Top 10 Automation Testing Tools in 2020Top 10 Automation Testing Tools in 2020
Top 10 Automation Testing Tools in 2020
Alaina Carter
 
Appium vs Espresso and XCUI Test
Appium vs Espresso and XCUI TestAppium vs Espresso and XCUI Test
Appium vs Espresso and XCUI Test
Perfecto by Perforce
 
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Sauce Labs
 
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
SOASTA
 
How to Test Security and Vulnerability of Your Android and iOS Apps
How to Test Security and Vulnerability of Your Android and iOS AppsHow to Test Security and Vulnerability of Your Android and iOS Apps
How to Test Security and Vulnerability of Your Android and iOS Apps
Bitbar
 
Fight back android fragmentation
Fight back android fragmentationFight back android fragmentation
Fight back android fragmentation
Bitbar
 
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and Testing
Bitbar
 
Continuous delivery mobile application development
Continuous delivery mobile application developmentContinuous delivery mobile application development
Continuous delivery mobile application development
Thoughtworks
 
Implementing Test Automation in Agile Projects
Implementing Test Automation in Agile ProjectsImplementing Test Automation in Agile Projects
Implementing Test Automation in Agile Projects
Dominik Dary
 
CI/CD for mobile at HERE
CI/CD for mobile at HERECI/CD for mobile at HERE
CI/CD for mobile at HERE
Stefan Verhoeff
 
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing
Sauce Labs
 
Agile Testing at eBay
Agile Testing at eBayAgile Testing at eBay
Agile Testing at eBay
Dominik Dary
 
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile UsersDevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
CA Technologies
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
SOASTA
 
Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game Testing
Bitbar
 
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team
Srijan Technologies
 
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
CloudBees
 
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Bitbar
 
Mobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CDMobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CD
GlobalLogic Ukraine
 

What's hot (20)

Build a Large Scale In-House Test Lab for Mobile Apps
Build a Large Scale In-House Test Lab for Mobile AppsBuild a Large Scale In-House Test Lab for Mobile Apps
Build a Large Scale In-House Test Lab for Mobile Apps
 
Top 10 Automation Testing Tools in 2020
Top 10 Automation Testing Tools in 2020Top 10 Automation Testing Tools in 2020
Top 10 Automation Testing Tools in 2020
 
Appium vs Espresso and XCUI Test
Appium vs Espresso and XCUI TestAppium vs Espresso and XCUI Test
Appium vs Espresso and XCUI Test
 
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
 
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
Automated Testing and Continuous Integration for Mobile Apps: Jenkins & Cloud...
 
How to Test Security and Vulnerability of Your Android and iOS Apps
How to Test Security and Vulnerability of Your Android and iOS AppsHow to Test Security and Vulnerability of Your Android and iOS Apps
How to Test Security and Vulnerability of Your Android and iOS Apps
 
Fight back android fragmentation
Fight back android fragmentationFight back android fragmentation
Fight back android fragmentation
 
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and Testing
 
Continuous delivery mobile application development
Continuous delivery mobile application developmentContinuous delivery mobile application development
Continuous delivery mobile application development
 
Implementing Test Automation in Agile Projects
Implementing Test Automation in Agile ProjectsImplementing Test Automation in Agile Projects
Implementing Test Automation in Agile Projects
 
CI/CD for mobile at HERE
CI/CD for mobile at HERECI/CD for mobile at HERE
CI/CD for mobile at HERE
 
Real Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated TestingReal Devices or Emulators: Wen to use What for Automated Testing
Real Devices or Emulators: Wen to use What for Automated Testing
 
Agile Testing at eBay
Agile Testing at eBayAgile Testing at eBay
Agile Testing at eBay
 
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile UsersDevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
DevOps for Mobile: Delivering a 5-Star App Experience to Your Mobile Users
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
 
Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game Testing
 
[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team[Srijan Wednesday Webinars] Building a High Performance QA Team
[Srijan Wednesday Webinars] Building a High Performance QA Team
 
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
Automated Testing and Continuous Deployment for Mobile Apps with Jenkins
 
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
 
Mobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CDMobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CD
 

Viewers also liked

Getting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App TestingGetting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App Testing
Bitbar
 
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017
Perfecto Mobile
 
Deploy your app with one Slack command
Deploy your app with one Slack commandDeploy your app with one Slack command
Deploy your app with one Slack command
Fabio Milano
 
Geekit -Testing Services
Geekit -Testing ServicesGeekit -Testing Services
Travis and fastlane
Travis and fastlaneTravis and fastlane
Travis and fastlane
Steven Shen
 
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
John Williams
 
Análisis lectura ¿qué es una constitución?
Análisis lectura   ¿qué es una constitución?Análisis lectura   ¿qué es una constitución?
Análisis lectura ¿qué es una constitución?
Jairo Ascencio Guevara
 
A Research Study into DevOps Bottlenecks
A Research Study into DevOps BottlenecksA Research Study into DevOps Bottlenecks
A Research Study into DevOps Bottlenecks
Baruch Sadogursky
 
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTreeThe Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
RedBlackTree
 
Fastlane - Automation and Continuous Delivery for iOS Apps
Fastlane - Automation and Continuous Delivery for iOS AppsFastlane - Automation and Continuous Delivery for iOS Apps
Fastlane - Automation and Continuous Delivery for iOS Apps
Sarath C
 
Devops (start walking in the same direction) by ops
Devops (start walking in the same direction) by opsDevops (start walking in the same direction) by ops
Devops (start walking in the same direction) by ops
Demis Rizzotto
 
DevOps for the Mobile Enterprise: Test and Deploy
DevOps for the Mobile Enterprise: Test and DeployDevOps for the Mobile Enterprise: Test and Deploy
DevOps for the Mobile Enterprise: Test and Deploy
Rosalind Radcliffe
 
Practical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User MonitoringPractical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User Monitoring
Dynatrace
 
Best Practices In Exploratory Testing
Best Practices In Exploratory TestingBest Practices In Exploratory Testing
Best Practices In Exploratory Testing
99tests
 
Mobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsMobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue Solutions
RapidValue
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
SOASTA
 
Mobile App Testing
Mobile App TestingMobile App Testing
DevOps 101 - Moving Fast with Confidence
DevOps 101 - Moving Fast with ConfidenceDevOps 101 - Moving Fast with Confidence
DevOps 101 - Moving Fast with Confidence
New Relic
 
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid CloudTesting Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
Bitbar
 
DevOps at DreamLab
DevOps at DreamLabDevOps at DreamLab
DevOps at DreamLab
DreamLab
 

Viewers also liked (20)

Getting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App TestingGetting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App Testing
 
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017
 
Deploy your app with one Slack command
Deploy your app with one Slack commandDeploy your app with one Slack command
Deploy your app with one Slack command
 
Geekit -Testing Services
Geekit -Testing ServicesGeekit -Testing Services
Geekit -Testing Services
 
Travis and fastlane
Travis and fastlaneTravis and fastlane
Travis and fastlane
 
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
Closing the Visibility Gap | How to Combine Application & Infrastructure Moni...
 
Análisis lectura ¿qué es una constitución?
Análisis lectura   ¿qué es una constitución?Análisis lectura   ¿qué es una constitución?
Análisis lectura ¿qué es una constitución?
 
A Research Study into DevOps Bottlenecks
A Research Study into DevOps BottlenecksA Research Study into DevOps Bottlenecks
A Research Study into DevOps Bottlenecks
 
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTreeThe Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
The Mobile ToolChain with Fastlane - Code Red Talk at RedBlackTree
 
Fastlane - Automation and Continuous Delivery for iOS Apps
Fastlane - Automation and Continuous Delivery for iOS AppsFastlane - Automation and Continuous Delivery for iOS Apps
Fastlane - Automation and Continuous Delivery for iOS Apps
 
Devops (start walking in the same direction) by ops
Devops (start walking in the same direction) by opsDevops (start walking in the same direction) by ops
Devops (start walking in the same direction) by ops
 
DevOps for the Mobile Enterprise: Test and Deploy
DevOps for the Mobile Enterprise: Test and DeployDevOps for the Mobile Enterprise: Test and Deploy
DevOps for the Mobile Enterprise: Test and Deploy
 
Practical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User MonitoringPractical Tips for Ops: End User Monitoring
Practical Tips for Ops: End User Monitoring
 
Best Practices In Exploratory Testing
Best Practices In Exploratory TestingBest Practices In Exploratory Testing
Best Practices In Exploratory Testing
 
Mobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsMobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue Solutions
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
 
Mobile App Testing
Mobile App TestingMobile App Testing
Mobile App Testing
 
DevOps 101 - Moving Fast with Confidence
DevOps 101 - Moving Fast with ConfidenceDevOps 101 - Moving Fast with Confidence
DevOps 101 - Moving Fast with Confidence
 
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid CloudTesting Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
 
DevOps at DreamLab
DevOps at DreamLabDevOps at DreamLab
DevOps at DreamLab
 

Similar to Exercising and Scaling Up Mobile DevOps in the Enterprise

DevOps & DevEx
DevOps & DevExDevOps & DevEx
DevOps & DevEx
Ifunga Ndana
 
Dev ops using Jenkins
Dev ops using JenkinsDev ops using Jenkins
How Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivityHow Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivity
Ivan Porta
 
DevOps Pipeline for Liferay Application
DevOps Pipeline for Liferay ApplicationDevOps Pipeline for Liferay Application
DevOps Pipeline for Liferay Application
Maruti Gollapudi
 
DevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver FasterDevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver Faster
Amazon Web Services
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
Ulf Mattsson
 
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsDeployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
IBM UrbanCode Products
 
Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree
Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree	Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree
Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree
AnikeyRoy
 
JCON_15FactorWorkshop.pptx
JCON_15FactorWorkshop.pptxJCON_15FactorWorkshop.pptx
JCON_15FactorWorkshop.pptx
Grace Jansen
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
Amazon Web Services
 
Optimizing Test Coverage throughout the DevOps Pipeline
Optimizing Test Coverage throughout the DevOps PipelineOptimizing Test Coverage throughout the DevOps Pipeline
Optimizing Test Coverage throughout the DevOps Pipeline
Perfecto Mobile
 
Increase the Velocity of Your Software Releases Using GitHub and DeployHub
Increase the Velocity of Your Software Releases Using GitHub and DeployHubIncrease the Velocity of Your Software Releases Using GitHub and DeployHub
Increase the Velocity of Your Software Releases Using GitHub and DeployHub
DevOps.com
 
SRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver FasterSRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver Faster
Amazon Web Services
 
Agile Secure Cloud Application Development Management
Agile Secure Cloud Application Development ManagementAgile Secure Cloud Application Development Management
Agile Secure Cloud Application Development Management
Adam Getchell
 
Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...
Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...
Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...
Bitnami
 
How to Add Perfecto to Your CI
How to Add Perfecto to Your CIHow to Add Perfecto to Your CI
How to Add Perfecto to Your CI
Lizzy Guido (she/her)
 
Journey toward3rdplatform
Journey toward3rdplatformJourney toward3rdplatform
Journey toward3rdplatform
Tzung-Hsien (Shawn) Ho
 
Visual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximoVisual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximo
Daniel Semedo
 
Developer Tools at AWS 2018.pdf
Developer Tools at AWS 2018.pdfDeveloper Tools at AWS 2018.pdf
Developer Tools at AWS 2018.pdf
Amazon Web Services
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
Dynatrace
 

Similar to Exercising and Scaling Up Mobile DevOps in the Enterprise (20)

DevOps & DevEx
DevOps & DevExDevOps & DevEx
DevOps & DevEx
 
Dev ops using Jenkins
Dev ops using JenkinsDev ops using Jenkins
Dev ops using Jenkins
 
How Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivityHow Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivity
 
DevOps Pipeline for Liferay Application
DevOps Pipeline for Liferay ApplicationDevOps Pipeline for Liferay Application
DevOps Pipeline for Liferay Application
 
DevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver FasterDevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver Faster
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
 
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform EnvironmentsDeployment Automation for Hybrid Cloud and Multi-Platform Environments
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
 
Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree
Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree	Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree
Building an In-House DevOps Service Platform for Mobility Solutions | Mindtree
 
JCON_15FactorWorkshop.pptx
JCON_15FactorWorkshop.pptxJCON_15FactorWorkshop.pptx
JCON_15FactorWorkshop.pptx
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
 
Optimizing Test Coverage throughout the DevOps Pipeline
Optimizing Test Coverage throughout the DevOps PipelineOptimizing Test Coverage throughout the DevOps Pipeline
Optimizing Test Coverage throughout the DevOps Pipeline
 
Increase the Velocity of Your Software Releases Using GitHub and DeployHub
Increase the Velocity of Your Software Releases Using GitHub and DeployHubIncrease the Velocity of Your Software Releases Using GitHub and DeployHub
Increase the Velocity of Your Software Releases Using GitHub and DeployHub
 
SRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver FasterSRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver Faster
 
Agile Secure Cloud Application Development Management
Agile Secure Cloud Application Development ManagementAgile Secure Cloud Application Development Management
Agile Secure Cloud Application Development Management
 
Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...
Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...
Thinking One Step Further with Time-saving DevOps Tools with Open Telekom Clo...
 
How to Add Perfecto to Your CI
How to Add Perfecto to Your CIHow to Add Perfecto to Your CI
How to Add Perfecto to Your CI
 
Journey toward3rdplatform
Journey toward3rdplatformJourney toward3rdplatform
Journey toward3rdplatform
 
Visual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximoVisual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximo
 
Developer Tools at AWS 2018.pdf
Developer Tools at AWS 2018.pdfDeveloper Tools at AWS 2018.pdf
Developer Tools at AWS 2018.pdf
 
From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]From 0 to DevOps in 80 Days [Webinar Replay]
From 0 to DevOps in 80 Days [Webinar Replay]
 

More from Bitbar

The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
Bitbar
 
How to Reliably Measure and Optimize Graphics Performance of Your Android Games
How to Reliably Measure and Optimize Graphics Performance of Your Android GamesHow to Reliably Measure and Optimize Graphics Performance of Your Android Games
How to Reliably Measure and Optimize Graphics Performance of Your Android Games
Bitbar
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Bitbar
 
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
Bitbar
 
Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development Environment
Bitbar
 
The Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of ViewThe Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of View
Bitbar
 
Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?
Bitbar
 
Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation Investment
Bitbar
 
Android testing
Android testingAndroid testing
Android testing
Bitbar
 

More from Bitbar (9)

The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
 
How to Reliably Measure and Optimize Graphics Performance of Your Android Games
How to Reliably Measure and Optimize Graphics Performance of Your Android GamesHow to Reliably Measure and Optimize Graphics Performance of Your Android Games
How to Reliably Measure and Optimize Graphics Performance of Your Android Games
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
 
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
 
Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development Environment
 
The Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of ViewThe Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of View
 
Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?
 
Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation Investment
 
Android testing
Android testingAndroid testing
Android testing
 

Recently uploaded

The Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive ComputingThe Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive Computing
Larry Smarr
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
Aurora Consulting
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
BookNet Canada
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
Toru Tamaki
 
7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf
Enterprise Wired
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
Andrey Yasko
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
Stephanie Beckett
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Bert Blevins
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
BookNet Canada
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
Yevgen Sysoyev
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
KAMAL CHOUDHARY
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
Stephanie Beckett
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Bert Blevins
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
Mark Billinghurst
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
ishalveerrandhawa1
 
UiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs ConferenceUiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs Conference
UiPathCommunity
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 

Recently uploaded (20)

The Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive ComputingThe Rise of Supernetwork Data Intensive Computing
The Rise of Supernetwork Data Intensive Computing
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
 
7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
 
Calgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptxCalgary MuleSoft Meetup APM and IDP .pptx
Calgary MuleSoft Meetup APM and IDP .pptx
 
UiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs ConferenceUiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs Conference
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 

Exercising and Scaling Up Mobile DevOps in the Enterprise

  • 1. The Mobile DevOps Company Ville-Veikko Helppi Head of Demand Generation ville-veikko.helppi@bitbar.com Exercising and Scaling Up Mobile DevOps in the Enterprise WEBINAR
  • 2. Mobile DevOps •  The ‘Mobile DevOps’, Process and Tools •  Infrastructure & Architecture •  Tips & Tricks for Scaling Up •  Troubleshooting Device Lab •  Demo •  Summary – Q&A Agenda More information about Mobile DevOps can be found at bitbar.com © Bitbar Technologies 2017 – h7p://bitbar.com
  • 4. •  On-Demand Mobile Device Infrastructure •  Support Any Development & Testing Framework •  Automate, Automate, Automate – To Save Time, Money and Hassle •  Provide Unprecedented Scale and Throughput •  Allow For Creative Use (Open API, Customizable Integrations) •  Adopt Mobile Development Thought Leadership and Expertise Support all development stages: Prototyping Development Testing Production Monitoring Successful Adoption of Mobile DevOps
  • 5. •  Modern mobile app development is Agile, but infrastructure does not support Agility well •  DevOps practices are emerging in to the intersection of Development, QA and Operations •  DevOps practice emphasizes the collaboration and communication of both software developers and operations while automating the process of software delivery and infrastructure changes •  DevOps practice establishes a culture and environment where building, testing, and releasing software, can happen rapidly, frequently, and more reliably. Mobile DevOps and Agile Development QA Operations Dev Ops © Bitbar Technologies 2017 – h7p://bitbar.com
  • 6. SPEED WINS It’s a simple fact. The faster you can deliver new applications, features and upgrades to market, and collect feedback, the better your business performs. For that you need higher development pace. And a lot of automation. THERE IS A DEMAND FOR MOBILE DEVOPS DevOps practices and tools have revolutionized the pace and quality of service delivery – but only for traditional server-based apps. FRAGMENTATION WITH TOOLS In mobile the delivery pipelines are more complex – in terms of tools and used methods. Cohesive and well-integrated development tool flow derives from Mobile DevOps practices. MANUAL DOING IS NOT EFFECTIVE Every stage requires a lot of manual work and silo’ed solutions from various vendors and/or open source tools. Why Mobile DevOps © Bitbar Technologies 2017 – h7p://bitbar.com
  • 7. Delivery Pipeline for Mobile Apps Development Source Code Management SCM Build Test Deploy Production Dev Tools: •  IDEs •  JIRA •  Slack •  etc. SCM: •  Git/GitHub/ GitLab •  Bitbucket •  MSFT •  etc. Continuous Integration and Build Automated Testing Automation for app store deployment, beta testers & enterprise app stores Production Monitoring and feedback to Dev © Bitbar Technologies 2017 – h7p://bitbar.com
  • 8. Delivery Pipeline with Mobile DevOps Development Source Code Management SCM Build Test Deploy Production Dev Tools: •  IDEs •  JIRA •  Slack •  etc. SCM: •  Git/GitHub/ GitLab •  Bitbucket •  MSFT •  etc. Continuous Integration and Build Automated Testing Automation for app store deployment, beta testers & enterprise app stores Production Monitoring and feedback to Dev The Scope of Mobile DevOps © Bitbar Technologies 2017 – h7p://bitbar.com
  • 9. Mobile DevOps - User Experience Development /IDE SCM Build Automated Testing Deploy / Release “Production” Automated builds for every code change Built binaries automatically tested Tested applications, Screenshots for various devices and languages, certificates, metadata ready to push to App stores Deploy To Devices Test apps in real world (Synthetic) Apps Used by Users •  Synthetic Monitoring •  Real User Monitoring Beta Testing (Humans) © Bitbar Technologies 2017 – h7p://bitbar.com
  • 12. The ‘Shift-Left’ – What People Think It Is Shi>-Le> TesAng (happens earlier) TradiAonal TesAng (happens before release) © Bitbar Technologies 2017 – h7p://bitbar.com
  • 13. The ‘Shift-Horizontal’ Is The Way Forward © Bitbar Technologies 2017 – h7p://bitbar.com
  • 14. Hardware & Software for Efficient and Scalable Mobile DevOps
  • 15. •  Parallelism, and Lots of Real Mobile Devices (Plug-and-Play) •  Mobile Test Automation Frameworks and Appropriate Use of Those •  Easy to Adopt, Deploy and Use Admin Configurability •  Use of Virtual Machines & Containers (Cloud, On-Premise) •  Open API and Ability to Integrate with Any Tools •  Efficient Use of Resources Support all development stages: Prototyping Development Testing Production Monitoring What Enables Scalability?
  • 16. Three Deployment Options for Test Automation with Devices Public Cloud Private Cloud On-Premise Reserved & User-Specific Devices Shared & Publicly Available Devices Hosted by Vendor Hosted Locally © Bitbar Technologies 2017 – h7p://bitbar.com
  • 17. UNPRECEDENTED SCALE By automating the creation, validation and deployment of the containers we are able to deploy large number of identical device servers in matter of minutes. ALWAYS CLEAN EXECUTION ENVIRONMENT New pristine container is started for each test session so that the environment is always identical from one session to another. FAST AND EASY TO UPDATE AND MAINTAIN Any updates need to be made only to the scripts that create the container images and the changes are orchestrated to all device servers ALLOWS RUN TIME CUSTOMIZATION OF THE ENVIRONMENT Because the tests are executed inside the container we can allow users to customize the environment any way they like during the test session. Why Containers Host Container 1 Container 2 Container 3 Container n … © Bitbar Technologies 2017 – h7p://bitbar.com
  • 18. Because the tests are executed inside the container we can allow users to customize the environment any way they like during the test session. This is done by using the run.sh script that is used to launch the the container session. Any shell command or tool that is installed on the container can be called from run.sh script. For instance you can build anything with Maven: mvn clean test –DexecutionType=serverside or install some library or tool with Brew brew install python Customizing The Environment Host Container 1 Container 2 Container 3 Container n … © Bitbar Technologies 2017 – h7p://bitbar.com
  • 19. #!/bin/bash startAppium(){ if [ "$(uname)" == "Darwin" ]; then startAppiumOSX elif [ "$(expr substr $(uname -s) 1 5)" == "Linux" ]; then startAppiumLinux else echo "Unknown OS system, exiting..." exit 1 fi } executeTests(){ echo "Extracting tests.zip..." unzip tests.zip if [ "$(uname)" == "Darwin" ]; then echo "Running iOS Tests..." mvn clean test -Dtest=IosAppiumExampleTest -DexecutionType=serverside elif [ "$(expr substr $(uname -s) 1 5)" == "Linux" ]; then echo "Running Android Tests..." mvn clean test -Dtest=AndroidAppiumExampleTest -DexecutionType=serverside fi echo "Finished Running Tests!" cp target/surefire-reports/junitreports/TEST-*.xml TEST-all.xml } startAppium executeTests Example of run.sh Script Host Container 1 Container 2 Container 3 Container n … © Bitbar Technologies 2017 – h7p://bitbar.com
  • 20. Example: iOS Virtual Machine Components 1.3.6, 1.4.3, 1.4.13, 1.4.16, 1.6.0, 1.6.3 + Appium_Helper: 1.3.6, 1.4.3, 1.4.13 0.20.4 Test AutomaAon Frameworks Dependencies and ‘Middleware’ iTunes Programming Languages Core Tools © Bitbar Technologies 2017 – h7p://bitbar.com
  • 21. Example: iOS Virtual Machine Components 1.3.6, 1.4.3, 1.4.13, 1.4.16, 1.6.0, 1.6.3 + Appium_Helper: 1.3.6, 1.4.3, 1.4.13 WGET ideviceinstaller Ios-webkit-debug-proxy usbmuxd/iproxy 0.20.4 AddiAonal frameworks 2.4.9 8.x / 7.x Settings & Config to VM •  Disable software updates, Disable screensaver, Disable sleeping, Disable Spotlight mds agent, Remove dock items, Disable hibernation, Remove sleepimage •  Remove swap files, Zero out free space, Shrink disk •  Set up /etc/hosts, Remove old Keychains, Import keychain •  Create ~/Library/MobileDevice directory, Create ~/Library/ MobileDevice/Provisioning Profiles directory •  Import mobileprovision © Bitbar Technologies 2017 – h7p://bitbar.com
  • 22. Mobile Test Automation Frameworks XCTEST/ XCUITEST UIAUTOMATOR ESPRESSO APPIUM CALABASH ANDROID No Yes Yes Yes Yes IOS Yes No No Yes Yes MOBILE WEB Yes Limited to x.y clicks No Yes No LANGUAGE Obj-C/Swift Java Java Almost any Ruby TOOL FOR TEST CREATION Xcode UIAutomator viewer Hierarchy viewer Appium.app CLI (Human-Readable syntax) COMMUNITY Apple Google Google Community Community © Bitbar Technologies 2017 – h7p://bitbar.com
  • 24. •  Easy to setup & easily extendable •  Time-independent •  Backward compatibility (supporting various API levels) •  A custom Instrumentation TestRunner with special privileges •  Works on any API levels •  Thin layer on top of Android Instrumentation Framework © Bitbar Technologies 2017 – h7p://bitbar.com
  • 25. •  Integral part of Xcode, works with both real devices and simulator •  XCTest allows developers to write tests for components at any level •  XCUITest provides rich UI testing capabilities for apps •  Objective-C / Swift •  Nearly all frameworks (Appium, EarlGrey) are working in conjuction with XCTest •  Bitbar Testing products support XCTest + XCUITest with all deployment options XCTest / XCUITest © Bitbar Technologies 2017 – h7p://bitbar.com
  • 26. •  Different Deployment Options o  Hosted in various locations (data centers) o  Co-location o  On-premise •  Infrastructure Support o  Wireless carrier support o  Rooted devices (optional) o  Support for hardware add-ons (i.e. Bluetooth, Wearables, etc) •  Security (seriously!) o  Isolated network o  Dedicated hardware resources o  VPN Support o  OAuth/SSO What Also Helps Scaling Up? © Bitbar Technologies 2017 – h7p://bitbar.com
  • 27. Private Cloud / Enterprise Support •  Network Test Support o  Network Performance Optimization o  Charles Proxy o  Fiddler •  Performance o  Built-in CPU / Memory tracking •  Graphics Benchmarking Integration o  FPS, GPU utilization, battery usage, etc •  Value-Added Services o  API Implementations o  On-demand scripting o  Video recording o  Custom reporting / formatting © Bitbar Technologies 2017 – h7p://bitbar.com
  • 28. iOS Device Cluster Server Mac OS 1.9 or later, i5 or greater CPU, 4GB RAM or 16GM Minimum for Parallel Device Runs, 256GB Hard Disk Minimum Android Device Cluster Server Ubuntu Linux 12.04, i5 or Greater CPU, 4GB RAM Minimum, 500MB Hard Disk, 10 Port USB 3.0 Hub or 1USB 3.0 Port per Device, Motherboard with BIOS that supports turning off USB Power Saving. Up to 10 Android devices per Machine. Web Front End Server Ubuntu Server 12.04 LTS 64-Bit (Virtual or Physical), 4-Core CPU Minimum, 16GB of RAM Minimum, 500GB Hard Disk Space, 1GBit Ethernet Connectivity Database Server Ubuntu Server 12.04 LTS 64-Bit (Virtual or Physical), 4-Core CPU Minimum, 8GB of RAM Minimum, 2TB Minimum of Hard Disk, Storage in RAID Array, 1GBit Ethernet Connectivity Other Equipment To Consider Server Racks, USB Cables, PDUs, WiFi Routers, UPS Hardware Infrastructure n © Bitbar Technologies 2017 – h7p://bitbar.com
  • 30. •  Devices o  So many things can go wrong … •  Infrastructural Hardware o  Device Control Hardware •  ADB and Instruments/Tools •  Hard Disks/Storage •  RAM o  USB •  Hubs •  Cables •  Network o  WiFi o  Cellular •  Software o  Jenkins/CI o  SCM o  Test Automation Frameworks 80% The Most Typical Problems 10% 5% 5% © Bitbar Technologies 2017 – h7p://bitbar.com
  • 31. The most typical problems •  Device doesn’t show up o  CI/On-Premise Solution/etc •  Device doesn’t react •  Device doesn’t start tests/run •  Device is out of battery/battery level low •  Device shows notifications Troubleshooting Mobile Devices Daily Check-Ups for Mobile Devices In order to maintain device farm, environment and all aspects of SW & HW, the following daily checks are recommended: •  Are devices powered up? •  Are all devices WiFi connected? •  Do all devices have an active USB connection? •  Are battery levels at least 50% (for every device)? •  Are there any pop-ups, system notifications, or other system dialogs open on device screen? •  Are screens unlocked? We recommend checking every device 3 times/day. © Bitbar Technologies 2017 – h7p://bitbar.com
  • 32. Too Many Devices Connected / Device Server •  Too large device cluster •  Maximum of ... o  3 iOS devices per Mac Mini o  10 Android devices per Linux server •  Enough harddisk/storage for all servers We recommend checking & cleaning harddisks (with a shell script) every day. Typical Mistakes (and How To Tackle) Device Server Check-Ups In addition to checking logs on server machines, it’s highly recommended to check following things: •  Diskspace on all machines (script) •  Available RAM (script) •  Do all devices have an active USB connection? •  Available and consumption of CPU for peaks •  Network conditions We recommend automated scripts for checking above-listed items every day. © Bitbar Technologies 2017 – h7p://bitbar.com
  • 33. Network Not Working Properly •  Need to check if network is working •  Network for ALL connected devices •  Take WiFi down and up – try connection with your browser We recommend checking network connection 6-9 times every day. Typical Mistakes (and How To Tackle) Other Software Not Working Properly Again, check all logs, that contain important information about the system and health of the environment: •  Syslog (on all server machines) •  Catalina out (on application server) •  Jenkins logs (on device servers) •  MySQL errors (and their logs) We recommend checking these items every day. In addition, it’s recommended to implement alarm script to notify about any occurring problems. © Bitbar Technologies 2017 – h7p://bitbar.com
  • 34. PROBLEM: If none of the devices connected to one device server are running tests (and you can’t initiate any manual session) SOLUTION: Majority of issues seen with non-running tests are related to Jenkins •  Check Jenkins log (https://hostname:8080/log/all) •  Restart Jenkins – https://hostname:8080/safeRestart •  Restart the device server Troubleshooting - Mobile Devices PROBLEM: Device is not running any tests. SOLUTION: First, try if you can establish a manual test session with any of your devices. If not, follow these steps: •  Check that device is powered and visible on Jenkins o  https://hostname:8080/android-devices or http://hostname:8080/ios-devices •  Check that device is available in Bitbar On-Premise o  https://cloudservername:9080/#service/admin/configuration © Bitbar Technologies 2017 – h7p://bitbar.com
  • 35. PROBLEM: Tests fail without running the test script successfully. Fail can happen at init or any phase of the script execution. SOLUTION: Find the exact error and follow these steps: •  Retrying test run is a good idea to see if the error is random or reproducable •  Check test run and device run views for logs and errors •  Check console.log for the test run •  Common failures: 1) app installation failed, 2) test zip structure is invalid, 3) Xcode didn’t start (iOS) Troubleshooting - Mobile Devices PROBLEM: None of devices are running any tests. SOLUTION: Start with logs. In all cases, the logs contain information about errors, wrong behavior and root cause of issues can be found in those. Start with these: •  First check application server log (catalina.out) •  Check available diskspace •  Then restart Application server (sudo reboot now) © Bitbar Technologies 2017 – h7p://bitbar.com
  • 36. Troubleshooting – Mobile Devices © Bitbar Technologies 2017 – h7p://bitbar.com
  • 37. Test On Real Devices Automation - Quickly and Efficiently Use Existing Assets Now and Future Tools Platform Designed For Agile Development •  Test real world scenarios on real, non-emulated devices with 100% certainty •  See exactly what the user experiences •  Reduce time and headache of device acquisition and management The Key Things to Boost Mobile DevOps •  Use any automation framework or test exercisers (e.g. Testdroid App Crawler) to get instant reports and results •  Hit the ground running and get actionable results on a wide range of devices •  Run more tests across more devices in less time, with fewer resources •  Bring your own hardware, tools and frameworks and the Bitbar team will integrate them into the cloud •  Bitbar solutions will not lock you in to any tool or automation framework •  No vendor lock-in means that you have a long term and future proof platform for all of your mobile development and testing needs •  Bitbar integrates seamlessly to your development tools and CI process •  Instant results give immediate feedback to the development team •  Faster iterations mean more efficient development, faster time to market and more satisfied users © Bitbar Technologies 2017 – h7p://bitbar.com
  • 39. Summary – Q&A More information about mobile app testing, mobile monitoring and mobile devops at bitbar.com