SlideShare a Scribd company logo
Performance Testing Cloud
Deployments
Shreyas & Manish
vodQA, Pune 16th March 2019
Shreyas Chaudhari
Quality Analyst at ThoughtWorks, Inc
About Me
Manish Hemnani
About Me
Quality Analyst at ThoughtWorks, Inc
4
Agenda
● Why Performance Testing
● Challenges
● Testing - Cloud Vs On-Premise
● Why AWS?
● Elastic Load Balancing [ELB]
● Auto Scaling
● Case Study - Architecture, Test Strategy
● AWS Console
● CloudWatch
● New Relic
5
Why Performance Testing?
Money
Customer
Reputation
6
Solution to Performance Issues
7
Patterns
8
Fluctuations - Different times of day
9
Fluctuations - Different days of year
10
Scaling for future
11
Diverse Geographies
Source :
https://www.researchgate.net/profile/Luca_Rossi8/publication/263811778/figure/fig1/AS:296493362
761730@1447700934536/Distribution-of-GitHub-users-in-the-world-For-each-user-a-partially-trans
parent-point.png
12
Cloud Vs On-Premise
13
Pros & Cons
Source :
https://www.cms-connected.com/getattachment/News-Archive/November-2017/Cloud-Digital-Asset-Man
agement/Cloud-Vs-On-Premises.jpg
14
CPU Utilization
15
Why AWS?
16
Public Cloud Adoption
Source : https://www.datamation.com/imagesvr_ce/7252/aws-azure-google.png
17
Gartner Quadrant
Source :
https://www.gartner.com/resources/336100/336148/336148_0001.png?reprintKey=1-2G2O5FC
18
Elastic Load Balancing [ELB]
19
Cross Zone Load Balancing - Enabled
https://docs.aws.amazon.com/elasticloadbalancing/latest/userguide/images/cross_zone_load_balancing_enabled.png
20
Cross Zone Load Balancing - Disabled
https://docs.aws.amazon.com/elasticloadbalancing/latest/userguide/images/cross_zone_load_balancing_disabled.png
21
Auto Scaling
22
What is Auto Scaling?
https://docs.aws.amazon.com/autoscaling/ec2/userguide/images/as-basic-diagram.png
23
Auto Scaling Options
Maintain current instance
levels all the time
Manual scaling
Scaling based on a schedule Scale based on demand
24
Availability
25
Global Infrastructure
Source :
https://d1.awsstatic.com/what-is-aws/2019%20Infra%20Map%20-%20PDX.7f48f37bcd0d5df0b757eb
26
Performance Testing - Case Study
27
Product Architecture
28
Test Environment Configuration
Component Instance Type Number of Instances
Scooper t2.medium 1
EventStore t2.large 3
Subscriber(s) t2.medium 1
Elastic Search m4.4xlarge.elasticsearch Master : 3 Data : 4
MongoDB t3.large 3
Service(s) t3.xlarge 3
Web t3.medium 3
Instance Types : https://aws.amazon.com/ec2/instance-types/
29
Testing Types
Load Stress
Spike Endurance
Page Load
30
Goal
99th percentile Page load time of the
application for the end user from
different geographies should be 2
seconds or less.
‘N’ Concurrent users should be able to
use the application
31
Test Strategy - Prerequisites
Perform Writes on Elastic
Search and MongoDB using
Data Migration Scripts
Perform Read on Elastic
Search and MongoDB using
Apis
32
Tools
33
Endurance Test Result
34
AWS Console - Parameters
35
AWS ElasticSearch Service
36
AWS ElasticSearch Service
37
AWS ElasticSearch Service
38
MongoDB & Public Apis
39
Application Monitoring
40
CloudWatch
Source : https://eu-west-2.console.aws.amazon.com/cloudwatch/home?region=eu-west-2
41
New Relic
Source : https://rpm.newrelic.com/accounts/1570350/applications/192890835
42
New Relic
Source : https://rpm.newrelic.com/accounts/1570350/applications/192890835/transactions
43
New Relic
Source : https://insights.newrelic.com/accounts/1570350/dashboards/845142
THANK YOU
For questions or suggestions mailto:
shreyasc@thoughtworks.com
hmanish@thoughtworks.com

More Related Content

Performance Testing : Cloud Deployments