SlideShare a Scribd company logo
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Matt Walburn
AWS Professional Services
ENT 206
Product Development in the Cloud
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Motivators?
Hitting roadblocks trying
to drive change
Best practices
review
Development practices
need a refresh
Reduce cost of failure and
experimentation
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Modern product development toolkit
Achieving organizational flow
How the cloud is changing product development
What we’ll cover:
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Methods and principles of
modern product development
DevOps
Interface for getting things
built and released
Agile teaming
The organizational glue that
keeps release cycle moving
continuously
Design thinking
Interface to customer and
feedback loop
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Design thinking is just …
User-centered
design
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. First, gain empathy
2. Then, frame the problems
3. Now you can ideate
4. Run simple, fast, frugal tests
Bring the outside in
Pinpoint the pain points
Radical ideas, real impact
Build to learn
Practical principles: Design thinking
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SCRUM
Continuously groomed backlog
No changes to work plan made during sprint
Product increment: must be completed, integrated, and tested
Agile teaming
Focus: Respond quickly to feedback
Agile principle
Learning over
following a plan
Each Agile framework has a way of bringing feedback into its workstream
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KANBAN
Finish task, and pull forward next work item
Uses work-in-progress (WIP) limits and cycle-time to manage flow of
new development
Adapted from Toyota production system
Agile teaming
Focus: Respond quickly to feedback
Agile principle
Learning over
following a plan
Each Agile framework has a way of bringing feedback into its workstream
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
XP – Extreme programming
Emphasizes technical excellence as a way to remain agile
Pair programming and code reviews are common methods
Frequent checkpoints − allows for constant feedback on customer
requirements
Agile teaming
Focus: Respond quickly to feedback
Agile principle
Learning over
following a plan
Each Agile framework has a way of bringing feedback into its workstream
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Practical principles: Agile
1. Rip the Band-Aid off, but have mercy
2. Keep it real … and small
3. Show something every sprint
4. Trap: Agile by the book
Use release maps
Two-pizza team model
Power of the demo
Find your agile center
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
All of these reduce cycle time and allow builders to focus on
product, quickly deploying and collecting feedback
DevOps
Focus: Promote and enable fast feedback
DevOps principles
Automate all things
Eliminate handoffs
Establish guardrails
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DevOpsAgile teamingDesign thinking
Putting the pieces together:
Finding organizational flow
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start with value hypothesis and growth hypothesis
Run small experiments to see if there is both value and demand
Bias toward many small tests vs. larger, extended ones
Persevere or pivot early based on results
MVP
Minimum Viable Product (MVP): What is the smallest thing you can
test to prove the unproven parts of your idea?
“One accurate measurement is worth more than a thousand expert opinions.”
− Admiral Grace Hopper
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Product
Continuous development
Customer defines roadmap
Measured by output and
outcomes
Project, product, or business KPI?
Methods to manage your product / technology portfolio
Project
Predefined requirements
scope and schedule
Deliver what was planned
Measured by output
Business objective
Maximize a strategic KPI
Types of KPIs: Minimize
waste, increase conversion
Measured by outcomes
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Project, product, or business KPI?
Project team Product team Objective team
Scope Defined set of
requirements
Ongoing creation /
enhancement of product
Business objective
Success Milestone adherence User satisfaction,
marketing objectives
KPI
Timeframe Defined beginning and
end
Ongoing Continuous evaluation
of business case
Involvement Implement requirements Gather, implement
feedback
Test, measure, repeat
Tools Gantt Chart Roadmap Impact map /
dashboards
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Typical release testing
Most tests
occur late
in process
Concept Dev Deployment
Functional
Acceptance
Performance
Security /
Compliance
Production
Monitor
Respond to
defects / incidents
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous testing
Always
be
testing
Concept
Hypothesis
A / B
MVP
Development
Functional
Acceptance
Performance
Security and compliance
Deployment
Functional
Acceptance
Performance
Security and compliance
Canary
Production
Prod testing
Chaos engineering
User testing feedback
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How Amazon achieves flow
Working backward
From the customer
Two-pizza teams
Run what you build
Microservices
Speed and agility
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Write the press release: Think big and focus on the
customer need
Write the FAQ: Customer and internal stakeholder
Define the user interaction and write the manual
Working backward
from the customer
PR
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“Most companies write the software,
they get it all working, and then they
throw it over the wall to the marketing
department, saying, ‘Here is what we
built, go write the press release.’ That
process is the one that’s actually
backwards.”
Jeffrey P. Bezos
Founder and Chief Executive Officer
Amazon.com, Inc.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon achieves speed and agility with two-pizza teams
Small, decentralized
teams are nimble
Own and run
what you
build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Developers Monolithic application Delivery pipeline
Build Test Release
Monoliths: Slow and rigid
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservices: Speed and agility
Developers Microservices Delivery pipelines
Build Test Release
Build Test Release
Build Test Release
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Microservices principles
Single purpose
API based
Highly decoupled
http://
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Quickly scaling
winning ideas
Rapid adoption of
new capabilities
Reducing cost
of failure
Impact of cloud on
product development
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud enables quick testing of unproven concepts
Quick time to market (TTM): 8 weeks from conception to production
Continuous scale: Seamlessly ramps up to peak traffic of 22 K
concurrent requests
Event-driven architecture maximizes resource efficiency
Reducing time to market for new ideas
Agero created the MileUp app and used crash prediction models to speed up
emergency response
Reducing cost of
experimentation
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud reduces undifferentiated infrastructure focus
Productivity: Allowed developers to focus more on runtime
functionality and less on infrastructure management
Cleaner separation of logging, metrics, and security infrastructure
from application code base
Cost: Spot Instances and containers cut Amazon EC2 costs in half
Devote more resources to customer value
Mapbox adds location services to any application with mapping, navigation,
and location search SDKs
Reducing cost of
new development
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition use case: Automated footage tagging
API access to advanced service capabilities
Built in 3 weeks
Index against 99,000 people
Saving 9,000 hours a year in labor
Cloud-native architectures
Accelerates adoption and innovation of new capabilities
Rapid adoption of new
capabilities
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
App container failure
prediction • Indicates which containers should
be removed before failure
• App and system logs used to train
model
• Developed by cloud team with no
ML / DL experience
Bad state predictor model
Outcomes:
*Improved user experience
*95% reduction in on-call
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Enterprises are achieving massive scale with cloud-
native architectures
Processes 4,000 requests
per second
Processes half a trillion
validations of stock
trades daily
Reduced the time to
ingest and process data
for its analytics pipeline
by 97%
Can handle spikes
of 80x normal traffic
Triggers 1.2 billion
AWS Lambda requests
each month
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Develop new ideas without limits
Natural language processing on 1.1 million concurrent vCPUs using
Amazon EC2 Spot Instances
1.2M
200K
06:38 21:40
Concurrent vCPUs in US-East (Northern Virginia)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud enables the massive scaling of big ideas
Immediate access to programmable hardware acceleration using
FPGAs at cloud scale
Utilized AWS Batch to provision and orchestrate compute jobs across
1,000 Amazon EC2 F1 instances
Compute infrastructure cost to analyze genome reduced to
staggeringly low ~$3 per whole human genome
Quickly scaling
winning ideas
FPGA world-record genome analysis
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless enables quick and agile product development
>95% decrease in overall deployment and operational costs
Scales up or down for variation in customer request volume
Migrating tasks to AWS Lambda took only a few weeks
Achieving massive scale, not massive cost
AWS Lambda serverless architecture enables the FICO Decision Management
Suite (DMS) to perform computations on machine learning models quickly,
cheaply, and efficiently
Quickly scaling
winning ideas
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Please complete the session survey in the summit mobile
app.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Submit Session Feedback
1. Tap the Schedule icon. 2. Select the session you
attended.
3. Tap Session Evaluation to
submit your feedback.

More Related Content

Product Development in the Cloud - ENT206 - Chicago AWS Summit

  • 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Matt Walburn AWS Professional Services ENT 206 Product Development in the Cloud
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Motivators? Hitting roadblocks trying to drive change Best practices review Development practices need a refresh Reduce cost of failure and experimentation
  • 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Modern product development toolkit Achieving organizational flow How the cloud is changing product development What we’ll cover:
  • 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Methods and principles of modern product development DevOps Interface for getting things built and released Agile teaming The organizational glue that keeps release cycle moving continuously Design thinking Interface to customer and feedback loop
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Design thinking is just … User-centered design
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 1. First, gain empathy 2. Then, frame the problems 3. Now you can ideate 4. Run simple, fast, frugal tests Bring the outside in Pinpoint the pain points Radical ideas, real impact Build to learn Practical principles: Design thinking
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SCRUM Continuously groomed backlog No changes to work plan made during sprint Product increment: must be completed, integrated, and tested Agile teaming Focus: Respond quickly to feedback Agile principle Learning over following a plan Each Agile framework has a way of bringing feedback into its workstream
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. KANBAN Finish task, and pull forward next work item Uses work-in-progress (WIP) limits and cycle-time to manage flow of new development Adapted from Toyota production system Agile teaming Focus: Respond quickly to feedback Agile principle Learning over following a plan Each Agile framework has a way of bringing feedback into its workstream
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. XP – Extreme programming Emphasizes technical excellence as a way to remain agile Pair programming and code reviews are common methods Frequent checkpoints − allows for constant feedback on customer requirements Agile teaming Focus: Respond quickly to feedback Agile principle Learning over following a plan Each Agile framework has a way of bringing feedback into its workstream
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Practical principles: Agile 1. Rip the Band-Aid off, but have mercy 2. Keep it real … and small 3. Show something every sprint 4. Trap: Agile by the book Use release maps Two-pizza team model Power of the demo Find your agile center
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. All of these reduce cycle time and allow builders to focus on product, quickly deploying and collecting feedback DevOps Focus: Promote and enable fast feedback DevOps principles Automate all things Eliminate handoffs Establish guardrails
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. DevOpsAgile teamingDesign thinking Putting the pieces together: Finding organizational flow
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Start with value hypothesis and growth hypothesis Run small experiments to see if there is both value and demand Bias toward many small tests vs. larger, extended ones Persevere or pivot early based on results MVP Minimum Viable Product (MVP): What is the smallest thing you can test to prove the unproven parts of your idea? “One accurate measurement is worth more than a thousand expert opinions.” − Admiral Grace Hopper
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Product Continuous development Customer defines roadmap Measured by output and outcomes Project, product, or business KPI? Methods to manage your product / technology portfolio Project Predefined requirements scope and schedule Deliver what was planned Measured by output Business objective Maximize a strategic KPI Types of KPIs: Minimize waste, increase conversion Measured by outcomes
  • 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Project, product, or business KPI? Project team Product team Objective team Scope Defined set of requirements Ongoing creation / enhancement of product Business objective Success Milestone adherence User satisfaction, marketing objectives KPI Timeframe Defined beginning and end Ongoing Continuous evaluation of business case Involvement Implement requirements Gather, implement feedback Test, measure, repeat Tools Gantt Chart Roadmap Impact map / dashboards
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Typical release testing Most tests occur late in process Concept Dev Deployment Functional Acceptance Performance Security / Compliance Production Monitor Respond to defects / incidents
  • 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Continuous testing Always be testing Concept Hypothesis A / B MVP Development Functional Acceptance Performance Security and compliance Deployment Functional Acceptance Performance Security and compliance Canary Production Prod testing Chaos engineering User testing feedback
  • 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How Amazon achieves flow Working backward From the customer Two-pizza teams Run what you build Microservices Speed and agility
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Write the press release: Think big and focus on the customer need Write the FAQ: Customer and internal stakeholder Define the user interaction and write the manual Working backward from the customer PR
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. “Most companies write the software, they get it all working, and then they throw it over the wall to the marketing department, saying, ‘Here is what we built, go write the press release.’ That process is the one that’s actually backwards.” Jeffrey P. Bezos Founder and Chief Executive Officer Amazon.com, Inc.
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon achieves speed and agility with two-pizza teams Small, decentralized teams are nimble Own and run what you build
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Developers Monolithic application Delivery pipeline Build Test Release Monoliths: Slow and rigid
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Microservices: Speed and agility Developers Microservices Delivery pipelines Build Test Release Build Test Release Build Test Release
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Microservices principles Single purpose API based Highly decoupled http://
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Quickly scaling winning ideas Rapid adoption of new capabilities Reducing cost of failure Impact of cloud on product development
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Cloud enables quick testing of unproven concepts Quick time to market (TTM): 8 weeks from conception to production Continuous scale: Seamlessly ramps up to peak traffic of 22 K concurrent requests Event-driven architecture maximizes resource efficiency Reducing time to market for new ideas Agero created the MileUp app and used crash prediction models to speed up emergency response Reducing cost of experimentation
  • 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Cloud reduces undifferentiated infrastructure focus Productivity: Allowed developers to focus more on runtime functionality and less on infrastructure management Cleaner separation of logging, metrics, and security infrastructure from application code base Cost: Spot Instances and containers cut Amazon EC2 costs in half Devote more resources to customer value Mapbox adds location services to any application with mapping, navigation, and location search SDKs Reducing cost of new development
  • 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Rekognition use case: Automated footage tagging API access to advanced service capabilities Built in 3 weeks Index against 99,000 people Saving 9,000 hours a year in labor Cloud-native architectures Accelerates adoption and innovation of new capabilities Rapid adoption of new capabilities
  • 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. App container failure prediction • Indicates which containers should be removed before failure • App and system logs used to train model • Developed by cloud team with no ML / DL experience Bad state predictor model Outcomes: *Improved user experience *95% reduction in on-call
  • 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Enterprises are achieving massive scale with cloud- native architectures Processes 4,000 requests per second Processes half a trillion validations of stock trades daily Reduced the time to ingest and process data for its analytics pipeline by 97% Can handle spikes of 80x normal traffic Triggers 1.2 billion AWS Lambda requests each month
  • 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Develop new ideas without limits Natural language processing on 1.1 million concurrent vCPUs using Amazon EC2 Spot Instances 1.2M 200K 06:38 21:40 Concurrent vCPUs in US-East (Northern Virginia)
  • 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Cloud enables the massive scaling of big ideas Immediate access to programmable hardware acceleration using FPGAs at cloud scale Utilized AWS Batch to provision and orchestrate compute jobs across 1,000 Amazon EC2 F1 instances Compute infrastructure cost to analyze genome reduced to staggeringly low ~$3 per whole human genome Quickly scaling winning ideas FPGA world-record genome analysis
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless enables quick and agile product development >95% decrease in overall deployment and operational costs Scales up or down for variation in customer request volume Migrating tasks to AWS Lambda took only a few weeks Achieving massive scale, not massive cost AWS Lambda serverless architecture enables the FICO Decision Management Suite (DMS) to perform computations on machine learning models quickly, cheaply, and efficiently Quickly scaling winning ideas
  • 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you!
  • 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Please complete the session survey in the summit mobile app.
  • 36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Submit Session Feedback 1. Tap the Schedule icon. 2. Select the session you attended. 3. Tap Session Evaluation to submit your feedback.