Balancing DevOps Speed with Quality
- 1. Balancing DevOps Speed with Quality
A Prescriptive Approach to Innovation for the Modern Enterprise
Featuring a guest speaker from:
Educational Series
- 3. Agenda
• [Forrester] Building the DevOps Operating Model
• [Forrester] Balancing Speed with Quality
• [Forrester] DevOps Challenges in the Enterprise
• [Quali] Cloud Sandbox Approach
• Demo
• Q&A
- 6. 6© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps Agenda
› Business Drivers Of DevOps
› DevOps Overview
› Examples
› Challenges of Adopting DevOps
- 7. 7© 2017 FORRESTER. REPRODUCTION PROHIBITED.
The customer-obsessed operating
model demands an organization that
is customer-led, insights-driven, fast,
and connected.
- 8. 8© 2016 Forrester Research, Inc. Reproduction Prohibited
Yes you want speed…
The Need For Speed Is Driving Teams To Adopt Automated
Processes…
- 9. 9© 2016 Forrester Research, Inc. Reproduction Prohibited
But Speed Without Quality Does Not Equate To Value !
- 10. 10© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Customer
Experience
Drives Revenue
Forrester report: Make A Modern Business Case For Agile And DevOpsDriven Digital Transformation
- 11. 11© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Improving The
Customer
Experience
Demands Greater
Velocity
Source: DevOps: The CIOs Guide To Velocity
- 12. 12© 2017 FORRESTER. REPRODUCTION PROHIBITED.
64% Of Business
Dissatisfied With
Release Velocity
Source: The Forrester Wave: Continuous Delivery And Release Automation, Q3 2017
- 14. 14© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps Consists
of Three Main
Dimensions:
> People
> Process
> Platforms
Forrester Report: Master DevOps For Faster Delivery Of Software Innovation
- 15. 15© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps Enabled
Teams Focus On
Delivering Value To
Customers In the
Form of Products
Forrester Report: Organize And Staff IO Pros For Successful DevOps Practices
- 16. 16© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Product Teams Encompass Each Phase of Software
Delivery
Product Owners
Business
Analyst
Developers
QA
Are we delivering
the right value?
What’s the release
cost run rate ?
What’s the cost of
the feature just
delivered ?
Is our release pace
improving CX?
How can we improve this
product to make customers
happy?
How well is our code
performing?
Is test coverage
adequate?
What’s the feedback
from live site?
OPS
What are the system
requirements?
Which KPIs should we
monitor?
- 17. 17© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Processes that embrace
DevOps do the following:
> Embrace design thinking
> Emphasize speed over
perfection
> Focus on end to end design
> Build an innovation
ecosystem
Forrester report: Case Study Lloyds Banking Groups JourneyFocused Digital Transformation
- 19. 19© 2017 FORRESTER. REPRODUCTION PROHIBITED.
VCS:
• GitHub
• BitBucket
• GitLab
• SVN
CI:
• Jenkins
• CircleCI
• AWS CodeBuild
Static Analysis:
• SonarCube
• VeraCode
ARA:
• XebiaLabs
• Plutora
Testing:
• Selenium
• JMeter
• Cucumber
Monitoring:
• Dynatrace
• Optimizely
Agile:
• Jira
• VersionOne
Artifact Repo:
• Artifactory
• Nexus
- 20. 20© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Continuous Delivery/Deployment
New World Of Release Automation
Source: Weaveworks
Image
Repo
OrchestratorDeploy
Synchronizer
Config
change
Manual
deployment
Git
Code change
Git
Update Hint
Continuous Integration
Deploy
Automator
CI
Pipeline
- 22. 22© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Source: Forrester's Global Business Technographics Developer Survey, 2017
14%
16%
18%
21%
24%
26%
27%
28%
30%
30%
33%
Outsource more software development activity to a third-party
services partner
Adopt more micro-service based app architecture
Use more opensource software or components
Create more multi-disciplinary product teams
Adopt a “design thinking” mindset and methodologies
Integrate front-end and back-end systems
Collect and integrate more feedback from users and customers into
software design and requirements
Speed up release cycle time
Add or improve customer experience measurements
Use more cloud-based development environments
Increase automation of SDLC tasks
Top Software Dev Team Priorities
Base: 346 North American and European enterprise developers; manager or higher
Development teams are focused on automating
processes and increasing use of cloud
Developers expect these
actions will directly help
the business:
23%
23%
24%
31%
Grow revenue
Improve our products
/services
Improve the experience of
our customers
Reduce costs
- 23. 23© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Source: Forrester's Global Business Technographics Developer Survey, 2017
57%
Of developers expect at
least some teams to use
by end of 2017
73%
APIsMICROSERVICES
FUNCTIONAL
PROGRAMMING
Of developers expect
at least some teams
to use by end of 2017
9% of developers use a
“severless” compute
infrastructure/ functional
pipeline
Development is shifting from large, discrete pieces of
software to smaller, more modular development
Are the underlying architecture for
modular development
description Models build software as a series
of functions, rather than objects
Development shops are
most often using or
interested in using service-
oriented architectures
42%
Of developer orgs are either planning to
implement, have implemented or are
expanding APIs exposed internally
37%
Of developer orgs are either planning to
implement, have implemented or are
expanding APIs exposed externally
Growth in use of APIs
exposed outside of orgs
is stagnant since 2015
DevOps Influences Software Design
- 24. 24© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps
Enablement
Gives
Development
Teams Greater
Insight
- 25. 25© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps: Velocity Accelerating
Source: Six Trends That Will Shape DevOps Adoption In 2017 And Beyond
- 26. 26© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps Heat Varies by Industry and Application Type
Source: Forrester DevOps Heatmap 2017 Report
- 27. 27© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Automate
Compliance To
Maintain Velocity
Forrester report: Use DevOps And Supply Chain Principles To Automate Application Delivery Governance
- 29. 29© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps Enabled
Dashboards Add
Transparency To
The Development &
Release Process
But you need to buy
or build them.
Xebia Labs XL Product Screen Shot
- 31. 31© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Only 29% Of
Releases Have
Complete Life-
Cycle
Automation
Source: The Need For Speed: Drive Velocity And Quality With DevOps
- 33. 33© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Source: http://ayankeepastor.blogspot.com/2013/08/passing-baton.html
Silo’s Of Automation
Destroying Velocity
66% Of Organizations Fail To Automate
From Development to Production!
- 34. 34© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps At Scale Is Not Easy
Source: Xebia Labs
- 35. 35© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DEVOPS Disconnects
Source: Forrester's Global Business Technographics Developer Survey, 2017
64% of development shops
integrate dev and ops staff
on at least some teams…
66% of developers
expect at least some
teams to use DevOps
by the end of 2017
PROCESS AND TOOLS
ORG AND CULTURE
23% of development
teams are automating
builds
27% of development
teams do continuous
integration
!…But only 38% of devs cite
excellent working relationship
with Ops
Systems of
record
Systems of
automation
Systems of
engagement
Systems of
insight
DevOps is most often
practiced on systems of
automation
39% of developers use open
source build and release
management tools weekly
or more
- 36. 36© 2017 FORRESTER. REPRODUCTION PROHIBITED.
Executives
Overestimate
DevOps Maturity
Forrester report: A Dangerous Disconnect Executives Overestimate DevOps Maturity
- 37. 37© 2017 FORRESTER. REPRODUCTION PROHIBITED.
DevOps Implementation Options
• Choose between Enterprise or OSS
backed tools
• Integrate or buy an integration
platform
• Maintain the Tools and their IT
• Maintain the integration through each
update
• Pros: Get to choose the best tools
for the job
• Cons: Expect 10% of Dev resources
to be dedicated to maintaining
DevOps tool chain
• Hosted CI/CD Tools Provide Low
maintenance options
• You still need to integrate peripheral
tools.
• Managing multiple environments in the
cloud and on premise can be
complicated.
• Pros: No IT to Manage
• Cons:
› Still require some integration
maintenance.
› Subscription fee
Build your own Hosted Options
- 38. 38© 2017 FORRESTER. REPRODUCTION PROHIBITED.
The DevOps checklist for speed
Improve speed, even deep in systems-of-record territory
Evaluate your progress with the five critical metrics
time-to-delivery
deployment frequency
change volume
success rate
time-to-recovery
Incorporate feedback at every step
Design with operational excellence in mind
Create a playbook as a blueprint for all your DevOps projects
Focus on delivering the product the customer wants, not on the framework
Source: Feb 2017, “The Need For Speed: Drive Velocity And Quality With DevOps,” Forrester report.
- 39. 01
02
03
Venture-funded start-up focused on Cloud
Automation and Orchestration. Managing
$Billions in Infrastructure.
Delivers “Cloud Sandboxes” - Replicas of
production environments delivered as-a-
service.
Strong Innovation DNA – Trusted by customers
Worldwide. Managing millions of Infrastructure
elements
About Quali
39
150+ customers – Cloud providers, Telcos, Enterprises
– across FSI, Retail, Healthcare and Government
~115 employees in USA, Israel and Europe focused on
serving customers worldwide150+
- 41. Speed Vs. Risk in the Software World
I pulled an all
nighter and just
deployed my code
“Whoa…what happened? It worked well on my desktop”
“I reproduced the problem. So, why isn’t it working? If only I could have access
to the working configuration <Sigh>”
“It was a small patch. My organization follows continuous I deployed directly
into production”
“It was working well in our datacenter. Why is the application performance
taking a hit on the public cloud?”
Did This Happen to You?
- 42. Application Complexity
Application Design
Application Testing
The Network
Infrastructure and Components of Application Services
The Butterfly Effect
Virtualization
Web Browser Scale / Peak Usage
Replicating Production Issues is Hard
Hybrid IT Multi-cloud
Compliance Security
Legacy Stack
Application Performance
Tune-up!!…
- 43. Move Fast But De-Risk Production
Start coding
Servers
delivered
IT builds Dev/Test
environments
Request Dev/Test
resources from IT
Project starts
Gather requirements
Prioritize work
IT kicks off
procurement Deployment
Performance
testing
Testing
Bug fixing
Production
DEV/TEST: Needs access to configured
environments – ideally access to
“production-like environment” Local
machines won’t work. No wasting time
on configuration issues
DEVOPS TEAM: Monitor release
velocity and team productivity. Tools,
governance and metrics
Feedback to
Blueprints
- 44. Quali Cloud Sandboxes
Blueprint Modeling Automation & Orchestration
Reservation & Scheduling Self-Service Catalog
Built-In Networking BI & Analytics
REST API
EMBEDDED GUI
DevOps Plug-Ins
BUILD ANY ENVIRONMENT. DEPLOY AS-A-SERVICE
Bare Metal
TO ANY CLOUD*
ENVIRONMENTFEATURESINTERACE
Applications Data Test Tools
Physical Infra. Virtual Infra. Services
Network Storage
Compute Security
CLOUD SANDBOX
- 45. Integrate With Existing DevOps Assets
Test framework
Build / Release Automation
Repository
Bug tracking Monitoring
Data Virtualization
Cloud & ContainersConfiguration
Management
Physical
Infrastructure
- 47. CI/CD Pipeline – Sandboxes with RESTful API
Pipeline Automic
Quali
Sandbox
Software
Load Security Integration
Staging/
Production
Dev
- 50. Case Study
Large European
Retailer
• 200+ Developers Distributed Globally across 3 Countries
• Dynamic Environments Req. for: Dev, Feature Validation & CI
• Orchestration a first-class citizen
• Manual+ Automated testing. Compartmentalized Environments
• Include configuration and installation of test tools
• Deploy over Public Cloud (Microsoft Azure)
• Blueprinting and Orchestration Created Standardization
• Self-Service with Dynamic Environments
• Leverage existing tools and automation assets
• Self-Service - Better Collaboration – Improved Productivity
• Automation – Increased Speed
REQUIREMENTSVALUEBENEFIT
- 51. Ask for a Technical Demo
(30-min web conference)
Start a Free Trial
(30-min web conference)
- 52. 2018 DevOps and Cloud Survey
http://info.quali.com/2018-devops-and-cloud-survey
- 56. Standardize via Blueprints
ENVIRONMENT
• Blueprinting allows DevOps engineers to take
on the role of environment designers and
ensure standardization
• Reusable building blocks improve
maintainability and reduce overhead
• In-built connectivity
ENVIRONMENT
- 57. Reserve – Deploy on Any Cloud
Bare Metal
ON ANY CLOUD*
“One-click” Deployment Path
- 58. Parting Thoughts
Balancing Speed with Quality is Critical to DevOps Success
Blueprinting can help Standardize and Scale
Cloud Sandboxes Bring Agility and Productivity to DevOps Workflows
Editor's Notes
- Pascal
- Pascal
- Pascal
- Visit the PowerPoint resources page Backstage for quick tips and slide layout solutions for your presentations.
- At Forrester we often talk about COOM
- The Forrester CX (customer experience) team has researched and analyzed data from over 100k customers across the displayed industries. Our research shows us that making a one point improvement in the CX score has the potential to make a significant impact on the bottom line.
Organizations that recognize the central importance of customer experience will lead their markets.
- Bjorn commits code (or config changes) and Deploy automates deployment
The Automator observes new builds and updates config to create a new release
Config changes are committed to Git
The Synchronizer ensures the orchestrator has the correct state
Deployment orchestration instant fix if you blow away Deploy Synchronizer
- This slide indicates the need for shorter and better feedback loops. Waterfall encourages a disconnection between the customer and product development team.
- Source: http://ayankeepastor.blogspot.com/2013/08/passing-baton.html
Only 29% of releases have complete life-cycle automation
- Users select environments from a catalog
DevOps team members design environments
Managers set policies on consumption and permissions
Consumption of an environment is always scoped by time or usage
- Pascal
The next step is to create a blueprint template that will effectively serve as a for your sandboxes. This process is quite simple.
It is based on the premise that the network architect should be able to just drag and drop elements from a resource and app catalog onto the canvas (physical or virtual assets) and connect them just like you would draw on a diagram in visio or even on a napkin.
Each element has preconfigured automation capabilities, and once the layout is complete all you have to do is decide on which parameter are going to be publish as input such as NFV version or firmware version and publish it to the self service catalog so that it becomes available for all users to consume.
In this layout you can see a number of physical resources like cisco routers that will be reserved, virtual application components including a vCPE that will be deployed at the time of deployment and tools such as IxLoad and BreakingPoint that will be used once the sandbox is active. Another important aspect is the connectivity between these elements is defined in the blueprint, in this case a number of VLAN segments and SD-WAN policies and configured by the orchestration at deployment time so that all these links are configured dynamically.
I will cover this example more in depth as part of the demo.
- Pascal
- seed questions: Alex will ask the question to Amritam and Pascal
- Pascal