Leveraging HybridMultiCloud for Devops and Automation Platform
- 2. Leveraging Hybrid MultiCloud
for DevOps and Automation Platform
© 2020 NetApp, Inc. All rights reserved.
Dedy Setiawan
Solutions Engineer – NetApp
Dedy.Setiawan@netapp.com
- 3. Agenda
1) Transitioning from Data Center to Cloud
2) Data Management Challenge for DevOps
3) DevOps Anywhere + Automation
4) Storage
▪ Persistent storage for containerized apps
▪ Trident
5) Demo
6) Key TakeAways
2 © 2020 NetApp, Inc. All rights reserved.
- 4. Starting with “?”
What are you developing
and automating?
Where are you developing
and automating?
What are your development
and automation priorities?
How are you developing and
automating. Who is doing the work?
3 © 2020 NetApp, Inc. All rights reserved.
- 5. Public cloud offers
advantages that users
have come to expect
• Empowers developers to work fast, without IT overhead
• Offers great services for modern application development
• Makes it easy to get started with minimal upfront cost and
preparation
• Enables applications to be scaled according to demand
© 2020 NetApp, Inc. All rights reserved.
- 6. • Regulatory compliance
• Privacy and confidentiality
• Protect core intellectual property
• No vendor lock-in
• Long-term economic advantages
• Low-latency integration with legacy systems
• Cloud repatriation
• Proper availability for typical off-the-shelf applications
• Many legacy architectures cannot be statelessly
load-balanced
• Need infrastructure-level availability
• Better long-term economics
On-premises advantages
For new application development... For traditional enterprise applications
© 2020 NetApp, Inc. All rights reserved
- 7. Ensure access,
security, and
reliability,
as well as data
sovereignty, of critical
data.
Control costs
and optimize application
performance.
Transitioning
large-scale and
virtualized
workloads from
the data center
to the cloud has
its challenges.
© 2020 NetApp, Inc. All rights reserved.6
of applications that are
already in production
and during migration.
Avoid disruption
- 8. Data Management Challenges for DevOps
7 © 2020 NetApp, Inc. All rights reserved.
Scale Out Agility
Quality of Service
Hybrid Cloud
Data management
Automation
Copies management
& Data protection
Develop
Collaboratively
- 9. DevOps and Automation: Core Capabilities
Services
Containers
Configuration
Management
Code and Binary
Management
Continuous Integration
and Continuous Delivery
Cloud and PaaS Analytics
8 © 2020 NetApp, Inc. All rights reserved.
- 10. DevOps Anywhere – Integrating Automation & Orchestration
9
© 2020 NetApp, Inc. All rights reserved.
Hybrid CloudPrivate
SCM
Data Management
(Develop & Deploy Anywhere – Movement,Management,Governance)
Continuous Integration/Continuous Delivery (CI/CD)
Tools
Define Code Build Test Deploy Release
Code
&
Repo’s
Code
&
Repo’s
Code
&
Repo’s
Code &
Repo’s
Development
Teams
Work Flow
& Tools
PaaS/IaaSSoftware
Defined
OpenStack
Integration
Containers
Efficiency Security
Automation Persistent Data
Store
Data
Protection HA/DR
Data
Portability
API’s, Automation and Orchestration
QA UAT
Workloads
Products &
Technology
- 11. Putting it All Together in the NetApp DevOps Eco-system
On Premises Public CloudsHybrid Clouds
Store Manage ProtectMove
Enterprise Data Management Software
Converged / Hyperconverged
Hybrid Arrays All Flash Arrays
Software-Defined Storage
Unified Storage
Object Storage
White box, third-party
or NetApp hardware
Cloud Integrated Storage
Strategy Design OperationsDeploy and Transition
© 2020 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
- 12. DevOps Integrations & Solutions
11 © 2020 NetApp, Inc. All rights reserved.
Development Tools
PaaS
(Platform as a Service)
Containers/
IaaS/Cloud
(Infrastructure as a Service) Automation
- 13. • Ansible
• Puppet
• Chef
• Terraform
Automation
and
Orchestration
Automation and Consumption Models
NetApp consumable in all forms
© 2020 NetApp, Inc. All rights reserved.12
Tools
Software Data Management
(OnPrem / Cloud)
Appliance
(Hy brid/Flash/SAN, Object)
White Box Cloud
Configuration
Management
Application / Workload
Orchestration
PaaS / IaaS
• Kubernetes
• OpenShift
• CloudFoundry
• Trident
API’s
• REST & REST API’s
• Tools/Libraries
- 14. Challenges of Enterprise Workloads in Containers
13 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Persistence
▪
▪
▪
Hybrid + Multi-Cloud
▪
▪
▪
Application-Consistency
▪
▪
▪
- 15. Jhon the Developer
Worries about what’s
inside the container
His code
His Libraries
His Package Manager
His Apps
His Data
All Linux servers look
the same
Rud the Ops Guy
Worries about what’s
outside the container
Logging
Remote access
Monitoring
Network config
All containers start, stop,
copy, attach, migrate, etc.
the same way
Separation of concerns
14 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
- 16. Simplify Storage for Apps
•
•
•
•
•
15 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
- 17. ▪ Connects to backends to
determine capabilities of storage
array
▪ Receives requests for storage
from frontends, e.g. Kubernetes,
REST
▪ Evaluates configured backends
against desired attributes in the
storage class
▪ Creates a list of eligible backends
▪ Selects one eligible backend,
requests provisioning
▪ Retries on failure until all eligible
backends are exhausted
Trident Architecture
16 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Storage Platform
Clients/AppsKubernetes
Orchestration Engine
CSI
Kubernetes
Plugin
Create/Delete Commands
AdministrationDocker
Docker
Plugin
etcd
REST
Container
Storage
Interface
- 18. Trident Support Matrix
17 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
1.11-1.18
3.11, 4.2 and 4.3
2.1, 3.0
1.1, 1.2 ANF
CVO
Operating System Container Platform Storage Backend
- 19. Kubernetes Persistent Storage Paradigm
Persistent volumes and persistent volume claims
18 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
claim
Pod
claim
Pools of Persistent Volumes
NFS
PV
iSCSI
PV
NFS
PV
Developer
Administrator
- 20. Kubernetes Persistent Storage Paradigm
Dynamic storage provisioning
19 © 2019 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
claim
Pod
claim
Developer
Administrator
Storage Classes
SSD
Gold
Bronze
PV
- 21. Trident Storage Provisioning
20 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
01 Configures storage backends
02 Installs Trident in K8s
03 Adds one or more backend
04 Defines StorageClass based on
preferred volume type
05 Creates PVC
TridentC
06 Detects creation of PVC
07 Finds storage pools that satisfy the Gold class
08 Creates volume in an appropriate storage pool
09 Creates PV and binds PVC with PV
10 Mounts the volume onto the container
Storage
Classes
- 22. Trident Storage Deprovisioning
21 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
01 Developer deletes PVC
TridentC
Storage
Classes
02 Detects deleted PVC
03 Finds and validates the matching PV
04 Determines PV reclaim policy
05 Deletes volume & PV if reclaim policy is “delete”
- 23. NFS Example: Create the PVC
22 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
” kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: pvcclaim-nas-gold
Spec:
parameters:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 10Gi
storageClassName: storage-class-nas-gold
- 24. Broad Support for Top Container Platforms
23 © 2020 NetApp, Inc. All rights reserved. --- PARTNER CONFIDENTIAL ---
HCI
Google GKE
Azure AKS
Docker EE
Block Storage
C O N T A I N E R O R C H E S T R A T O R S S T O R A G E P L A T F O R M S
Unified Storage
Cloud Volumes
- 25. Container Adoption
24 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
Modernize
Apps
Cloud-native
Apps
Pipelines
Platform
Meet Business
Requirements
Lifecycle
Orchestrate common
app operations
Portability
Migrate between clouds
without change
Security
Isolate and introspectwith
integrity guarantees
Freedom
Build apps the way you
want without constraints
Innovate
Fully flexible and
scalable micro services
Standardize
Well-definedsharable
app definitions
Accelerate
Seamlesslymove
along the SDLC
Integrate
APIs and openinterfaces
tie everything together
Automate
Rapid repetitionimproves
quality and time to value
CostSavings
Increase density and
reduce VM licensing
Efficiency
Enable self-service
and reduce maintenance
Optimize
Maximize resource
utilization and availability
- 26. 25 © 2020 NetApp, Inc. All rights reserved.
Demo
Moving Kubernetes Application Workloads Between Hybrid-Cloud Endpoints
- 27. ▪ Success is knowing your data and how to manage it, One stack, one experience,
anywhere
▪ Deliver a consistent experience across OnPrem & Public/Private Cloud - to streamline
software development
▪ IT and operational efficiency by delivering automation and flexibility
▪ Business and operational benefits – Provide faster delivery and time to value
▪ Using Ansible [automation] to manage NetApp systems can bring deployment time down
from days to minutes
26 © 2020 NetApp, Inc. All rights reserved.
Key Takeaways
- 28. thePub: NetApp’s Developer and Open Source Community
Sharing is Caring!
27 © 2020 NetApp, Inc. All rights reserved. — NETAPP CONFIDENTIAL —
GitHub
https://github.com/NetApp
thePub
netapp.io
Twitter
@NetAppPub
Slack
netapp.io/slack
NetApp website
netapp.com/devops