New stuff in CloudStack!

The Cloud Specialists
ShapeBlue.com @ShapeBlueThe Cloud Specialists

C l i c k t o e d i t
A b o u t m e
Cloud Architect @ ShapeBlue
From Belgrade, Serbia
Apache CloudStack Project Committer and PMC member
Involved with CloudStack since 4.0.0-incubating
Interested in:
Cloud infrastructure architecture and engineering.
Virtualization, Storage and SDxx
Downtime:
Father to 2 princesses
Music, gym and hobby electronic

“ShapeBlue are expert builders of public
& private clouds. They are the leading
independent global CloudStack services
company”
A b o u t S h a p e B l u e

S h a p e B l u e c u s t o m e r s

Introduction

New in 4.13

• Ability to have constrained/bounded custom offerings
• Ability to have networks which aren’t charged for
• OVA Appliance support (extra data)
• Ability to Create a Storage compute, network, VPC Offering for specified
domain(s) and zone(s)
• Ability to set tags when creating a resource like a snap or a snap policy
• VMware 6.7 support
• Better support for UI branding
• DPDK Live migration & Offerings
• Multidisk OVA upload from local support
• ISO upload from local support

Or simply go to:
http://docs.cloudstack.apache.org/en/4.13.0.0/releasenotes/changes.html

Constrained custom offerings

Unmetered/system networks
• Useful for service networks such as
monitoring or backup networks which
you wouldn’t charge end users for.

OVA Appliance support (extraconfig)

OVA Appliance support (extraconfig)
• Cisco® ASAv
• Juniper® vSRX
• Cisco® vWAAS (wide-area-application-services)
• Riverbed® SteelHead CX

Zone or Domain specific disk,
compute, network & VPC Offerings
• i.e. roll out new storage hardware zone by
zone. Disk and compute offerings can be
created to leverage this hardware and
scoped to zones.

Hereditary tags on Recurring
Snapshots
• Allows tags to be set which will be applied
to future snapshots

• More flexible UI branding (simpler white labelling)
• Many UI tweaks and updates
• Shared template support in UI
• Allow live migration of DPDK enabled instances
• (some bugs!)

Shared template support in UI
• Hidden away in the API, now exposed
in the UI.
Option (global setting) to enumerate
accounts/projects for users to select
from.

New in 4.14*

• Backup and Recovery*
• KVM Rolling Maintenance
• KVM DRS
• VR Health-checks
• System VM Management API
• VM Ingestion
• Direct Download for systemVM template (KVM)
• Primary Storage Agnostic Direct Downloads (KVM)
• CloudStack Kubernetes Service and CloudStack
Kubernetes Provider

KVM Rolling Maintenance
• Select a zone, pod or cluster
• Supply upgrade/patching scripts to KVM hosts
• Instruct CloudStack to run scripts on the hosts one by one in a
cluster, evacuating a host and putting it into maintenance
mode where necessary

KVM DRS
(an enterprise feature, without the enterprise price tag ☺)
• Iterative migration of guest instances to either:
• Balance host
• Pack hosts (defragment anyone?)
• DRS process simplified by
• Calculating the most effect guest instance to move*
• Live migrating it
• Checking to see if DRS threshold has be satisfied
• If not, calculate the most effect guest instance to move now

VR Health-Checks
• Router periodically running self checks
• Management servers periodically polling to ensure checks
have run and receive results
• Configurable thresholds set to avoid false positives
• Alerts raised when checks fail
• Automatic VR restarts when specified checks fail (optional)

VR Health-Checks
• Basic connectivity from management server to virtual router
• Basic connectivity to virtual router interfaces' gateways
• Free disk space on virtual router's disk
• CPU and memory usage
• Basic VR Sanity checks:
• dnsmasq/strongswan/haproxy/etc service running
• DHCP/DNS config sanity check
• Advanced VR Sanity checks:
• DHCP/DNS configuration matches mgmt server DB
• IPtables rules match mgmt server DB records
• HAproxy config matches mgmt server DB records
• VM network sanity checks

System VM Management API
• Enables granular management over systemVM templates
• Register many, change the “active” one at any time
• Define systemVM template during zone deployment
• no more pre-seeding of the template required
• Decouple ACS upgrades from systemVM upgrade
• Allow for easy setup of new/customized systemVM template
• Security patches, port opening, other customizations

System VM Management API

VM ingestion
• Take existing VMs from vSphere and “import” them into CloudStack
Prerequisites
• vSphere datacentre linked to a CloudStack zone
• The clusters, hosts and related “Primary Storage” already added to
CloudStack
• Networks* (with the same VLAN ID) pre-created in CloudStack

VM ingestion
• listUnmanagedInstances API
• importUnmanagedInstance API
• discover_networks.py helper script
• Automatic vSphere to ACS network mapping based on VLAN ID
• Automatic IP assigning with VMware tools in place*
• Not handling IPv6
• Automatic volumes migration if compute/storage tags don’t match to the
selected Offering*

VM ingestion - DEMO

• CloudStack Kubernetes Service (CKS = matured CCS)
• A plugin to create and manage Kubernetes cluster
• CoreOS templates for nodes, kubeadm for cluster
provisioning
• Offline installation of k8s and docker binaries on cluster
nodes for selected k8s version via ISO (uploaded by admin)
• Gracefully scale up or scale down
• Access kube.config for cluster for accessing k8s dashboard
• Delete cluster while removing nodes and k8s service
CKS + CKP =

• Backup and Recovery
• almost there..
• for real this time…
• Seriously!

Vo l u m e s n a p s h o t s
• Not consistent across volumes
• A VM with separate disks for say; OS, logs and
data, will have each disk processed at different
times
• Only crash consistent within a volume
and they aren’t application aware
• A database will not be quiesced before snapshot is
taken
• Transaction logs won’t be processed
• VMware tools or XenTools may help with some
basics

• They can be very slow.
• Data has to be transferred from primary storage to
secondary storage
• In the case of vSphere, this data must go via the
SSVM to be compressed into a OVA while being
moved to secondary storage.
• CloudStack locks out other actions while a
snapshot is taking place. Workarounds have their
own issues.

• Restoration of a VM requires a number of steps
(and did I mention it’s slow)
• User must make a template from snapshot
(VM image copied via SSVM from one part of secondary
storage to another – 2x network transfers)
• User then creates VM from template
(VM image copied from secondary to primary to create
template on primary storage, then primary storage based
template copied to make actual VM. 2x network assuming
network based primary storage and 1x on-disk copy)
• To restore a VM ‘exactly as it was’ requires considerable
operator intervention

Specifically:
• Support for:
• Operator created ‘policy based’ backups (RPOs)
• Scheduled backups (similar to snapshot scheduling)
• Ad hoc backups
• Backups as first class citizens
• ‘In-place’ restoration of entire VM including data disks
• Restoration of VM backup after original VM is destroyed
• Restoration of individual VM volumes (can then be attached to another VM)
• Full integration into the CloudStack usage service, recording both protected and
on-disk data metrics
B a c k u p a n d R e c o v e r y

@ShapeBlueShapeBlue.comThe Cloud Specialists
‘Policy Based’ Backups
• listBackupPolices external=true
Returns ‘template’ jobs.
• importBackupPolicy Creates a policy (with
a name and description) in CloudStack
and maps it to a Veeam template job.
ie.
GOLD – 6hr RPO
SILVER – 24hr RPO
BRONZE – 7 day RPO

@ShapeBlueShapeBlue.comThe Cloud Specialists
‘Ad-hoc’ & Scheduled Backups
• CloudStack will send command to carry
out an ad-hoc run of the policy based job
or create one as required.
• Ad-hoc and scheduled jobs will be driven
by CloudStack
• One VM to one Veeam job mapping allows
for simpler accounting and unified
incremental backups

Q u e s t i o n s
?

CloudStack
ShapeBlue.com • @ShapeBlue
Andrija Panic, Cloud architect • PMC Apache CloudStack
andrija.panic@shapeblue.com • @AndrijaRS
N e w s t u f f i n

New stuff in CloudStack!

More Related Content

New stuff in CloudStack!