Building virtualised CloudStack test environments

Building Virtualised CloudStack
Test Environments
Geoff Higginbottom
CTO ShapeBlue
geoff.higginbottom@shapeblue.com
Twitter: @CloudStackGuru

 Cloud Architect & ShapeBlue CTO
www.shapeblue.com @CloudStackGuru
 Specialise in….
 Designing & Building Clouds based on Apache CloudStack / Citrix
CloudPlatform
 Developing CloudStack training
 Blogging and sharing CloudStack knowledge
 Involved with CloudStack before donation to Apache
 Designed Clouds for Cloudera, Everyware, SunGard, Ascenty, BskyB,
Trader Media, M5 Hosting, Team Cymru, Interoute, University of
Pennsylvania.…
 CloudStack Committer
About Me

Requirements
 Portable Test / Training / Demo Environment
 Windows, MAC and Linux Support
 Open Source Software
 Reflect Production CloudStack deployments
 Basic Networking
 With and Without Security Groups
 Advanced Networking
 VLANs for Traffic Isolation
 Utilise XenServer Hypervisor(s)
 Shared / Local Primary Storage
 Dedicated Storage Networks for Shared Primary, and Secondary Storage
 100% CloudStack Feature Support

Additional Requirements
 Flexible Architecture
 Remote access to system
 Manage external Hypervisors
 Use External Storage
 Test HA Failover
 Dual Management Servers with Load Balancing
 Dual MySQL Servers with Replication
 Dual DNS for ‘Internal DNS’
 Configuration Management (Ansible)

VirtualBox
 Cross Platform Virtualisation Application
 Support to Windows, OSX and Linux
 OpenSource (unlike VMware Workstation / Fusion)
 Capable of running XenServer (but without HVM support)
 Downloads available from
 https://www.virtualbox.org/wiki/Downloads

 Management Server VM
 CentOS 6.5 VM
 CloudStack Management Server
 MySQL Server
 NFS Storage Server
 NGINX (for hosting templates)
 XenServer VM
 XenServer 6.2
Sandbox Deployment

Storage
Host Only Network 2
Public
Host Only Network 1
NAT
Network Design
Management
Guest
XenServer VM
Host Only Network 0
Internal Network
Management VM
NFS Storage
Templates

Network Design
Management VM XenServer VM
Storage
10.10.100.0/24 – vlan 100
10.10.101.0/24 – vlan 101
Public
172.30.0.0/24 - untagged
Management
Guest
192.168.56.0/24 - untagged
10.1.1.0/24
vlans 600-699
NFS Storage
Templates
NAT
10.0.2.0/24

VirtualBox Configuration
Management VM Resources
 2GB RAM
 Minimum required to install CloudStack
 Reduce to 1GB after CloudStack is deployed
 1vCPU
 Enable I/O APIC, PAE/NX, VT-x/AMD-v
 4 NICs
 16 GB disc minimum – more if available on host

Management VM Networks
Adapter 1:
Management Traffic

Adapter 2:
NAT to enable access
to internet for install
and updating etc

Adapter 3:
‘Public’ Traffic to
allow the hosting
of Templates via
nginx

Adapter 4:
Storage Traffic
acting as NFS Server
for Primary and
Secondary Storage

XenServer VM Resources
 1.5GB (4GB RAM Host)
 2vCPU
 Enable I/O APIC, PAE/NX, VT-x/AMD-v
 4 NICs
 16 GB disk minimum – more if testing local storage

XenServer VM Networks
Adapter 1:
Management Traffic

Adapter 2:
Guest Traffic

Adapter 3:
Public Traffic

Adapter 4:
Storage Traffic

Management Server Interfaces
eth0 - Management
DEVICE=eth0
TYPE=Ethernet
IPADDR=192.168.56.11
PREFIX=24
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
NAME=MGMT

eth1 - NAT
DEVICE=eth1
TYPE=Ethernet
IPADDR=10.0.2.11
GATEWAY=10.0.2.1
PREFIX=24
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
DEFROUTE=yes
PEERROUTES=yes
IPV6INIT=no
NAME=NAT

eth2 – Public
DDEVICE=eth2
TYPE=Ethernet
IPADDR=172.30.0.11
PREFIX=24
ONBOOT=yes
NM_CONTROLLED=no
BOOTPROTO=none
IPV6INIT=no
NAME=PUBLIC

eth3 / eth3.100 / eth3.101 - Storage
DEVICE=eth3.100
TYPE=Ethernet
IPADDR=10.10.100.11
PREFIX=24
ONBOOT=yes
BOOTPROTO=none
NAME=PRI-STOR
VLAN=yes
USERCTL=no
MTU=9000
DEVICE=eth3.101
TYPE=Ethernet
IPADDR=10.10.101.11
PREFIX=24
ONBOOT=yes
BOOTPROTO=none
NAME=SEC-STOR
VLAN=yes
USERCTL=no
MTU=9000
DEVICE=eth3
TYPE=Ethernet
BOOTPROTO=none
ONBOOT=yes
MTU=9000
VLAN=yes
USERCTL=no
MTU=9000

XenServer Networks

Management Server Install
 Install CentOS 6.5 Minimal and update
 Follow the ‘Quick Installation Guide for CentOS’
 http://docs.cloudstack.apache.org/projects/cloudstack-installation/
en/latest/qig.html
 Install and configure the following:
 MySQL Server
 NFS
 CloudStack-Management

Configuration Tweaks
 Install nginx so it can be used to host Templates
 Once installed download the default CentOS template and place in the
nginx web folder
# cd /usr/share/nginx/html
# wget -nc http://download.cloud.com/templates/builtin/centos56-
x86_64.vhd.bz2
 Update the CloudStack DB to change the location of the default
template
# mysql –p<password> cloud -e "UPDATE cloud.vm_template SET
url='http://192.168.56.11/centos56-x86_64.vhd.bz2' WHERE
unique_name='centos56-x86_64-xen';"

Enable use of Non-HVM XenServer
# mysql –p<password> cloud -e "INSERT INTO cloud.configuration
(category, instance, component, name, value, description) VALUES
('Advanced', 'DEFAULT', 'management-server', 'xen.check.hvm', 'false',
'Shoud we allow only the XenServers support HVM');"

Reduce the RAM allocations for System VMs
# mysql -u root –p<password> cloud -e "UPDATE cloud.service_offering SET
ram_size='128', speed='128' WHERE vm_type='domainrouter';"
ram_size='128', speed='128' WHERE vm_type='elasticloadbalancervm';"
ram_size='128', speed='128' WHERE vm_type='secondarystoragevm';"
ram_size='128', speed='128' WHERE vm_type='internalloadbalancervm';"
ram_size='128', speed='128' WHERE vm_type='consoleproxy';"

Update Global Settings for this special install
expunge.delay = 60
expunge.interval = 60
account.cleanup.interval = 60
capacity.skip.counting.hours = 60
cluster.cpu.allocated.capacity.disablethreshold = 0.99
cluster.memory.allocated.capacity.disablethreshold = 0.99
capacity.check.period = 60000
event.purge.delay = 1
network.gc.interval = 60
network.gc.wait = 60
vm.op.cleanup.interval = 600

Update Global Settings for this special install
vm.op.cleanup.wait = 60
vm.tranisition.wait.interval = 600
vm.tranisition.wait.interval = 600
vpc.cleanup.interval = 60
cpu.overprovisioning.factor = 4
storage.overprovisioning.factor = 4
secstorage.allowed.internal.sites = 192.168.56.11/32
management.network.cidr = 192.168.56.0/24
host = 192.168.56.11
enable.dynamic.scale.vm = true
secstorage.vm.mtu.size = 9000

XenServer Install
 Install XenServer 6.2 from ISO
 Apply latest patches in line with
http://support.citrix.com/cms/kc/cloud-troubleshooting/
cloudplatform-compatibility-matrix/

CloudStack Settings
 Zone Name – Test
 IPv4 DNS1 – 8.8.8.8
 Internal DNS 1 – 192.168.56.11
 Hypervisor – XenServer
 Guest CIDR – 10.1.1.0/24
Zone Setup

CloudStack Settings
Physical Network

CloudStack Settings
Network Traffic Labels

CloudStack Settings
Public Traffic
 Gateway – 172.30.0.1
 Netmask – 255.255.255.0
 VLAN - <blank>*
 Start IP – 172.30.0.21
 End IP -172.30.0.30
* Leave VLAN blank so the Host Laptop can access the Public
Network

CloudStack Settings
POD Settings
 POD Name – POD1
 Reserved System Gateway – 192.168.56.1
 Reserved System Netmask – 255.255.255.0
 Start Reserved System IP – 192.168.56.21
 End Reserved System IP – 192.168.56.30

CloudStack Settings
 VLAN Range – 600 - 699
Guest Traffic

CloudStack Settings
Storage Traffic
 Gateway – 10.10.101.1
 Netmask – 255.255.255.0
 VLAN – <blank>*
 Start IP – 10.10.101.21
 End IP – 10.10.101.30
* Storage VLAN is left blank as it is being set by XenServer on its
virtual network, if you also set it here it will not work

CloudStack Settings
 Hypervisor – XenServer
 Cluster Name – CLU1
Cluster

CloudStack Settings
 Host Name - 192.168.56.101
 Username – root
 Password – xxxxxxxx
Host

CloudStack Settings
 Name – PRI1
 Scope – Cluster
 Server – 10.10.100.11
 Path - /exports/primary
Primary Storage

CloudStack Settings
Secondary Storage
 Provider – NFS
 Name – SEC1
 Server – 10.10.101.11
 Path - /exports/secondary

Enhanced Deployment
 Sandbox configuration limits access to only the Host laptop
 Enhanced configuration allows external access to system:
 Management Server
 Secondary Storage VM and Console Proxy VM
 XenServer Management (via XenCenter)
 Also enables:
 External Hypervisors (e.g. ESXi Cluster)
 External Storage

Changes to VirtualBox
 Replace ‘Host Only’ Networks with ‘Bridged’ Networks
 Requires Physical NIC as VirtualBox does not support Promiscuous
mode over Wifi
 Public IP Range should be compatible with Hosts Physical Network
 Management Network
 Replace 192.168.56.x with 192.168.57.x (prevents conflict with VB)
 Add 192.168.57.x IP to Host Laptop as secondary IP
 Configure external devices with 192.168.57.x IP to access UI
 Will still operate as a ‘Sandbox’ config when not connected to
Bridged Network

Get Ambitious!
 2x CloudStack Management
 2x MySQL - Master / Slave
 2x HAProxy Keepalived
 2x Bind Servers
 2x Citrix XenServers
All on an 8GB RAM Laptop
Quick Demo (if time allows)

Building virtualised CloudStack test environments

More Related Content

Building virtualised CloudStack test environments