Cloud computing OpenStack_discussion_2014-05
•
1 like•792 views
The document discusses VNG Corporation's use of OpenStack for its infrastructure platform. VNG is a Vietnamese game publisher and developer that also operates online media, social network, and e-commerce platforms. Its IRD department is researching and building an infrastructure on OpenStack to enhance business operations and meet new technology needs. The document provides an overview of OpenStack architecture, networking, deployment models using Ceph storage, and the monitoring component Ceilometer. It aims to introduce OpenStack and how VNG is leveraging it to power its cloud infrastructure.
Report
Share
Cloud computing OpenStack_discussion_2014-05
- 1. Cloud Computing OpenStack VNG – Infrastructure platform Tran Anh Nhan – IRD department head Pham Tran Kim Chi – Lead System Engineer May 2014
- 2. Cloud Computing - OpenStack - VNG - IRD Agenda • VNG - IRD • What is Cloud Computing? • OpenStack Architecture • OpenStack Networking • Deployment Model • Ceilometer
- 3. Cloud Computing - OpenStack - VNG - IRD New Section VNG Corp introduction
- 4. Cloud Computing - OpenStack - VNG - IRD VNG Corporation • Game publisher/developer (VLTK, VLCM, Gunny, Boom, Khu vuon tren may, ZingPlay …) • Online music/media (ZingMP3, ZingTV) • Social network (Zing Me, Zalo) • E-commerce (123mua.vn, 123pay.vn)
- 5. Cloud Computing - OpenStack - VNG - IRD IRD Department Research and build the infrastructure platform for VNG to enhance business, optimize quality and cost, meet the new technology. • Content Delivery Network (CDN) system is used by all VNG products that want to optimize static bandwidth. • Live-streaming system is a streaming platform for Zing events, Talk TV. • OpenStack provides servers and networks for some products with a small scale (in pilot phase. Project Team is receiving feedback for further enhancement). • Object storage (in POC phase).
- 6. Cloud Computing - OpenStack - VNG - IRD New Section What is Cloud Computing?
- 7. Cloud Computing - OpenStack - VNG - IRD References • Gartner • Synergy research • The National Institute of Standards and Technology (NIST) • Cloud computing today • 451 Research
- 8. Cloud Computing - OpenStack - VNG - IRD Number & trend
- 9. Cloud Computing - OpenStack - VNG - IRD Number & trend
- 10. Cloud Computing - OpenStack - VNG - IRD What is Cloud computing?
- 11. Cloud Computing - OpenStack - VNG - IRD What is Cloud computing?
- 12. Cloud Computing - OpenStack - VNG - IRD What is Cloud computing?
- 13. Cloud Computing - OpenStack - VNG - IRD Cloud Services
- 14. Cloud Computing - OpenStack - VNG - IRD Cloud Services • AWS #1 of cloud services provider - What services AWS provide? – Amazon Web Services (AWS) continues to dominate the IaaS and PaaS space in terms of revenue. AWS: 3.8$B revenue (2013) – Compute & Networking (Amazon EC2, Auto Scaling, Elastic Load Balancing, Route 53 ,..) – Storage & CDN (Amazon S3, Amazon Glacier a low cost storage for backup, Amazon EBS, Cloud Front/CDN) – DB – Cache: RDS (MySQL, Oracle, SQL Server, and PostgreSQL), DynamoDB (NoSQL data store), ElastiCache (In-Memory Caching Service), Redshift (Data Warehouse Service) – Application services: Elastic Transcoder,..
- 15. Cloud Computing - OpenStack - VNG - IRD Cloud Orchestration Framework
- 16. Cloud Computing - OpenStack - VNG - IRD New Section OpenStack Architecture
- 17. Cloud Computing - OpenStack - VNG - IRD History • OpenStack is an open source IaaS initiative for managing and creating huge groups of virtual private servers in a cloud computing environment. It was initially developed by Rackspace and NASA.
- 18. Cloud Computing - OpenStack - VNG - IRD
- 19. Cloud Computing - OpenStack - VNG - IRD Nowadays
- 20. Cloud Computing - OpenStack - VNG - IRD Servers Storage Network switch Network switch Network switch Virtualization Solution (VMWare VCenter, Citrix XEN Server, Ovirt, Proxmox….) Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
- 21. Cloud Computing - OpenStack - VNG - IRD Cloud Infrastructure • Modular architecture • Designed to easily scale out • Based on set of core services
- 22. Cloud Computing - OpenStack - VNG - IRD OpenStack Platform Servers Storage Network switch Network switch Network switch Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
- 23. Cloud Computing - OpenStack - VNG - IRD Infrastructure As A Service Overview
- 24. Cloud Computing - OpenStack - VNG - IRD Infrastructure As A Service roles • Cloud Ops: monitor/add/remove physical compute nodes, storage nodes, controller nodes, network nodes. • App Owner: add/remove/upgrade cloud services, check billing status. • Dev Ops: launch/ terminate/ scale instances, storage. Register/ unregister new image. Backup/ restore instances/ storage. These tasks can be done via dashboard or API. • App Devs: call the dev ops tasks inside application logical flow.
- 25. Cloud Computing - OpenStack - VNG - IRD OpenStack Architecture
- 26. Cloud Computing - OpenStack - VNG - IRD OpenStack Architecture On-Demand Self-Services Resource pooling Broad Network Access Mesearued services
- 27. Cloud Computing - OpenStack - VNG - IRD OpenStack Architecture Hypervisor Server Storage Network Nova compute Cinder Neutron
- 28. Cloud Computing - OpenStack - VNG - IRD
- 29. Cloud Computing - OpenStack - VNG - IRD New Section OpenStack Networking
- 30. Cloud Computing - OpenStack - VNG - IRD OpenStack Networking
- 31. Cloud Computing - OpenStack - VNG - IRD Network Node Compute Node phy- br- em2 phy- br- em2 em1: 172.16.0.2 em1: 172.16.0.3 em2: no ip address em2: no ip address Nova API … ovs/ br-int dnsmasq dchp agent IP name space Nova Compute … tap-xx qvo-xx int-br- em2 tap-xx qvb-xx Linux bridge qbr-xxxxx Instance eth0 ovs/ br-int qvo-xx int-br- em2 veth Neutron API 0.0.0.0:9696 management network dedicated physical VLAN for neutron traffic between nodes neutron ovs plugin veth
- 32. Cloud Computing - OpenStack - VNG - IRD
- 33. Cloud Computing - OpenStack - VNG - IRD New Section Deployment Model
- 34. Cloud Computing - OpenStack - VNG - IRD Cinder API COROSYNC + HAProxy Controller 01 Controller 02 Rabbit MQ Keyston e Glance API Nova API PACEMAK ER Compute node 1 Compute node n Ceph node 1 Ceph node n QEMUDriver Ceph node 2 Compute node 2 RBD Driver
- 35. Cloud Computing - OpenStack - VNG - IRD OpenStack Networking Neutron Server Switch Interface Driver Physical switch Controller Node OVS Plugin OVS Plugin Openvswitch Instances Compute Node Neutron OVS agent DHCP InstancesInstances OVS Plugin Openvswitch Instances Compute Node Neutron OVS agent InstancesInstances L3 Agent DHCP L3 Agent
- 36. Cloud Computing - OpenStack - VNG - IRD Feature • Launch instance • Snapshot/ restore instance • Attach device to instance • Snapshot/ restore attach device • Scale up instance • Internal network for instances • Provide instances with VLAN as product requires. • Instances are stored totally in Ceph Storage.
- 37. Cloud Computing - OpenStack - VNG - IRD DEMO
- 38. Cloud Computing - OpenStack - VNG - IRD New Section Ceilometer
- 39. Cloud Computing - OpenStack - VNG - IRD OpenStack Architecture On-Demand Self-Services Resource pooling Broad Network Access Mesearued services
- 40. Cloud Computing - OpenStack - VNG - IRD Monitoring • Monitor physical host by cacti, graphite, zabbix. • Monitor instances status by ceilometer. • Monitor OpenStack statistics by ceilometer.
- 41. Cloud Computing - OpenStack - VNG - IRD Ceilometer • Objectives • Ceilometer component • Ceilometer collect data • Access collected data
- 42. Objectives • Provide a infrastructure to collect any information in OPS. • Publish information for other monitoring. • Integrate with Heat for trigger auto scale. Celiometer - OpenStack - VNG - IRD
- 43. Ceilometer collect data • Bus listener • Polling agent • Push agents Celiometer - OpenStack - VNG - IRD
- 44. Cloud Computing - OpenStack - VNG - IRD Ceilometer
- 45. Cloud Computing - OpenStack - VNG - IRD Process meter
- 46. Access collected data • Via API • Via Ceilometer command Celiometer - OpenStack - VNG - IRD
- 47. Cloud Computing - OpenStack - VNG - IRD DEMO
- 48. Cloud Computing - OpenStack - VNG - IRD Q & A