Basics of Kubernetes on BOSH: Run Production-grade Kubernetes on the SDDC
- 1. Matt McNeeney Senior Product Manager, Pivotal R&D mmcneeney@pivotal.io @1mattmc Nathan Ness Technical Product Manager, CNABU @nvpnathan CNA2080BE Basics of Kubernetes on BOSH: Run Production- grade Kubernetes on the SDDC
- 2. Disclaimer • This presentation may contain product features that are currently under development. • This overview of new technology represents no commitment from VMware to deliver these features in any generally available product. • Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. • Technical feasibility and market demand will affect final delivery. • Pricing and packaging for any new technologies or features discussed or presented have not been determined. 2
- 3. Agenda Introductions What and Why of SDDC What and Why BOSH What and Why Kubernetes What and Why Kubo What and Why of PKS
- 5. What and Why of SDDC
- 6. What is the SDDC 6 Abstraction of Hardware
- 8. Ops Teams Network StorageCompute WW A A R Web 2 VMs, 2CPU, 2GB mem, 10GB disk, RHEL LoadBalancer Open 80,443 App 2 VMs 4CPU, 4GB mem, 30GB disk Open 22 internal only, 8443 from Web Request Infrastructure web_instance: webxyz flavor: m1.small image: RHEL-x86_64-chef network: web-net security: web-sec quantity: 2 -------<snip>---------- Web-net: web-net Subnet: 10.10.0.0 Mask: 255.255.255.0 Web-sec: name: web-sec in: allow: tcp: 22 out: allow: tcp: 80, 443 Describe Infrastructure Days & Variability Fast & Predictabl flavor: m1.small Cpu: 2 Mem: 2 Disk: 10 Cloud APIs Infrastructure “Consumer” Wait https://youtu.be/Nk8JCAgmDmg Long LivedShort Lived IaaS
- 9. What and Why of BOSH
- 10. Coordinating a few things is OK
- 11. Coordinating lots of things is hard
- 12. What do we need to be able to do this?
- 13. Bundled releases - identifiabilityWhat do we need to be able to do this?
- 14. Bundled releases - identifiability Integration - reproducibility What do we need to be able to do this?
- 15. Bundled releases - identifiability Integration - reproducibility Deployment framework - consistency What do we need to be able to do this?
- 18. Great for building out servers (but not a software packaging tool) Great for packing up software to deploy anywhere Great for keeping infrastructure in a good state (but designed for servers, not services)
- 19. BOSH can do it all!
- 20. “BOSH is an open source tool for release engineering, deployment, lifecycle management, and monitoring of distributed systems.”
- 21. BOSH Director VM
- 29. What does this give us? The Day Two Experience
- 30. ● Declarative and self-healing What does this give us? The Day Two Experience
- 31. ● Declarative and self-healing ● Updates What does this give us? The Day Two Experience
- 32. ● Declarative and self-healing ● Updates ● Scaling What does this give us? The Day Two Experience
- 33. What and Why Kubernetes
- 35. I have 1000s of containers!!
- 36. What is Kubernetes (K8s) • Kubernetes, is an open-source platform for managing, automating deployment, scaling, and operating containerized applications across a cluster of worker nodes. 36 Capabilities: • Deploy your applications quickly and predictably • Scale your applications on the fly • Seamlessly roll out new features • Optimize use of your hardware by using only the resources you need Role: • K8s sits in the Container as a Service (CaaS) or Container orchestration layer
- 37. Deployment_X.yaml ContainerImage1 Replicas: 3 ContainerImage2 Replicas: 2 10,000 Foot View • Container Cluster = “Desired State Management” – Kubernetes Cluster Services (w/API) • Worker = (Container Host) have agent called “Kubelet” • Deployment = Configuration File of desired state • Container Image = Runs in a Pod • Replicas = QTY of Pods that must be running 37 Worker (Container Host) P1R1 Worker (Container Host) P1R2 P2R1 P1R1 P2R1 Worker (Container Host) P1R3 P2R2 P2R2 Kubernetes Cluster Services API K K K Deployment_Y.yaml ContainerImage1 Replicas: 1 ContainerImage2 Replicas: 2 P1R1 P1R2 P2R1
- 38. What and Why of Kubo
- 42. + = KuBo
- 44. What problem does KuBo solve? Uniform way to instantiate, deploy, and manage highly available Kubernetes clusters. On any cloud.
- 45. What and Why of PKS
- 46. 1)Manifests
- 47. 1)Manifests Open Source Cloud Foundry is about 6000 lines of YAML...
- 48. 1)Manifests Open Source Cloud Foundry is about 6000 lines of YAML... ...and writing YAML is not fun
- 49. 2) Tenancy
- 50. 2) Tenancy Everybody wants their own Kubernetes...
- 51. 2) Tenancy This is difficult.
- 52. 2) Tenancy What do dev teams need?
- 53. ● Security 2) Tenancy What do dev teams need?
- 54. ● Security ● Compute performance isolation2) Tenancy What do dev teams need?
- 55. ● Security ● Compute performance isolation ● Network performance isolation 2) Tenancy What do dev teams need?
- 56. ● Security ● Compute performance isolation ● Network performance isolation ● Storage performance isolation 2) Tenancy What do dev teams need?
- 58. BOSH-managed Kubernetes environments (Kubo) provisioned through a service broker. BOSH Service Broker VSphere What is Pivotal Container Service (PKS)? pks cli
- 59. BOSH-managed Kubernetes environments provisioned through a service broker. BOSH Service Broker VSphere What is Pivotal Container Service (PKS)? pks cli
- 60. K8s cluster BOSH-managed Kubernetes environments provisioned through a service broker. BOSH Service Broker VSphere So, what is PKS? pks cli
- 61. K8s cluster BOSH-managed Kubernetes environments provisioned through a service broker. BOSH Service Broker VSphere kubectl So, what is PKS? pks cli
- 62. K8s cluster K8s cluster K8s cluster BOSH-managed Kubernetes environments provisioned through a service broker. BOSH Service Broker VSphere kubectl So, what is PKS? pks cli
- 63. K8s cluster K8s cluster K8s cluster K8s cluster BOSH-managed Kubernetes environments provisioned through a service broker. BOSH Service Broker VSphere K8s cluster K8s cluster kubectl So, what is PKS? pks cli Everyone can have their own Kubernetes!
- 65. Sample v1.0 PKS CLI Experience Deploy a K8s cluster instance $ pks create-service kubo-odb small myk8s Get access credentials to Kubernetes API $ pks create-service-key myk8s myk8s-key Use existing Kubernetes toolchain $ kubectl get pods --namespace=kube-system
- 66. Q&A 66