What do the terms serverless, containers, and virtual machines mean? Which should I use to build my app? The answer (as always) is "it depends." In this session learn the tradeoffs between these different approaches, whether you're building your app from scratch or want to move an existing web or mobile application to the cloud. We'll discuss open source tools such as Kubernetes, Istio, and Knative, and we'll discuss Google Cloud Platform tools like Compute Engine, Google Kubernetes Engine (GKE), App Engine, and Cloud Functions.
GDG Jakarta Meetup - Streaming Analytics With Apache Beam
Google slide version of this slide can be accessed from: https://docs.google.com/presentation/d/1Ws73JxlVH39HiKiYuF3vW903j8wFzxPQihXz4CQ_HZM/edit?usp=sharing
Introduction to gRPC - Mete Atamel - Codemotion Rome 2017
gRPC is a high performance, language-neutral, general RPC framework developed and open sourced by Google. Built on the HTTP/2 standard, gRPC brings many benefits such as bidirectional streaming, flow control, header compression, multiplexing and more. In this session, you will learn about gRPC and how you can use it in your applications.
Cliff Crocker discusses best practices for measuring what matters and applying an understandable methodology that achieves what we are all after: happier users.
Fluent 2018: When third parties stop being polite... and start getting real
At Fluent Conference 2018, Nic Jansma and Charles Vazac perform an honest audit of several popular third-party libraries to understand their true cost to your site, exploring loading patterns, SPOF avoidance, JavaScript parsing, long tasks, runtime overhead, polyfill headaches, security and privacy concerns, and more. They also share tools to help you decide if a library’s risks and unseen costs are worth it.
Google Cloud Platform itself has been on a very rapid rise over the past few years. It has a lot of advantages over AWS or Microsoft Azure. In this slideshow, you can learn more about these top advantages. For more details, you can also read this post https://kinsta.com/blog/google-cloud-hosting/
Google App Engine is a platform as a service that allows developers to build and host web applications at scale on Google's infrastructure. It handles all the complexities of scaling such as automatically increasing the number of application instances in response to traffic. Developers can write code in Python and other languages and App Engine provides APIs for common services like email, storage, databases and more so additional setup is not needed. It also automatically sends code to the nearest data center based on user location for fast performance.
The document provides information about Simon Su and his expertise in Google Dataflow. It includes Simon's contact information and links to his online profiles. It then discusses Simon's areas of specialization including data scientist, data engineer, and frontend engineer. The document proceeds to provide information about preparing for a Google Dataflow workshop, including documents and labs to review. It also discusses Google Cloud services for data processing and analysis like Dataflow, BigQuery, Pub/Sub, and Dataproc. Finally, it outlines the agenda for the workshop, which will include hands-on labs to deploy users' first Dataflow project and create a streaming Dataflow model.
Serverless orchestration and automation with Cloud Workflows
Join this session to understand how Cloud Workflows resolves challenges in connecting services, HTTP based service orchestration and automation. We are going to dive deep how serverless HTTP service automation works to automate step engines. Based on practical examples we will demonstrate the built-in decision and conditional executions, subworkflows, support for external built-in API calls, and integration with any Google Cloud product without worrying about authentication. We are going to cover Marketing, Retail, Industrial and Developer possibilities, such as event driven marketing workflow execution, or inventory chain operations, generating and automatic state machines, or orchestrate DevOps workflows and automating the Cloud.
Cloud Computing:
Cloud computing is the delivery of different services through the Internet. These resources include tools and applications like data storage, servers, databases, networking, and software.
Google Cloud Dataflow can be used to build TensorFlow pipelines. Dataflow allows training multiple TensorFlow models in parallel and writing results to Cloud Datastore. A sample pipeline shows generating training parameters, mapping over them to train models, and writing accuracy results to Cloud Storage. Dataflow provides autoscaling and machine types can be configured. The new DatastoreIO allows reading from and writing to Cloud Datastore from Dataflow pipelines using Protobuf and entity conversion helpers.
This document provides an overview and introduction to Google Cloud Platform products and services including Cloud Datastore, Cloud Storage, Cloud SQL, BigQuery, App Engine, Compute Engine, and more. Key features and benefits are highlighted for each service such as scalability, availability, developer tools and SDKs, pricing models, and comparisons to other cloud offerings. Code samples and steps to get started with the services are also provided.
This document provides an overview of a Firebase workshop. It introduces Firebase services like Authentication, Realtime Database, Cloud Functions, and Cloud Storage. For each service, it discusses what it is, how it works, use cases, and recommendations for using it correctly. It also includes examples using Github repos. The workshop concludes with a Kahoot quiz and a request for feedback.
Optimizing web app delivery speed with PRPL pattern. Interactive demo with Webpack and React sample code. Project available with an incremental 7-step process for free on GitHub. Presentation from Split.JS Meetup.
GitHub project: https://github.com/ModusCreateOrg/react-dynamic-route-loading-es6/tree/steps/6-no-helmet-scripttags
This document provides an overview of Google Compute Engine (GCE), including what it is, the benefits of using it, how to get started, and how to work with the GCE web console and APIs. It demonstrates how to create GCE instances, connect to them using gcutil, and program with the GCE APIs in Java. It also discusses related Google Cloud services and resources for developers.
Presentation at Google DevFest Ahmedabad, December 2014. This talk gives an overview of Google Cloud Platform and then goes into Cloud Endpoints and building out a simple IoT Project
Getting Started with Google's Infrastructure is summarized as follows:
1. Google Cloud Platform provides infrastructure services including virtual machines, networking, and storage hosted on Google's global network of data centers.
2. Google Compute Engine is an infrastructure as a service offering that allows users to launch and manage virtual machine instances.
3. The document provides an overview of Google Compute Engine including machine types, regions, persistent disks, load balancing, and pricing models.
GCP Meetup #3 - Approaches to Cloud Native Architectures
Talk by Daniel Leahy and Nic Gibson, given at the Google Cloud Meetup on March 3, 2020, hosted by Nine Internet Solutions AG - Your Swiss Managed Cloud Service Provider.
Ultimate Guide to Microservice Architecture on Kubernetes
This document provides an overview of microservice architecture on Kubernetes. It discusses:
1. Benefits of microservice architecture like independent deployability and scalability compared to monolithic applications.
2. Best practices for microservices including RESTful design, distributed configuration, client code generation, and API gateways.
3. Tools for microservices on Kubernetes including Prometheus for monitoring, Elasticsearch (ELK) stack for logging, service meshes, and event sourcing with CQRS.
Containerizing GPU Applications with Docker for Scaling to the Cloud
This document discusses containerizing GPU applications with Docker to enable scaling to the cloud. It describes how containers can solve problems of hardware and software portability by allowing applications to run consistently across different infrastructure. The document demonstrates how to build a GPU container using Dockerfiles and deploy it across multiple clouds. It also introduces Boost Containers which combine Bitfusion Boost technology with containers to build virtual GPU machines and clusters, enabling flexible scheduling of GPU workflows without code changes.
Join this workshop and accelerate your journey to production-ready Kubernetes by learning the practical techniques for reliably operating your software lifecycle using the GitOps pattern. The Weaveworks team will be running a full-day workshop, sharing their expertise as users and contributors of Kubernetes and Prometheus, as well as followers of GitOps (operations by pull request) practices.
Using a combination of instructor led demonstrations and hands-on exercises, the workshop will enable the attendee to go into detail on the following topics:
• Developing and operating your Kubernetes microservices at scale
• DevOps best practices and the movement towards a “GitOps” approach
• Building with Kubernetes in production: caring for your apps, implementing CI/CD best practices, and utilizing the right metrics, monitoring tools, and automated alerts
• Operating Kubernetes in production: Upgrading and managing Kubernetes, managing incident response, and adhering to security best practices for Kubernetes
OSDC 2018 | Three years running containers with Kubernetes in Production by T...
The talk gives a state of the art update of experiences with deploying applications in Kubernetes on scale. If in clouds or on premises, Kubernetes took over the leading role as a container operating system. The central paradigm of stateless containers connected to storage and services is the core of Kubernetes. However, it can be extended to distributed databases, Machine Learning, Windows VMs in Kubernetes. All these applications have been considered as edge cases a few years ago, however, are going more and more mainstream today.
Cloud Native Night, April 2018, Mainz: Workshop led by Jörg Schad (@joerg_schad, Technical Community Lead / Developer at Mesosphere)
Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night/
PLEASE NOTE:
During this workshop, Jörg showed many demos and the audience could participate on their laptops. Unfortunately, we can't provide these demos. Nevertheless, Jörg's slides give a deep dive into the topic.
DETAILS ABOUT THE WORKSHOP:
Kubernetes has been one of the topics in 2017 and will probably remain so in 2018. In this hands-on technical workshop you will learn how best to deploy, operate and scale Kubernetes clusters from one to hundreds of nodes using DC/OS. You will learn how to integrate and run Kubernetes alongside traditional applications and fast data services of your choice (e.g. Apache Cassandra, Apache Kafka, Apache Spark, TensorFlow and more) on any infrastructure.
This workshop best suits operators focussed on keeping their apps and services up and running in production and developers focussed on quickly delivering internal and customer facing apps into production.
You will learn how to:
- Introduction to Kubernetes and DC/OS (including the differences between both)
- Deploy Kubernetes on DC/OS in a secure, highly available, and fault-tolerant manner
- Solve operational challenges of running a large/multiple Kubernetes cluster
- One-click deploy big data stateful and stateless services alongside a Kubernetes cluster
This document provides an overview of Docker and cloud native training presented by Brian Christner of 56K.Cloud. It includes an agenda for Docker labs, common IT struggles Docker can address, and 56K.Cloud's consulting and training services. It discusses concepts like containers, microservices, DevOps, infrastructure as code, and cloud migration. It also includes sections on Docker architecture, networking, volumes, logging, and monitoring tools. Case studies and examples are provided to demonstrate how Docker delivers speed, agility, and cost savings for application development.
Knative and Kubernetes - bringing serverless to more developers
(From 2018) Kubernetes and Istio provide a great foundation for orchestrating, monitoring, and scaling your apps. They're open source and work great in your data center or in any major cloud. Meanwhile, the serverless development model has empowered devs to build software faster than ever by eliminating concerns like scaling, networking, load balancing, OS patching, etc.
Come learn how you can combine the power of Kubernetes with the ease of use of serverless to create new, powerful and flexible development experiences.
See me give this talk in 2018 at https://www.youtube.com/watch?v=bYxOx9tcYDE&ab_channel=Devoxx
----
About Bret McGowen
Bret is a Developer Advocate for Serverless on the Google Cloud Platform team at Google, focusing on serverless products like Google Cloud Functions, App Engine, Firebase, machine learning APIs, and more. He's currently an aspiring Node.js developer. Prior to Google, Bret worked as a software engineer in the cloud industry at Rackspace. Before that, he led engineering teams at e-commerce and non-profits and tried his hand at creating two startups. He's often on the running trail, volleyball court or kickball field.
Bret earned a bachelor’s degree in computer science from Texas A&M University.
Reach Bret on Twitter at @bretmcg
Infrastructure-related skills are essential for developers in cross-functional teams who build microservices for the cloud. Becoming proficient in infrastructure development is not just about understanding the hardware and software components on top of which applications run in the cloud. It's also about being able to use the tools that provide virtual access to this infrastructure and enable us to provision, configure, monitor it, and deploy applications to it. In this talk Gesa shares how building a Kubernetes cluster of Raspberry Pis and serving applications from it can help in acquiring fundamental infrastructure skills.
This document provides an overview of the history and evolution of cloud computing models. It discusses how cloud computing has moved from traditional on-premises software to software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS). It also describes how containers helped revolutionize IT by providing standardized, portable, and efficient application packaging and deployment. The document outlines some of the key benefits that containers provide to customers and discusses related technologies like Kubernetes for container orchestration.
Enabling Cognitive Workloads on the Cloud: GPUs with Mesos, Docker and Marath...
This document provides an overview of enabling cognitive workloads on the cloud using GPUs with Mesos, Docker, and Marathon on IBM's POWER systems. It discusses requirements for GPUs in the cloud like exposing GPUs to containers and supporting multiple GPUs per node. It also summarizes Mesos and Kubernetes support for GPUs, and demonstrates running a deep learning workload on OpenPOWER hardware to identify dog breeds using Docker containers and GPUs.
As a k8s cluster-admin your app teams have a certain expectation of your cluster to be available to deploy services at any time without problems. While there is no shortage on metrics in k8s its important to have the right metrics to alert on issues and giving you enough data to react to potential availability issues. Prometheus has become a standard and sheds light on the inner behaviour of Kubernetes clusters and workloads. Lots of KPIs (CPU, IO, network. Etc) in our On-Premise environment are less precise when we start to work in a Cloud environment. Ebpf is the perfect technology that fulfills that requirement as it gives us information down to the kernel level. In 2018 Cloudflare shared an opensource project to expose custom ebpf metrics in Prometheus. Join this session and learn about: • What is ebpf? • What type of metrics we can collect? • How to expose those metrics in a K8s environment. This session will try to deliver a step-by-step guide on how to take advantage of the ebpf exporter.
This document discusses microservices and containers. It provides an overview of microservices architecture compared to monolithic architecture, highlighting that microservices are composed of many small, independent services with separate deployments and databases. It then discusses containers and how Docker is used to package and run applications in isolated containers. Finally, it introduces Kubernetes as a container orchestration system to manage and scale multiple containerized applications across a cluster of machines.
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
Az előadás témája hogyan építhető fel egy rugalmas, jól skálázható szolgáltatás a felhőszolgáltatók platformjain. Hogyan lehet megoldani, hogy a szolgáltatás, amelynek induláskor legfeljebb néhány tíz vagy száz felhasználót kell kiszolgálnia, akár több ezer vagy nagyságrendekkel több felhasználót is képes legyen kiszolgálni rugalmasan? Hátradőlni és csodálni az autoscaling funkciót a Black Friday napján. Beszélni fogunk virtualizációról, platformszintű virtualizációről, szuperkönnyű alkalmazáskonténerekről, a munkaterhek közel valósidejű “pakolgatásával”. Bemutatásra kerül a Google Cloud Platform számos komponense. Bankok, biztosítók, webshopok és így tovább mind a cloudban látják a kitörési pontot.
Sprekers: Stijn Van den Enden & Stijn Wijndaele (ACA IT-Solutions) DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.
In deze avondconferentie werd, na een korte toelichting over DevOps, nagegaan wat Docker en de Cloud kunnen betekenen voor uw business, en hoe zij als enablers kunnen dienen voor het tot stand brengen van een DevOps-cultuur. Het container-landschap waarvan tools zoals Kubernetes, Docker Swarm, ...een belangrijk onderdeel vormen, wordt toegelicht en er wordt ingegaan op de wijze waarop deze tools aangewend kunnen worden om 'development' en 'operations' efficiënt te laten samenwerken.
DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.
Kubernetes: від знайомства до використання у CI/CD
Kubernetes: від знайомства до використання у CI/CD
Олександр Занічковський
Technical Lead у компанії SoftServe
14+ років досвіду розробки різноманітного програмного забезпечення, як для десктопа, так і для веб
Працював фріланс-програмістом та в команді
Цікавиться архітектурою ПЗ, автоматизацією процесів інтеграції та доставки нових версій продукту, хмарними технологіями
Віднедавна займається менторінгом майбутніх техлідів
У вільний від роботи час грає на гітарі і мріє про велику сцену
Олександр поділиться власним досвідом роботи з Kubernetes:
ознайомить з базовими поняттями та примітивами K8S
опише можливі сценарії використання Kubernetes для CI/CD на прикладі GitLab
покаже, як можна використовувати постійне сховище, збирати метрики контейнерів, використовувати Ingress для роутинга запитів за певними правилами
покаже, як можна самому встановити K8S для ознайомлення чи локальної роботи
We are honored to launch and host this event for our UiPath Polish Community, with the help of our partners - Proservartner!
We certainly hope we have managed to spike your interest in the subjects to be presented and the incredible networking opportunities at hand, too!
Check out our proposed agenda below 👇👇
08:30 ☕ Welcome coffee (30')
09:00 Opening note/ Intro to UiPath Community (10')
Cristina Vidu, Global Manager, Marketing Community @UiPath
Dawid Kot, Digital Transformation Lead @Proservartner
09:10 Cloud migration - Proservartner & DOVISTA case study (30')
Marcin Drozdowski, Automation CoE Manager @DOVISTA
Pawel Kamiński, RPA developer @DOVISTA
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
09:40 From bottlenecks to breakthroughs: Citizen Development in action (25')
Pawel Poplawski, Director, Improvement and Automation @McCormick & Company
Michał Cieślak, Senior Manager, Automation Programs @McCormick & Company
10:05 Next-level bots: API integration in UiPath Studio (30')
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
10:35 ☕ Coffee Break (15')
10:50 Document Understanding with my RPA Companion (45')
Ewa Gruszka, Enterprise Sales Specialist, AI & ML @UiPath
11:35 Power up your Robots: GenAI and GPT in REFramework (45')
Krzysztof Karaszewski, Global RPA Product Manager
12:20 🍕 Lunch Break (1hr)
13:20 From Concept to Quality: UiPath Test Suite for AI-powered Knowledge Bots (30')
Kamil Miśko, UiPath MVP, Senior RPA Developer @Zurich Insurance
13:50 Communications Mining - focus on AI capabilities (30')
Thomasz Wierzbicki, Business Analyst @Office Samurai
14:20 Polish MVP panel: Insights on MVP award achievements and career profiling
Invited Remote Lecture to SC21
The International Conference for High Performance Computing, Networking, Storage, and Analysis
St. Louis, Missouri
November 18, 2021
Sustainability requires ingenuity and stewardship. Did you know Pigging Solutions pigging systems help you achieve your sustainable manufacturing goals AND provide rapid return on investment.
How? Our systems recover over 99% of product in transfer piping. Recovering trapped product from transfer lines that would otherwise become flush-waste, means you can increase batch yields and eliminate flush waste. From raw materials to finished product, if you can pump it, we can pig it.
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
Your comprehensive guide to RPA in healthcare for 2024. Explore the benefits, use cases, and emerging trends of robotic process automation. Understand the challenges and prepare for the future of healthcare automation
7 Most Powerful Solar Storms in the History of Earth.pdf
Solar Storms (Geo Magnetic Storms) are the motion of accelerated charged particles in the solar environment with high velocities due to the coronal mass ejection (CME).
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
Transcript: Details of description part II: Describing images in practice - T...
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Cybersecurity is a major concern in today's connected digital world. Threats to organizations are constantly evolving and have the potential to compromise sensitive information, disrupt operations, and lead to significant financial losses. Traditional cybersecurity techniques often fall short against modern attackers. Therefore, advanced techniques for cyber security analysis and anomaly detection are essential for protecting digital assets. This blog explores these cutting-edge methods, providing a comprehensive overview of their application and importance.
Blockchain technology is transforming industries and reshaping the way we conduct business, manage data, and secure transactions. Whether you're new to blockchain or looking to deepen your knowledge, our guidebook, "Blockchain for Dummies", is your ultimate resource.
These fighter aircraft have uses outside of traditional combat situations. They are essential in defending India's territorial integrity, averting dangers, and delivering aid to those in need during natural calamities. Additionally, the IAF improves its interoperability and fortifies international military alliances by working together and conducting joint exercises with other air forces.
Choose our Linux Web Hosting for a seamless and successful online presence
Our Linux Web Hosting plans offer unbeatable performance, security, and scalability, ensuring your website runs smoothly and efficiently.
Visit- https://onliveserver.com/linux-web-hosting/
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami, Bailan He, Gengyuan Zhang, Ruotong Liao, Yao Qin, Volker Tresp, Philip Torr "A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models" arXiv2023
https://arxiv.org/abs/2307.12980
GDG Heraklion - Architecting for the Google Cloud PlatformMárton Kodok
Learn about cloud components, architecture overviews to build an app using GCP components.
You will get hands-on information on how to build highly scalable and flexible applications optimized to run in GCP on the same infrastructure that powers Google. We will discuss cloud concepts and highlights various design patterns and best practices.
By the end of the session you will have hands-on experience to build a basic cloud application, it could be a simple web tier, powered by highly distributed database, background tasks executed on a pub/subsystem, and you get information how to go next level with advanced concepts like analytics warehouse, recommendation engines, and ML.
What is Google Cloud Platform - GDG DevFest 18 DepokImre Nagi
This document provides an overview of Google Cloud Platform (GCP) services presented by Imre Nagi. It discusses:
1. What cloud computing is and how GCP provides infrastructure like virtual machines, networking, and storage in Google's data centers while handling scaling, migrations, and maintenance.
2. The main GCP services including Compute Engine, Kubernetes Engine, App Engine, and Cloud Functions for deploying applications, as well as storage, database, analytics, and machine learning services.
3. Options for deploying applications to GCP including using Compute Engine virtual machines, containers on Kubernetes Engine, or serverless functions on Cloud Functions. It notes advantages of managed services like App Engine over unmanaged infrastructure.
Google Cloud Platform (GCP) allows developers to build and deploy applications at scale. GCP provides infrastructure like virtual machines and containers to deploy applications without hardware limitations. It also offers services for continuous integration/delivery (CI/CD) pipelines, monitoring, error handling, and machine learning/artificial intelligence to add capabilities to applications. Completing a 30 day training on GCP can help engineers become more dynamic by learning how to use GCP's full suite of tools and services to build real-world applications.
GDG Jakarta Meetup - Streaming Analytics With Apache BeamImre Nagi
Google slide version of this slide can be accessed from: https://docs.google.com/presentation/d/1Ws73JxlVH39HiKiYuF3vW903j8wFzxPQihXz4CQ_HZM/edit?usp=sharing
Introduction to gRPC - Mete Atamel - Codemotion Rome 2017Codemotion
gRPC is a high performance, language-neutral, general RPC framework developed and open sourced by Google. Built on the HTTP/2 standard, gRPC brings many benefits such as bidirectional streaming, flow control, header compression, multiplexing and more. In this session, you will learn about gRPC and how you can use it in your applications.
Cliff Crocker discusses best practices for measuring what matters and applying an understandable methodology that achieves what we are all after: happier users.
At Fluent Conference 2018, Nic Jansma and Charles Vazac perform an honest audit of several popular third-party libraries to understand their true cost to your site, exploring loading patterns, SPOF avoidance, JavaScript parsing, long tasks, runtime overhead, polyfill headaches, security and privacy concerns, and more. They also share tools to help you decide if a library’s risks and unseen costs are worth it.
Google Cloud Platform itself has been on a very rapid rise over the past few years. It has a lot of advantages over AWS or Microsoft Azure. In this slideshow, you can learn more about these top advantages. For more details, you can also read this post https://kinsta.com/blog/google-cloud-hosting/
Google App Engine is a platform as a service that allows developers to build and host web applications at scale on Google's infrastructure. It handles all the complexities of scaling such as automatically increasing the number of application instances in response to traffic. Developers can write code in Python and other languages and App Engine provides APIs for common services like email, storage, databases and more so additional setup is not needed. It also automatically sends code to the nearest data center based on user location for fast performance.
The document provides information about Simon Su and his expertise in Google Dataflow. It includes Simon's contact information and links to his online profiles. It then discusses Simon's areas of specialization including data scientist, data engineer, and frontend engineer. The document proceeds to provide information about preparing for a Google Dataflow workshop, including documents and labs to review. It also discusses Google Cloud services for data processing and analysis like Dataflow, BigQuery, Pub/Sub, and Dataproc. Finally, it outlines the agenda for the workshop, which will include hands-on labs to deploy users' first Dataflow project and create a streaming Dataflow model.
Serverless orchestration and automation with Cloud WorkflowsMárton Kodok
Join this session to understand how Cloud Workflows resolves challenges in connecting services, HTTP based service orchestration and automation. We are going to dive deep how serverless HTTP service automation works to automate step engines. Based on practical examples we will demonstrate the built-in decision and conditional executions, subworkflows, support for external built-in API calls, and integration with any Google Cloud product without worrying about authentication. We are going to cover Marketing, Retail, Industrial and Developer possibilities, such as event driven marketing workflow execution, or inventory chain operations, generating and automatic state machines, or orchestrate DevOps workflows and automating the Cloud.
Cloud Computing:
Cloud computing is the delivery of different services through the Internet. These resources include tools and applications like data storage, servers, databases, networking, and software.
Google Cloud Dataflow can be used to build TensorFlow pipelines. Dataflow allows training multiple TensorFlow models in parallel and writing results to Cloud Datastore. A sample pipeline shows generating training parameters, mapping over them to train models, and writing accuracy results to Cloud Storage. Dataflow provides autoscaling and machine types can be configured. The new DatastoreIO allows reading from and writing to Cloud Datastore from Dataflow pipelines using Protobuf and entity conversion helpers.
Google Cloud Platform 2014Q1 - Starter GuideSimon Su
This document provides an overview and introduction to Google Cloud Platform products and services including Cloud Datastore, Cloud Storage, Cloud SQL, BigQuery, App Engine, Compute Engine, and more. Key features and benefits are highlighted for each service such as scalability, availability, developer tools and SDKs, pricing models, and comparisons to other cloud offerings. Code samples and steps to get started with the services are also provided.
This document provides an overview of a Firebase workshop. It introduces Firebase services like Authentication, Realtime Database, Cloud Functions, and Cloud Storage. For each service, it discusses what it is, how it works, use cases, and recommendations for using it correctly. It also includes examples using Github repos. The workshop concludes with a Kahoot quiz and a request for feedback.
Optimizing web app delivery speed with PRPL pattern. Interactive demo with Webpack and React sample code. Project available with an incremental 7-step process for free on GitHub. Presentation from Split.JS Meetup.
GitHub project: https://github.com/ModusCreateOrg/react-dynamic-route-loading-es6/tree/steps/6-no-helmet-scripttags
This document provides an overview of Google Compute Engine (GCE), including what it is, the benefits of using it, how to get started, and how to work with the GCE web console and APIs. It demonstrates how to create GCE instances, connect to them using gcutil, and program with the GCE APIs in Java. It also discusses related Google Cloud services and resources for developers.
Powering your Apps via Google Cloud PlatformRomin Irani
Presentation at Google DevFest Ahmedabad, December 2014. This talk gives an overview of Google Cloud Platform and then goes into Cloud Endpoints and building out a simple IoT Project
Getting Started with Google's Infrastructure is summarized as follows:
1. Google Cloud Platform provides infrastructure services including virtual machines, networking, and storage hosted on Google's global network of data centers.
2. Google Compute Engine is an infrastructure as a service offering that allows users to launch and manage virtual machine instances.
3. The document provides an overview of Google Compute Engine including machine types, regions, persistent disks, load balancing, and pricing models.
GCP Meetup #3 - Approaches to Cloud Native Architecturesnine
Talk by Daniel Leahy and Nic Gibson, given at the Google Cloud Meetup on March 3, 2020, hosted by Nine Internet Solutions AG - Your Swiss Managed Cloud Service Provider.
Ultimate Guide to Microservice Architecture on Kuberneteskloia
This document provides an overview of microservice architecture on Kubernetes. It discusses:
1. Benefits of microservice architecture like independent deployability and scalability compared to monolithic applications.
2. Best practices for microservices including RESTful design, distributed configuration, client code generation, and API gateways.
3. Tools for microservices on Kubernetes including Prometheus for monitoring, Elasticsearch (ELK) stack for logging, service meshes, and event sourcing with CQRS.
Containerizing GPU Applications with Docker for Scaling to the CloudSubbu Rama
This document discusses containerizing GPU applications with Docker to enable scaling to the cloud. It describes how containers can solve problems of hardware and software portability by allowing applications to run consistently across different infrastructure. The document demonstrates how to build a GPU container using Dockerfiles and deploy it across multiple clouds. It also introduces Boost Containers which combine Bitfusion Boost technology with containers to build virtual GPU machines and clusters, enabling flexible scheduling of GPU workflows without code changes.
Join this workshop and accelerate your journey to production-ready Kubernetes by learning the practical techniques for reliably operating your software lifecycle using the GitOps pattern. The Weaveworks team will be running a full-day workshop, sharing their expertise as users and contributors of Kubernetes and Prometheus, as well as followers of GitOps (operations by pull request) practices.
Using a combination of instructor led demonstrations and hands-on exercises, the workshop will enable the attendee to go into detail on the following topics:
• Developing and operating your Kubernetes microservices at scale
• DevOps best practices and the movement towards a “GitOps” approach
• Building with Kubernetes in production: caring for your apps, implementing CI/CD best practices, and utilizing the right metrics, monitoring tools, and automated alerts
• Operating Kubernetes in production: Upgrading and managing Kubernetes, managing incident response, and adhering to security best practices for Kubernetes
OSDC 2018 | Three years running containers with Kubernetes in Production by T...NETWAYS
The talk gives a state of the art update of experiences with deploying applications in Kubernetes on scale. If in clouds or on premises, Kubernetes took over the leading role as a container operating system. The central paradigm of stateless containers connected to storage and services is the core of Kubernetes. However, it can be extended to distributed databases, Machine Learning, Windows VMs in Kubernetes. All these applications have been considered as edge cases a few years ago, however, are going more and more mainstream today.
Cloud Native Night, April 2018, Mainz: Workshop led by Jörg Schad (@joerg_schad, Technical Community Lead / Developer at Mesosphere)
Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night/
PLEASE NOTE:
During this workshop, Jörg showed many demos and the audience could participate on their laptops. Unfortunately, we can't provide these demos. Nevertheless, Jörg's slides give a deep dive into the topic.
DETAILS ABOUT THE WORKSHOP:
Kubernetes has been one of the topics in 2017 and will probably remain so in 2018. In this hands-on technical workshop you will learn how best to deploy, operate and scale Kubernetes clusters from one to hundreds of nodes using DC/OS. You will learn how to integrate and run Kubernetes alongside traditional applications and fast data services of your choice (e.g. Apache Cassandra, Apache Kafka, Apache Spark, TensorFlow and more) on any infrastructure.
This workshop best suits operators focussed on keeping their apps and services up and running in production and developers focussed on quickly delivering internal and customer facing apps into production.
You will learn how to:
- Introduction to Kubernetes and DC/OS (including the differences between both)
- Deploy Kubernetes on DC/OS in a secure, highly available, and fault-tolerant manner
- Solve operational challenges of running a large/multiple Kubernetes cluster
- One-click deploy big data stateful and stateless services alongside a Kubernetes cluster
This document provides an overview of Docker and cloud native training presented by Brian Christner of 56K.Cloud. It includes an agenda for Docker labs, common IT struggles Docker can address, and 56K.Cloud's consulting and training services. It discusses concepts like containers, microservices, DevOps, infrastructure as code, and cloud migration. It also includes sections on Docker architecture, networking, volumes, logging, and monitoring tools. Case studies and examples are provided to demonstrate how Docker delivers speed, agility, and cost savings for application development.
(From 2018) Kubernetes and Istio provide a great foundation for orchestrating, monitoring, and scaling your apps. They're open source and work great in your data center or in any major cloud. Meanwhile, the serverless development model has empowered devs to build software faster than ever by eliminating concerns like scaling, networking, load balancing, OS patching, etc.
Come learn how you can combine the power of Kubernetes with the ease of use of serverless to create new, powerful and flexible development experiences.
See me give this talk in 2018 at https://www.youtube.com/watch?v=bYxOx9tcYDE&ab_channel=Devoxx
----
About Bret McGowen
Bret is a Developer Advocate for Serverless on the Google Cloud Platform team at Google, focusing on serverless products like Google Cloud Functions, App Engine, Firebase, machine learning APIs, and more. He's currently an aspiring Node.js developer. Prior to Google, Bret worked as a software engineer in the cloud industry at Rackspace. Before that, he led engineering teams at e-commerce and non-profits and tried his hand at creating two startups. He's often on the running trail, volleyball court or kickball field.
Bret earned a bachelor’s degree in computer science from Texas A&M University.
Reach Bret on Twitter at @bretmcg
Can i service this from my raspberry piThoughtworks
Infrastructure-related skills are essential for developers in cross-functional teams who build microservices for the cloud. Becoming proficient in infrastructure development is not just about understanding the hardware and software components on top of which applications run in the cloud. It's also about being able to use the tools that provide virtual access to this infrastructure and enable us to provision, configure, monitor it, and deploy applications to it. In this talk Gesa shares how building a Kubernetes cluster of Raspberry Pis and serving applications from it can help in acquiring fundamental infrastructure skills.
20190613 - IBM Cloud Côte d'Azur meetup - "Cloud & Containers"IBM France Lab
This document provides an overview of the history and evolution of cloud computing models. It discusses how cloud computing has moved from traditional on-premises software to software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS). It also describes how containers helped revolutionize IT by providing standardized, portable, and efficient application packaging and deployment. The document outlines some of the key benefits that containers provide to customers and discusses related technologies like Kubernetes for container orchestration.
Enabling Cognitive Workloads on the Cloud: GPUs with Mesos, Docker and Marath...Indrajit Poddar
This document provides an overview of enabling cognitive workloads on the cloud using GPUs with Mesos, Docker, and Marathon on IBM's POWER systems. It discusses requirements for GPUs in the cloud like exposing GPUs to containers and supporting multiple GPUs per node. It also summarizes Mesos and Kubernetes support for GPUs, and demonstrates running a deep learning workload on OpenPOWER hardware to identify dog breeds using Docker containers and GPUs.
Using eBPF to Measure the k8s Cluster HealthScyllaDB
As a k8s cluster-admin your app teams have a certain expectation of your cluster to be available to deploy services at any time without problems. While there is no shortage on metrics in k8s its important to have the right metrics to alert on issues and giving you enough data to react to potential availability issues. Prometheus has become a standard and sheds light on the inner behaviour of Kubernetes clusters and workloads. Lots of KPIs (CPU, IO, network. Etc) in our On-Premise environment are less precise when we start to work in a Cloud environment. Ebpf is the perfect technology that fulfills that requirement as it gives us information down to the kernel level. In 2018 Cloudflare shared an opensource project to expose custom ebpf metrics in Prometheus. Join this session and learn about: • What is ebpf? • What type of metrics we can collect? • How to expose those metrics in a K8s environment. This session will try to deliver a step-by-step guide on how to take advantage of the ebpf exporter.
Microservices , Docker , CI/CD , Kubernetes Seminar - Sri Lanka Mario Ishara Fernando
This document discusses microservices and containers. It provides an overview of microservices architecture compared to monolithic architecture, highlighting that microservices are composed of many small, independent services with separate deployments and databases. It then discusses containers and how Docker is used to package and run applications in isolated containers. Finally, it introduces Kubernetes as a container orchestration system to manage and scale multiple containerized applications across a cluster of machines.
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud PlatformonMárton Kodok
Az előadás témája hogyan építhető fel egy rugalmas, jól skálázható szolgáltatás a felhőszolgáltatók platformjain. Hogyan lehet megoldani, hogy a szolgáltatás, amelynek induláskor legfeljebb néhány tíz vagy száz felhasználót kell kiszolgálnia, akár több ezer vagy nagyságrendekkel több felhasználót is képes legyen kiszolgálni rugalmasan? Hátradőlni és csodálni az autoscaling funkciót a Black Friday napján. Beszélni fogunk virtualizációról, platformszintű virtualizációről, szuperkönnyű alkalmazáskonténerekről, a munkaterhek közel valósidejű “pakolgatásával”. Bemutatásra kerül a Google Cloud Platform számos komponense. Bankok, biztosítók, webshopok és így tovább mind a cloudban látják a kitörési pontot.
Sprekers: Stijn Van den Enden & Stijn Wijndaele (ACA IT-Solutions) DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.
In deze avondconferentie werd, na een korte toelichting over DevOps, nagegaan wat Docker en de Cloud kunnen betekenen voor uw business, en hoe zij als enablers kunnen dienen voor het tot stand brengen van een DevOps-cultuur. Het container-landschap waarvan tools zoals Kubernetes, Docker Swarm, ...een belangrijk onderdeel vormen, wordt toegelicht en er wordt ingegaan op de wijze waarop deze tools aangewend kunnen worden om 'development' en 'operations' efficiënt te laten samenwerken.
Docker and Cloud - Enables for DevOps - by ACA-ITStijn Wijndaele
DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.
Kubernetes: від знайомства до використання у CI/CDStfalcon Meetups
Kubernetes: від знайомства до використання у CI/CD
Олександр Занічковський
Technical Lead у компанії SoftServe
14+ років досвіду розробки різноманітного програмного забезпечення, як для десктопа, так і для веб
Працював фріланс-програмістом та в команді
Цікавиться архітектурою ПЗ, автоматизацією процесів інтеграції та доставки нових версій продукту, хмарними технологіями
Віднедавна займається менторінгом майбутніх техлідів
У вільний від роботи час грає на гітарі і мріє про велику сцену
Олександр поділиться власним досвідом роботи з Kubernetes:
ознайомить з базовими поняттями та примітивами K8S
опише можливі сценарії використання Kubernetes для CI/CD на прикладі GitLab
покаже, як можна використовувати постійне сховище, збирати метрики контейнерів, використовувати Ingress для роутинга запитів за певними правилами
покаже, як можна самому встановити K8S для ознайомлення чи локальної роботи
Similar to Where should I run my code? Serverless, Containers, Virtual Machines and more (20)
UiPath Community Day Kraków: Devs4Devs ConferenceUiPathCommunity
We are honored to launch and host this event for our UiPath Polish Community, with the help of our partners - Proservartner!
We certainly hope we have managed to spike your interest in the subjects to be presented and the incredible networking opportunities at hand, too!
Check out our proposed agenda below 👇👇
08:30 ☕ Welcome coffee (30')
09:00 Opening note/ Intro to UiPath Community (10')
Cristina Vidu, Global Manager, Marketing Community @UiPath
Dawid Kot, Digital Transformation Lead @Proservartner
09:10 Cloud migration - Proservartner & DOVISTA case study (30')
Marcin Drozdowski, Automation CoE Manager @DOVISTA
Pawel Kamiński, RPA developer @DOVISTA
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
09:40 From bottlenecks to breakthroughs: Citizen Development in action (25')
Pawel Poplawski, Director, Improvement and Automation @McCormick & Company
Michał Cieślak, Senior Manager, Automation Programs @McCormick & Company
10:05 Next-level bots: API integration in UiPath Studio (30')
Mikolaj Zielinski, UiPath MVP, Senior Solutions Engineer @Proservartner
10:35 ☕ Coffee Break (15')
10:50 Document Understanding with my RPA Companion (45')
Ewa Gruszka, Enterprise Sales Specialist, AI & ML @UiPath
11:35 Power up your Robots: GenAI and GPT in REFramework (45')
Krzysztof Karaszewski, Global RPA Product Manager
12:20 🍕 Lunch Break (1hr)
13:20 From Concept to Quality: UiPath Test Suite for AI-powered Knowledge Bots (30')
Kamil Miśko, UiPath MVP, Senior RPA Developer @Zurich Insurance
13:50 Communications Mining - focus on AI capabilities (30')
Thomasz Wierzbicki, Business Analyst @Office Samurai
14:20 Polish MVP panel: Insights on MVP award achievements and career profiling
The Rise of Supernetwork Data Intensive ComputingLarry Smarr
Invited Remote Lecture to SC21
The International Conference for High Performance Computing, Networking, Storage, and Analysis
St. Louis, Missouri
November 18, 2021
Sustainability requires ingenuity and stewardship. Did you know Pigging Solutions pigging systems help you achieve your sustainable manufacturing goals AND provide rapid return on investment.
How? Our systems recover over 99% of product in transfer piping. Recovering trapped product from transfer lines that would otherwise become flush-waste, means you can increase batch yields and eliminate flush waste. From raw materials to finished product, if you can pump it, we can pig it.
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxSynapseIndia
Your comprehensive guide to RPA in healthcare for 2024. Explore the benefits, use cases, and emerging trends of robotic process automation. Understand the challenges and prepare for the future of healthcare automation
7 Most Powerful Solar Storms in the History of Earth.pdfEnterprise Wired
Solar Storms (Geo Magnetic Storms) are the motion of accelerated charged particles in the solar environment with high velocities due to the coronal mass ejection (CME).
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
Transcript: Details of description part II: Describing images in practice - T...BookNet Canada
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and slides: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionBert Blevins
Cybersecurity is a major concern in today's connected digital world. Threats to organizations are constantly evolving and have the potential to compromise sensitive information, disrupt operations, and lead to significant financial losses. Traditional cybersecurity techniques often fall short against modern attackers. Therefore, advanced techniques for cyber security analysis and anomaly detection are essential for protecting digital assets. This blog explores these cutting-edge methods, providing a comprehensive overview of their application and importance.
Blockchain technology is transforming industries and reshaping the way we conduct business, manage data, and secure transactions. Whether you're new to blockchain or looking to deepen your knowledge, our guidebook, "Blockchain for Dummies", is your ultimate resource.
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfjackson110191
These fighter aircraft have uses outside of traditional combat situations. They are essential in defending India's territorial integrity, averting dangers, and delivering aid to those in need during natural calamities. Additionally, the IAF improves its interoperability and fortifies international military alliances by working together and conducting joint exercises with other air forces.
Choose our Linux Web Hosting for a seamless and successful online presencerajancomputerfbd
Our Linux Web Hosting plans offer unbeatable performance, security, and scalability, ensuring your website runs smoothly and efficiently.
Visit- https://onliveserver.com/linux-web-hosting/
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...Toru Tamaki
Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami, Bailan He, Gengyuan Zhang, Ruotong Liao, Yao Qin, Volker Tresp, Philip Torr "A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models" arXiv2023
https://arxiv.org/abs/2307.12980
11. @BretMcG
Virtual
Machines
Google Compute Engine
Infrastructure as a Service
// Require the Stripe library w/ secret key.
const stripe = require('stripe')('sk_key...');
// Create a payment from a test card token.
const charge = await stripe.charges.create({
amount: 2000,
currency: 'usd',
source: 'tok_amex',
description: 'My first payment'
});
14. @BretMcG
Virtual machines and networking
● Per VM max: 160 CPUs, 3,844 GB of RAM, 64 TB of
disk, 96 GPUs, TPUs
● Independently configurable, including disk!
● Sole tenant nodes
Start quickly, ~20 seconds to user code running
Pre-built images, or create your own
● Debian, CentOS, CoreOS, Ubuntu, RHEL, SUSE
● Windows Server Datacenter: 2008, 2012 R2, 2016
What is Compute Engine?
Run your software
15. @BretMcG
Disk
Persistent Disk
● Live resize
● Network based
● Configure size (to 64 TB)
● Disk or SSD
● Independent of VM
Global Snapshots
Multi-VM RO mount
● Larger disks == more throughput
Local SSD
● Lowest latency
● 375 GB per disk (up to 8)
● Tied to VM lifecycle
16. @BretMcG
More than just virtual machines
Can run Docker containers directly on Container Optimized OS
Managed Instance Groups
● template / image based
● autoscaling
● regional groups (multi-zone)
● rolling updates and canaries
Load Balancer --> Google Front End, 1M QPS
17. @BretMcG
What do you think about?
Your software
Updating your software
Operating system / disk images
CPU, RAM, Disk
Networking
● Firewall rules
● Load balancers
● VPNs
18. @BretMcG
Good fit? Constraints?
Good fit
Existing systems (lift and shift)
1:1 container:VM mapping
Specific OS / kernel required
License requirements
Running databases
Network protocols beyond HTTP/S
Constraints
Scaling speed floor
~20s per VM, 1000s in ~60s
Decide how to handle software
updates yourself
20. @BretMcG
Why Compute Engine?
Consistency - ask for 10 VMs, you get 10 good VMs
Custom VMs - choose RAM and CPU, GPUs
Live disk resize - also any size disk on any machine
Billing - Sustained use discounts, preemptible VMs, per minute billing
Live migrations - your VMs stay up longer
Architecture - good fit for most existing systems
BTW, we run services on GCE, too.
26. @BretMcG
kernel
libs
app
app app
app
Shared machines
x
x
x
No isolation
Common libs
Highly coupled apps & OS
x
libs
app
kernel
libs
app
libs
app
libs
app
Containers
Isolation
No common libs
Less overhead
Less dependency on host OS
Evolution of app infrastructure
x
x
app
libs
kernel
libs
app app
kernel
app
libs
libs
kernel
kernel
Virtual Machines
Isolation
No common libs
Expensive and inefficient
Hard to manage
29. @BretMcG
I've got a bunch of apps/services
running in containers. Now what?
Kubernetes is open source and the
de facto platform for running containers.
30. @BretMcG
Kubernetes handles...
Scheduling:
Decide where my containers should run
Lifecycle and health:
Keep my containers running despite failures
Scaling:
Make sets of containers bigger or smaller
Naming and discovery:
Find where my containers are now
Load balancing:
Distribute traffic across a set of containers
Storage volumes:
Provide data to containers
Logging and monitoring:
Track what’s happening with my containers
Debugging and introspection:
Enter or attach to containers
Identity and authorization:
Control who can do things to my containers
31. @BretMcG
Making your app robust
Kubernetes keeps your applications running while you're asleep.
● Container died?
○ Restart it.
● Container unhealthy?
○ Reschedule to another node.
● Container overloaded?
○ Add more replicas automatically.
36. @BretMcG
What do you think about?
Logical infrastructure
Applications, not computers or containers
Whiteboarding view
● What programs?
● How are they connected?
● Where do they store state?
37. @BretMcG
Good fit? Constraints?
Good fit
Run app in multiple environments
● Clouds, hybrid, dev/test/prod
Take full advantage of containers
Have good team communication
● Between dev, ops, security, etc.
Have or want CI/CD pipeline
Network protocols beyond HTTP/S
Constraints
Must use containers
Licensing (ex: per-machine)
Some architectural constraints
40. @BretMcG
Developers using Kubernetes still have a lot to do
Have to do
Write code
Build docker image
Upload image to registry
Deploy service
Expose to the internet
Setup logging & monitoring
Scale workload
Want to do
Write code
41. @BretMcG
It's not the right abstraction for end-developer experience.
(This did not stop developers from using Kubernetes directly!)
But it's a great platform for building a PaaS on top of.
Kubernetes isn't actually for developers
46. @BretMcG
What is App Engine?
App Engine goal: let developers focus on code, while we handle the rest
“Serverless” before it was cool ;)
Started in 2008, with tradeoff: write it this way, we'll scale for you
Geared toward HTTP/web-facing applications
Can scale very quickly
47. @BretMcG
App Engine Standard (2nd gen)
● Open-source, idiomatic experience
● Use any extension, binary, or framework
● Supported Runtimes
○ Python 3.7
○ Java 8
○ Node.js 8, and Node.js 10 (beta)
○ PHP 7.2 (beta)
○ Go 1.11
48. @BretMcG
App Engine
Standard (2nd gen)
● Open-source, idiomatic experience
● Use any extension, binary, or framework
● Supported Runtimes
○ Python 3.7
○ Java 8
○ Node.js 8, and Node.js 10 (beta)
○ PHP 7.2 (beta)
○ Go 1.11
App Engine
Flexible
● Runs Docker containers
● Open source runtimes for Node.js, Ruby,
Java, Python, Go, PHP, .NET
● Also, if it runs in a Docker container,
you can run it ← nearly everything
49. @BretMcG
App Engine runtimes
Standard Standard 2nd generation
(soon!)
Flexible
Python 2.X, Java, PHP, Go Node.js 8 & 10, Python 3.7,
Go 1.11, PHP 7.2,
Node.js, Ruby, Java, Python,
Go, PHP, .NET
& custom container images
Sandboxed processes Runs on managed VMs
GAE specific APIs + GCP APIs Use GCP APIs directly
No binary modules/libraries any extension, binary, or framework
open-source, idiomatic experience
51. @BretMcG
Good fit? Constraints?
Good fit
HTTP/S request-response
Stateless serving applications
Scaling to high traffic
Constraints
Standard (1st gen)
● Runtimes for Python, Java, PHP, Go, Node
Standard (2nd gen)
● Can use use binary extensions
● Python, Node, Java, Go
Flexible runtimes
● Inherit Docker constraints
● Not best for very low traffic sites
52. @BretMcG
Why App Engine?
Developers focus on code, while we handle the rest
Optimized for web serving workloads
Especially great for variable load
App Engine currently serves more than 320B requests per day
58. @BretMcG
@BretMcG
Back end code functions that automatically
run in response to a trigger event
Microservices
Cloud "glue"
Node.js, Python, Go
Cloud Functions
59. @BretMcG
@BretMcG
Cloud Function event triggers
Cloud storage (incl. Firebase)
Cloud Pub/Sub
HTTPS
Firebase realtime database
& the new Firestore database
Firebase authentication
Google analytics for Firebase
Firebase hosting
Firebase Crashlytics
60. @BretMcG
Cloud Functions?
A serverless environment to build and connect cloud services
Event driven - connect Cloud services
● Via: HTTP requests, Cloud Storage, Firestore, Firebase events, and Cloud Pub/Sub
Serverless
● Fully managed execution environment
● Pay only for what you use
● Autoscales with usage
Node.js 6, 8, Python 3.7 (beta), Go 1.11 (beta)
Serverless Containers on GCF: sign up: g.co/serverlesscontainers
62. @BretMcG
Good fit? Constraints?
Good fit
“Serverless”
Using Pub/Sub and/or Cloud Storage
Don't want to think about runtime env
Data transformations (ETL)
Cloud-based HTTP glue
Constraints
Two runtimes today: JS on Node.js and
Python
Function level granularity
Must interact via events
63. @BretMcG
Why Cloud Functions?
Don't have to even think about servers
Pay only for what you use
Simple developer experience (deploy functions not apps)
70. @BretMcG
@BretMcG
Serverless containers
Secure on gVisor
Fully managed
BYO workloads
Pay for use & stateless
Alpha invitations coming
later this year
Sign up: g.co/serverlesscontainers
New: serverless containers on GCF (EAP)
77. @BretMcG
Recap - what do you think about?
Events
Function definitions
Code
HTTP Requests
Applications, not computers or containers
What programs? How are they connected? State?
Your software, operating system / disk images
CPU, RAM, Disk
Networking: Firewall rules, Load balancers, VPNs
Cloud Functions
App Engine
Kubernetes Engine
Compute Engine
78. @BretMcG
Technical requirements pull you down the stack
GPUs, need specific kernel, Windows,
software licensing requirements, migrating
most existing systems
Hybrid, need specific OS, network protocols
beyond HTTP/S
Support any programming language, run in
containers
Cloud Functions
App Engine
Kubernetes Engine
Compute Engine
79. @BretMcG
Team and organization
Team is mostly dev focused
Team is mostly dev focused
Team integration: Dev, Ops, Security work together;
org is open to app architecture updates
Adaptable to various team structures and tool
preferences
Cloud Functions
App Engine
Kubernetes Engine
Compute Engine
80. @BretMcG
Unsure? Containers let you move between
layers
Cloud Functions
App Engine
(2nd gen & Flex)
Kubernetes Engine
Compute Engine
(soon!)
87. @BretMcG
@BretMcG
Helping you decide: monoliths vs microservices
Choose the right
primitive for the
workload, or change
the workload
My Big
Java
Monolith
My Big
Java
Monolith
No!
Maybe
My
Discrete
Services
Yes!
✓
88. @BretMcG
Detour: Serverless Concurrency & Billing
Two Predominant Models:
1. Functions (Single Concern)
Billed per request, independent of instance
2. Apps (Multiple Concerns)
Billed per instance, independent of request
A Function (#1) model implies single concurrent
requests per instance!
90. @BretMcG
Detour: Single vs Multi-purpose
App Function
Multi Purpose
Some Shared State
Multi-concurrent
Single Purpose
No Shared State
Single-concurrent
91. @BretMcG
Lifecycle: Compute Time & Threads
The App model bills for the lifetime of an instance,
handles concurrent requests and accommodates
for compute time outside the scope of a request
The Function model bills for the lifetime of a
request, handles a single concurrent request and
assumes a freeze/thaw model where compute time
is not available outside the scope of the request
93. @BretMcG
Kubernetes
• Powerful
• Can be Scary
Serverless
• Higher-level abstraction
• Similar in concept, but a lot
friendlier and easier to manage
Kubernetes
and Serverless
94. @BretMcG
● OSS project on GitHub, Apache 2 license
● Set of primitives (Build, Events, Serving)
● Solves for modern development patterns
● Implements learnings from Google, partners
● In collaboration with OSS FaaS frameworks
● github.com/knative
Kubernetes-based
platform to build,
deploy, and manage
modern serverless
workloads
Bonus: Introducing Knative
99. @BretMcG
OK FINE. Start with App Engine Standard (2nd gen)
Web apps or APIs
Idiomatic for each language
Stateless
Scales to zero
Scales up very quickly
Node 8, 10
Python 3.7
Go 1.11
Java 8
PHP 7.2