As part of the Introduction to AWS Workshop Series, see how to scale your website from your first user, right up to a complex architecture to support 10 million users.
Webinar AWS 201 - Using Amazon Virtual Private Cloud (VPC)Amazon Web Services
This document discusses using Amazon Virtual Private Cloud (VPC) for hybrid IT architectures. It defines hybrid IT and outlines some common AWS services that can be used to build hybrid solutions, including VPC, VPN/Direct Connect networking, IAM policies and virtual images. Specific examples are given for disaster recovery and development/test environments extending on-premises networks to AWS. The presentation concludes with a demonstration of creating a VPC with IPSEC VPN tunnels to an on-premises office and deploying a CMS within the VPC.
Training for AWS Solutions Architect at http://zekelabs.com/courses/amazon-web-services-training-bangalore/.This slide describes about features of EC2, EC2 Options, family type, storage, EBS Volumes, EC2 Instance Store, Security Groups, Volumes and Snapshots, Amazon Machine Image (AMI), Elastic load balancer, Classic load balancer, Application load balancer, Network load balancer, AWS CLI and EC2 Metadata
___________________________________________________
zekeLabs is a Technology training platform. We provide instructor led corporate training and classroom training on Industry relevant Cutting Edge Technologies like Big Data, Machine Learning, Natural Language Processing, Artificial Intelligence, Data Science, Amazon Web Services, DevOps, Cloud Computing and Frameworks like Django,Spring, Ruby on Rails, Angular 2 and many more to Professionals.
Reach out to us at www.zekelabs.com or call us at +91 8095465880 or drop a mail at info@zekelabs.com
This document discusses AWS Auto Scaling, which automatically launches and terminates EC2 instances based on demand. It describes the key components of Auto Scaling including launch configurations, Auto Scaling groups, scaling policies, and CloudWatch alarms. It provides step-by-step instructions for setting up a simple Auto Scaling group to support a web application, including creating an AMI, load balancer, launch configuration, Auto Scaling group, scaling policies, and CloudWatch alarms to dynamically scale the number of EC2 instances.
The document describes a presentation on Amazon Athena, a serverless interactive query service that allows users to analyze data directly from Amazon S3 using standard SQL. The presentation will introduce Athena and demonstrate how it can be used to query data in S3 without having to load it into a database first. It will also discuss how Athena uses Presto and the Glue Data Catalog under the hood and show some customer use cases for log analysis, ETL workflows, and analytics reporting using Athena with other AWS services.
An introduction to AWS CloudFormation - Pop-up Loft Tel AvivAmazon Web Services
This document introduces AWS CloudFormation, which allows users to automate the deployment and configuration of AWS resources through templates. CloudFormation templates describe the configuration of AWS resources using JSON or YAML files. When deployed, the template creates a "stack" of linked resources. Common uses of CloudFormation include replicating environments, deploying across regions, and disaster recovery. The document also discusses best practices like reusing templates, using parameters and mappings, and versioning templates with AWS CodeCommit.
Amazon API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any scale. With a few clicks in the AWS Management Console, you can create an API that acts as a “front door” for applications to access data, business logic, or functionality from your back-end services, such as workloads running on Amazon Elastic Compute Cloud (Amazon EC2), code running on AWS Lambda, or any Web application. Amazon API Gateway handles all the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, authorization and access control, monitoring, and API version management.
Presented by: Danilo Poccia, Technical Evangelist, Amazon Web Services
The document discusses content delivery networks (CDNs) and Amazon CloudFront. A CDN improves performance and reliability by caching content across globally distributed edge servers close to users. CloudFront is AWS's CDN that provides low latency, high bandwidth, redundancy, scalability and cost-effectiveness. It supports dynamic and static content delivery via HTTP, RTMP and more. Customers can use CloudFront to improve website performance and user experience.
Amazon Web Services (AWS) is a subsidiary of Amazon.com that provides on-demand cloud computing platforms operated from server farms located across 16 geographical regions worldwide. AWS allows organizations to access shared computing and storage resources over the internet rather than building and maintaining their own infrastructure. Some benefits of AWS include lower costs, easy management, portability, and no direct coupling between hardware and software. Large companies like Netflix, Adobe, and General Electric utilize AWS for its scalable and reliable cloud services.
AWS Glue is a fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data for analytics. You can create and run an ETL job with a few clicks in the AWS Management Console. You simply point AWS Glue to your data stored on AWS, and AWS Glue discovers your data and stores the associated metadata (e.g. table definition and schema) in the AWS Glue Data Catalog. Once cataloged, your data is immediately searchable, queryable, and available for ETL. AWS Glue generates the code to execute your data transformations and data loading processes.
Level: Intermediate
Speakers:
Ryan Malecky - Solutions Architect, EdTech, AWS
Rajakumar Sampathkumar - Sr. Technical Account Manager, AWS
This document discusses Amazon Athena and AWS Glue. It provides an overview of Athena and how it uses Presto to query data in S3. It then discusses common issues with Athena like 503 slow down errors and only supporting single line JSON. It also discusses AWS Glue and common issues with crawlers, ETL jobs being slow or failing. It provides recommendations like using partitions, enabling job metrics, and contacting support with specific logs and information.
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...Amazon Web Services
Learn about architecture best practices for combining AWS storage and database technologies. We outline AWS storage options (Amazon EBS, Amazon EC2 Instance Storage, Amazon S3 and Amazon Glacier) along with AWS database options including Amazon ElastiCache (in-memory data store), Amazon RDS (SQL database), Amazon DynamoDB (NoSQL database), Amazon CloudSearch (search), Amazon EMR (hadoop) and Amazon Redshift (data warehouse). Then we discuss how to architect your database tier by using the right database and storage technologies to achieve the required functionality, performance, availability, and durability—at the right cost.
성능과 비용을 최적화하고 상황에 맞게 인프라를 조정하고자 할 때 Amazon EC2는 적절한 워크로드 선택을 위한 다양한 컴퓨팅 옵션 포트폴리오를 제공합니다. 2023년 신규 Amazon EC2의 기능, 제품 업데이트와 신규 포트폴리오를 통해 Amazon EC2 옵션들이 고성능 및 특화된 서비스를 요구하는 고객의 서비스 변화에 어떻게 도움을 드릴 수 있는지 살펴봅니다. 최적의 Amazon EC2 도입을 통해 비용 절감 효과에 대한 고객 사례도 살펴봅니다.
This document provides an introduction to AWS Glue. It discusses that ETL development consumes 70% of data warehouse resources on average. AWS Glue is a fully managed ETL service that automates ETL processes on a serverless Apache Spark environment. It features a data catalog, job authoring tools for Python/Spark code generation, and job execution on serverless Spark. Use cases include understanding data, querying data lakes on S3, and building event-driven ETL pipelines. The presentation demonstrates AWS Glue and reviews pricing.
by Joyjeet Banerjee, Solutions Architect, AWS
Amazon Athena is a new serverless query service that makes it easy to analyze data in Amazon S3, using standard SQL. With Athena, there is no infrastructure to setup or manage, and you can start analyzing your data immediately. You don’t even need to load your data into Athena, it works directly with data stored in S3. Level 200
In this session, we will show you how easy it is to start querying your data stored in Amazon S3, with Amazon Athena. First we will use Athena to create the schema for data already in S3. Then, we will demonstrate how you can run interactive queries through the built-in query editor. We will provide best practices and use cases for Athena. Then, we will talk about supported queries, data formats, and strategies to save costs when querying data with Athena.
Amazon EMR enables fast processing of large structured or unstructured datasets, and in this presentation we'll show you how to setup an Amazon EMR job flow to analyse application logs, and perform Hive queries against it. We also review best practices around data file organisation on Amazon Simple Storage Service (S3), how clusters can be started from the AWS web console and command line, and how to monitor the status of a Map/Reduce job.
Finally we take a look at Hadoop ecosystem tools you can use with Amazon EMR and the additional features of the service.
See a recording of the webinar based on this presentation on YouTube here:
Check out the rest of the Masterclass webinars for 2015 here: http://aws.amazon.com/campaigns/emea/masterclass/
See the Journey Through the Cloud webinar series here: http://aws.amazon.com/campaigns/emea/journey/
This document introduces Amazon CloudFront, a content delivery network (CDN) that provides fast, secure, and cost-effective global delivery of content. Some key features of CloudFront include its full-featured caching network with a global infrastructure tuned for optimal performance, high security, robust analytics, and self-service capabilities. CloudFront can deliver content for various market segments like media/entertainment, gaming, eCommerce, and software downloads. It aims to provide high performance, reach a wide global audience, and ensure financial feasibility for scalable content delivery.
This document discusses cost optimization strategies on AWS. It provides examples of cost savings achieved by companies that migrated applications to AWS including a 14 million dollar annual savings for GE. It outlines approaches for architecting efficiently for cost, optimizing usage costs over time, and taking advantage of AWS pricing benefits like reserved instances, spot instances, and different storage options. The document emphasizes optimizing through proactive monitoring and billing tools, leveraging the various EC2 pricing plans, and combining options for further savings.
Apache Unomi presentation and update. By Serge Huber, CTO JahiaJahia Solutions Group
Serge Huber, CTO & Co-founder of Jahia presents Apache Unomi Project and it's evolution over years. He also updates us with the project's upcoming news & updates.
This document discusses predicting costs with Amazon Web Services. It begins with an agenda that includes an introduction, tool review, and costing examples. It then discusses new challenges of cloud services like pay as you go models and automatic scaling. It emphasizes the importance of understanding detailed cost visibility. The rest of the document focuses on the five M's of cost analysis: measure, model, multiply, monitor, and master. It provides examples of costing a static website, simple dynamic site, and complex auto-scaled site to demonstrate applying the five M's.
Join this workshop to understand the core concepts of “Cloud Computing” and how businesses around the world are running the infrastructure that supports their websites to lower costs, improve time-to-market, and enable rapid scalability matching resource to demands of users. Whether you are an enterprise looking for IT innovation, agility and resiliency or small and medium business who wants to accelerate growth without a big upfront investment in cash or time for technology, the AWS Cloud provides a complete set of services at zero upfront costs which are available with a few clicks and within minutes.
Scaling on AWS for the First 10 Million Users (ARC206) | AWS re:Invent 2013Amazon Web Services
Cloud computing gives you a number of advantages in being able to scale on demand, easily replace whole parts of your infrastructure, and much more. As a new business looking to use the cloud, you inevitably ask yourself, Where do I start? Join us at this session to understand some of the common patterns and recommended areas of focus you can expect to work through while scaling an infrastructure to handle going from zero to millions of users. From leveraging highly scalable AWS services to making smart decisions on building out your application, you'll learn a number of best practices for scaling your infrastructure in the cloud. The patterns and practices reviewed in this session will get you there.
Java For The Cloud Presentation @ AlphaCSP's JavaEdge 2008Baruch Sadogursky
This document discusses the evolution of applications from single machines to large distributed systems across multiple machines and data centers. It notes that building and maintaining such large infrastructures can be costly and inefficient if the capacity is not fully utilized. The document then introduces cloud computing as a more efficient alternative that allows applications to dynamically scale across remote data centers and only pay for the resources that are actually used. Several examples of cloud platforms like Amazon Web Services, Google App Engine, and Microsoft Azure are provided. Both advantages and potential drawbacks of cloud computing are discussed.
Java Update - Bristol JUG. Part 2 - Java EE / Java in the Cloud.Steve Elliott
This document provides an overview and update on Java technologies. It discusses the Java SE and Java EE roadmaps, including updates on Java EE 7 and 8. It also discusses how Java is evolving for cloud computing, including how Java EE applications can be developed as microservices. The document contains information on Oracle's Java cloud platform and how it supports both Java EE and other JVM languages like Java SE and Node.js in a container-based environment.
Amazon Web Services provides cloud computing services to customers in 190 countries, focusing on security, operational excellence, flexibility and choice, innovation, and lowering costs. AWS has a global infrastructure with regions in the US, Europe, Asia Pacific, and South America. It offers a variety of computing, storage, database, application services and has over 30 services available. AWS aims to rapidly innovate based on customer feedback by continuously adding new services and features weekly/monthly while also lowering prices over time to help customers compete globally.
This document discusses using cloud computing for bioinformatics. It begins by defining cloud computing and describing its key characteristics like on-demand access to computing resources and rapid elasticity. It then discusses different cloud delivery models like Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS). The document provides examples of public cloud providers for each delivery model. It also introduces tools like CloudBridge that help make applications cloud-independent and CloudLaunch, a portal for deploying cloud-enabled bioinformatics applications. Finally, it briefly discusses how these tools and cloud resources can help improve bioinformatics workflows by providing scalable infrastructure for processing large genomic datasets.
Java EE 7: Developing for the Cloud at Java Day, Istanbul, May 2012Arun Gupta
The document discusses Java EE 7 and its focus on cloud computing. Key points include:
- Java EE 7 aims to define the Java EE platform as a service (PaaS) to make it easier for developers to leverage public, private and hybrid clouds.
- This includes adding metadata for service provisioning and configuration, and APIs to support features like elastic scaling and multi-tenancy.
- A demo is described showing how a Java EE application can be deployed to the cloud by including service metadata that allows for automatic provisioning of resources.
The document discusses various topics related to cloud computing including traditional client-server concepts, virtual server concepts, cloud computing definitions, characteristics and benefits of cloud computing, core technologies influencing cloud computing like distributed systems, virtualization, and types of cloud deployment models. The key technologies discussed are distributed systems, virtualization, and different types of virtualization. Cloud computing provides on-demand access to configurable computing resources and services over the Internet on a pay-per-use basis.
This document provides guidance on scaling infrastructure on AWS for handling large numbers of users, from 1 user to over 10 million users. It discusses starting simply with a single EC2 instance and database, then expanding horizontally and vertically by adding more instances, separating tiers, using auto-scaling, and implementing a service-oriented architecture. As the number of users grows from thousands to millions, it recommends techniques like database read replicas, DynamoDB, ElastiCache, SQS/SNS, and database sharding or federation. Monitoring, metrics, and outsourcing management are also emphasized as critical pieces for large-scale applications.
Simplify Cloud Applications using Spring CloudRamnivas Laddad
This document discusses how to simplify cloud applications using Spring Cloud. It describes Spring Cloud's goals of abstracting over cloud services and environments. It covers using Java and XML configuration, scanning for services, and acquiring services. It also discusses Spring Cloud's extensibility for cloud platforms, services, and frameworks. The document includes demos of using Spring Cloud on Cloud Foundry, Heroku, and with Hadoop. It describes the integration with Spring Boot.
The document discusses various AWS services for monitoring, logging, and security. It provides examples of AWS CloudTrail logs and best practices for CloudTrail such as enabling in all regions, log file validation, encryption, and integration with CloudWatch Logs. It also summarizes VPC flow logs, CloudWatch metrics and logs, and tools for automating compliance like Config rules, CloudWatch events, and Inspector.
The document discusses Spring Cloud services. It describes how to implement a configuration server, service registry, and circuit breaker dashboard locally using Spring Cloud. It then explains how these same patterns and services can be provided on Pivotal Cloud Foundry as managed services, including how to create and bind the services in Cloud Foundry.
Cloud Native Microservices with Spring CloudConor Svensson
In this talk we are going to discuss some of the key components of Spring Cloud. This includes the Netflix OSS integrations for Spring Boot apps which include Service Discovery (Eureka), Circuit Breaker (Hystrix), Intelligent Routing (Zuul) and Client Side Load Balancing (Ribbon). We will also touch on the Spring Cloud centralised configuration server and deploy these apps to Cloud Foundry.
Microservices - java ee vs spring boot and spring cloudBen Wilcock
Spring Boot and Spring Cloud provide an easier and more productive framework for building cloud-native microservices compared to Java EE. Spring Boot simplifies the development, deployment, and management of microservices. Spring Cloud adds helpful capabilities for service discovery, external configuration, load balancing, and monitoring that are missing from Java EE. While Java EE adoption is declining, the use of Spring Boot and Spring Cloud is growing rapidly among developers.
This document provides a summary of a presentation on cost optimization at scale when using AWS. The presentation covers building architectures with cost in mind, implementing and maintaining cost-optimized operations, and getting started with a cost optimization program. It discusses key drivers of cost optimization like right-sizing instances, increasing elasticity, leveraging the right pricing models and storage classes, and measuring and monitoring usage. The presentation provides case studies and examples of how customers have been able to significantly reduce their AWS costs through these techniques. It also discusses tools and programs available from AWS and partners to help customers implement cost optimization practices at scale.
The document discusses strategies for scaling a web application from its first users to millions of users on Amazon Web Services. It recommends starting with a single EC2 instance and database, then expanding horizontally by adding more instances, load balancing, caching, and read replicas as traffic increases. It also suggests moving static content to S3 and CloudFront, session state to ElastiCache, and using DynamoDB. Finally, it recommends using Auto Scaling to dynamically scale the infrastructure in response to demand changes. The goal is to build a scalable and resilient architecture utilizing many AWS services.
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014Amazon Web Services
This document provides an overview of strategies for building scalable applications on AWS. It recommends starting simply with EC2, RDS, and Route 53, then adding services like S3, DynamoDB, ElastiCache, and CloudFront to optimize performance. Auto Scaling is introduced to automatically scale resources based on demand. The document discusses best practices like separating databases by function, implementing sharding, and leveraging serverless options. The goal is to demonstrate how these techniques can help applications scale to millions of users on AWS.
(SOV204) Scaling Up to Your First 10 Million Users | AWS re:Invent 2014Amazon Web Services
Cloud computing gives you a number of advantages, such as the ability to scale your application on demand. If you have a new business and want to use cloud computing, you might be asking yourself, andquot;Where do I start?andquot; Join us in this session to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Building and Managing Scalable Applications on AWS: 1 to 500K usersAmazon Web Services
This presentation session from the Cloud Management, Services and Applications Theatre at Cloud Expo Europe 2014 explores the techniques and AWS services that you can use in order to build high scalability web applications on AWS. It also features a great overview of a high-scalability mobile application built by Myriad Group, and AWS customer, that serves over 41 million users.
Best Practices Scaling Web Application Up to Your First 10 Million UsersAmazon Web Services
If you have a new web application and want to use cloud computing, you might be asking yourself, "Where do I start?" Cloud computing gives you a number of advantages, such as the ability to scale your web application on demand. Join us in this webinar to understand best practices for scaling your resources from zero to millions of users. We show you how to best combine different AWS services, how to make smarter decisions for architecting your application, and how to scale your infrastructure in the cloud.
Why Scale Matters and How the Cloud is Really Different (at scale)Amazon Web Services
This document discusses how various companies scale their services and applications on AWS to handle large user loads and data volumes. It provides examples of Animoto handling over 1 billion files saved per day and Airbnb having over 9 million guests. It then outlines an approach for scaling an application from 1 user to millions by starting with EC2 instances, adding services like S3, DynamoDB, ElastiCache and auto-scaling groups. The document emphasizes using AWS managed services to avoid re-inventing solutions for tasks like queuing, storage and databases.
Learn about the patterns and techniques a business should be using in building their infrastructure on Amazon Web Services to be able to handle rapid growth and success in the early days. From leveraging highly scalable AWS services, to architecting best patterns, there are a number of smart choices you can make early on to help you overcome some typical infrastructure issues.
Presenter: Chris Munns,Solutions Architect, Amazon Web Services
AWS Summit Stockholm 2014 – T1 – Architecting highly available applications o...Amazon Web Services
This session teaches you how to architect scalable, highly-available, and secure applications on AWS. In this session, we cover the differences between traditional and cloud-based availability, how to apply AWS availability options to workloads, architectural design patterns for automatingfault tolerance, and examples of highly available architectures.
Aplicaciones a gran escala: Cómo servir a millones de usuariosAmazon Web Services
(Diapositivas de presentación son en inglés.)
¿Cómo podemos hacer escalar nuestras aplicaciones? Escalar aplicaciones no es un tarea sencilla ya que existen múltiples variables a analizar (red, servidores, almacenamiento, aplicación, arquitectura, cdn, etc.), así como diferentes alternativas para construir y operar plataformas a gran escala. En esta sesión se cubrirá el recorrido de una plataforma que pueda dar cobertura desde un usuario hasta millones de usuarios.
AWS Services Overview and Quarterly Update - April 2017 AWS Online Tech TalksAmazon Web Services
Learning Objectives:
• Overview of AWS New & Existing Services
• Advice for Getting Started
Join the “AWS Services Overview and Quarterly Update” webinar to take a fast-paced 45-minute tour through our broad range of new and existing services. We will also provide an update so you can review and catch up on the biggest updates from the past quarter. During the webinar, you will have the opportunity to propose questions for the live Q&A session following the presentation.
AWS Services Overview and Quarterly Update - April 2017 AWS Online Tech TalksAmazon Web Services
• Overview of AWS New & Existing Services
• Advice for Getting Started
Join the “AWS Services Overview and Quarterly Update” webinar to take a fast-paced 45-minute tour through our broad range of new and existing services. We will also provide an update so you can review and catch up on the biggest updates from the past quarter. During the webinar, you will have the opportunity to propose questions for the live Q&A session following the presentation.
Scaling on AWS for the First 10 Million Users at Websummit DublinIan Massingham
In this talk from the Dublin Websummit 2014 AWS Technical Evangelist Ian Massingham discusses the techniques that AWS customers can use to create highly scalable infrastructure to support the operation of large scale applications on the AWS cloud.
Includes a walk-through of how you can evolve your architecture as your application becomes more popular and you need to scale up your infrastructure to support increased demand.
Scaling on AWS for the First 10 Million Users at Websummit DublinAmazon Web Services
Ian Massingham gave a presentation on scaling applications on AWS from initial launch to over 1 million users. He began by discussing foundational AWS services and database options. He then walked through examples of scaling an application from 1 user to over 500,000 users by leveraging services like EC2, RDS, DynamoDB, ElastiCache, S3, CloudFront, and Auto Scaling. Key strategies included separating components across instances, adding redundancy, implementing caching, and leveraging auto scaling to dynamically scale resources based on demand. Massingham concluded by discussing strategies for scaling beyond 500,000 users such as service-oriented architectures and workload distribution across availability zones.
Kalibrr is a startup that provides an online talent assessment platform. They launched their minimum viable product (MVP) on AWS in March 2013, seeing user growth from 0 to 25,000 in two months. AWS allowed Kalibrr to scale easily and provided reliability with no downtime. Kalibrr uses EC2 instances to host their web servers, SES for email, S3 for content storage, ELB for load balancing, and Route 53 for DNS management. AWS's scalability, ease of use, and reliability helped Kalibrr launch their MVP successfully and support further growth.
This document discusses how to scale applications hosted on Amazon Web Services (AWS) as user demand grows over time from 1 user to millions of users. It recommends starting with a single EC2 instance and expanding horizontally by adding more instances, separating application tiers, using managed database services like RDS, and leveraging auto-scaling and serverless technologies like AWS Lambda. Several case studies are presented showing how companies like Supercell and Airbnb have scaled to support tens or hundreds of millions of users daily using these AWS strategies and services.
"How to optimize the architecture of your platform" by Julien SimonTheFamily
You want to launch your online platform and from a technical perspective you are wondering where to start and how to optimize your architecture?
Cloud Computing presents several advantages such as scaling whenever you want your app our your Website. The hardest part is to define where to begin!
During this 45 minutes workshop, Julien Simon will share with you the best practices to scale your platform from 0 to millions of users. He will present:
- How to combine efficiently the tools Amazon Web Services provides,
- How to set up the best architecture for your platform
- How to scale your infrastructure in the Cloud.
Before joining AWS, Julien worked as CTO of Viadeo and Aldebaran Robotics. He also spent more than 3 years as VP Engineering at Criteo. He is particularly interested by architecture, performance, deployment, scalability and data.
AWS Data Transfer Services: Data Ingest Strategies Into the AWS CloudAmazon Web Services
This document provides an overview of various AWS data transfer services for ingesting data into AWS cloud storage. It describes Internet/VPN ingest which uses existing internet connectivity to directly put data into S3 buckets. For accelerating data transfer, it recommends using S3 transfer acceleration, CloudFront, or AWS Direct Connect depending on needs. AWS Snowball is described as a way to transfer petabyte-scale data by shipping physical storage devices. Storage Gateway allows on-premises data to be cached locally with backups stored in AWS. Kinesis Firehose can continuously load streaming data into S3, Redshift or Elasticsearch.
This document provides an overview and introduction to Amazon Web Services (AWS). It discusses AWS's global infrastructure including regions and availability zones. It also describes various AWS computing, storage, database, deployment/administration and application services like EC2, S3, RDS, Elastic Beanstalk, and CloudFront. The document emphasizes AWS's scalability, elasticity, pay-as-you-go model and how customers can build fault tolerant and dynamic applications on AWS.
Journey Towards Scaling Your Application to Million UsersAdrian Hornsby
1) The document discusses scaling a web application from basic static hosting to serving millions of users on AWS, including strategies like serverless architectures, auto-scaling, caching, messaging queues, and database sharding.
2) It provides an overview of AWS services that can be used at different stages of scaling, from basic S3 hosting to load balancing, caching with ElastiCache, auto-scaling groups, and serverless architectures using Lambda and API Gateway.
3) The document outlines an example progression of an application from version 0.1 with a single EC2 instance to version 0.7 with decoupled and event-driven architectures, discussing strategies for scaling databases, adding asynchronous processing, and implementing micro
Similar to Your First 10 million Users on the AWS Cloud (20)
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
1) The document discusses building a minimum viable product (MVP) using Amazon Web Services (AWS).
2) It provides an example of an MVP for an omni-channel messenger platform that was built from 2017 to connect ecommerce stores to customers via web chat, Facebook Messenger, WhatsApp, and other channels.
3) The founder discusses how they started with an MVP in 2017 with 200 ecommerce stores in Hong Kong and Taiwan, and have since expanded to over 5000 clients across Southeast Asia using AWS for scaling.
This document discusses pitch decks and fundraising materials. It explains that venture capitalists will typically spend only 3 minutes and 44 seconds reviewing a pitch deck. Therefore, the deck needs to tell a compelling story to grab their attention. It also provides tips on tailoring different types of decks for different purposes, such as creating a concise 1-2 page teaser, a presentation deck for pitching in-person, and a more detailed read-only or fundraising deck. The document stresses the importance of including key information like the problem, solution, product, traction, market size, plans, team, and ask.
This document discusses building serverless web applications using AWS services like API Gateway, Lambda, DynamoDB, S3 and Amplify. It provides an overview of each service and how they can work together to create a scalable, secure and cost-effective serverless application stack without having to manage servers or infrastructure. Key services covered include API Gateway for hosting APIs, Lambda for backend logic, DynamoDB for database needs, S3 for static content, and Amplify for frontend hosting and continuous deployment.
This document provides tips for fundraising from startup founders Roland Yau and Sze Lok Chan. It discusses generating competition to create urgency for investors, fundraising in parallel rather than sequentially, having a clear fundraising narrative focused on what you do and why it's compelling, and prioritizing relationships with people over firms. It also notes how the pandemic has changed fundraising, with examples of deals done virtually during this time. The tips emphasize being fully prepared before fundraising and cultivating connections with investors in advance.
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
This document discusses Amazon's machine learning services for building conversational interfaces and extracting insights from unstructured text and audio. It describes Amazon Lex for creating chatbots, Amazon Comprehend for natural language processing tasks like entity extraction and sentiment analysis, and how they can be used together for applications like intelligent call centers and content analysis. Pre-trained APIs simplify adding machine learning to apps without requiring ML expertise.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.
Implementations of Fused Deposition Modeling in real worldEmerging Tech
The presentation showcases the diverse real-world applications of Fused Deposition Modeling (FDM) across multiple industries:
1. **Manufacturing**: FDM is utilized in manufacturing for rapid prototyping, creating custom tools and fixtures, and producing functional end-use parts. Companies leverage its cost-effectiveness and flexibility to streamline production processes.
2. **Medical**: In the medical field, FDM is used to create patient-specific anatomical models, surgical guides, and prosthetics. Its ability to produce precise and biocompatible parts supports advancements in personalized healthcare solutions.
3. **Education**: FDM plays a crucial role in education by enabling students to learn about design and engineering through hands-on 3D printing projects. It promotes innovation and practical skill development in STEM disciplines.
4. **Science**: Researchers use FDM to prototype equipment for scientific experiments, build custom laboratory tools, and create models for visualization and testing purposes. It facilitates rapid iteration and customization in scientific endeavors.
5. **Automotive**: Automotive manufacturers employ FDM for prototyping vehicle components, tooling for assembly lines, and customized parts. It speeds up the design validation process and enhances efficiency in automotive engineering.
6. **Consumer Electronics**: FDM is utilized in consumer electronics for designing and prototyping product enclosures, casings, and internal components. It enables rapid iteration and customization to meet evolving consumer demands.
7. **Robotics**: Robotics engineers leverage FDM to prototype robot parts, create lightweight and durable components, and customize robot designs for specific applications. It supports innovation and optimization in robotic systems.
8. **Aerospace**: In aerospace, FDM is used to manufacture lightweight parts, complex geometries, and prototypes of aircraft components. It contributes to cost reduction, faster production cycles, and weight savings in aerospace engineering.
9. **Architecture**: Architects utilize FDM for creating detailed architectural models, prototypes of building components, and intricate designs. It aids in visualizing concepts, testing structural integrity, and communicating design ideas effectively.
Each industry example demonstrates how FDM enhances innovation, accelerates product development, and addresses specific challenges through advanced manufacturing capabilities.
Choose our Linux Web Hosting for a seamless and successful online presencerajancomputerfbd
Our Linux Web Hosting plans offer unbeatable performance, security, and scalability, ensuring your website runs smoothly and efficiently.
Visit- https://onliveserver.com/linux-web-hosting/
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc
Six months into 2024, and it is clear the privacy ecosystem takes no days off!! Regulators continue to implement and enforce new regulations, businesses strive to meet requirements, and technology advances like AI have privacy professionals scratching their heads about managing risk.
What can we learn about the first six months of data privacy trends and events in 2024? How should this inform your privacy program management for the rest of the year?
Join TrustArc, Goodwin, and Snyk privacy experts as they discuss the changes we’ve seen in the first half of 2024 and gain insight into the concrete, actionable steps you can take to up-level your privacy program in the second half of the year.
This webinar will review:
- Key changes to privacy regulations in 2024
- Key themes in privacy and data governance in 2024
- How to maximize your privacy program in the second half of 2024
Mitigating the Impact of State Management in Cloud Stream Processing SystemsScyllaDB
Stream processing is a crucial component of modern data infrastructure, but constructing an efficient and scalable stream processing system can be challenging. Decoupling compute and storage architecture has emerged as an effective solution to these challenges, but it can introduce high latency issues, especially when dealing with complex continuous queries that necessitate managing extra-large internal states.
In this talk, we focus on addressing the high latency issues associated with S3 storage in stream processing systems that employ a decoupled compute and storage architecture. We delve into the root causes of latency in this context and explore various techniques to minimize the impact of S3 latency on stream processing performance. Our proposed approach is to implement a tiered storage mechanism that leverages a blend of high-performance and low-cost storage tiers to reduce data movement between the compute and storage layers while maintaining efficient processing.
Throughout the talk, we will present experimental results that demonstrate the effectiveness of our approach in mitigating the impact of S3 latency on stream processing. By the end of the talk, attendees will have gained insights into how to optimize their stream processing systems for reduced latency and improved cost-efficiency.
Sustainability requires ingenuity and stewardship. Did you know Pigging Solutions pigging systems help you achieve your sustainable manufacturing goals AND provide rapid return on investment.
How? Our systems recover over 99% of product in transfer piping. Recovering trapped product from transfer lines that would otherwise become flush-waste, means you can increase batch yields and eliminate flush waste. From raw materials to finished product, if you can pump it, we can pig it.
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
7 Most Powerful Solar Storms in the History of Earth.pdfEnterprise Wired
Solar Storms (Geo Magnetic Storms) are the motion of accelerated charged particles in the solar environment with high velocities due to the coronal mass ejection (CME).
Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data.
The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs.
Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution!
Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfNeo4j
Presented at Gartner Data & Analytics, London Maty 2024. BT Group has used the Neo4j Graph Database to enable impressive digital transformation programs over the last 6 years. By re-imagining their operational support systems to adopt self-serve and data lead principles they have substantially reduced the number of applications and complexity of their operations. The result has been a substantial reduction in risk and costs while improving time to value, innovation, and process automation. Join this session to hear their story, the lessons they learned along the way and how their future innovation plans include the exploration of uses of EKG + Generative AI.
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Erasmo Purificato
Slide of the tutorial entitled "Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Emerging Trends" held at UMAP'24: 32nd ACM Conference on User Modeling, Adaptation and Personalization (July 1, 2024 | Cagliari, Italy)
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfjackson110191
These fighter aircraft have uses outside of traditional combat situations. They are essential in defending India's territorial integrity, averting dangers, and delivering aid to those in need during natural calamities. Additionally, the IAF improves its interoperability and fortifies international military alliances by working together and conducting joint exercises with other air forces.
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsMydbops
This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization.
Key Takeaways:
* Understand why connection pooling is essential for high-traffic applications
* Explore various connection poolers available for PostgreSQL, including pgbouncer
* Learn the configuration options and functionalities of pgbouncer
* Discover best practices for monitoring and troubleshooting connection pooling setups
* Gain insights into real-world use cases and considerations for production environments
This presentation is ideal for:
* Database administrators (DBAs)
* Developers working with PostgreSQL
* DevOps engineers
* Anyone interested in optimizing PostgreSQL performance
Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services
9. US-WEST (Oregon)
EU-WEST (Ireland)
ASIA PAC (Tokyo)
US-WEST (N. California)
SOUTH AMERICA
(Sao Paulo)
US-EAST (Virginia)
AWS GovCloud (US)
ASIA PAC (Sydney)
ASIA PAC
(Singapore)
CHINA (Beijing)
EU-CENTRAL (Frankfurt)
10. US-WEST (Oregon)
EU-WEST (Ireland)
ASIA PAC (Tokyo)
US-WEST (N. California)
SOUTH AMERICA
(Sao Paulo)
US-EAST (Virginia)
AWS GovCloud (US)
ASIA PAC (Sydney)
ASIA PAC
(Singapore)
CHINA (Beijing)
EU-CENTRAL (Frankfurt)
12. AWS Provides Broad and Deep Services to
Support any Cloud Workload
Application Services
AWS Global Infrastructure
Networking
Deployment & Administration
Compute StorageCompute Database
13. Mobile
Push
Notifications
Mobile
Analytics
Cognito
Cognito
Sync
Analytics
Kinesis
Data
Pipeline
RedShift EMR
AWS Global Infrastructure
Your Applications
AWS Global Infrastructure11 Regions 28 Availability Zones 53 Edge Locations
Network
VPC
Direct
Connect
Route 53
API
Human Interaction
Support
Web Console
Interaction
Command Line
Libraries,
SDK’s
Storage
EBS S3 Glacier CloudFront
Database
DynamoDBRDS ElastiCache
Deployment & Management
Elastic
Beanstalk
OpsWorks
Cloud
Formation
Code
Deploy
Code
Pipeline
Code
Commit
Security & Administration
CloudWatch Config
Cloud
Trail
IAM Directory KMS
Application
SQS SWF
App
Stream
Elastic
Transcoder
SES
Cloud
Search
SNS
Enterprise Applications
WorkSpaces WorkMail WorkDocs
Compute
EC2 ELB
Auto
Scaling
LambdaECS
17. • Will hit an endpoint eventually
c3.8xlarge
m3.2xlarge
t2.micro
18. utilizes Intel® Xeon® processors
Core count,
Memory size, Storage size & type, Network performance, & CPU
technologies
• Hurry Up & Go Idle
19. Intel® Xeon® v3
• Haswell microarchitecture has better branch prediction; efficient at
prefetching instructions and data; along with other improvements that
can boost existing applications’ performance by 30% or more
P state and C state control
Intel® AVX2.0
20. • Intel® AVX – Get dramatically better performance for highly parallel
HPC workloads such as life science engineering, data mining, financial
analysis, or other technical computing applications. AVX also
enhances image, video, and audio processing.
• Intel® AES-NI – Enhance your security with these new encryption
instructions that reduce the performance penalty associated with
encrypting/decrypting data.
• Intel® Turbo Boost Technology – Get more computing power when you
need it with performance that adapts to spikes in your workload with
Intel® Turbo Boost Technology 2.0
25. Self-managed Fully managed
Database server
on Amazon EC2
Your choice of
database running on
Amazon EC2
Bring Your Own
License (BYOL)
Amazon
DynamoDB
Managed NoSQL
database service
using SSD storage
Seamless scalability
Zero administration
Amazon RDS
Aurora,
Microsoft SQL,
Oracle, MySQL or
PostgreSQL as a
managed service
BYOL or License
Included
Amazon
Redshift
Massively parallel,
petabyte-scale data
warehouse service
Fast, powerful, and
easy to scale
Database options
26. But how do I choose
what DB technology I
need? SQL? NoSQL?
31. Web
Instance
RDS DB Instance
Active (Multi-AZ)
Availability Zone Availability Zone
Web
Instance
RDS DB Instance
Standby (Multi-AZ)
Elastic Load
Balancer
Amazon
Route 53
User
32. • Create highly scalable applications
• Distribute load across EC2 instances
in multiple Availability Zones
Feature
Details
Available
Load
balances
across
instances
in
mul1ple
Availability
Zones
Health
checks
Automa1cally
checks
health
of
instances
and
takes
them
in
or
out
of
service
Session
s6ckiness
Routes
requests
to
the
same
instance
Secure
sockets
layer
Supports
SSL
offload
from
web
and
applica1on
servers
with
flexible
cipher
support
Monitoring
Publishes
metrics
to
CloudWatch
and
can
get
logs
of
requests
processed
Elastic Load
Balancer
Elastic Load Balancer
34. User 10k-100k’s
RDS DB Instance
Active (Multi-AZ)
Availability Zone Availability Zone
RDS DB Instance
Standby (Multi-AZ)
Elastic Load
Balancer
RDS DB Instance
Read Replica
RDS DB Instance
Read Replica
RDS DB Instance
Read Replica
RDS DB Instance
Read Replica
Web
Instance
Web
Instance
Web
Instance
Web
Instance
Web
Instance
Web
Instance
Web
Instance
Web
Instance
Amazon
Route 53
User
35. This will take us pretty far, but
we care about performance
and efficiency, so let’s improve
further
37. Web
Instance
RDS DB Instance
Active (Multi-AZ)
Availability Zone
Elastic Load
Balancer
Amazon S3
Amazon
Cloudfront
Amazon
Route 53
User
• Move static content from
the web instance to
Amazon S3 and Amazon
CloudFront
39. CloudFront
Amazon CloudFront is a web service for scalable
content delivery:
• Cache static content at the edge for faster delivery
• Helps lower load on origin infrastructure
• Dynamic and static content
• Streaming video
• Custom SSL certificates
• Low TTLs (as short as 0 seconds)
• Lower costs for origin fetches (between Amazon
S3 / Amazon EC2 and CloudFront)
• Optimized to work with Amazon EC2, Amazon S3,
Elastic Load Balancing, and Amazon Route 53
Response
Time
Server
Load
Response
Time
Server
Load
Response
Time
Server
Load
No
CDN
CDN
for
Sta1c
Content
CDN
for
Sta1c
&
Dynamic
Content
0
20
40
60
80
8:00
AM
9:00
AM
10:00
AM
11:00
AM
12:00
PM
1:00
PM
2:00
PM
3:00
PM
4:00
PM
5:00
PM
6:00
PM
7:00
PM
8:00
PM
9:00
PM
VolumeofData
Delivered(Gbps)
41. • Move session/state and
DB caching to Amazon
ElastiCache or Amazon
DynamoDB
Web
Instance
RDS DB Instance
Active (Multi-AZ)
Availability Zone
Elastic Load
Balancer
Amazon S3
Amazon
Cloudfront
Amazon
Route 53
User
ElastiCache
DynamoDB
42. • Managed, provisioned throughput
NoSQL database
• Fast, predictable performance
• Fully distributed, fault tolerant
architecture
• JSON support (NEW)
• Items up to 400 KB (NEW)
Feature
Details
Provisioned
throughput
Dial
up
or
down
provisioned
read/write
capacity
Predictable
performance
Average
single
digit
millisecond
latencies
from
SSD-‐backed
infrastructure
Strong
consistency
Be
sure
you
are
reading
the
most
up
to
date
values
Fault
tolerant
Data
replicated
across
Availability
Zones
Monitoring
Integrated
with
Amazon
CloudWatch
Secure
Integrates
with
AWS
Iden1ty
and
Access
Management
(IAM)
44. • Move dynamic content from
the ELB to Amazon
CloudFront
Web
Instance
RDS DB Instance
Active (Multi-AZ)
Availability Zone
Elastic Load
Balancer
Amazon S3
Amazon
Cloudfront
Amazon
Route 53
User
ElastiCache
DynamoDB
45. • Move dynamic content
from the ELB to Amazon
CloudFront
Web
Instance
RDS DB Instance
Active (Multi-AZ)
Availability Zone
Elastic Load
Balancer
Amazon S3
Amazon
Cloudfront
Amazon
Route 53
User
ElastiCache
DynamoDB
46. Now that our web tier is
much more lightweight, we
can revisit the beginning of
our talk…
48. Automatic resizing of compute
clusters based on demand
Feature
Details
Control
Define
minimum
and
maximum
instance
pool
sizes
and
when
scaling
and
cool
down
occurs.
Integrated
to
Amazon
CloudWatch
Use
metrics
gathered
by
CloudWatch
to
drive
scaling.
Instance
types
Run
Auto
Scaling
for
on-‐demand
and
Spot
Instances.
Compa1ble
with
VPC.
aws autoscaling create-auto-scaling-group
--auto-scaling-group-name MyGroup
--launch-configuration-name MyConfig
--min-size 4
--max-size 200
--availability-zones us-west-2c, us-west-2b
Auto Scaling Trigger auto-scaling policy
Amazon
CloudWatch
56. Availability Zone
Amazon
Route 53
User
Amazon S3
Amazon
Cloudfront
Availability Zone
Elastic Load
Balancer
DynamoDB
RDS DB Instance
Read Replica
Web
Instance
Web
Instance
Web
Instance
ElastiCache RDS DB Instance
Read Replica
Web
Instance
Web
Instance
Web
Instance
ElastiCacheRDS DB Instance
Standby (Multi-AZ)
RDS DB Instance
Active (Multi-AZ)
59. AWS application management solutions
Convenience Control
Higher-level services Do it yourself
AWS
Elastic Beanstalk
AWS
OpsWorks
AWS
CloudFormation
Amazon EC2
66. Controller
A
Controller
B
Controller
A
Controller
B
Q
Q
Tight
coupling
Use
Amazon
SQS
as
buffers
Loose
coupling
67. DON’T REINVENT THE WHEEL
Examples:
• Email
• Queuing
• Transcoding
• Search
• Databases
• Monitoring
• Metrics
• Logging
Amazon
CloudSearch
Amazon SQSAmazon SNS
Amazon Elastic
Transcoder
Amazon SWF
Amazon SES
In the early days, if someone has a service for it already,
opt to use that instead of building it yourself.
69. RDS DB Instance
Active (Multi-AZ)
Availability Zone
Elastic Load
Balancer
RDS DB Instance
Read Replica
RDS DB Instance
Read Replica
Web
Instance
Web
Instance
Web
Instance
Web
Instance
Amazon
Route 53
User
Amazon S3
Amazon
Cloudfront
DynamoDB
Amazon SQS
ElastiCache
Worker
Instance
Worker
Instance
Amazon
CloudWatch
Internal App
Instance
Internal App
Instance
Amazon SES
72. • Split up databases by function/
purpose
• Harder to do cross-function
queries
• Essentially delaying the need
for something like sharding/
NoSQL until much further down
the line
• Won’t help with single huge
functions/tables
ForumsDB
UsersDB
ProductsDB
73. Sharded horizontal scaling
• More complex at the
application layer
• No practical limit on
scalability
• Operation complexity/
sophistication
• Shard by function or key
space
• RDBMS or NoSQL
User ShardID
002345 A
002346 B
002347 C
002348 B
002349 A
Shard C
Shard B
Shard A
74. Shifting functionality to NoSQL
• ALeverage hosted services like DynamoDB
• Some use cases:
– Leaderboards/scoring
– Rapid ingest of clickstream/log data
– Temporary data needs (cart data)
– “Hot” tables
– Metadata/lookup tables
DynamoDB
80. Expand Your Cloud Skills with AWS
Certification
aws.amazon.com/certification
Validate your proven
technical expertise with the
AWS platform and gain
recognition for your skills
Online videos and
labs
aws.amazon.com/training/
self-paced-labs
Start working with an AWS
service in minutes with free
online instructional videos
and labs
aws.amazon.com/training
Instructor-led courses
Learn how to design, deploy,
and operate highly available,
cost-effective, and secure
applications on AWS