Intro to Amazon Web Services (AWS) and Gen AI

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Intro to AWS + Generative AI
Sami Hoda
Senior Solutions Architect, Federal Partners
AWS

Outcomes
Build and validate an overall understanding of the AWS Cloud and
key terminology, and help advance your AWS Cloud skills
Learn about the foundations of getting started using AWS Cloud
infrastructure and services in the compute, storage, database,
networking, and security categories
Understand AWS’s approach to Generative AI

Agenda
What is the cloud? Why AWS?
Understanding AWS global infrastructure
Key services overview
Generative AI

What is the cloud? Why AWS?

What is the cloud?
Cloud computing lets you stop thinking of infrastructure as hardware,
and instead think of it (and use it) as software
Programmable
resources
Pay as
you go
Dynamic
abilities

What is the cloud?
“Cloud computing is the on-demand delivery of
IT resources over the Internet with pay-as-you-go
pricing. Instead of buying, owning, and maintaining
physical data centers and servers, you can access
technology services, such as computing power,
storage, and databases, on an as-needed basis
from a cloud provider.”

Why customers choose AWS
7
Long Term Value
Accurate Cost Modelling
Pricing Consistency
Price Reductions Culture
Large Community
1M+ Customers
Partner Community
Marketplace
Operational Resiliency
Global Reach & Scale
Better Availability & Higher
Reliability
Security & Compliance
Culture of Innovation
Customer-Centric Innovation
Rapid Time-To-Market
AWS-Designed Silicon
Breadth & Depth
200+ Services for any Cloud
Workload
Right Tool for the Job
Leadership
Cloud Pioneer and Leader
Most Experience
Enterprise Support

8
Long Term Value
Pricing Consistency
Large Community
1M+ Customers
Partner Community
Marketplace
Reliability
Breadth & Depth
Workload
Leadership
Most Experience
Enterprise Support

AWS 17 Years of Innovation on Behalf of Customers
CustomerObsession is a healthy,long termbusiness strategy
9
200+ Fully featured services, 90% is driven by customers,10% we’ve invented on their behalf
Pioneers
of Customers and Partners. Millions of customers, and more than 100,000 Partners
Largest and most dynamic community
2011
80
New significant
services and
features released
per year
2012
160
2014
516
2015
722
2016
1,017
2017
1,430
2018
1,957
2019
2,345
2020
2,757
2021
3,084
2013
280
2022
3,332
Customer-Focused and Long-Term oriented. We’ve lowered our prices 134 times since 2006
Unusually
2023
3,410

Gartner does not endorse any vendor, product or service depicted in its research publications and does not advise technology users to select only those vendors with the highest ratings or
other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties,
expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. GARTNER is a registered trademark and service mark of
Gartner and Magic Quadrant is a registered trademark of Gartner, Inc. and/or its affiliates in the U.S. and internationally and are used herein with permission. All rights reserved. This graphic
was published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from
AWS.
Longest-running Magic
Quadrant Leader –
Gartner names AWS a Leader
for the 13th consecutive year.
10

Source: IDC Worldwide Semiannual Public Cloud Services Tracker-Foundational Services, 2H, 2022
41%
21%
6%
5%
2%
25%
Amazon Web Services Microsoft Google Alibaba Group IBM Others
$169.1B
State of Cloud - 2022
Market share analysis by analysts, Gartner and IDC
Source: Gartner: Worldwide IaaS Public Cloud Services Market Share, 2022
40%
22%
7%
8%
23%
Amazon Web Services Microsoft Google Alibaba Group Others
$120.3B
Gartner IDC
11

12
Long Term Value
Pricing Consistency
Large Community…
1M+ Customers
Partner Community
Marketplace
Reliability
Breadth & Depth
Workload
Leadership
Most Experience
Enterprise Support

The AWS Cloud spans 105 Availability Zones within 33
geographic regions around the world, with announced
plans for 18 more Availability Zones and 6 more AWS
Regions in Malaysia, Mexico, New Zealand, the Kingdom
of Saudi Arabia, Thailand, and the AWS European
Sovereign Cloud.
With AWS Local Zones, you can easily run highly-
demanding applications that require single-digit
millisecond latencies to your end-users.
Amazon CloudFront uses a global network of 600+
Points of Presence (400+ Edge locations and 13 regional
caches) in 90+ cities across 48 countries.
And If your data lives off this planet, you can use AWS
Ground Station, which provides satellite antennas in
close proximity to AWS infrastructure Regions
A secure, extensive, sustainable, and
reliable Global Cloud Infrastructure
See interactive map
200+ fully featured services from
data centers globally
Amazon is on a path to powering its
operations with 100% renewable
energy by 2025—five years ahead
of its original target of 2030
13

AWS Region design
14
AWS Regions are comprised of multiple AZs for high availability,
high scalability, and high fault tolerance. Applications and data are
replicated in real time and consistent in the different AZs.
R E G I O N A V A I L A B I L I T Y Z O N E
( A Z )
Data centers
1 2
N
1 2
N
1 2
N
A V A I L A B I L I T
Y
Z O N E ( A Z )
Distance ensures high
availability
Low latency ensures real-
time data replication

15
1.43k
5.41k
28.38k
92k
0.00k 20.00k 40.00k 60.00k 80.00k 100.00k
AWS
Next provider
Next provider
Next provider
AWS Next provider Next provider Next provider
Higher Downtime & Security incidents
haver bigger impact on customers’ costs
Source: IDC: Annual Fortume 1000 application downtime costs Study
Ponemon Institute: Cost of Data Center Outages, ; updates and stats
* Sources: Public Status Pages for Cloud Providers
AWS Cloud Infrastructure Designed to Scale with Highest Availability
AWS Investments on Underlying Higher Resilient Infrastructure translates into lower costs to customers
Global Service Disruption Hours (Public) by Provider in 2023
Service disruption hours published = Downtime hours published * Regions Impacted * Services Impacted

16
AWS supports more security standards and compliance certifications than
any other offering, including PCI-DSS, HIPAA/HITECH, FedRAMP, GDPR,
FIPS 140-2, and NIST 800-171, helping satisfy compliance requirements for
virtually every regulatory agency around the globe.
All AWS services that store customer data offer the ability to encrypt that
data.
Security and Compliance

Why do customers choose AWS
17
Long Term Value
Pricing Consistency
Large Community…
1M+ Customers
Partner Community
Marketplace
Reliability
Breadth & Depth
Workload
Leadership
Most Experience
Enterprise Support

High volume / low margin businesses are in our core DNA
Trade capital
expense for
variable expense
Our economies of
scale provide us
with lower costs
134 price
reductions
since 2006
Pricing model
choice to support
variable and
stable workloads
On-demand
Savings Plans
Reserved Instances
Spot
Save more money as
you grow bigger
Tiered pricing
Volume discounts
Custom pricing
Pay for what
you use
Pricing Philosophy
18

Amazon Elastic
Container Service
(Amazon ECS)
Amazon
EMR
AWS
CloudFormation
AWS Batch
Amazon EC2
Auto Scaling
Amazon Elastic
Kubernetes Service
(Amazon EKS)
EC2 Fleet AWS
Thinkbox
AWS services make this easy and efficient
S C A L E U S I N G S P O T
F O R F L E X I B L E ,
F A U L T - T O L E R A N T
W O R K L O A D S
S C A L E U S I N G O N - D E M A N D
F O R N E W O R S T A T E F U L
S P I K Y W O R K L O A D S
U S E R I s A N D S A V I N G S P L A N S
F O R K N O W N /
S T E A D Y - S T A T E W O R K L O A D S
Simplifying capacity and cost optimization
19

Plan
Save Run
See
Planning and
forecasting
Cost
optimization
Cloud financial
operations
Measurement and
accountability
https://aws.amazon.com/aws-cost-management
AWS Budgets, AWS Organizations,
AWS Cost Tags, Compute Optimizer
AWS IAM ,Billing Console,
AWS Anomaly Detection,
AWS Cost Profiler, AWS
Instance Scheduler , EC2
Auto Scaling
AWS Cost Explorer, AWS Cost &
Usage Reports, AWS Cost
Categories, AWS Credits, AWS
Billing Conductor
Savings Plans, Reserved
Instances, Spot Instances,
Right Sizing, AWS Free tier
AWS Cloud Financial Management (CFM) - FinOps
Manage, optimize, and plan AWS cost and usage
20

21
Long Term Value
Pricing Consistency
Large Community…
1M+ Customers
Partner Community
Marketplace
Reliability
Breadth & Depth
Workload
Leadership
Most Experience
Enterprise Support

How do we organize for innovation?
22
»Culture
Customer obsession, hire builders, let them build, support
them with a belief system
»Mechanisms
Encoded behaviors that facilitate innovative thinking
»Architecture
Structure that supports rapid growth and change
»Organization
Small, empowered teams that own what they create

Hire and
Develop the
Best
Frugality
Deliver
Results
Are Right, A Lot
Dive Deep
Earn Trust
Ownership
Think Big
Have Backbone;
Disagree and
Commit
Invent and
Simplify
Bias for Action
Insist on the
Highest Standards
Customer
Obsession
Learn and
Be Curious
Strive to be Earth’s
Best Employer
Success and Scale
Bring Broad
Responsibility
https://www.amazon.
jobs/en/principles
Our Leadership Principles
23

24
Long Term Value
Pricing Consistency
Large Community…
1M+ Customers
Partner Community
Marketplace
Reliability
Breadth & Depth
Workload
Leadership
Most Experience
Enterprise Support

429
266 257
316
512
389 380
103
192
317
204 207
238
419
295
207
56
136
247
87
171 171
302
204 195
29
45
0
100
200
300
400
500
600
Compute Storage Networking &
CDN
Security,
Identity,
Compliance
Databases Analytics AI/ML Migration IoT
Number of Total Cloud Features by Cloud Provider
AWS Next Provider Next Provider2
Breadth and Depth of Cloud Services
Source: AWS Functionality Matrix (as of August 2023)
25

Right compute for the right application and workload
Intel® Xeon® Scalable
(Skylake) processor
AMD EPYC processor
NVIDIA V100
Tensor Core GPUs
FPGAs for custom
hardware acceleration
AWS Graviton
Processor (arm)
Choose your processor and architecture
26

27
Analytics
Analytics
Data Exchange
Data Lake
Data Pipelines
Data Warehouse
Elasticsearch
Streaming
ETL
Hadoop / Spark
Interactive SQL Queries
Visualizations
Business Applications
Contact Center
Sharing & Collaboration
Online Meetings & Chat
Voice-Enabled Workplace
Unified Communications
Mobile & Web Apps Without
Programming
Blockchain
Blockchain Templates
Ledger Database
Managed Blockchain
Security, Identity, and Compliance
Access Control
Assessment & Reporting
Configuration Compliance
Data Protection
DDOS Protection
Identity Management
Key Management & Storage
Monitoring & Logging
Resource Management
Threat Detection
Web Application Firewall
Storage
Archive Storage
Backup & Restore
Block Storage
Data Transfer
Edge Processing & Computing
File Storage
High-Performance File System
Hybrid Cloud Storage
Object Storage
Unified Communications
Windows File System
Database
Aurora, a high-performance,
relational database Built
for the Cloud
Managed SQL Server
Managed MariaDB
Managed MySQL
Managed Oracle
Managed PostgreSQL
Document Database
Graph Database
In-Memory Caching
Key-Value Store Database
Ledger Database
Time Series Database
Development Tools
Analyze and Debug
Application Lifecycle
Management
Authoring
Build & Test
Containers
DevOps Resource
Management
One-Click App Development
Patching
Pipeline Orchestration
Resource Templates
Triggers
Compute
Compute
Auto-Scaling
Batch Jobs
Event-Driven Serverless
Computing
Instance Types
Managed Virtual Private Servers
Managed Repository for
Serverless Apps
Run & Manage Web Apps
Serverless Compute
Virtual Servers
Containers
Container Service
Managed Kubernetes
Store & Retrieve Docker Images
Media Services
Live Video Transport
Media Storage
Transcoding
Video Origination & Packaging
Video Personalization &
Monetization
Video Processing & Delivery
Video Streaming Analysis
Hybrid Architecture
AWS Services on Premises
Data Integration
Integrated Devices & Edge
Systems
Integrated Identity & Access
Integrated Networking
Integrated Resource &
Deployment Management
VMWare Cloud on AWS
Integrated SG
Internet of Things (IOT)
Rules Engine
Device Analytics
Device Gateway
Device SDK
Device Shadows
Event Detection & Response
Local Compute
Local Data Collection
Management & Security
Microcontroller Operating
System
Registry
Visual Applications
Development
Machine Learning (ML)
ML Frameworks
Deep Learning AMIs &
Containers
Hardware Acceleration
ML at the Edge
TensorFlow, PyTorch, MXNet
Sagemaker
Automatic Model Tuning
Data Labeling
Hosted Notebooks
ML Marketplace
Model Hosting
Model Optimization
Model Training
Pre-Built Algorithms
Topic Modeling
Deep Learning Models
Reinforcement Learning
Spot Instances
Batch Predictions
Real-Time Predictions
AI Services
Chatbots
Entity Extraction
Face Analytics
Face Search Forecasting
Image Labeling
Natural Language Processing
Personalization &
Recommendation
Sentiment Analysis
Speech Translation
Text & Data Extraction
Text to Speech Translation
Video & Image Analysis
Content Moderation
Breadth and Depth of Services: 200+ fully featured services

28
Long Term Value
Pricing Consistency
Large Community…
1M+ Customers
Partner Community
Marketplace
Reliability
Breadth & Depth
Workload
Leadership
Most Experience
Enterprise Support

29
The AWS Partner Network (APN) is a global
community of partners that leverages programs,
expertise, and resources to build, market, and sell
customer offerings.
The AWS Partner Network has more than
100,000 Partners from more than 150 countries,
with almost 70% headquartered outside of the
United States.
Quick Starts are built by Amazon Web Services
(AWS) solutions architects and partners to help
you deploy popular technologies on AWS, based
on AWS best practices for security and high
availability. There are more than 350 Quick Starts
published.
AWS Marketplace is a digital catalog with thousands of
software listings from independent software vendors that
make it easy to find, test, buy, and deploy software that runs
on AWS.
partner
network
Community of customers and partners

30
Global portfolio of customers in 190 countries

More than 100,000 customers use AWS for ML
31

AWS positioned as a Leader in the Gartner Magic Quadrant for Cloud
Infrastructure as a Service, Worldwide
Enterprise Leader
Helping millions of customers since 2006. Best availability track record.
Running a wide variety of use cases at greater scale than any cloud provider.
Most Proven Operational Experience
Continuous improvement. Culture of cost reductions and passing savings to
customers. 134 Price reductions since 2006
Long-Term Value
200+ fully featured services to support any cloud workload.
Unique silicon to power off-load compute, networking and I/O. Best price/
performance ratio with Graviton.
Breadth & Depth
AWS has millions of active customers every month.
The AWS Partner Network has more than 100,000 Partners from more than
150 countries, with almost 70% headquartered outside of the United States.
Largest and most diverse Community
of Customers and Partners
Recognized as the most innovative public cloud provider. Fastest pace of
innovation
What Sets AWS Apart
32

The economics of cloud
Lost opportunity
Key
Predicted demand
Traditional hardware
Actual demand
AWS
Time
Infrastructure
cost
($)
Large capital expenditure
Opportunity cost

Cost savings (TCO)
20% reduction in IT
infrastructure costs as a
percentage of revenue
What is it?
Infrastructure cost
savings/ avoidance from
moving to the cloud
Tactical impact Strategic impact
Staff productivity
66% increase in VMs
managed per server
admin
What is it?
Efficiency improvement
by function on a task-by-
task basis
Operational resilience
69% reduction in
unplanned downtime
What is it?
Benefit of improving
SLAs and reducing
unplanned outage
Business agility
43% reduction in time-
to-market for new
application features
What is it?
Deploying new features/
applications faster and
reducing errors
Sustainability
88% reduction in
workload carbon
footprint
What is it?
Minimizing
environmental impact
of operations
AWS has been helping enterprises for 14+ years

AWS reduces IT investment risk
Using AWS is a two-way door decision
Investing in a data center
tends to be an irreversible,
one-way door decision
Leveraging AWS
represents a reversible,
two-way door decision

Innovate with AWS
On-premises
20%
80%
New technology Keeping the lights on
AWS Cloud
20%
40%
40%
Keeping the lights on Transformation Savings

Questions to consider when
evaluating cloud vendors
G L O B A L
I N F R A S T R U C T U R E
What is the underlying
architecture and design of
this to enable High
Availability and
synchronous replication?
S E C U R I T Y
How many third-party
attestations and security
features do the vendors
have?
Do they have
international customers
that can attest to this?
I N N O V A T I O N
Is the vendor investing for
the long term and have
demonstrated capability
with reference customers
taking advantage of
innovative services?
C O S T
What is the philosophy of
the company when it comes
to cost? Is it economies of
scale driven for long term or
is it undercutting the market
or credits for the short term?
Have you evaluated price to
features across vendors?

E X P E R I E N C E
18 years
helping millions
of customers
G L O B A L R E A C H
33 Regions
spanning 105
Availability Zones and over
135 Direct Connect
locations
S E C U R I T Y
300+
security features
I N N O V A T I O N
200+
service offerings
A W S I N F R A S T R U C T U R E
3.6x+
energy efficient than the
median of surveyed U.S.
enterprise data centers
T C O
134
price reductions
since 2006
E C O S Y S T E M
12,000
software listings from
2,000 ISVs
Source: AWS Approved Public Stats

Understanding the AWS Global Infrastructure
R E G I O N
A physical location where we
cluster data centers. Each
Region consists of a minimum
of three isolated, and
physically separate AZ’s.
A V A I L A B I L I T Y Z O N E
( A Z )
One or more discrete data
centers with redundant power,
networking, and connectivity
in an AWS Region.
L O C A L Z O N E S
AWS Local Zones place
compute, storage, database,
and other AWS services closer
to end-users so you can run
latency-sensitive applications
and meet data residency
requirements in more locations
P O I N T S O F P R E S E N C E
Reduce latency by delivering
data through 600+ globally
dispersed Points of Presence
(PoPs) with automated
network mapping and
intelligent routing using
Amazon CloudFront.
W A V E L E N G T H Z O N E S
AWS infrastructure
deployments that embed AWS
services within
telecommunications providers’
data centers at the edge of the
5G network.
D I R E C T C O N N E C T
L O C A T I O N S
The Direct Connect service
establishes a private, physical
network connection between
AWS and your data center or
office environment –
bypassing the public internet.
O U T P O S T S
AWS Outposts are a family of
fully managed solutions
delivering AWS infrastructure
and services to virtually any
on-premises or edge location
for a truly consistent
hybrid experience.

Regional Expansion
33 total regions with 4 coming soon
2 0 0 6 - 2 0 1 1
8 New Regions
N. AMERICA
Northern Virginia
Northern California
Oregon
GovCloud US-West
S. AMERICA
São Paulo
EUROPE
Ireland
ASIA PACIFIC
Singapore
Tokyo
2 0 1 2 - 2 0 1 7
10 New Regions
N. AMERICA
Ohio
Canada Central
EUROPE
Frankfurt
London
Paris
ASIA PACIFIC
Seoul
Mumbai
*Beijing
*Ningxia
AUSTRALIA &
NEW ZEALAND
Sydney
2 0 1 8 - 2 0 2 3
15 New Regions
N. AMERICA
GovCloud US-East
Canada West
EUROPE
Stockholm
Milan
Zurich
Spain
MIDDLE EAST
Bahrain
UAE
Tel Aviv
ASIA PACIFIC
Hong Kong
Osaka
Jakarta
Hyderabad
AFRICA
Cape Town
AUSTRALIA &
NEW ZEALAND
Melbourne
C O M I N G S O O N
4 New Regions
EUROPE
Germany
ASIA PACIFIC
Thailand
Malaysia
AUSTRALIA &
NEW ZEALAND
Auckland

Availability zones design for resiliency
Distance ensures
high availability
Low latency
ensures real-time
data replication
1 2
N
1 2
N
1 2
N
R E G I O N
A V A I L A B I L I T Y
Z O N E ( A Z )
I S O L A T E D P A R T I T I O N
Fully isolated with one or more datacenters
D I S T A N C E
Physically separated by a meaningful distance –
all within 60 miles (100km) of each other
I N T E R C O N N E C T I O N
Datacenters connected via fully redundant and
isolated metro fiber
P O W E R
Highly available, fault tolerant, and scalable
100K+ servers at scale

AWS Global Infrastructure
K E Y
Region
Local Zone
Direct Connect
Edge location
Multiple edge locations
Regional Edge caches

Summary
› Cloud computing eliminates undifferentiated work including
infrastructure procurement, maintenance, and capacity planning
› Organizations leverage AWS to reduce the opportunity cost
of underutilized technology and scale to meet demand
› Organizations realize quantifiable benefits including cost savings, staff
productivity, operational resilience and business agility when using AWS
› Inherit global security and compliance controls when using AWS

Core services overview

Compute
Compute for any workload—instances, containers, and serverless computing
Pay as you go: $/compute-hr, $/month
Savings Plans, Reserved Instances, EC2 Spot Instances, autoscaling, scheduling, rightsizing,
modernization, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark.
Compute services landscape
AWS manages Customer manages
Data source integrations
Physical hardware, software,
networking, and facilities
Provisioning
Application code
Container orchestration, provisioning
Cluster scaling
Physical hardware, host OS/kernel,
Application code
Data source
integrations
Security config and updates
Network config
Management tasks
Container orchestration control plane
Physical hardware software, networking,
and facilities
Application code
Work clusters
Security config and updates,
network config, firewall,
management tasks
Physical hardware software,
Application code
Scaling
Security config and updates
Network config
Management tasks
Provisioning, managing scaling
and patching of servers
AWS Lambda
Serverless functions
AWS Fargate
Serverless containers
Amazon ECS/EKS
Container-management
-as-a-service
Amazon EC2
Infrastructure-as-a-Service
Less
More
Opinionated

T4g
General
Purpose
M5
T3
T3a M5a
M5
Compute
Optimized
C5 C5n
Memory
Optimized
Accelerated
Computing
Storage
Optimized
R5 X2iedn
X1
R6a
R5
Z1d
Z1d
G3 F1
P2 H1
D3
I3
I3
C5
metal
General
Purpose
Burstable
performance
Big Data
Optimized
Dense
Storage
Memory
Optimized
Memory
Intensive
In-memory
Compute +
network up to
100 Gbps*
High I/O
Graphics
Intensive
Compute
Intensive FPGA
General
Purpose GPU
Compute and
Memory
Intensive
Local storage
(NVMe SSD) M5d C5d R5d
AWS
Graviton
I3en
u-
24tb1
M7g C7g R7g
G5
G5g Im4gn
C7gn X2gd
Instance Types
48

Storage
A reliable, scalable, and secure place for your data
Pay as you go: Storage space provisioned vs. used, $/read, $/write
Infrequent access tiers, rightsizing, batching reads/writes, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

Storage Services
BLOCK
Amazon
EBS Amazon EFS
Amazon FSx for
Windows File Server
FILE
Amazon FSx
for Lustre
OBJECT
Amazon
S3
AWS Snowball
Edge
AWS Snowcone
AWS Storage
Gateway
AWS Snowmobile
AWS
DataSync
AWS Transfer
Family
DATA TRANSFER AND EDGE PROCESSING
Amazon FSx for
NetApp ONTAP
Amazon FSx for
OpenZFS
BACKUP
AWS
Backup
Amazon File
Cache

Database
The broadest selection of purpose-built databases for all your application needs
Pay as you go: $/compute-hr, storage space provisioned vs. used, $/read, $/write
Infrequent access tiers, rightsizing, batching reads/writes, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

Purpose Built Databases

Analytics
Fastest way to get answers from all your data to all your users
Pay as you go: $/compute-hr, $/query, storage space provisioned , $/user
Reserved Instances, other usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

Networking and content delivery
The global cloud network for every workload
Pay as you go: Data transfer out (DTO), $/request
Usage-based optimizations
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

Security, identity, and compliance
Secure your workloads and applications in the cloud
Pay as you go: $/check, $/events analyzed, DTO, $/rule, $/request, $/S3 bucket evaluated
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

AWS Security, Identity, and Compliance Solutions
AWS Identity and Access
Management (IAM)
AWS IAM Identity Center
(successor to AWS SSO)
AWS Organizations
AWS Directory Service
Amazon Cognito
AWS Resource Access
Manager
AWS Security Hub
Amazon GuardDuty
Amazon Inspector
Amazon CloudWatch
AWS Config
AWS CloudTrail
VPC Flow Logs
AWS IoT
Device Defender
AWS Firewall Manager
AWS Network Firewall
AWS Shield
AWS WAF
Amazon VPC
AWS PrivateLink
AWS Systems Manager
Amazon Macie
AWS Key Management Service
(KMS)
AWS CloudHSM
AWS Certificate Manager
AWS Secrets Manager
AWS VPN
Server-Side Encryption
Amazon Detective
Amazon EventBridge
AWS Backup
AWS Security Hub
AWS Elastic Disaster
Recovery
Identity and access
management
Infrastructure
protection
Incident
response
AWS Artifact
AWS Audit Manager
Amazon CloudWatch
AWS CloudTrail
AWS Config
AWS Security Hub
AWS Systems
Manager
Data
protection
Privacy and
Compliance
Detective
controls

Management and governance
Implement control but maintain or increase business agility
Pay as you go: $/metric, $/event, $/api call, AWS Support, Free
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

Application integration
Integrate distributed systems and serverless applications with less code
Pay as you go: $/state transition, $/flow, $/published event, $/compute-hr.
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

Internet of Things (IoT)
IoT services for industrial, consumer, and commercial solutions
Pay as you go: $/min-connection, $/message, $/device, $/update, $/searches
DESCRIPTION
GENERAL PRICING
OPTIMIZATIONS

1. Compute

Amazon Elastic Compute Cloud (Amazon EC2)
• Complete control of your computing resources
• Resizable compute capacity
• Reduced time required to obtain and boot
new server instances
• Over 475 types of compute instances
Amazon
EC2

What’s your use case?
I N S T A N C E T Y P E D E T A I L S
General
purpose
Compute
optimized
Memory
optimized
Accelerated
computing
Storage
optimized
Instance types
a1, m4, m5,
t2, t3
c4, c5
r4, r5,
x1, z1
f1, g3, g4,
p2, p3
d2, h1, i3
Use case
Broad High
performance
In-memory
databases
Machine
learning (ML)
Distributed file
systems

Amazon EC2 Auto Scaling
Su M T W Th F Sa
Used capacity
(demand)
Provisioned capacity
• Helps you maintain application
availability
• Enables you to automatically add or
remove EC2 instances, according to
conditions you define
• Detects impaired EC2 instances and
unhealthy applications, and replaces
the instances without intervention
• Provides several scaling options:
Manual, scheduled, dynamic or
on demand, and predictive

Serverless computing

What is serverless?
Building and running applications and services without
managing servers
No servers to
provision or manage
Never pay
for idle
Scales
with usage
Availability and
fault tolerance built in

AWS Lambda
• Fully managed compute service
• Supports multiple languages
• Runs stateless code
• Runs your code on a schedule or in
response to events, such as changes
to data in an Amazon S3 bucket or
Amazon DynamoDB table
• Per millisecond pricing
AWS
Lambda

Web
applications
Static websites
Complex web
applications
Packages for
Flask and
Express
Data
processing
Real time
MapReduce
Batch
ML inference
Chatbots
Powering
chatbot logic
Backends
Applications
and services
Mobile
Internet of
Things (IoT)
Amazon
Alexa
Powering
voice-enabled
applications
Alexa
Skills Kit
IT
automation
Policy engines
Extending
AWS services
Infrastructure
management
Serverless application use cases

Containers

Running containers on AWS
Amazon Elastic
Container
Service
(Amazon ECS)
Remove the complexity of standing up the
infrastructure
Orchestrate the execution of containers
Maintain and scale the fleet of nodes
running your containers
Amazon Elastic
Kubernetes
Service
(Amazon EKS)

2. Storage

AWS storage options
Amazon Simple Storage
Service (Amazon S3)
Scalable, highly durable
object storage in the cloud
Amazon Elastic File System
(Amazon EFS)
Scalable network file storage
for Amazon EC2 instances
Amazon S3 Glacier
Low-cost, highly durable
archive storage in the cloud
Amazon Elastic Block Store
(Amazon EBS)
Network-attached volumes that
provide durable block-level storage
for Amazon EC2 instances

Amazon S3
Object-level
storage
Designed for
99.999999999%
durability
Event triggers
Amazon
S3
Use cases
• Content storage and distribution
• Backup and archiving
• Big data analytics
• Disaster recovery
• Static website hosting

Amazon EBS
• Persistent network-attached
block storage for instances
• Different drive types
• Scalable
• Pay only for what
you provision
• Snapshot functionality
• Encryption available
Amazon EBS volumes
EC2
instance
EC2
instance
AWS Cloud
Monday’s snapshot
Tuesday’s snapshot
Wednesday’s snapshot
Thursday’s snapshot
Friday’s snapshot
Detach and reattach volumes
to other EC2 instances
Create volume snapshots
for backup and recovery

Amazon EFS
Performant and
cost optimized
Serverless
shared storage
Full AWS compute integration Four storage classes
Serverless and scalable
Simple and
highly reliable
Elastic
Highly durable and available
Performant

3. Databases

Purpose-built databases
Amazon
RDS
Amazon
Aurora
Amazon
Redshift
Relational
database
Nonrelational
key value
Amazon
DocumentDB
Amazon
DynamoDB
Nonrelational
document
Amazon
Neptune
Nonrelational
graph
Amazon
QLDB
Nonrelational
ledger
Amazon
ElastiCache
Nonrelational
In memory

Amazon RDS
Set up, operate, and scale a relational database in the cloud with just
a few clicks
Database engines
Easy to set up
and operate
Scales
Amazon RDS
Amazon Aurora
MySQL
ORACLE
Microsoft
SQL Server

Amazon Aurora
MySQL- and PostgreSQL-compatible relational database built for the cloud
High
availability
and durability
High
performance
Compatible
Multi-Region
Amazon Aurora
High
scalability

Amazon DynamoDB
Fast and flexible NoSQL database service for any scale
Fully
managed
Fast,
consistent
performance
Fine-grained
access control
Flexible
Amazon DynamoDB

4. Networking

Amazon VPC
Amazon
VPC
Provides logical
isolation for
your workloads
Dev Test
Allows custom access
controls and security
settings for your resources
Your private
network space in
the AWS Cloud
VPC
AWS Cloud

Example
Amazon EC2
Auto Scaling
group
EC2 instances
Amazon VPC
Clients
Amazon
Route 53
Amazon
ELB
Internet
gateway

5. Security

Highest standards for privacy and data security
Encryption at scale
with keys managed by
our AWS Key Management
Service (KMS) or managing
your own encryption keys
with AWS CloudHSM using FIPS
140-2 Level 3 validated HSMs
Meet data residency
requirements, choose
an AWS Region and AWS will
not replicate it elsewhere
unless you choose to do so
Comply with local
data privacy laws
by controlling who
can access content, its
lifecycle, and disposal
Access services and tools
that enable you to
build compliant
infrastructure
on top of AWS

Shared responsibility model
AWS
Security of
the cloud
AWS is responsible for
protecting the infrastructure
that runs all of the services
offered in the AWS Cloud
Security in
the cloud
Customer responsibility will
be determined by the AWS
Cloud services that a
customer selects
CUSTOMER

Shared responsibility model
Customer
responsibility
AWS
responsibility
AWS foundation services
Compute Storage Databases Networking
AWS global infrastructure
Availability Zones
Regions Edge locations
Platform, applications, and identity and access management (IAM)
Operating system, network, and firewall configuration
Customer data
Network traffic
protection (encryption,
integrity, identity)
Client-side data
encryption and data
integrity authentication
Server-side encryption
(file system/data)

AWS Compliance
Find out more: https://aws.amazon.com/compliance/

Security, identity, and compliance service
category
AWS security, identity,
and compliance services
AWS Identity and Access
Management (IAM)
AWS Artifact
AWS KMS
AWS Shield
And more . . .

AWS Identity and Access Management (IAM)
• Securely control access to your AWS resources
• Assign granular permissions to users, groups,
or roles
• Share temporary access to your AWS account
• Federate users in your corporate network or
with an internet identity provider
AWS IAM

AWS Trusted Advisor
Provides guidance to help you reduce cost, increase performance,
and improve security

Pricing

Pay for what
you use
Pay less when
you reserve
Pay less with
volume-based
discounts
Pay even less
as AWS grows
AWS pricing concepts

AWS Free Tier
Enables you to gain hands-on experience with
the AWS platform, products, and services at no cost
https://aws.amazon.com/free
Always free 12 months
free
Trials

Amazon EC2 purchasing options
On-Demand
Instances
Reserved
Instances
Savings
plans
Spot
Instances
• Charged per
hour/second
• Short-term
• Unpredictable
workloads
• Discount for
1- to 3-year
commitments
• Larger upfront
payment for greater
discount
• Up to 90% discount
• Applications with
flexible start and end
times
• Urgent computing
needs for large
amounts of capacity

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved
Reimagine the experience across the
entire software development lifecycle
Amazon Q Developer

M O R E T H A N
of enterprises will have
used generative AI APIs
or deployed generative
AI-enabled apps by
20261
A C C O R D I N G T O G A R T N E R , I N C . ®
1 Gartner, “More than 80% of Enterprises,” October 11, 2023.

INFRASTRUCTURE FOR FM TRAINING AND INFERENCE
GPUs AWS
Inferentia
AWS
Trainium
Amazon
SageMaker
Amazon EC2
Capacity Blocks
AWS
Neuron
Amazon EC2
UltraClusters
Elastic Fabric
Adapter (EFA)
AWS
Nitro
TOOLS TO BUILD WITH LLMs AND OTHER FMs
Amazon Bedrock
Guardrails Agents Customization capabilities
Generative AI stack
APPLICATIONS THAT USE LLMs AND OTHER FMs
Amazon Q
Business
Amazon Q
Developer
Amazon Q in
QuickSight
Amazon Q in
Connect

Amazon Q, a generative AI–powered assistant from AWS
AMAZON Q BUSINESS
AMAZON Q DEVELOPER
In-built privacy and security Customizable to your business
Benefits
Developers IT professionals Employees Business analysts
Personas

< one hour coding time
The median developer spends less than one hour a day writing code1
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved
99
73% 27%
of time is spent
on running and
maintaining applications
of time is spent
on innovation and
transformation
1 Software.com, “Global Code Time Report,” January 2022.

Where are developers
spending time in the SDLC?
Test and
secure
Operate
Plan
Create
Maintain and
modernize
Plan
• Find accurate and specific technical
guidance from relevant documentation,
code examples, resources, and so on
• Design changes based on business
and technical requirements
Create
• Generate code
• Manage infrastructure
Test and secure
• Apply proper test cases for code changes
• Scan for security vulnerabilities in code
Operate
• Identify and mitigate code issues
• Monitor performance and efficiency
Maintain and modernize
• Modernize and update old code
languages and dependencies

Amazon Q
Developer
Reimagines the experience across the entire
software development lifecycle (SDLC)
Helps developers and IT professionals build and manage
secure, scalable, and highly available applications
Helps you write, debug, test, optimize, and
upgrade your code faster
Converses with you to explore new AWS capabilities,
learn unfamiliar technologies, and architect solutions
Amazon Q is built with security and privacy in mind from the start, making
it easier for organizations to use generative AI safely.

Amazon Q supports developers
across the SDLC
Plan
• Amazon Q Developer in the AWS Management Console (best
practices, AWS WAF, Amazon EC2 instance optimization)
• Business-specific application
• Explain code with conversational coding
Create
• Inline coding companion in IDE and CLI
• Software development
• Conversational coding
Test and secure
• Unit test generation
• Security scanning and remediation
Operate
• Troubleshoot errors (Amazon S3, AWS Lambda, Amazon
EC2, Amazon Elastic Kubernetes Service)
• VPC Reachability Analyzer
• Debug and optimize code with conversational coding
• Helps you optimize your AWS resources and costs [NEW]
Maintain and modernize
• Update code with Amazon Q Developer Agent for
code transformation
Test and
secure
Operate
Plan
Create
Maintain and
modernize

Amazon Q is available where you do your work
Amazon
CodeCatalyst
AWS consoles IDEs AWS documentation
Slack and Teams
(through AWS Chatbot)
AWS Console
Mobile Application

Explore and plan
Ask questions and
get guidance from
17 years of AWS
knowledge, best
practices, well-
architected advice
Create a business-
expert application
using your data,
systems, and more.

Create
Generate code
Explain code
Help understand
your code base
Customizable
to your code

Advanced capability: Amazon Q Developer
Agent for software development
Amazon Q Developer
Agent for software
development can help
you write and
implement entire
application features in
minutes right from a
simple natural language
prompt in your IDE, with
interactive step-by-step
instructions, code, tests,
and best practices.

Test and secure
Generate unit tests
Scan entire project
for security
vulnerabilities
Generate
remediations to
improve security
and code quality

Operate
Diagnose and
troubleshoot
errors in the
console
Analyze
network
connectivity
and VPC
reachability

Amazon Q Developer knows your AWS account resources and billing
List, describe, and
get guidance
based on
resources in your
AWS account
Retrieve and
analyze cost data
from AWS Cost
Explorer (preview)

Build
and test
(Java 8)
Apply
knowledge
base
Build
and test
(Java 17)
Gen AI
fixes
errors
Upgraded
code
Source
code
M O D E R N I Z E L A N G U A G E V E R S I O N S I N A F R A C T I O N O F T H E T I M E
Maintain and modernize: Amazon Q Developer Agent for
code transformation
Knowledge
database

Amazon Q
Developer Agent
for code
transformation
Automates the complete
process of upgrading
and transforming code

Java applications Minutes each,
on average
Days
Amazon Q
Developer Agent
for code
transformation

Retire tech debt at scale
Modernize projects and upgrade language version and
dependencies with Amazon Q Developer Agent for code transformation
Summary of core use cases
Drive developer productivity
Get inline coding recommendations, summarize and document code,
scan for security issues, diagnose and troubleshoot bugs, and write unit tests
Improve security and code quality
Ship more secure code with less effort with code scanning and
automated code remediation

© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. 114
Amazon Q also accelerates time to insights
> Increase user productivity: Empowers you to
integrate and query data using natural language
without deep knowledge in coding, AWS data
services, or your organization’s database metadata
> Generative AI in every place: Assists you
everywhere you work with AWS: in the console,
studio, notebooks, and SQL Editor
> Reduce time to insights: Answers your questions
on data and AWS services, troubleshoots issues,
and proposes solutions
Q in Redshift Q in Glue

AWS AI/ML stack
B R O A D E S T A N D M O S T C O M P L E T E S E T O F M A C H I N E L E A R N I N G C A P A B I L I T I E S
ML FRAMEWORKS
& INFRASTRUCTURE
STUDIO IDE
AMAZON
SAGEMAKER
CANVAS
No-code ML for
business analysts
STUDIO LAB
Learn ML
GROUND TRUTH
Label data Prepare data Geospatial
ML
Store features
Build with
notebooks
Train
models
Tune
parameters
Manage
and monitor
Deploy in
production
PyTorch, Apache MXNet, TensorFlow Amazon EC2 CPUs GPUs
AWS
Trainium
AWS
Inferentia
FPGA
Habana
Gaudi
CORE
SPECIALIZED
AI
SERVICES
BUSINESS PROCESSES
Amazon Personalize
Amazon Forecast
Amazon Fraud Detector
Amazon Lookout for Metrics
SEARCH
Amazon Kendra
CONVERSATION
Amazon Lex
Amazon Transcribe Call Analytics
Contact Lens
Voice ID
CODE + DEVOPS
Amazon CodeGuru
Amazon CodeWhisperer
Amazon DevOps Guru
INDUSTRIAL
Amazon Monitron
Amazon Lookout for Equipment
Amazon Lookout for Vision
HEALTH
Amazon HealthLake
Amazon Comprehend Medical
Amazon Transcribe Medical
Amazon Omics
TEXT
Amazon Translate Amazon Comprehend
SPEECH
Amazon Polly Amazon Transcribe
VISION
Amazon Textract Amazon Rekognition AWS Panorama
CI/CD | GOVERNANCE | RESPONSIBLE ML
EDGE MANAGER
Manage edge devices

Generative AI with AWS

117
BLOOM
Question: What is generative AI?
Creates new content and ideas, including conversations,
stories, images, videos, and music
Powered by large models that are pretrained on vast corpora of
data and commonly referred to as foundation models (FMs)

Generative AI is powered
by FMs
Pretrained on vast amounts of
unstructured data
Contain large number of parameters that make
them capable of learning complex concepts
Can be applied in a wide
range of contexts
Customize FMs using your data for domain-
specific tasks
118

How FMs differ from other machine learning
(ML) models
119
Text generation
Summarization
Information
extraction
Q&A
Chatbot
Pretrain Adapt
Foundation models
Tasks
Unlabeled
data
FM
Traditional ML models
Text generation
Summarization
Information
extraction
Q&A
Chatbot
Train Deploy
Tasks
ML model
ML model
ML model
ML model
ML model
Labeled data
Labeled data
Labeled data
Labeled data
Labeled data

Types of FMs
120
Text-to-text
Generate text from natural
language prompts
Text-to-embeddings
Generate numerical
representation of text
“summarize the
articles on impact of
walking on heart health”
“a photo of an astronaut
riding a horse on mars”
Multimodal
Create and edit images using
natural language prompts
“hand soap”
Numerical representation of
“Hand soap refills
Hand soap dispenser
Hand soap antibacterial”
“Ten thousand steps per day
is optimum for maintaining
a healthy heart”
Input Output
FM

Writing
Media design
Conversational search
Virtual assistants
Chatbots
Personalization
AI-powered Contact Center
Summarization
Modeling
Code generation
Data to insights
Document processing
Process optimization
Data augmentation
Cybersecurity
Enhance
customer
experience
Boost
employee
productivity
Creativity
and content
creation
Improve
business
operations
Generative AI can be used for a wide range of use cases
121

The Year
of POCs
What does this mean for my business? What is a Foundation Model?
What is a Large Language Model?
What is generative AI?
Do I need to become a prompt engineer?
Is this secure?
How do I choose a model? Where do I get started?
Which models should we try out? What is FM?

The Year of
Production
(FOR SOME)
How do I prioritize my projects?
How can we move faster?
How do I make this real?
How can I lower my costs?
How I can I scale this? Which models should I use?
How do I manage risks?
Should I train my own model?
What customization method should I use?

Innovation opportunities

Generative AI has potential to
create significant business value
Create new content and
ideas, including
conversations, stories,
images, videos, and music
Radically improve productivity
across all lines of business
Extract insights and
clear answers from all
your corporate information,
enabling faster and
better decisions
Create new innovative and
engaging ways of
interacting with your
customers and employees

CREATIVE GENERATION AND
OPTIMIZATION
OPTIMIZE BUSINESS
PROCESSES
Generative AI use cases across industries
CHATBOTS
VIRTUAL
ASSISTANTS
CONVERSATION
ANALYTICS
CONVERSATIONAL
SEARCH
SUMMARIZATION
CONTENT
CREATION CODE
DOCUMENT
PROCESSING
DATA
AUGMENTATION
FRAUD DETECTION

Make generative AI
work with
Generalized and specialized knowledge for your domain
Unlabeled, unstructured enterprise data
Change a copy of the foundation model
Specialized knowledge for specific tasks
Small number of labeled examples
Change a copy of the foundation model
Specialized knowledge through prompt augmentation
Enterprise knowledge corpus
No change to the foundation model

Build a data foundation to fuel
your generative AI applications on
AWS
End-to-end data
governance capabilities,
responsible AI, and regulating
user interactions with LLMs
Choices for integrating
data including zero ETL
so you can easily connect
to all your data
Comprehensive set of
services for storing and
querying structured,
unstructured, and vector data

generative AI for your
business
From models to tools, choice enables long-term more flexibility and agility
Security and privacy must be built in from day one
Ensure your data is readily accessible and ready for AI
Customization is key to delivering differentiated experiences

Make the leap from
Measure and track the business value and ROI as you scale
Manage risk, maintain trust, and build responsibly with strong compliance & governance
Use services designed for to enable innovation, and designed to scale
Optimize for your cost, latency, and accuracy needs

Security considerations for generative AI
The policies, procedures,
and reporting needed to
empower the business
while minimizing risk
---
Create generative AI usage
guidelines
Establish process for
output validation
Develop monitoring &
reporting processes
The specific regulatory,
legal, and privacy
requirements for using
or creating generative AI
solutions.
---
Retain control of your
data
Encrypt data in transit
and at rest
Support regulatory
standards
The implementation of
security controls that are
used to mitigate risk.
---
Human-in-the-loop
Explainability & audibility
Testing strategy
Identity and access
management
Identification of potential
threats to generative AI
solutions and
recommended
mitigations.
---
Threat modeling
Third-party risk
assessments
Ownership of data,
including prompts and
responses
How to architect
generative AI solutions to
maintain availability and
meet business SLAs.
---
Data management
strategy
Availability
High Availability and
Disaster Recovery
strategy

Considering impacts
on different groups
of stakeholders
Understanding
and evaluating
system outputs
Having mechanisms
to monitor and steer
AI system behavior
Appropriately obtaining,
using and protecting
data and models
Incorporating best practices
into the AI supply chain,
including providers
and deployers
Enabling stakeholders to
make informed choices
about their engagement
with an AI system
Responsible AI Dimensions
Preventing harmful system
output and misuse
Achieving correct
system outputs,
even with unexpected
or adversarial inputs

Amazon
Bedrock
The easiest way to build and
scale generative AI applications
with foundation models (FMs)
Choice of leading FMs through a single API
Model customization
Retrieval Augmented Generation (RAG)
Agents that execute multistep tasks
Security, privacy, and safety

Amazon
Helps keep your data
secure and private
None of the customer’s data is used to
train the underlying model
All data is encrypted in transit and at rest;
data used for customization is securely
transferred through customer’s VPC
Data remains in the Region where the API
is processed
Support for GDPR, SOC, ISO, CSA
compliance, and HIPAA eligibility

Guardrails for
Amazon Bedrock
Implement safeguards customized to
your application requirements and
responsible AI policies
Apply guardrails to multiple foundation
models and Agents for Amazon Bedrock
Configure harmful content filtering
based on your responsible AI policies
Define and disallow denied topics with
short natural language descriptions
Redact or block sensitive information
such as PIIs, and custom Regex.

Next steps

Classroom training AWS Certification
In-person and virtual training
from instructors who teach your
team in a hands-on learning
environment
Identify skilled professionals to
lead cloud initiatives using AWS
Digital training
No cost, on-demand courses so
your team can learn about the
latest services when and where
it’s convenient
Expand your cloud skills with AWS

Validate expertise with AWS Certification
Why certify?
• Demonstrate
your expertise
• Earn recognition
and visibility
• Foster credibility with
your employer and peers
Certification
resources
• Exam readiness training
• Self-paced labs

Deepen your skills with digital
learning on demand
Access 500+ free digital courses
and Learning Plans
Earn an industry-recognized
credential
AWS Skill Builder AWS Certifications
Explore resources with a variety
of skill levels and 16+ languages
to meet your learning needs
Join the AWS Certified community
and get exclusive benefits
Receive Foundational,
Associate, Professional,
and Specialty certifications
Train now
Access new
exam guides
Learn in-demand AWS Cloud skills

Thank you!
Sami Hoda
LinkedIn: @samihoda

Intro to Amazon Web Services (AWS) and Gen AI

More Related Content

Similar to Intro to Amazon Web Services (AWS) and Gen AI

Similar to Intro to Amazon Web Services (AWS) and Gen AI (20)

More from Ortus Solutions, Corp

More from Ortus Solutions, Corp (20)

Recently uploaded

Recently uploaded (20)

Intro to Amazon Web Services (AWS) and Gen AI