Amazon Aurora 클러스터를 초당 수백만 건의 쓰기 트랜잭션으로 확장하고 페타바이트 규모의 데이터를 관리할 수 있으며, 사용자 지정 애플리케이션 로직을 생성하거나 여러 데이터베이스를 관리할 필요 없이 Aurora에서 관계형 데이터베이스 워크로드를 단일 Aurora 라이터 인스턴스의 한도 이상으로 확장할 수 있는 Amazon Aurora Limitless Database를 소개합니다.
The document discusses strategies for establishing a single view of data across an organization. It recommends bringing all organizational data together in a single platform to provide a comprehensive and consistent view for all stakeholders. This allows gaining new insights from data that may have previously been overlooked or unused. It also discusses challenges like data silos and quality issues and how democratizing data access can improve business outcomes through greater collaboration and innovation. The document concludes by examining emerging technologies at the leading edge of data and AI like AI assistants and how establishing a data mesh architecture can help decentralize data management.
Oracle to Amazon Aurora Migration, Step by Step (DAT435-R1) - AWS re:Invent 2018
Learn the concepts, best practices, blueprints and tips for migrating large enterprise Oracle databases to Amazon Aurora from an expert in the field. We use a combination of automated tools (AWS Schema Conversion Tool, AWS Database Migration Service), manual procedures, and DBA know-how. We take questions on the Amazon Aurora architecture and capabilities, how they compare to Oracle technologies such as RAC and DataGuard, and how to migrate core Oracle features, capabilities, and schema objects to their equivalent counterparts in AWS. We also share tips on choosing between PostgreSQL and MySQL as the target platform for your database.
AWS RDS Data API and CloudTrail. Who drop the table_.pdf
- Utilize AWS RDS Data API for secure database access and operations
- CloudTrail for auditing and activity monitoring
- Investigating incidents and preventing unauthorized access
- PostgreSQL Auditing (pgAudit) extension
An Intro to Building and Optimizing a Hybrid Cloud on AWS
An Intro to Building and Optimizing a Hybrid Cloud on AWS, hosted by AWS Solutions Architect, Samir Kadoo will help you discover the best hybrid cloud uses cases for your organization, and AWS services that enable hybrid cloud environments, including VMware Cloud on AWS and AWS Outposts. In addition, Samir demonstratea the migration of virtual machines from on-premises to VMware Cloud on AWS utilizing VMware vMotion.
Introduction to GraphQL and AWS Appsync on AWS - iOS
by Rohan Dubal, Software Development Engineer, AWS
One of the biggest time sinks and challenges for mobile application developers is developing, accessing, and managing all of the disparate data sources that are involved in delivering delightful, collaborative, and real-time mobile experiences for users while also enabling offline capabilities for when a user is not connected, but still wants to use the app. In this session, you be introduced to the new AWS AppSync service that speed and simplifies these tasks for developers using GraphQL to provide a data abstraction layer and easy query and update statements without having to know the details of the underlying data sources.
AWS Lambda Powertools is a developer toolkit to implement Serverless best practices and increase developer velocity. It started as an open-source project in 2020 focused in making Tracing, Logging, and Metrics easier. Fast-forward, Powertools added 13 more features, grew a vibrant community who regularly contributes up to 60% of our releases, now covering a plethora of use cases: REST and GraphQL APIs, Batch processing, Idempotency, Feature Flags, Data Validation, and more.
You’ll learn why this developer toolkit was created, key use cases, and find out how you can adopt common industry and AWS best practices in seconds. We’ll also cover two of the most anticipated new features coming in 2023, and live demo(s).
Il cloud ibrido fa riferimento all'uso di risorse locali in aggiunta alle risorse pubbliche del cloud. Un cloud ibrido consente a un'organizzazione di migrare applicazioni e dati nel cloud, estendere la capacità del data center, utilizzare nuove funzionalità native del cloud, avvicinare le applicazioni ai clienti e creare una soluzione di backup e disaster recovery con una elevata disponibilità. In questa sessione verranno presentate le principali architetture ed i tool AWS per realizzarle.
Businesses are quickly moving to NoSQL databases to power their modern applications. However, a technology migration involves risk, especially if you have to change your data model. What if you could host a relatively unmodified RDBMS schema on your NoSQL database, then optimize it over time?
We’ll show you how Couchbase makes it easy to:
• Use SQL for JSON to query your data and create joins
• Optimize indexes and perform HashMap queries
• Build applications and analysis with NoSQL
VMware Cloud on AWS provides a VMware software-defined data center delivered as a service on AWS infrastructure. It allows customers to run applications using VMware technologies like vSphere, vSAN and NSX in AWS without having to manage underlying hardware. Key features include dynamic capacity, software-defined data center capabilities, and integration with AWS services. The document discusses the architecture, account structure, connectivity options, use cases and resources for VMware Cloud on AWS.
ITCamp 2018 - Magnus Mårtensson - Azure Resource Manager For The Win
With the new model, Azure Resource Manger Microsoft are gaining the repeatability they always wanted to have for deployment to the Cloud and removing the dreary, repetitive, error prone manual deployment tasks which has always held us back! With ARM, you can create a Template for your environment and use that for deploying identical environments every time without fail! There is some news in the world of “infrastructure as code” that we need to consider while setting up our Cloud environments. The Win we get from being able to deploy our development environment or our temporary load test environment automatically and identically to our production environment cannot be understated. This is ARM from a project efficiency, development and DevOps perspective. This is what you need to know to make you much more efficient every day of development.
Migrating Databases to the Cloud: Introduction to AWS DMS - SRV215 - Chicago ...
In this introductory session, we cover how to convert and migrate your relational databases, non-relational databases, and data warehouses to the cloud. AWS Database Migration Service (AWS DMS) and AWS Schema Conversion Tool (AWS SCT) have been used to migrate tens of thousands of databases across the world. This includes homogeneous migrations, such as PostgreSQL to PostgreSQL, and heterogeneous migrations between different database engines, such as Oracle or SQL Server to Amazon Aurora, Amazon DynamoDB, and Amazon Redshift. Learn how to quickly and securely migrate your data and procedural code, enjoy flexibility and cost savings, and minimize the downtime of your applications.
J1 T1 4 - Azure Data Factory vs SSIS - Regis Baccaro
This document compares Azure Data Factory (ADF) and SQL Server Integration Services (SSIS) for data integration tasks. It outlines the core concepts and architecture of ADF, including datasets, pipelines, activities, scheduling and execution. It then provides an overview of what SSIS is used for and its benefits. The document proceeds to compare ADF and SSIS in terms of development, administration, deployment, monitoring, supported sources and destinations, security, and pricing. It concludes that while both tools are not meant for the same purposes, organizations can benefit from using them together in a hybrid approach for different tasks.
Join me in this session where I'll share our journey of building a fully serverless application that flawlessly managed check-ins for an event with a staggering 80 thousand registrations.
We'll dive into three key strategies that made this possible. Firstly, by harnessing DynamoDB global tables, we ensured global service availability and data replication across regions, boosting performance and disaster recovery. Next, we'll explore how we seamlessly integrated real-time updates into the app using Appsync subscriptions, making the experience dynamic and engaging for users. Finally, I'll discuss how provisioned concurrency not only improved performance but also kept costs in check, highlighting the cost-effectiveness of serverless architectures.
Through these strategies and the inherent scalability of serverless technology, our application effortlessly handled massive user loads without manual intervention. This session is a real world example to the power and efficiency of modern cloud-based solutions in enabling seamless scalability and robust performance with Serverless
Lot of new AWS services were announced in 2022 re:Invent, far too many to cover in one talk. Sharing consolidated list of most prominent new AWS service and feature launches announced at AWS re:Invent 2022 across various technologies - compute, storage, devops, serverless, machine learning, data, analytics, security, networking, developer experience and more!
Introduction to AWS OutIntroduction to AWS Outposts - CMP203 - Chicago AWS Su...
AWS Outposts allows customers to run compute and storage on-premises while connecting to AWS's full range of services in the cloud. It provides three main benefits:
1) It allows customers to build applications once and deploy them on-premises or in the cloud using the same AWS APIs, services, and tools.
2) It offers a fully managed service model so customers don't have to worry about procuring, operating, or maintaining their own infrastructure.
3) It provides the same security, performance, reliability, and operational experience of AWS regions while also addressing the needs of applications that require low latency access to on-premises systems or local data processing.
클라우드에서 Database를 백업하고 복구하는 방법에 대해 설명드립니다. AWS Backup을 사용하여 전체백업/복구 부터 PITR(Point in Time Recovery)백업, 그리고 멀티 어카운트, 멀티 리전등 다양한 데이터 보호 방법을 소개합니다(데모 포함). 또한 self-managed DB 의 데이터 저장소로 Amazon FSx for NetApp ONTAP 스토리지 서비스를 사용할 경우 얼마나 신속하게 데이터를 복구/복제 할수 있는지 살펴 봅니다.
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
기업은 이벤트나 신제품 출시 등으로 예기치 못한 트래픽 급증 시 데이터베이스 과부하, 서비스 지연 및 중단 등의 문제를 겪곤 합니다. Aurora 오토스케일링은 프로비저닝 시간으로 인해 실시간 대응이 어렵고, 트래픽 대응을 위한 과잉 프로비���닝이 발생합니다. 이러한 문제를 해결하기 위해 프로비저닝된 Amazon Aurora 클러스터와 Aurora Serverless v2(ASV2) 인스턴스를 결합하는 Amazon Aurora 혼합 구성 클러스터 아키텍처와 고해상도 지표를 기반으로 하는 커스텀 오토스케일링 솔루션을 소개합니다.
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
Amazon Aurora MySQL 호환 버전 2(MySQL 5.7 호환성 지원)는 2024년 10월 31일에 표준 지원이 종료될 예정입니다. 이로 인해 Aurora MySQL의 메이저 버전 업그레이드를 검토하고 계시다면, Amazon Blue/Green Deployments는 운영 환경에 영향을 주지 않고 메이저 버전 업그레이드를 할 수 있는 최적의 솔루션입니다. 본 세션에서는 Blue/Green Deployments를 통한 Aurora MySQL의 메이저 버전 업그레이드를 실습합니다.
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
Database Migration Service(DMS)는 RDBMS 이외에도 다양한 데이터베이스 이관을 지원합니다. 실제 고객사 사례를 통해 DMS가 데이터베이스 이관, 통합, 분리를 수행하는 데 어떻게 활용되는지 알아보고, 동시에 데이터 분석을 위한 데이터 수집(Data Ingest)에도 어떤 역할을 하는지 살펴보겠습니다.
Amazon ElastiCache는 Redis 및 MemCached와 호환되는 완전관리형 서비스로서 현대적 애플리케이션의 성능을 최적의 비용으로 실시간으로 개선해 줍니다. ElastiCache의 Best Practice를 통해 최적의 성능과 서비스 최적화 방법에 대해 알아봅니다.
AWS SSA Webinar 28 - Getting Started with AWS - Infrastructure as CodeCobus Bernard
One of the parts of doing things properly at scale is being able to describe your infrastructure as code and deploy it as such. If we already treat our infrastructure as code, why not apply all the best practices of software delivery to infrastructure delivery.
In this session we look into Infrastructure as Code solutions, best practices and patterns on AWS.
Marcia Villalba, an AWS Developer Advocate, gives a presentation on serverless architecture using AWS Lambda. She discusses how serverless allows developers to focus on business logic without managing infrastructure. Lambda runs code in response to events and scales automatically. The document then provides a simple example of building a "hello world" API using API Gateway, Lambda, and DynamoDB. Code is deployed via SAM and the API is tested with Postman. Finally, the backend is integrated into a website.
One of the biggest time sinks and challenges for mobile application developers is developing, accessing, and managing all of the disparate data sources that are involved in delivering delightful, collaborative, and real-time mobile experiences for users while also enabling offline capabilities for when a user is not connected, but still wants to use the app. In this session, you be introduced to the new AWS AppSync service that speed and simplifies these tasks for developers using GraphQL to provide a data abstraction layer and easy query and update statements without having to know the details of the underlying data sources.
The document discusses strategies for establishing a single view of data across an organization. It recommends bringing all organizational data together in a single platform to provide a comprehensive and consistent view for all stakeholders. This allows gaining new insights from data that may have previously been overlooked or unused. It also discusses challenges like data silos and quality issues and how democratizing data access can improve business outcomes through greater collaboration and innovation. The document concludes by examining emerging technologies at the leading edge of data and AI like AI assistants and how establishing a data mesh architecture can help decentralize data management.
Oracle to Amazon Aurora Migration, Step by Step (DAT435-R1) - AWS re:Invent 2018Amazon Web Services
Learn the concepts, best practices, blueprints and tips for migrating large enterprise Oracle databases to Amazon Aurora from an expert in the field. We use a combination of automated tools (AWS Schema Conversion Tool, AWS Database Migration Service), manual procedures, and DBA know-how. We take questions on the Amazon Aurora architecture and capabilities, how they compare to Oracle technologies such as RAC and DataGuard, and how to migrate core Oracle features, capabilities, and schema objects to their equivalent counterparts in AWS. We also share tips on choosing between PostgreSQL and MySQL as the target platform for your database.
AWS RDS Data API and CloudTrail. Who drop the table_.pdfVladimir Samoylov
- Utilize AWS RDS Data API for secure database access and operations
- CloudTrail for auditing and activity monitoring
- Investigating incidents and preventing unauthorized access
- PostgreSQL Auditing (pgAudit) extension
An Intro to Building and Optimizing a Hybrid Cloud on AWSAmazon Web Services
An Intro to Building and Optimizing a Hybrid Cloud on AWS, hosted by AWS Solutions Architect, Samir Kadoo will help you discover the best hybrid cloud uses cases for your organization, and AWS services that enable hybrid cloud environments, including VMware Cloud on AWS and AWS Outposts. In addition, Samir demonstratea the migration of virtual machines from on-premises to VMware Cloud on AWS utilizing VMware vMotion.
by Rohan Dubal, Software Development Engineer, AWS
One of the biggest time sinks and challenges for mobile application developers is developing, accessing, and managing all of the disparate data sources that are involved in delivering delightful, collaborative, and real-time mobile experiences for users while also enabling offline capabilities for when a user is not connected, but still wants to use the app. In this session, you be introduced to the new AWS AppSync service that speed and simplifies these tasks for developers using GraphQL to provide a data abstraction layer and easy query and update statements without having to know the details of the underlying data sources.
AWS Lambda Powertools is a developer toolkit to implement Serverless best practices and increase developer velocity. It started as an open-source project in 2020 focused in making Tracing, Logging, and Metrics easier. Fast-forward, Powertools added 13 more features, grew a vibrant community who regularly contributes up to 60% of our releases, now covering a plethora of use cases: REST and GraphQL APIs, Batch processing, Idempotency, Feature Flags, Data Validation, and more.
You’ll learn why this developer toolkit was created, key use cases, and find out how you can adopt common industry and AWS best practices in seconds. We’ll also cover two of the most anticipated new features coming in 2023, and live demo(s).
Il cloud ibrido fa riferimento all'uso di risorse locali in aggiunta alle risorse pubbliche del cloud. Un cloud ibrido consente a un'organizzazione di migrare applicazioni e dati nel cloud, estendere la capacità del data center, utilizzare nuove funzionalità native del cloud, avvicinare le applicazioni ai clienti e creare una soluzione di backup e disaster recovery con una elevata disponibilità. In questa sessione verranno presentate le principali architetture ed i tool AWS per realizzarle.
Slides: Moving from a Relational Model to NoSQLDATAVERSITY
Businesses are quickly moving to NoSQL databases to power their modern applications. However, a technology migration involves risk, especially if you have to change your data model. What if you could host a relatively unmodified RDBMS schema on your NoSQL database, then optimize it over time?
We’ll show you how Couchbase makes it easy to:
• Use SQL for JSON to query your data and create joins
• Optimize indexes and perform HashMap queries
• Build applications and analysis with NoSQL
VMware Cloud on AWS provides a VMware software-defined data center delivered as a service on AWS infrastructure. It allows customers to run applications using VMware technologies like vSphere, vSAN and NSX in AWS without having to manage underlying hardware. Key features include dynamic capacity, software-defined data center capabilities, and integration with AWS services. The document discusses the architecture, account structure, connectivity options, use cases and resources for VMware Cloud on AWS.
ITCamp 2018 - Magnus Mårtensson - Azure Resource Manager For The WinITCamp
With the new model, Azure Resource Manger Microsoft are gaining the repeatability they always wanted to have for deployment to the Cloud and removing the dreary, repetitive, error prone manual deployment tasks which has always held us back! With ARM, you can create a Template for your environment and use that for deploying identical environments every time without fail! There is some news in the world of “infrastructure as code” that we need to consider while setting up our Cloud environments. The Win we get from being able to deploy our development environment or our temporary load test environment automatically and identically to our production environment cannot be understated. This is ARM from a project efficiency, development and DevOps perspective. This is what you need to know to make you much more efficient every day of development.
Migrating Databases to the Cloud: Introduction to AWS DMS - SRV215 - Chicago ...Amazon Web Services
In this introductory session, we cover how to convert and migrate your relational databases, non-relational databases, and data warehouses to the cloud. AWS Database Migration Service (AWS DMS) and AWS Schema Conversion Tool (AWS SCT) have been used to migrate tens of thousands of databases across the world. This includes homogeneous migrations, such as PostgreSQL to PostgreSQL, and heterogeneous migrations between different database engines, such as Oracle or SQL Server to Amazon Aurora, Amazon DynamoDB, and Amazon Redshift. Learn how to quickly and securely migrate your data and procedural code, enjoy flexibility and cost savings, and minimize the downtime of your applications.
J1 T1 4 - Azure Data Factory vs SSIS - Regis BaccaroMS Cloud Summit
This document compares Azure Data Factory (ADF) and SQL Server Integration Services (SSIS) for data integration tasks. It outlines the core concepts and architecture of ADF, including datasets, pipelines, activities, scheduling and execution. It then provides an overview of what SSIS is used for and its benefits. The document proceeds to compare ADF and SSIS in terms of development, administration, deployment, monitoring, supported sources and destinations, security, and pricing. It concludes that while both tools are not meant for the same purposes, organizations can benefit from using them together in a hybrid approach for different tasks.
Join me in this session where I'll share our journey of building a fully serverless application that flawlessly managed check-ins for an event with a staggering 80 thousand registrations.
We'll dive into three key strategies that made this possible. Firstly, by harnessing DynamoDB global tables, we ensured global service availability and data replication across regions, boosting performance and disaster recovery. Next, we'll explore how we seamlessly integrated real-time updates into the app using Appsync subscriptions, making the experience dynamic and engaging for users. Finally, I'll discuss how provisioned concurrency not only improved performance but also kept costs in check, highlighting the cost-effectiveness of serverless architectures.
Through these strategies and the inherent scalability of serverless technology, our application effortlessly handled massive user loads without manual intervention. This session is a real world example to the power and efficiency of modern cloud-based solutions in enabling seamless scalability and robust performance with Serverless
AWS re-Invent re-Cap general deck 2022-2023 .pdfRohini Gaonkar
Lot of new AWS services were announced in 2022 re:Invent, far too many to cover in one talk. Sharing consolidated list of most prominent new AWS service and feature launches announced at AWS re:Invent 2022 across various technologies - compute, storage, devops, serverless, machine learning, data, analytics, security, networking, developer experience and more!
Introduction to AWS OutIntroduction to AWS Outposts - CMP203 - Chicago AWS Su...Amazon Web Services
AWS Outposts allows customers to run compute and storage on-premises while connecting to AWS's full range of services in the cloud. It provides three main benefits:
1) It allows customers to build applications once and deploy them on-premises or in the cloud using the same AWS APIs, services, and tools.
2) It offers a fully managed service model so customers don't have to worry about procuring, operating, or maintaining their own infrastructure.
3) It provides the same security, performance, reliability, and operational experience of AWS regions while also addressing the needs of applications that require low latency access to on-premises systems or local data processing.
Similar to [D3T1S02] Aurora Limitless Database Introduction (20)
클라우드에서 Database를 백업하고 복구하는 방법에 대해 설명드립니다. AWS Backup을 사용하여 전체백업/복구 부터 PITR(Point in Time Recovery)백업, 그리고 멀티 어카운트, 멀티 리전등 다양한 데이터 보호 방법을 소개합니다(데모 포함). 또한 self-managed DB 의 데이터 저장소로 Amazon FSx for NetApp ONTAP 스토리지 서비스를 사용할 경우 얼마나 신속하게 데이터를 복구/복제 할수 있는지 살펴 봅니다.
기업은 이벤트나 신제품 출시 등으로 예기치 못한 트래픽 급증 시 데이터베이스 과부하, 서비스 지연 및 중단 등의 문제를 겪곤 합니다. Aurora 오토스케일링은 프로비저닝 시간으로 인해 실시간 대응이 어렵고, 트래픽 대응을 위한 과잉 프로비저닝이 발생합니다. 이러한 문제를 해결하기 위해 프로비저닝된 Amazon Aurora 클러스터와 Aurora Serverless v2(ASV2) 인스턴스를 결합하는 Amazon Aurora 혼합 구성 클러스터 아키텍처와 고해상도 지표를 기반으로 하는 커스텀 오토스케일링 솔루션을 소개합니다.
Amazon Aurora MySQL 호환 버전 2(MySQL 5.7 호환성 지원)는 2024년 10월 31일에 표준 지원이 종료될 예정입니다. 이로 인해 Aurora MySQL의 메이저 버전 업그레이드를 검토하고 계시다면, Amazon Blue/Green Deployments는 운영 환경에 영향을 주지 않고 메이저 버전 업그레이드를 할 수 있는 최적의 솔루션입니다. 본 세션에서는 Blue/Green Deployments를 통한 Aurora MySQL의 메이저 버전 업그레이드를 실습합니다.
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...Amazon Web Services Korea
Database Migration Service(DMS)는 RDBMS 이외에도 다양한 데이터베이스 이관을 지원합니다. 실제 고객사 사례를 통해 DMS가 데이터베이스 이관, 통합, 분리를 수행하는 데 어떻게 활용되는지 알아보고, 동시에 데이터 분석을 위한 데이터 수집(Data Ingest)에도 어떤 역할을 하는지 살펴보겠습니다.
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...Amazon Web Services Korea
Amazon ElastiCache는 Redis 및 MemCached와 호환되는 완전관리형 서비스로서 현대적 애플리케이션의 성능을 최적의 비용으로 실시간으로 개선해 줍니다. ElastiCache의 Best Practice를 통해 최적의 성능과 서비스 최적화 방법에 대해 알아봅니다.
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...Amazon Web Services Korea
ccAmazon Aurora 데이터베이스는 클라우드용으로 구축된 관계형 데이터베이스입니다. Aurora는 상용 데이터베이스의 성능과 가용성, 그리고 오픈소스 데이터베이스의 단순성과 비용 효율성을 모두 제공합니다. 이 세션은 Aurora의 고급 사용자들을 위한 세션으로써 Aurora의 내부 구조와 성능 최적화에 대해 알아봅니다.
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...Amazon Web Services Korea
오랫동안 관계형 데이터베이스가 가장 많이 사용되었으며 거의 모든 애플리케이션에서 널리 사용되었습니다. 따라서 애플리케이션 아키텍처에서 데이터베이스를 선택하기가 더 쉬웠지만, 구축할 수 있는 애플리케이션의 유형이 제한적이었습니다. 관계형 데이터베이스는 스위스 군용 칼과 같아서 많은 일을 할 수 있지만 특정 업무에는 완벽하게 적합하지는 않습니다. 클라우드 컴퓨팅의 등장으로 경제적인 방식으로 더욱 탄력적이고 확장 가능한 애플리케이션을 구축할 수 있게 되면서 기술적으로 가능한 일이 달라졌습니다. 이러한 변화는 전용 데이터베이스의 부상으로 이어졌습니다. 개발자는 더 이상 기본 관계형 데이터베이스를 사용할 필요가 없습니다. 개발자는 애플리케이션의 요구 사항을 신중하게 고려하고 이러한 요구 사항에 맞는 데이터베이스를 선택할 수 있습니다.
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...Amazon Web Services Korea
실시간 분석은 AWS 고객의 사용 사례가 점점 늘어나고 있습니다. 이 세션에 참여하여 스트리밍 데이터 기술이 어떻게 데이터를 즉시 분석하고, 시스템 간에 데이터를 실시간으로 이동하고, 실행 가능한 통찰력을 더 빠르게 얻을 수 있는지 알아보십시오. 일반적인 스트리밍 데이터 사용 사례, 비즈니스에서 실시간 분석을 쉽게 활성화하는 단계, AWS가 Amazon Kinesis와 같은 AWS 스트리밍 데이터 서비스를 사용하도록 지원하는 방법을 다룹니다.
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...Amazon Web Services Korea
Amazon EMR은 Apache Spark, Hive, Presto, Trino, HBase 및 Flink와 같은 오픈 소스 프레임워크를 사용하여 분석 애플리케이션을 쉽게 실행할 수 있는 관리형 서비스를 제공합니다. Spark 및 Presto용 Amazon EMR 런타임에는 오픈 소스 Apache Spark 및 Presto에 비해 두 배 이상의 성능 향상을 제공하는 최적화 기능이 포함되어 있습니다. Amazon EMR Serverless는 Amazon EMR의 새로운 배포 옵션이지만 데이터 엔지니어와 분석가는 클라우드에서 페타바이트 규모의 데이터 분석을 쉽고 비용 효율적으로 실행할 수 있습니다. 이 세션에 참여하여 개념, 설계 패턴, 라이브 데모를 사용하여 Amazon EMR/EMR 서버리스를 살펴보고 Spark 및 Hive 워크로드, Amazon EMR 스튜디오 및 Amazon SageMaker Studio와의 Amazon EMR 통합을 실행하는 것이 얼마나 쉬운지 알아보십시오.
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...Amazon Web Services Korea
로그 및 지표 데이터를 쉽게 가져오고, OpenSearch 검색 API를 사용하고, OpenSearch 대시보드를 사용하여 시각화를 구축하는 등 Amazon OpenSearch의 새로운 기능과 기능에 대해 자세히 알아보십시오. 애플리케이션 문제를 디버깅할 수 있는 OpenSearch의 Observability 기능에 대해 알아보세요. Amazon OpenSearch Service를 통해 인프라 관리에 대해 걱정하지 않고 검색 또는 모니터링 문제에 집중할 수 있는 방법을 알아보십시오.
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...Amazon Web Services Korea
데이터 거버넌스는 전체 프로세스에서 데이터를 관리하여 데이터의 정확성과 완전성을 보장하고 필요한 사람들이 데이터에 액세스할 수 있도록 하는 프로세스입니다. 이 세션에 참여하여 AWS가 어떻게 분석 서비스 전반에서 데이터 준비 및 통합부터 데이터 액세스, 데이터 품질 및 메타데이터 관리에 이르기까지 포괄적인 데이터 거버넌스를 제공하는지 알아보십시오. AWS에서의 스트리밍에 대해 자세히 알아보십시오.
Amazon Redshift Deep Dive - Serverless, Streaming, ML, Auto Copy (New feature...Amazon Web Services Korea
이 세션에 참여하여 Amazon Redshift의 새로운 기능을 자세히 살펴보십시오. Amazon Data Sharing, Amazon Redshift Serverless, Redshift Streaming, Redshift ML 및 자동 복사 등에 대한 자세한 내용과 데모를 통해 Amazon Redshift의 새로운 기능을 알고 싶은 사용자에게 적합합니다.
From Insights to Action, How to build and maintain a Data Driven Organization...Amazon Web Services Korea
데이터는 혁신과 변혁의 토대입니다. 비즈니스 혁신을 이끄는 혁신은 특정 시점의 전략이나 솔루션이 아니라 성장을 위한 반복적이고 집단적인 계획입니다. 혁신에 이러한 접근 방식을 채택하는 기업은 전략과 비즈니스 문화에서 데이터를 기반으로 하는 경우가 많습니다. 이러한 접근 방식을 개발하려면 리더가 데이터를 조직의 자산처럼 취급하고 조직이 더 나은 비즈니스 성과를 위해 데이터를 활용할 수 있도록 권한을 부여해야 합니다. AWS와 Amazon이 어떻게 데이터와 분석을 활용하여 확장 가능한 비즈니스 효율성을 창출하고 고객의 가장 복잡한 문제를 해결하는 메커니즘을 개발했는지 알아보십시오.
LG전자 - Amazon Aurora 및 RDS 블루/그린 배포를 이용한 데이터베이스 업그레이드 안정성 확보 - 발표자: 이은경 책임, L...Amazon Web Services Korea
LG ThinQ는 LG전자의 가전제품과 서비스를 아우르는 플랫폼 브랜드로서 앱 하나로 간편한 컨트롤, 똑똑한 케어, 스마트한 쇼핑까지 한번에 가능한 플랫폼입니다. ThinQ 플랫폼은 글로벌 서비스로 제공되고 있어, 작업 시간을 최소화하고, 서비스의 영향을 최소화 할 필요가 있었습니다. 따라서 DB 버전 업그레이드 작업 시 애플리케이션 배포가 필요없는 Blue/Green Deployment 방식은 최선의 선택이 되었습니다.
Cómo hemos implementado semántica de "Exactly Once" en nuestra base de datos ...javier ramirez
Los sistemas distribuidos son difíciles. Los sistemas distribuidos de alto rendimiento, más. Latencias de red, mensajes sin confirmación de recibo, reinicios de servidores, fallos de hardware, bugs en el software, releases problemáticas, timeouts... hay un montón de motivos por los que es muy difícil saber si un mensaje que has enviado se ha recibido y procesado correctamente en destino. Así que para asegurar mandas el mensaje otra vez.. y otra... y cruzas los dedos para que el sistema del otro lado tenga tolerancia a los duplicados.
QuestDB es una base de datos open source diseñada para alto rendimiento. Nos queríamos asegurar de poder ofrecer garantías de "exactly once", deduplicando mensajes en tiempo de ingestión. En esta charla, te cuento cómo diseñamos e implementamos la palabra clave DEDUP en QuestDB, permitiendo deduplicar y además permitiendo Upserts en datos en tiempo real, añadiendo solo un 8% de tiempo de proceso, incluso en flujos con millones de inserciones por segundo.
Además, explicaré nuestra arquitectura de log de escrituras (WAL) paralelo y multithread. Por supuesto, todo esto te lo cuento con demos, para que veas cómo funciona en la práctica.
How We Added Replication to QuestDB - JonTheBeachjavier ramirez
Building a database that can beat industry benchmarks is hard work, and we had to use every trick in the book to keep as close to the hardware as possible. In doing so, we initially decided QuestDB would scale only vertically, on a single instance.
A few years later, data replication —for horizontally scaling reads and for high availability— became one of the most demanded features, especially for enterprise and cloud environments. So, we rolled up our sleeves and made it happen.
Today, QuestDB supports an unbounded number of geographically distributed read-replicas without slowing down reads on the primary node, which can ingest data at over 4 million rows per second.
In this talk, I will tell you about the technical decisions we made, and their trade offs. You'll learn how we had to revamp the whole ingestion layer, and how we actually made the primary faster than before when we added multi-threaded Write Ahead Logs to deal with data replication. I'll also discuss how we are leveraging object storage as a central part of the process. And of course, I'll show you a live demo of high-performance multi-region replication in action.
Airline Satisfaction Project using Azure
This presentation is created as a foundation of understanding and comparing data science/machine learning solutions made in Python notebooks locally and on Azure cloud, as a part of Course DP-100 - Designing and Implementing a Data Science Solution on Azure.