This document provides guidance and best practices for using Infrastructure as a Service (IaaS) on Microsoft Azure for database workloads. It discusses key differences between IaaS, Platform as a Service (PaaS), and Software as a Service (SaaS). The document also covers Azure-specific concepts like virtual machine series, availability zones, storage accounts, and redundancy options to help architects design cloud infrastructures that meet business requirements. Specialized configurations like constrained VMs and ultra disks are also presented along with strategies for ensuring high performance and availability of database workloads on Azure IaaS.
This document provides an overview of Azure Virtual Machines, including how to provision VMs, available VM sizes and pricing, data persistence options, high availability features, networking capabilities, and load balancing options. Key points include being able to launch Windows and Linux VMs in minutes and scale from 1 to 1000s of instances with per-minute billing. VM extensions enable customization, and VMs can be made highly available through features like availability sets and fault domains. Virtual networks allow creating protected private networks in Azure that can connect to on-premises environments.
- Data protection is critical for all businesses regardless of size due to the potential costs of downtime or data loss.
- Disaster recovery as a service (DRaaS) provides new opportunities for affordable data protection via the public cloud.
- Unplanned downtime can result in significant financial losses, with the average revenue loss per hour of downtime ranging from $60,000 to over $10 million depending on the industry.
- Azure Site Recovery enables disaster recovery of VMs and physical servers to Microsoft Azure, providing DRaaS capabilities for SMBs, enterprises and service providers.
An overview of running Oracle Database, Fusion Middleware and Oracle Applications on AWS. Covers licensing, pricing, support, security, networking, Amazon VPC, Amazon EC2, Amazon EBS, use cases, and customer successes.
The document discusses Microsoft Azure Infrastructure as a Service (IaaS) capabilities. It covers various Azure Virtual Machine sizes and their specifications. It also discusses high availability options, image types, resource groups vs affinity groups, networking configurations, cost considerations, and templates for deploying IaaS resources. Links are provided for documentation, quick start templates, and support communities.
Data is as critical as ever. Storage costs are lower but we have more and more data to store. This is where Microsoft Azure Data Storage solutions come in. This slide deck provides an overview of the most important data storage options available in Azure.
Note: I did not create this deck. I instead combined slides from the Microsoft Azure-Readiness/DevCamp repo on GitHub (https://github.com/Azure-Readiness/DevCamp) while adding additional material from a slide deck of David Chappell's.
This talk was given at Cloud Camp Kitchener 2015.
This document discusses Microsoft Azure's infrastructure as a service capabilities including provisioning virtual machines and environments, disk types, virtual networking, connectivity options like SQL Azure Data Sync and Service Bus, and hybrid public/private cloud capabilities. It also mentions Azure's DNS services and VPN connectivity options like IKE and encryption standards.
In this presentation, I have talked about Resiliency in Azure.
I have also talked about how you can do Azure VM Improvements and Maintenance. Along with that, I have also talked about Disaster Recovery with ASR.
AWS Storage Tiering for Enterprise WorkloadsTom Laszewski
This document provides an overview of best practices for using different Amazon Web Services storage tiers for enterprise workloads. It discusses the various AWS storage options including ephemeral storage, EBS, S3, and Glacier. It covers best practices for using each storage tier, including using EBS-optimized instances, provisioned IOPS, striping EBS volumes for performance, and using S3 and Glacier for archival storage. It also provides a sample storage configuration for running Oracle Database on AWS using EBS PIOPS volumes, ASM, and backups to S3. Finally, it presents a case study of how RISO uses AWS storage solutions.
Architecting Enterprise Applications in the Cloud presentation by Matt Tavis, AWS Solutions Architect, and the Cloud for the Enterprise Event in NY on October 19, 2009
The document discusses Microsoft Azure storage solutions and services, highlighting key capabilities like Azure Files for file shares, Premium Storage for high performance workloads, and integration with hybrid solutions like StorSimple. It also provides an overview of Azure Storage APIs and compares Azure storage features to competitive offerings from AWS. The document is aimed at helping customers understand how Azure storage can meet their needs for scalability, reliability, security and hybrid cloud capabilities.
The document discusses the benefits of exercise for mental health. Regular physical activity can help reduce anxiety and depression and improve mood and cognitive function. Exercise causes chemical changes in the brain that may help protect against mental illness and improve symptoms.
One of the frustrating point for IT department is planning and implementing Disaster Recovery solutions. Are you sure your DR will function properly during a disaster time? Can I test my DR solution without taking downtime of my production systems for days? These are some of the daunting questions you must have faced.
During this session we’ll share with you how Microsoft simplify the Disaster Recovery solution with Azure. Be it your physical servers, Hyper-V or VMWare workloads; Azure Site Recovery handles all these in single portal with ease management.
Microsoft Azure Hybrid Cloud - Getting Started For TechiesAidan Finn
This is my "getting started for techies" presentation on using the Microsoft Azure public cloud to build hybrid cloud solutions in conjunction with Windows Server 2012 R2 Hyper-V and System Center.
The document discusses various capabilities and features of Azure SQL Database including predictable performance with basic, standard, and premium tiers; database transaction units (DTUs); JSON support with built-in functions and OPENJSON; temporal tables; row-level security; dynamic data masking; geo-replication; scalability patterns including scaling up/down between service tiers, elastic database pools, and sharding; and query performance insight.
Azure Boot Camp 21.04.2018 SQL Server in Azure Iaas PaaS on-prem Lars PlatzdaschLars Platzdasch
This document provides an overview and comparison of SQL Server hosting options in Azure, including Azure SQL Database (PaaS) and SQL Server in Azure VMs (IaaS). It discusses the key differences between the two options, highlighting that Azure SQL Database is fully managed while SQL Server in VMs gives more control. It also covers topics like manageability, performance metrics, pricing tiers, security best practices, and demos of the Azure portal. The document aims to help audiences choose between the "red pill" of Azure SQL Database or the "blue pill" of SQL Server in Azure VMs.
Introduction to running Oracle on AWS. Focuses on Oracle partnership, time line of partnership, licensing, pricing, use cases, common architectures, customer successes, and what is new.
In this session, we will discuss strategies, tools, and techniques for migrating and running off-the-shelf Oracle packages on AWS. We'll consider applications like Oracle eBusiness Suite, PeopleSoft, JD Edwards, Endeca, and Siebel. These applications are complex by themselves, they are frequently customized, they have many touch points on other systems in the enterprise, and they often have large associated databases. Therefore, they may not seem good candidates for the cloud at first look. Nevertheless, running enterprise applications in the cloud affords powerful benefits, and we'll identify the factors and best practices that most influence success.
Azure templates can be used to deploy and manage Azure resources in a declarative and repeatable way. They define the resources to deploy, including virtual machines, databases, and networking components, as well as the relationships between resources. Azure templates allow for idempotent deployments, simplified orchestration of rollbacks and upgrades, and cross-resource configuration and updates. They are stored as JSON or ARM template files in source control and can be deployed via the Azure CLI, PowerShell, or REST APIs. A wide range of community-created quickstart templates are available on GitHub for common workload deployments.
This document discusses best practices for migrating database workloads to Azure Infrastructure as a Service (IaaS). Some key points include:
- Choosing the appropriate VM series like E or M series optimized for database workloads.
- Using availability zones and geo-redundant storage for high availability and disaster recovery.
- Sizing storage correctly based on the database's input/output needs and using premium SSDs where needed.
- Migrating existing monitoring and management tools to the cloud to provide familiarity and automating tasks like backups, patching, and problem resolution.
Clash of Technologies Google Cloud vs Microsoft AzureMihail Mateev
This document compares Google Cloud and Microsoft Azure on various features. It discusses their pricing models, infrastructure as a service and platform as a service capabilities. Some key findings are that Azure has better coverage in Asia while Google Cloud has better coverage in the US. AWS leads the cloud market currently. The document also analyzes storage performance, virtual machine pricing and types, database offerings, microservices support, load balancing options and example use cases for each provider.
The document provides information about database administration including:
1. It discusses different database management system (DBMS) architectures like enterprise, departmental, personal, mobile, and cloud.
2. It describes factors to consider when choosing a DBMS like operating system support, organization type, benchmarks, scalability, tools availability, technicians availability, and cost of ownership.
3. It outlines the Oracle database installation process including hardware and software requirements, available installation options, and tools for database administration.
The document provides information about database administration including:
1. It discusses different database management system (DBMS) architectures like enterprise, departmental, personal, mobile, and cloud.
2. It describes factors to consider when choosing a DBMS like operating system support, organization type, benchmarks, scalability, tools availability, technicians availability, and cost of ownership.
3. It outlines the Oracle database installation process including hardware and software requirements, available installation options, and tools for database administration.
Amazon RDS is a fully managed relational database service that enables you to launch an optimally configured, secure, and highly available database with just a few clicks. It manages time-consuming database administration tasks, freeing you to focus on your applications and business. In this session, we review the capabilities of the service and the latest available features.
Azure SQL Database is a relational database-as-a-service hosted in the Azure cloud that reduces costs by eliminating the need to manage virtual machines, operating systems, or database software. It provides automatic backups, high availability through geo-replication, and the ability to scale performance by changing service tiers. Azure Cosmos DB is a globally distributed, multi-model database that supports automatic indexing, multiple data models via different APIs, and configurable consistency levels with strong performance guarantees. Azure Redis Cache uses the open-source Redis data structure store with managed caching instances in Azure for improved application performance.
Amazon RDS is a fully managed relational database service that enables you to launch an optimally configured, secure, and highly available database with just a few clicks. In this session, we review the service’s capabilities and its latest features. We also show you how Amazon RDS manages time-consuming database administration tasks, freeing you to focus on your applications and business.
SAP HANA System Replication (HSR) versus SAP Replication Server (SRS)Gary Jackson MBCS
This document provides information about SAP HANA System Replication (HSR) and compares it to SAP Replication Server (SRS). HSR replicates transaction log entries from a primary HANA database to secondary databases. It supports synchronous and asynchronous replication and can be used for high availability and disaster recovery. The document outlines the initial setup process and ongoing administration of HSR configurations.
Maaz Anjum - IOUG Collaborate 2013 - An Insight into Space Realization on ODA...Maaz Anjum
The document provides an overview of Maaz Anjum, a solutions architect specializing in Oracle products like OEM12c, Golden Gate, and Engineered Systems. It lists his email, blog, and experience using Oracle products since 2001. It also provides details about Bias Corporation, the company he works for, including its founding date, certifications, expertise, customers, and implementations.
This presentation is for those of you who are interested in moving your on-prem SQL Server databases and servers to Azure virtual machines (VM’s) in the cloud so you can take advantage of all the benefits of being in the cloud. This is commonly referred to as a “lift and shift” as part of an Infrastructure-as-a-service (IaaS) solution. I will discuss the various Azure VM sizes and options, migration strategies, storage options, high availability (HA) and disaster recovery (DR) solutions, and best practices.
- Big Green IT is a Microsoft Gold Partner that provides Azure Backup and Azure Site Recovery services.
- Azure Backup allows backing up of physical servers, virtual machines, files/folders to Azure using the Azure Backup agent, Azure Backup server, or native Azure VM backup.
- Azure Site Recovery allows replication and disaster recovery of on-premises and Azure VMs to Azure.
Migrating Your Databases to AWS Deep Dive on Amazon RDS and AWSKristana Kane
This document provides an overview of migrating databases to AWS using Amazon RDS and AWS Database Migration Service (DMS). It discusses how AWS RDS offers scalable, managed relational databases, the different database engines supported by RDS, and key features like security, monitoring, high availability and scaling. It then covers how AWS DMS can be used to migrate databases to AWS with no downtime by continuously replicating and migrating data. Finally, it shares examples of how customers have used RDS and DMS for heterogeneous, homogeneous, large-scale and split migrations.
Sql Start! 2020 - SQL Server Lift & Shift su AzureMarco Obinu
Slide of the session delivered during SQL Start! 2020, where I illustrate different approaches to determine the best landing zone for you SQL Server workloads.
Video (ITA): https://youtu.be/1hqT_xHs0Qs
This document discusses SQL Azure and Windows Azure Storage. SQL Azure allows storing databases in the cloud with high availability and load balancing. Windows Azure Storage provides durable cloud storage for blobs, disks, tables and queues. It replicates data across multiple datacenters for high availability and scales massively to store large amounts of unstructured and structured data.
Design, Deploy, and Optimize SQL Server on AWS - AWS Online Tech TalksAmazon Web Services
Enterprises are quickly moving database workloads like SQL Server to the cloud, but with so many options, the best approach isn’t always obvious. You exercise full control of your SQL Server workloads by running them on Amazon EC2 instances, or leverage Amazon RDS for a fully managed database experience. This session will go deep on best practices and considerations for running SQL Server on AWS. We will cover best practices for deploying SQL Server, how to choose between Amazon EC2 and Amazon RDS, ways to optimize the performance of your SQL Server deployment for different applications types. We review in detail how to provision and monitor your SQL Server databases, and how to manage scalability, performance, availability, security, and backup and recovery, in both Amazon RDS and Amazon EC2.
Design, Deploy, and Optimize SQL Server on AWS - June 2017 AWS Online Tech TalksAmazon Web Services
Learning Objectives:
- Learn how to build applications on AWS from a strong foundation on SQL Server
- Learn when to deploy SQL Server on Amazon EC2 versus Amazon RDS
- Learn how to take advantage of the latest features in SQL Server 2016 when running on AWS
Enterprises are quickly moving database workloads like SQL Server to the cloud, but with so many options, the best approach isn’t always obvious. You exercise full control of your SQL Server workloads by running them on Amazon EC2 instances, or leverage Amazon RDS for a fully managed database experience. This session will go deep on best practices and considerations for running SQL Server on AWS. We will cover best practices for deploying SQL Server, how to choose between Amazon EC2 and Amazon RDS, ways to optimize the performance of your SQL Server deployment for different applications types. We review in detail how to provision and monitor your SQL Server databases, and how to manage scalability, performance, availability, security, and backup and recovery, in both Amazon RDS and Amazon EC2.
This presentation is based on a real life experience migrating Oracle E-Business Suite production to AWS.
We will talk about:
- Certification basics. Overview on supported configurations.
- How to build. Recommendations based on migration and 2 year production runtime experience.
- Advanced configurations.
- R12.2.
- Microsoft Azure and Oracle Cloud review. Quick comparison outline of main alternative platforms. How ready is Oracle's own cloud service.
- Scaling.
This is a very client demanding topic. Many are looking into cloud migration options and how they can optimize the cost compared to the on-premise hosting, and many misunderstand the complexity of Oracle EBS stack being capable for cloud deployment.
This are my keynote slides from SQL Saturday Oregon 2023 on AI and the Intersection of AI, Machine Learning and Economnic Challenges as a Technical Specialist
This document discusses migrating high IO SQL Server workloads to Azure. It begins by explaining that every company has at least one "whale" workload that requires high CPU, memory and IO. These whales can be challenging to move to the cloud. The document then provides tips on determining if a workload's issue is truly high IO or caused by another factor. It discusses various wait events that may indicate IO problems and tools for monitoring IO performance. Finally, it covers some considerations for IO in the cloud.
This document provides an overview of options for running Oracle solutions on Microsoft Azure infrastructure as a service (IaaS). It discusses architectural considerations for high availability, disaster recovery, storage, licensing, and migrating workloads from Oracle Exadata. Key points covered include using Oracle Data Guard for replication and failover, storage options like Azure NetApp Files that can support Exadata workloads, and identifying databases that are not dependent on Exadata features for lift and shift to Azure IaaS. The document aims to help customers understand how to optimize their use of Oracle solutions when deploying to Azure.
This document discusses strategies for managing ADHD as an adult. It begins by describing the three main types of ADHD - inattentive, hyperactive-impulsive, and combined. It then lists some of the biggest challenges of ADHD like executive dysfunction, disorganization, lack of attention, procrastination, and internal preoccupation. The document provides tips and strategies for overcoming each challenge through organization, scheduling, list-making, breaking large tasks into small ones, and using technology tools. It emphasizes finding accommodations that work for the individual and their specific ADHD presentation and challenges.
Kellyn Gorman shares her experience living with ADHD and strategies for turning it into a positive. She discusses how ADHD impacted her childhood and how it still presents challenges as an adult. However, with the right tools and understanding of her needs, she is able to find success. She provides tips for organizing, prioritizing tasks, managing distractions, and accessing support. The key is learning about ADHD and how to structure one's environment and routine to play to one's strengths rather than fighting against the condition.
Migrating Oracle workloads to Azure requires understanding the workload and hardware requirements. It is important to analyze the workload using the Automatic Workload Repository (AWR) report to accurately size infrastructure needs. The right virtual machine series and storage options must be selected to meet the identified input/output and capacity needs. Rather than moving existing hardware, the focus should be migrating the Oracle workload to take advantage of cloud capabilities while ensuring performance and high availability.
This document discusses overcoming silos when implementing DevOps for a new product at a company. The teams involved were dispersed globally and siloed in their tools and processes. Challenges included isolating workload sizes, choosing a Linux image, and team ownership issues. The solution involved aligning teams, automating deployment with Bash scripts called by Terraform and Azure DevOps, and evolving the automation. This improved communication, decreased teams from 120 people to 7, and increased deployments and profits for the successful project.
This document provides an overview of how to successfully migrate Oracle workloads to Microsoft Azure. It begins with an introduction of the presenter and their experience. It then discusses why customers might want to migrate to the cloud and the different Azure database options available. The bulk of the document outlines the key steps in planning and executing an Oracle workload migration to Azure, including sizing, deployment, monitoring, backup strategies, and ensuring high availability. It emphasizes adapting architectures for the cloud rather than directly porting on-premises systems. The document concludes with recommendations around automation, education resources, and references for Oracle-Azure configurations.
This document discusses the future of data and the Azure data ecosystem. It highlights that by 2025 there will be 175 zettabytes of data in the world and the average person will have over 5,000 digital interactions per day. It promotes Azure services like Power BI, Azure Synapse Analytics, Azure Data Factory and Azure Machine Learning for extracting value from data through analytics, visualization and machine learning. The document provides overviews of key Azure data and analytics services and how they fit together in an end-to-end data platform for business intelligence, artificial intelligence and continuous intelligence applications.
This is the second session of the learning pathway at PASS Summit 2019, which is still a stand alone session to teach you how to write proper Linux BASH scripts
This document discusses techniques for optimizing Power BI performance. It recommends tracing queries using DAX Studio to identify slow queries and refresh times. Tracing tools like SQL Profiler and log files can provide insights into issues occurring in the data sources, Power BI layer, and across the network. Focusing on optimization by addressing wait times through a scientific process can help resolve long-term performance problems.
The document provides tips and tricks for scripting success on Linux. It begins with introducing the speaker and emphasizing that the session will focus on best practices for those already familiar with BASH scripting. It then details various tips across multiple areas: setting the shell and environment variables, adding headers and comments to scripts, validating input, implementing error handling and debugging, leveraging utilities like CRON for scheduling, and ensuring scripts continue running across sessions. The tips are meant to help authors write more readable, maintainable, and reliable scripts.
This document discusses connecting Oracle Analytics Cloud (OAC) Essbase data to Microsoft Power BI. It provides an overview of Power BI and OAC, describes various methods for connecting the two including using a REST API and exporting data to Excel or CSV files, and demonstrates some visualization capabilities in Power BI including trends over time. Key lessons learned are that data can be accessed across tools through various connections, analytics concepts are often similar between tools, and while partnerships exist between Microsoft and Oracle, integration between specific products like Power BI and OAC is still limited.
Mentors provide guidance and support, while sponsors use their influence to advocate for and promote a protege's career. Obtaining both mentors and sponsors is important for advancing in one's field and overcoming biases, yet women often have fewer sponsors than men. The document outlines strategies for how women can find and work with sponsors, and how men can act as allies in supporting women. Developing representation of women in technology fields through mentorship and sponsorship can help initiatives become self-sustaining over time.
Kellyn Pot'Vin-Gorman presented on GDPR compliance. Some key points include:
- GDPR went into effect in May 2018 and covers any data belonging to an EU citizen.
- Fines for non-compliance can be up to 4% of annual revenue or €20 million.
- DBAs play a role in identifying critical data, auditing processes, and reporting on compliance.
- An AI tool assessed the privacy policies of 14 major companies and found they all failed to meet GDPR requirements.
- Achieving compliance requires security frameworks, data mapping, encryption, access controls, and dedicated teams.
This document provides tips for optimizing performance in Power BI by focusing on different areas like data sources, the data model, visuals, dashboards, and using trace and log files. Some key recommendations include filtering data early, keeping the data model and queries simple, limiting visual complexity, monitoring resource usage, and leveraging log files to identify specific waits and bottlenecks. An overall approach of focusing on time-based optimization by identifying and addressing the areas contributing most to latency is advocated.
Kellyn Pot’Vin-Gorman discusses DevOps tools for winning agility. She emphasizes that while many organizations automate testing, the DevOps journey is longer and involves additional steps like orchestration between environments, security, collaboration, and establishing a culture of continuous improvement. She also stresses that organizations should not forget about managing their data as part of the DevOps process and advocates for approaches like database virtualization to help enhance DevOps initiatives.
Best Practices for Effectively Running dbt in Airflow.pdfTatiana Al-Chueyr
As a popular open-source library for analytics engineering, dbt is often used in combination with Airflow. Orchestrating and executing dbt models as DAGs ensures an additional layer of control over tasks, observability, and provides a reliable, scalable environment to run dbt models.
This webinar will cover a step-by-step guide to Cosmos, an open source package from Astronomer that helps you easily run your dbt Core projects as Airflow DAGs and Task Groups, all with just a few lines of code. We’ll walk through:
- Standard ways of running dbt (and when to utilize other methods)
- How Cosmos can be used to run and visualize your dbt projects in Airflow
- Common challenges and how to address them, including performance, dependency conflicts, and more
- How running dbt projects in Airflow helps with cost optimization
Webinar given on 9 July 2024
Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data.
The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs.
Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution!
Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
Blockchain technology is transforming industries and reshaping the way we conduct business, manage data, and secure transactions. Whether you're new to blockchain or looking to deepen your knowledge, our guidebook, "Blockchain for Dummies", is your ultimate resource.
Details of description part II: Describing images in practice - Tech Forum 2024BookNet Canada
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and transcript: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxSynapseIndia
Your comprehensive guide to RPA in healthcare for 2024. Explore the benefits, use cases, and emerging trends of robotic process automation. Understand the challenges and prepare for the future of healthcare automation
How Social Media Hackers Help You to See Your Wife's Message.pdfHackersList
In the modern digital era, social media platforms have become integral to our daily lives. These platforms, including Facebook, Instagram, WhatsApp, and Snapchat, offer countless ways to connect, share, and communicate.
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionBert Blevins
Cybersecurity is a major concern in today's connected digital world. Threats to organizations are constantly evolving and have the potential to compromise sensitive information, disrupt operations, and lead to significant financial losses. Traditional cybersecurity techniques often fall short against modern attackers. Therefore, advanced techniques for cyber security analysis and anomaly detection are essential for protecting digital assets. This blog explores these cutting-edge methods, providing a comprehensive overview of their application and importance.
Sustainability requires ingenuity and stewardship. Did you know Pigging Solutions pigging systems help you achieve your sustainable manufacturing goals AND provide rapid return on investment.
How? Our systems recover over 99% of product in transfer piping. Recovering trapped product from transfer lines that would otherwise become flush-waste, means you can increase batch yields and eliminate flush waste. From raw materials to finished product, if you can pump it, we can pig it.
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfjackson110191
These fighter aircraft have uses outside of traditional combat situations. They are essential in defending India's territorial integrity, averting dangers, and delivering aid to those in need during natural calamities. Additionally, the IAF improves its interoperability and fortifies international military alliances by working together and conducting joint exercises with other air forces.
2. About me
Sr. Cloud Solution Architect
@DBAKevlar
https://dbakevlar.com
kegorman@microsoft.com
dbakevlar@gmail.com
SME for Oracle on Azure at Microsoft
3. “The best DBAs always
have control issues”
~Kellyn Gorman
Still a DBA
4. Why IaaS instead of
PaaS/SaaS?
BUSINESS SLAS OR
POLICIES
VENDOR SPECIFIC
REQUIREMENTS
PLATFORM DEMANDS,
(NO PAAS OFFERING
FOR ORACLE ON AZURE)
6. Benefits of IaaS
QUICKER MIGRATION TIMES THAN OTHER CLOUD
OFFERINGS
ABILITY TO KEEP SIMILAR ARCHITECTURE
INTRODUCE CLOUD SERVICES AND FEATURES
REMOVE THE DATACENTER
7. Insanity Is Doing the Same Thing
Over and Over Again and
Expecting Different Results
~Einstein
*Also Infrastructure folks who continually try to lift and
shift the infrastructure for database workloads…
8. Migrate the Workload, not the
Hardware
• Servers may not have been sized appropriately for the
workload.
• Workload of database may have changed over time.
• May cost you more in licensing than what the
workload actually requires.
• For different databases, there are different tools to
assist:
• SQL Server: DMVs, PerfMon, Scripting, (Randal,
Klee, etc) Redgate SQL Monitor
• Oracle: AWR, OEM, ASH, SASH, Statspack, Tracing
• MySQL: Solarwinds DPA, Instrumental, Panopta
9. Architect for the Cloud
Deploy all tiers to the cloud
Avoid ingress or egress charges
Reduce latency
Remove complexity and centrally locate to
the cloud
Refactor processes that utilize
large percentages of resources
and network. In the cloud, this
has an impactful cost.
A lift and shift does not equal
taking what you have on-prem
and duplicating it. Success
means you take the database
and lift and shift it with the
support of cloud services.
11. https://azure.microsoft.com/en-
us/pricing/details/virtual-machines/series/
Understand
IaaS VM
Series
• A and B-series commonly won’t work for
databases.
• D-series can work for some, but consider matching
series to production vms, but lesser resources
• L and H-series are outliers for database workloads.
• Identify workload needs
• D-series is for general use
• E-series and M-series are the most common VMs in the
database industry
• E-series for average production databases
• M-series, but verify IO storage/network limits!
13. https://docs.microsoft.com/en-us/azure/virtual-
machines/windows/constrained-vcpu
When one VM
is too Much-
Constrained
VMs
• Allows for isolation of vCPU to application
licensing for database and app workloads
• Matched in existing series VMs in the Azure
Pricing Calculator
• Share storage between databases or apps
• Before choosing, ensure your product licensing
support constrained vCPU VMs
• Carefully match workloads on IO and memory,
not just vCPU usage when combining.
14. Specialized
Constrained
vCPU VMs
Name vCPU Specs
Standard_M8-2ms 2 Same as M8ms
Standard_M8-4ms 4 Same as M8ms
Standard_M16-4ms 4 Same as M16ms
Standard_M16-8ms 8 Same as M16ms
Standard_M32-8ms 8 Same as M32ms
Standard_M32-16ms 16 Same as M32ms
Standard_M64-32ms 32 Same as M64ms
Standard_M64-16ms 16 Same as M64ms
Standard_M128-64ms 64 Same as M128ms
Standard_M128-32ms 32 Same as M128ms
Standard_E4-2s_v3 2 Same as E4s_v3
Standard_E8-4s_v3 4 Same as E8s_v3
Standard_E8-2s_v3 2 Same as E8s_v3
Standard_E16-8s_v3 8 Same as E16s_v3
https://docs.microsoft.com/en-us/azure/virtual-machines/windows/constrained-vcpu
16. https://www.oracle.com/database/technologies/high-availability/maa.html
Architect for
the Cloud
• Maximum Availability Architecture
• Different names for different vendors.
• Get a clear understanding of the SLA uptime for the business
and environment.
• Onprem datacenters are not the same as cloud architecture.
• Pivot products and services to cover what you need.
• High Availability
• Identify what HA means to stakeholders.
• Often, it’s specific features, not a product, then marry these to
a cloud product which:
• Matches the IaaS architecture
• Doesn’t introduce overhead
• Has vendor support
• Identify what cloud services may duplicate or simulate
the same feature if unavailable.
17. Azure Location Concepts
Concept Description
Region Multiple datacenters within a specific perimeter and connected
through a low-latency network
Geography A specific location area. The area may have more than one Azure
region
Availability Zone Physical regions located within a region. Each zone has one or more
datacenters equipped with independent power, cooling and
network.
Geo-Region Current region recommended with the appropriate services and
redundancy for the database and other workloads.
Secondary Region Utilized to spread a workload for HA and/or recovery
20. Use Availability Zones
• High Availability, (HA) offering to
protect data and apps from
datacenter failures.
• Contain multiple locations
within a single Azure region.
• Not all products or services are
available for AZ or in every
region.
• No additional cost to deploy
VMs in an Availability Zone.
https://docs.microsoft.com/en-us/azure/availability-zones/az-overview
22. Disaster
Recovery
• Along with AZ/AG,
etc.
• Use DR products
that best support
cloud
• Always-on
Availability Groups
and Oracle
DataGuard
• Implement
advanced,
automation features
to remove manual
intervention
• Clearly identify RPO,
(Recovery Point
Objective) and RTO,
(Recovery Time
Objective) for your
business.
• Ensure that the HR,
DR, backup and
recovery decisions
meet these and
have been fully
TESTED.
24. Storage is
SEPARATE
and
Important
• Ensure you know the IO workload for your
database going to the cloud
• Understand both the MB/s and the IO
throughput for the database.
• Oracle has demonstrated, on average,
much higher demands for IO than MSSQL,
MySQL or PostgreSQL.
• Storage is separate to ensure the right
combination in IaaS can be reached.
25. Storage
Considerations
What is the storage to
be used for?
Data- OLTP,
DSS, OLAP, Big
Data?
Logging
Backup
Ensure that backups and data
refresh requirements are calculated
into the IO demands for the
database.
27. Storage Accounts
Storage Account Services Supported Tiers Access Support Replication
GP V2 Blob, File, Queue,
Table, Disk, Data
Lake Gen2
Standard, Premium Hot, Cool, Archive LRS, GRS, RA-GRS,
ZRS, GZRS, RA-GZRS,
GP V1 Blob, File, Queue,
Table and Disk
Standard, Premium N/A LRS, GRS, RA-GRS
Block Blob Storage Blob Premium N/A LRS, ZRS
File Storage File Only Premium N/A LRS, ZRS
Blob Storage Blob Standard Hot, Cool, Archive LRS, GRS, RA-GRS
https://docs.microsoft.com/en-us/azure/storage/common/storage-account-overview
28. Premium SSD- Size and Limits
Name Capacity (GiB)
IOPS per
disk
Max burstable
IOPS
Throughput per disk
(MB/s)
Max burstable
throughput per disk
(MB/s)
Cache limit per
disk (GiB)
P1 4 120 3,500 25 170 4
P2 8 120 3,500 25 170 8
P3 16 120 3,500 25 170 16
P4 32 120 3,500 25 170 32
P6 64 240 3,500 50 170 64
P10 128 500 3,500 100 170 128
P15 256 1,100 3,500 125 170 256
P20 512 2,300 3,500 150 170 512
P30 1,024 5,000 200 1,024
P40 2,048 7,500 250 2,048
P50 4,096 7,500 250 4,095
P60 8,192 16,000 500 4,095
P70 16,384 18,000 750 4,095
P80 32,727 20,000 900 4,095
Source: Managed disks pricing
29. Ultra Disk
Ultra Disk Offerings
Disk Size
(GiB)
4 8 16 32 64 128 256 512
1,024-
65,536 (in
increment
s of 1 TiB)
IOPS
Range
1,200 2,400 4,800 9,600 19,200 38,400 76,800 160,000 160,000
Throughpu
t Range
(MB/s)
300 600 1,200 2,000 2,000 2,000 2,000 2,000 2,000
30. Ultradisks
• Often the first recommendation by Infra
• Be aware of the limitations before
recommending for database workloads:
• Oracle 12.2 later is supported
• Only supports un-cached reads and un-cached writes
• Doesn't support disk snapshots, VM images, availability
sets, Azure Dedicated Hosts, or Azure disk encryption
• No integration with Azure Backup or Azure Site Recovery
• Offers up to 16 TiB per region per subscription
unless upped via support.
• Isn’t available in all regions.
Capacity
per disk
(GiB)
IOPS per
disk
Throughput
per disk
(MB/s)
Mininum 4 100 1
Maximum 65536 160000 2000
https://docs.microsoft.com/en-us/azure/virtual-machines/disks-enable-ultra-ssd#ga-scope-and-limitations
GiB * .05, MBPs * 1.01, IOPs * .12, vCPU * 4.83
31. Redundancy
• Locally Redundant Storage, (LRS)- copies data
synchronously 3 times within a single physical
location in the same region. Not considered HA.
• Zone-Redundant Storage, (ZRS)- copy data
synchronously across 3 Azure AZ in the primary
region. HA would have first 2 in first region and 3rd in
secondary region.
• Geo-Redundant Storage, (GRS)- Copies data
synchronously in a single physical location of the
primary region using LRS, then copies data async to a
physical location in a secondary region.
• Geo-Zone-Redundant Storage, (GZRS)- Copies data
synchronously across 3 Azure AZ in primary region
using ZRS & then copies to a physical region in a
secondary region.
32. IO Throttling
• Why it happens?
• No, you can’t have all the
resources for yourself.
• What all can be involved?
• It’s not just the database.
• How to identify it?
• What do to when it is
identified?
https://docs.microsoft.com/en-us/azure/virtual-machines/sizes-memory?toc=/azure/virtual-
machines/linux/toc.json&bc=/azure/virtual-machines/linux/breadcrumb/toc.json
33. Bring in
Additional
Solutions
• High IOPS-
• MBPs: Azure NetApp
Files
• Higher IO
throughput:
Consider Silk,
Flashgrid Storage,
Pure Storage or
Excelero.
• Consider disk
striping of smaller
disks and parallel
processing at the
database level.
• Backups, batch loading
and other challenges:
• Offload backups
with secondary
backup solutions.
• Refactor batch
processing with
other services,
(Azure Data Factory,
Azure Analysis
Services, Databricks,
etc.)
34. Azure NetApp
Files
• Fully Managed, PaaS,
Microsoft Azure Storage
Service
• All Flash Baremetal Storage
• Only dependent on Nic, not
VM.
• *Available in Standard,
Premium, (common) and
Ultra, (optimal)
Azure
Files
Premium
Files
Azure NetApp
Files
Premium
Disk
Performance 1K IOPs 100K IOPs 320K IOPs 20K IOPs
Capacity Pool 5TB 100TB 500TB 32TB
AD Integration Azure AD N/A Bring Your Own
AD
/ Azure AD
N/A
Protocol SMB SMB NFS & SMB Disk
Data Protection LRS Only Snapshots
Back Up Tools
Snapshots
*Be aware of pricing with scaling to meet IO
35. Types of cache
Settings
• Available to Premium Storage
• A Multi-tier caching technology, aka BlobCache
• OS Disk- ReadWrite is fine, which is the default,
but not for datafiles.
• ReadOnly Cache is, as it caches reads, while
letting writes pass through to disk.
• Limit of 4095Gib on per individual premium disk
• Results in any disk above a P40 for entirety
will silently disable read caching.
• Larger disks are preferably used without
caching, otherwise additional space is
wasted. P50, just allocate 4095 of the 4096
size.
• Use smaller disks and choose to stripe and
mirror.
• M-series available and VM series dependent.
37. When To Go
Old-School
• Depending on the combination of storage, striping
and RAID, performance can vary greatly.
• Verify that disk is striped correctly, (log creation
commands and document.)
• Consider smaller disk size and stripe vs. larger,
single drive to offer better performance.
• In Linux, consider huge pages and use LVM,
(Linux Volume Manager) or Oracle ASM,
(Automatic Storage Management) to provide
advanced features for diskgroup layout.
• Keep an eye on disk sector size, (there’s a bug
requiring 512 byte sector size in Oracle 12.1)
38. Failure Due to
Backups
• Modernize the way the database is backed up and
restore if RMAN is 40% of total IO in AWR or
database has small window to backup.
• Archaic backup and data refresh strategies can
impact a cloud environment heavily in IO and
network latency
• Snapshot technology with database consistency
should be your FIRST choice in backup solutions for
large databases.
• Oracle AWR can demonstrate the impact on the
overall database workload of RMAN and
datapump jobs.
• The Profiler can identify the workload impact in
SQL Server.
39. Simplify the
Shift to the
Cloud
• Migrate your tools that you already use to
monitor and manage the database on-prem into
the cloud whenever possible.
• For Oracle, we implement Oracle Enterprise
Manager, (Cloud Control) to ensure the
cloud environment looks just like their
onprem one.
• Redgate SQL Monitor, Solarwinds SQL
Sentry, Dynatrace, Idera Uptime
Infrastructure Monitor, etc.
• Use features to automate OS patching using
Azure Linux/Windows automated patching
service.
• Incorporate DevOps automation to the cloud
changes FIRST.
40. It’s Not Just
Infrastructure
• No matter if during the migration or when there are
issues:
• Infrastructure support will be the first line of
defense.
• Database workload will be an afterthought.
• Data support may be a request only option.
• First inclination is to “throw iron” at the problem.
• Demand to look at the code, database design,
etc.
• If you fix the real cause, you fix it once vs.
revisiting it over and over.
• Do have support take advantage of advanced
Azure tools to help identify where the problem
is, (IO, memory, CPU)
41. Manage with
What You Know
• Use the cloud services of what you already use on-
prem.
• If you can deploy your existing, on-prem tool on a
VM, consider doing this, (Oracle Enterprise Manager,
Redgate, Idera, Solarwinds, etc.- and its cloud ready,
do it!)
• Keep backup, replication tools as often as you are
able- don’t create larger learning curves than what is
required.
42. Simulate PaaS in
IaaS
• Use Azure Managed Instance for SQL Server
• Use Lifecycle Management Pack with Oracle
Enterprise Manager to automate monitoring,
management and database patching.
• Use Linux Automated Patching, (preview) to
automate OS patching of VMs.
43. Review: Database Workloads on IaaS
Know
Know the
infrastructure
Know
Infrastructure must
know the database
Know
Know what is the
cause of the
problem- don’t
guess.
Bring in
Bring in existing
tools that are cloud
enabled
Know
Know what tools are
available in the
cloud and when
stuck, bring in Azure
support.
44. References
Oracle Dataguard on Azure:
• https://docs.microsoft.com/en-us/azure/virtual-machines/workloads/oracle/configure-oracle-dataguard
Oracle Dataguard Far Sync:
• https://docs.oracle.com/database/121/SBYDB/create_fs.htm#SBYDB5416
Oracle DataGuard standby from RAC to single instance:
• https://docs.oracle.com/en/database/oracle/oracle-database/19/sbydb/configuring-data-guard-standby-databases-in-oracle-RAC.html#GUID-
3140A293-DDD8-4559-8493-B6C21646E90F
Azure VM Sizing:
• Generation 1: https://docs.microsoft.com/en-us/azure/virtual-machines/linux/sizes
• Generation 2: https://docs.microsoft.com/en-us/azure/virtual-machines/linux/generation-2
Isolated Bare Metal:
• https://docs.microsoft.com/en-us/azure/virtual-machines/linux/isolation
Express Route Documentation:
• https://docs.microsoft.com/en-us/azure/expressroute/
Ultradisks for Azure Linux VMs:
• https://docs.microsoft.com/en-us/azure/virtual-machines/linux/disks-enable-ultra-ssd
No one can have it all. One of the benefits of the cloud is also one of the challenges- how to give everyone a share. Throttling occurshttps://docs.microsoft.com/en-us/azure/virtual-machines/sizes-memory?toc=/azure/virtual-machines/linux/toc.json&bc=/azure/virtual-machines/linux/breadcrumb/toc.json
*
Azure Premium Storage have a multi-tier caching technology called BlobCache, which uses a combination of the host vRAM and local SSD for caching I/O. By default, this cache setting is set to Read/Write for OS disks, which is the disk on which the Linux OS resides, and ReadOnly for data disks, which are the disks on which Oracle database files might reside.
As the name suggests, ReadWrite caches both read I/O and write I/O from the VM, and because writes are not persisted directly to storage, this is unsuitable for database applications. Also as the name suggests, ReadOnly caches only read I/O, allowing write I/O to write-through directly to storage, which is appropriate for databases.