Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster

•

0 likes•8,657 views

This document discusses online migration from an existing MySQL master-slave setup to a Galera cluster. It outlines the steps to enable binary logging on the slave, dump the schema and data, load this into the first Galera node to initialize replication, and transition reads to the Galera cluster while writes continue on the master initially at 90% before being cut over fully to the cluster. Operational checklists, backup procedures, and disaster recovery options for the new Galera cluster configuration are also reviewed.

Migrating to MySQL, MariaDB
Galera, and/or Percona XtraDB
Cluster
March 2014
Johan Andersson
Severalnines AB
johan@severalnines.com
Mobile +46 73 073 60 99

Online Migration
!  Existing MySQL Server
!  E.g Master – Slave setup
!  Single server
!  Tired of slave lag and data loss?
!  Easy scaling w/o read/write splits?
!  Feasibility - Data set, queries, suits Galera
2
Copyright 2014 Severalnines AB

Online Migration
3
Copyright 2014 Severalnines AB
Master �� Slave
RW R
Galera Cluster
m1 s1 gm1 gm2 gm3
Setup with
http://www.severalnines.com/galera-configurator
Existing setup
(examples based on 5.5)

Online Migration
!  On s1:
!  Enable
log-bin=binlog
log-slave-updates=1
!  GRANT
REPLICATION_SLAVE ON
*.* TO ‘repl’@’gm1’
IDENTIFIED BY ‘repl’
!  Dump schema and data
into two separate files.
!  Easier to convert the
schema
!  Best: convert schema
already on slave
Copyright 2014 Severalnines AB
4
Master – Slave
RW R
m1 s1

Online Migration
!  On gm1:
!  Load in converted schema
!  Load in data
!  CHANGE MASTER TO
MASTER_HOST=‘s1’,
MASTER_USER=‘repl’,
MASTER_PASSWORD=‘repl’;
!  START SLAVE;
Copyright 2014 Severalnines AB
5
Galera Cluster
gm1 gm2 gm3

Online Migration
6
Copyright 2014 Severalnines AB
Master – Slave Galera Cluster
RW R
R/W

Online Migration
7
Copyright 2014 Severalnines AB
Master – Slave Galera Cluster
RW R
90% R/W 10% Reads

Cut Off
8
Copyright 2014 Severalnines AB
Master – Slave Galera Cluster
RW R
R/W

Demo Time!
!  Setting up Replication from Master to Galera Cluster
(acting as a slave cluster).
!  Master – Percona Server 5.5
!  Slave - 3 Node Galera Cluster – PXC 5.6
9
Copyright 2014 Severalnines AB
Master Galera Cluster

Operational Checklist
!  Are queues building up?
!  Slow queries? Tune queries in the Query Monitor.
!  Are backups working?
!  Reporting queries?
!  Latency issue?
!  Do you have random node restarts and failures? Time to upgrade.
!  Did you test new code before putting in production?
You worst enemy is the network administrator!
10
Copyright 2014 Severalnines AB

Belt and Suspenders
!  Apply your backup procedures as normal
!  mysqldump –single-transaction
!  s9s_backup, front-end to xtrabackup
http://johanandersson.blogspot.se/2012/10/hotbackup-of-galera-cluster-for-
mysql.html
!  http://www.severalnines.com/blog/full-restore-mysql-galera-cluster-backup
!  You may still want to have an async slave connected to the cluster
!  Reporting
!  Disaster Recovery
!  http://www.severalnines.com/blog/asynchronous-replication-galera-cluster-
mysql-server-gtid’
!  Point in time recovery
!  http://www.severalnines.com/blog/point-time-recovery-galera-cluster
11
Copyright 2014 Severalnines AB

Thank you.
13
Copyright 2014 Severalnines AB
For further questions please contact John-Jerome Schmidt:
jj@severalnines.com

What's hot

Using and Benchmarking Galera in different architectures (PLUK 2012)

Henrik Ingo

Galera Cluster Best Practices for DBA's and DevOps Part 1

Codership Oy - Creators of Galera Cluster

MariaDB Galera Cluster - Simple, Transparent, Highly Available

MariaDB Corporation

Introduction to Galera

Henrik Ingo

Advanced Percona XtraDB Cluster in a nutshell... la suite

Kenny Gryp

This document provides a hands-on tutorial for advanced Percona XtraDB Cluster users. It discusses setting up a 3 node PXC cluster environment in VirtualBox and bootstrapping the initial cluster. It then covers topics like avoiding state snapshot transfers when restarting MySQL, recovering from clean and unclean shutdowns, and reproducing and diagnosing different types of conflicts through examples.

Percona XtraDB Cluster

Kenny Gryp

Built-in MySQL Replication is known for its capability to enable to scale reads easily. However, there are some limitations and known issues with this solution because of the asynchronous nature of this replication. This talk will describe another way of doing MySQL replication, by using synchronous replication, available in Percona XtraDB Cluster. The open source solution will be explained and compared to traditional asynchronous MySQL replication, as well as some known use cases will be described. Percona XtraDB Cluster is an, open source, high availability and high scalability solution for MySQL clustering. Features include: Synchronous replication, Multi-master replication support, Parallel replication, Automatic node provisioning.

Webinar slides: Top 9 Tips for building a stable MySQL Replication environment

Severalnines

MySQL replication is a widely known and proven solution to build scalable clusters of databases. It is very easy to deploy, even easier with GTID. Easy deployment doesn't mean you don't need knowledge and skills to operate it correctly. If you'd like to learn what is needed to build a stable environment using MySQL replication, this webinar is for you. AGENDA 1. Sanity checks before migrating into MySQL replication setup 2. Operating system configuration 3. Replication 4. Backup 5. Provisioning 6. Performance 7. Schema changes 8. Reporting 9. Disaster recovery SPEAKER Krzysztof Książek, Senior Support Engineer at Severalnines, is a MySQL DBA with experience managing complex database environments for companies like Zendesk, Chegg, Pinterest and Flipboard.

High Availability with Galera Cluster - SkySQL Road Show 2013 in Berlin

MariaDB Corporation

Reducing Risk When Upgrading MySQL

Kenny Gryp

Upgrading MySQL databases do not come without risk. There is no guarantee that no problems will happen if you move to a new major MySQL version. Should we just upgrade and rollback immediately if problems occur? But what if these problems only happen a few days after migrating to this new version? You might have a database environment that is risk-adverse, where you really have to be sure that this new MySQL version will handle the workload properly. Examples: - Both MySQL 5.6 and 5.7 have a lot of changes in the MySQL Optimizer. It is expected that this improves performance of my queries, but is it really the case? What if there is a performance regression? How will this affect my database performance? - Also, there are a lot of incompatible changes which are documented in the release notes, how do I know if I'm affected by this in my workload? It's a lot to read.. - Can I go immediately from MySQL 5.5 to 5.7 and skip MySQL 5.6 even though the MySQL documentation states that this is not supported? - Many companies have staging environments, but is there a QA team and do they really test all functionality, under a similar workload? This presentation will show you a process, using open source tools, of these types of migrations with a focus on assessing risk and fixing any problems you might run into prior to the migration. This process can then be used for various changes: - MySQL upgrades for major version upgrades - Switching storage engines - Changing hardware architecture Additionally, we will describe ways to do the actual migration and rollback with the least amount of downtime.

Galera Cluster 3.0 Features

Codership Oy - Creators of Galera Cluster

Galera webinar migration to galera cluster from my sql async replication

Codership Oy - Creators of Galera Cluster

This document summarizes migrating from MySQL replication to Galera Cluster. It describes Galera Cluster as providing synchronous multi-master replication with automatic failover. The migration procedure involves converting an existing asynchronous slave to Galera, building up the Galera Cluster to the desired size, switching readers and writers over to the cluster, and then deactivating the original asynchronous replication. Key benefits of Galera Cluster include strong consistency, high availability, and ability to join new nodes automatically.

Codership's galera cluster installation and quickstart webinar march 2016

Sakari Keskitalo

In this webinar, we will describe how to get started with Galera Cluster and build a functional multi-master cluster. First, will show how to easily install the required packages using the new preferred installation method – the dedicated Galera package repository. Then we will discuss the important Galera configuration settings and how to select values for them. Finally, we will demonstrate how to bootstrap a 3-node Galera installation with the right sequence of steps. Once the nodes are up and running we will discuss how to monitor the health of the cluster and which status variables are important to watch. Galera Cluster is trusted by thousands of users. Galera Cluster powers Percona XtraDB Cluster and MariaDB Enterprise Cluster. This is a webinar presented by Codership, the developers and experts of Galera Cluster.

Percon XtraDB Cluster in a nutshell

Frederic Descamps

Percona XtraDB Cluster is a high availability and high scalability solution for MySQL clustering. Percona XtraDB Cluster integrates Percona Server with the Galera synchronous replication library in a single product package which enables you to create a cost-effective MySQL cluster. This tutorial will cover the following topics: - Migration from standard MySQL Master-Slave Architecture to PXC - Configuration differences between standard MySQLl and Xtradb Cluster - How to add a node and what does SST, IST mean ? How to use them ? - How to backup the cluster - How to monitor the cluster - 2 nodes servers- Why this isn't ideal but reasons and steps to setting it up anyway. - Galera Arbitrator: Defining what it is. - How to maintain the cluster - Setting up load balancing for Xtradb cluster - How to handle the cluster in the cloud - Tips and tricks - ... and if available cover PXC 5.6 with Galera 3 !!

Scaling with sync_replication using Galera and EC2

Marco Tusa

Galera Cluster - Node Recovery - Webinar slides

Severalnines

Slides for the webinar held on January 21st 2014 Repair & Recovery for your MySQL, MariaDB & MongoDB / TokuMX Clusters Galera Cluster, NDB Cluster, VIP with HAProxy and Keepalived, MongoDB Sharded Cluster, etc. all have their own availability models. We are aware of these availability models and will demonstrate in this webinar how to take corrective action in case of failures via our cluster management tool, ClusterControl. In this webinar, Severalnines CTO Johan Andersson will show you how to leverage ClusterControl to detect failures in your database cluster and automatically repair them to maximize the availability of your database services. And Codership CEO Seppo Jaakola will be joining Johan to provide a deep-dive into Galera recovery internals. Agenda: Redundancy models for Galera, NDB and MongoDB/TokuMX Failover & Recovery (Automatic vs Manual) Zooming into Galera recovery procedures Split brains in multi-datacenter setups

Introducing Galera 3.0

Codership Oy - Creators of Galera Cluster

From these slides you'll learn how Galera integrates with MySQL 5.6 and Global Transaction IDs to enable cross-datacenter and cloud replication over high latency networks. ABOUT GALERA CLUSTER Galera Cluster for MySQL is a true multi-master MySQL replication plugin, and has been proven in mission-critical infrastructures of companies like Ping Identity, AVG Technologies, KPN and HP Cloud DNS. In this webcast you¹ll learn about the following Galera Cluster capabilities, including the latest innovations in the new 3.0 release: Galera Cluster features and benefits Support for MySQL 5.6 Integration with MySQL Global Transaction Identifiers Mixing Galera synchronous replication and asynchronous MySQL replication Deploying in WAN and Cloud environments Handling high-latency networks Management of Galera

Oss4b - pxc introduction

Frederic Descamps

This document provides an introduction to parallel synchronous replication using Percona XtraDB Cluster (PXC). It discusses the limitations of traditional MySQL replication and how PXC implements a data-centric approach with synchronous multi-master replication between nodes. Key features of PXC highlighted include parallel replication, data consistency, and automatic provisioning of new nodes. The document also covers integration with load balancers and limitations to be aware of for write-intensive or large transaction workloads.

Maria DB Galera Cluster for High Availability

OSSCube

Easy MySQL Replication Setup and Troubleshooting

Bob Burgess

The document describes how to set up basic MySQL replication with three servers - a master and a replica. It explains key replication concepts like the binary log on the master which records all data changes and is used by the replica to apply the same changes. It also provides details on configuration items needed like the server IDs and commands used to control replication like CHANGE MASTER TO, START SLAVE and SHOW SLAVE STATUS.

MySQL Multi Master Replication

Moshe Kaplan

This document summarizes and compares several solutions for multi-master replication in MySQL databases: Native MySQL replication, MySQL Cluster (NDB), Galera, and Tungsten. Native MySQL replication supports only limited topologies and has asynchronous replication. MySQL Cluster allows synchronous replication across two data centers but is limited to in-memory tables. Galera provides synchronous, row-based replication across multiple masters with automatic conflict resolution. Tungsten allows asynchronous multi-master replication to different database systems and automatic failover.

What's hot (20)

Using and Benchmarking Galera in different architectures (PLUK 2012)

Galera Cluster Best Practices for DBA's and DevOps Part 1

MariaDB Galera Cluster - Simple, Transparent, Highly Available

Introduction to Galera

Advanced Percona XtraDB Cluster in a nutshell... la suite

Percona XtraDB Cluster

Webinar slides: Top 9 Tips for building a stable MySQL Replication environment

High Availability with Galera Cluster - SkySQL Road Show 2013 in Berlin

Reducing Risk When Upgrading MySQL

Galera Cluster 3.0 Features

Galera webinar migration to galera cluster from my sql async replication

Codership's galera cluster installation and quickstart webinar march 2016

Percon XtraDB Cluster in a nutshell

Scaling with sync_replication using Galera and EC2

Galera Cluster - Node Recovery - Webinar slides

Introducing Galera 3.0

Oss4b - pxc introduction

Maria DB Galera Cluster for High Availability

Easy MySQL Replication Setup and Troubleshooting

MySQL Multi Master Replication

Viewers also liked

Zero Downtime Schema Changes - Galera Cluster - Best Practices

Severalnines

Database schema changes are usually not popular among DBAs or sysadmins, not when you are operating a cluster and cannot afford to switch off the service during a maintenance window. There are different ways to perform schema changes, some procedures being more complicated than others. Galera Cluster is great at making your MySQL database highly available, but are you concerned about schema changes? Is an ALTER TABLE statement something that requires a lot of advance scheduling? What is the impact on your database uptime? This is a common question, since ALTER operations in MySQL usually cause the table to be locked and rebuilt – which can potentially be disruptive to your live applications. Fortunately, Galera Cluster has mechanisms to replicate DDL across its nodes. In these slides, you will learn about the following: How to perform Zero Downtime Schema Changes 2 main methods: TOI and RSU Total Order Isolation: predictability and consistency Rolling Schema Upgrades pt-online-schema-change Schema synchronization with re-joining nodes Recommended procedures Common pitfalls/user errors The slides are courtesy of Seppo Jaakola, CEO, Codership - creators of Galera Cluster

Galera 3.0 Webinar Slides: Galera Monitoring & Management

Severalnines

Slides used for the webinar: Introducing Galera 3.0 - Now supporting MySQL 5.6, Global Transaction IDs & WAN. These slides covered the section: Galera Monitoring & Management Setting up and maintaining a database cluster can be tricky. ClusterControl gives you the power to deploy, manage, monitor and scale entire clusters efficiently and reliably. ClusterControl supports a variety of SQL and NoSQL cluster topologies, as well as SQL load balancing via HAProxy. Galera Cluster for MySQL is a true multi-master MySQL replication plugin, and has been proven in mission-critical infrastructures of companies like Ping Identity, AVG Technologies, KPN and HP Cloud DNS. In this webcast you¹ll learn about the following Galera Cluster capabilities, including the latest innovations in the new 3.0 release: Galera Cluster features and benefits Support for MySQL 5.6 Integration with MySQL Global Transaction Identifiers Mixing Galera synchronous replication and asynchronous MySQL replication Deploying in WAN and Cloud environments Handling high-latency networks Management of Galera

Slides: Severalnines ClusterControl 1.2.6 Webinar - May 2014

Severalnines

Webinar on release 1.2.6 of ClusterControl: This release contains key new features (along with performance improvements and bug fixes), which are demonstrated live during the webinar. Highlights include: * Centralized Authentication using LDAP or Active Directory * Role-Based Access Control * OpenStack: Galera Deployment Automation * Hybrid setups with Galera and Asynchronous MySQL Replication * Manage single instance MySQL Servers or existing MySQL Replication setups About ClusterControl: Setting up, maintaining and operating a database cluster can be tricky. ClusterControl gives you the power to deploy, manage, monitor and scale entire clusters efficiently and reliably. ClusterControl supports a variety of MySQL-based clusters (Galera, NDB, 5.6 Replication) as well as MongoDB/TokuMX-based clusters.

Galera Cluster for MySQL vs MySQL (NDB) Cluster: A High Level Comparison

Severalnines

Galera Cluster for MySQL, Percona XtraDB Cluster and MariaDB Cluster (the three “flavours” of Galera Cluster) make use of the Galera WSREP libraries to handle synchronous replication.MySQL Cluster is the official clustering solution from Oracle, while Galera Cluster for MySQL is slowly but surely establishing itself as the de-facto clustering solution in the wider MySQL eco-system. In this webinar, we will look at all these alternatives and present an unbiased view on their strengths/weaknesses and the use cases that fit each alternative. This webinar will cover the following: MySQL Cluster architecture: strengths and limitations Galera Architecture: strengths and limitations Deployment scenarios Data migration Read and write workloads (Optimistic/pessimistic locking) WAN/Geographical replication Schema changes Management and monitoring

How To Set Up SQL Load Balancing with HAProxy - Slides

Severalnines

We continuously see great interest in MySQL load balancing and HAProxy, so we thought it was about time we organised a live webinar on the topic! Here is the replay of that webinar! As most of you will know, database clusters and load balancing go hand in hand. Once your data is distributed and replicated across multiple database nodes, a load balancing mechanism helps distribute database requests, and gives applications a single database endpoint to connect to. Instance failures or maintenance operations like node additions/removals, reconfigurations or version upgrades can be masked behind a load balancer. This provides an efficient way of isolating changes in the database layer from the rest of the infrastructure. In this webinar, we cover the concepts around the popular open-source HAProxy load balancer, and show you how to use it with your SQL-based database clusters. We also discuss HA strategies for HAProxy with Keepalived and Virtual IP. Agenda: * What is HAProxy? * SQL Load balancing for MySQL * Failure detection using MySQL health checks * High Availability with Keepalived and Virtual IP * Use cases: MySQL Cluster, Galera Cluster and MySQL Replication * Alternative methods: Database drivers with inbuilt cluster support, MySQL proxy, MaxScale, ProxySQL

Management and Automation of MongoDB Clusters - Slides

Severalnines

Use MongoDB at Any Scale As you scale, one of the challenges is optimizing your clusters and mitigating operational risk. Proper preparation can result in significant savings and reduced downtime. This session covers: * Deployment of dev/test/production environments across private data centers or public clouds * What to monitor in production environments * Management automation with ClusterControl from Severalnines * How ClusterControl works with TokuMX The session will give you the tools to more effectively manage your cluster, immediately. The presentation will include code samples and a live Q&A session. This webinar is being delivered jointly by Severalnines & Tokutek. Severalnines provides automation and management tools to reduce the complexity of working with highly available database clusters. Tokutek provides high-performance and scalability for MongoDB, MySQL and MariaDB.

Mini-Training: Netflix Simian Army

Betclic Everest Group Tech Team

The History of DevOps (and what you need to do about it)

dev2ops

The document discusses the history and evolution of DevOps. It traces the origins of DevOps back to 2007 when the terms "DevOps" and "Agile Infrastructure" first emerged. It then summarizes the rise in DevOps conferences and communities from 2009 onward. The document also outlines key findings that DevOps adopters see significantly faster lead times, higher deployment frequencies, better change success rates, and faster recovery times compared to non-adopters. Additionally, DevOps teams are more likely to exceed goals for profitability, market share and productivity. The document argues that organizations should focus on fast feedback loops, continuous improvement and adopting an "Improvement System" like DevOps Kaizen in order to see these benefits as a

Netflix CDN and Open Source

Gleb Smirnoff

Netflix operates a large content delivery network (CDN) to stream video to over 50 million subscribers globally. To reduce costs and improve performance, Netflix built its own CDN called OpenConnect, using open source software like FreeBSD and Nginx. Netflix has significantly improved the performance of OpenConnect over time by contributions to open source projects, such as reducing locking contention and improving networking, storage, and virtual memory subsystems. Netflix aims to continue optimizing OpenConnect and working with open source communities to achieve its goal of over 80Gbps performance per appliance.

AWS Re:Invent - High Availability Architecture at Netflix

Adrian Cockcroft

Netflix Global Cloud Architecture

Adrian Cockcroft

ARC301 Intro to Chaos Monkey & the Simian Army - AWS re: Invent 2012

Amazon Web Services

Viewers also liked (12)

Zero Downtime Schema Changes - Galera Cluster - Best Practices

Galera 3.0 Webinar Slides: Galera Monitoring & Management

Slides: Severalnines ClusterControl 1.2.6 Webinar - May 2014

Galera Cluster for MySQL vs MySQL (NDB) Cluster: A High Level Comparison

How To Set Up SQL Load Balancing with HAProxy - Slides

Management and Automation of MongoDB Clusters - Slides

Mini-Training: Netflix Simian Army

The History of DevOps (and what you need to do about it)

Netflix CDN and Open Source

AWS Re:Invent - High Availability Architecture at Netflix

Netflix Global Cloud Architecture

ARC301 Intro to Chaos Monkey & the Simian Army - AWS re: Invent 2012

Disaster Recovery Planning for MySQL & MariaDB

Severalnines

Bart Oles - Severalnines AB Organizations need an appropriate disaster recovery plan to mitigate the impact of downtime. But how much should a business invest? Designing a highly available system comes at a cost, and not all businesses and indeed not all applications need five 9's availability. We will explain fundamental disaster recovery concepts and walk you through the relevant options from the MySQL & MariaDB ecosystem to meet different tiers of disaster recovery requirements, and demonstrate how to automate an appropriate disaster recovery plan.

MariaDB Performance Tuning Crash Course

Severalnines

Krzysztof Ksiazek - Severalnines AB So, you are a developer or sysadmin and showed some abilities in dealing with databases issues. And now, you have been elected to the role of DBA. And as you start managing the databases, you wonderâ€¦ * How do I tune them to make best use of the hardware? * How do I optimize the Operating System? * How do I best configure MySQL or MariaDB for a specific database workload? If you're asking yourself the following questions when it comes to optimally running your MySQL or MariaDB databases, then this talk is for you! We will discuss some of the settings that are most often tweaked and which can bring you significant improvement in the performance of your MySQL or MariaDB database. We will also cover some of the variables which are frequently modified even though they should not. Performance tuning is not easy, especially if you're not an experienced DBA, but you can go a surprisingly long way with a few basic guidelines.

Performance Tuning Cheat Sheet for MongoDB

Severalnines

Bart Oles - Severalnines AB Database performance affects organizational performance, and we tend to look for quick fixes when under stress. But how can we better understand our database workload and factors that may cause harm to it? What are the limitations in MongoDB that could potentially impact cluster performance? In this talk, we will show you how to identify the factors that limit database performance. We will start with the free MongoDB Cloud monitoring tools. Then we will move on to log files and queries. To be able to achieve optimal use of hardware resources, we will take a look into kernel optimization and other crucial OS settings. Finally, we will look into how to examine performance of MongoDB replication.

Advanced MySql Data-at-Rest Encryption in Percona Server

Severalnines

Iwo Panowicz - Percona & Bart Oles - Severalnines AB The purpose of the talk is to present data-at-rest encryption implementation in Percona Server for MySQL. Differences between Oracle's MySQL and MariaDB implementation. - How it is implemented? - What is encrypted: - Tablespaces? - General tablespace? - Double write buffer/parallel double write buffer? - Temporary tablespaces? (KEY BLOCKS) - Binlogs? - Slow/general/error logs? - MyISAM? MyRocks? X? - Performance overhead. - Backups? - Transportable tablespaces. Transfer key. - Plugins - Keyrings in general - Key rotation? - General-Purpose Keyring Key-Management Functions - Keyring_file - Is useful? How to make it profitable? - Keyring Vault - How does it work? - How to make a transition from keyring_file

Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife

Severalnines

Art Van Scheppingen - vidaXL & Bart Oles - Severalnines AB Over the past few years, VidaXL has become a European market leader in the online retail of slow moving consumer goods. When a company achieved over 50% year over year growth for the past 9 years, there is hardly enough time to overhaul existing systems. This means existing systems will be stretched to the maximum of their capabilities, and often additional performance will be gained by utilizing a large variety of datastores. Polyglot persistence reigns in rapidly growing environments and the traditional one-size-fits-all strategy of monoglots is over. VidaXL has a broad landscape of datastores, ranging from traditional SQL data stores, like MySQL or PostgreSQL alongside more recent load balancing technologies such as ProxySQL, to document stores like MongoDB and search engines such as SOLR and Elasticsearch.

Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...

Severalnines

Traditional server monitoring tools are not built for modern distributed database architectures. Let’s face it, most production databases today run in some kind of high availability setup - from simpler master-slave replication to multi-master clusters fronted by redundant load balancers. Operations teams deal with dozens, often hundreds of services that make up the database environment. This is why we built ClusterControl - to address modern, highly distributed database setups based on replication or clustering. We wanted something that could provide a systems view of all the components of a distributed cluster, including load balancers. Watch this replay of a webinar on free database monitoring using ClusterControl Community Edition. We show you how to monitor all your MySQL, MariaDB, PostgreSQL and MongoDB systems from a single point of control - whether they are deployed as Galera Clusters, sharded clusters or replication setups across on-prem and cloud data centers. We also see how to use Advisors in order to improve performance. AGENDA - Requirements for monitoring distributed database systems - Cloud-based vs On-prem monitoring solutions - Agent-based vs Agentless monitoring - Deepdive into ClusterControl Community Edition - Architecture - Metrics Collection - Trending - Dashboards - Queries - Performance Advisors - Other features available to Community users SPEAKER Bartlomiej Oles is a MySQL and Oracle DBA, with over 15 years experience in managing highly available production systems at IBM, Nordea Bank, Acxiom, Lufthansa, and other Fortune 500 companies. In the past five years, his focus has been on building and applying automation tools to manage multi-datacenter database environments.

Webinar slides: An Introduction to Performance Monitoring for PostgreSQL

Severalnines

To operate PostgreSQL efficiently, you need to have insight into database performance and make sure it is at optimal levels. With that in mind, we dive into monitoring PostgreSQL for performance in this webinar replay. PostgreSQL offers many metrics through various status overviews and commands, but which ones really matter to you? How do you trend and alert on them? What is the meaning behind the metrics? And what are some of the most common causes for performance problems in production? We discuss this and more in ordinary, plain DBA language. We also have a look at some of the tools available for PostgreSQL monitoring and trending; and we’ll show you how to leverage ClusterControl’s PostgreSQL metrics, dashboards, custom alerting and other features to track and optimize the performance of your system. AGENDA - PostgreSQL architecture overview - Performance problems in production - Common causes - Key PostgreSQL metrics and their meaning - Tuning for performance - Performance monitoring tools - Impact of monitoring on performance - How to use ClusterControl to identify performance issues - Demo SPEAKER Sebastian Insausti, Support Engineer at Severalnines, has loved technology since his childhood, when he did his first computer course (Windows 3.11). And from that moment he was decided on what his profession would be. He has since built up experience with MySQL, PostgreSQL, HAProxy, WAF (ModSecurity), Linux (RedHat, CentOS, OL, Ubuntu server), Monitoring (Nagios), Networking and Virtualization (VMWare, Proxmox, Hyper-V, RHEV). Prior to joining Severalnines, Sebastian worked as a consultant to state companies in security, database replication and high availability scenarios. He’s also a speaker and has given a few talks locally on InnoDB Cluster and MySQL Enterprise together with an Oracle team. Previous to that, he worked for a Mexican company as chief of sysadmin department as well as for a local ISP (Internet Service Provider), where he managed customers' servers and connectivity. This webinar builds upon a related blog post by Sebastian: https://severalnines.com/blog/performance-cheat-sheet-postgresql.

More from Severalnines (20)

WEBINAR SLIDES: CCX for Cloud Service Providers

LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution

Kubernetes at Scale: Going Multi-Cluster with Istio

DIY DBaaS: A guide to building your own full-featured DBaaS

Cloud's future runs through Sovereign DBaaS

Tips to drive maria db cluster performance for nextcloud

Working with the Moodle Database: The Basics

SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB

(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...

Webinar slides: How to Migrate from Oracle DB to MariaDB

Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl

Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...

Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...

Disaster Recovery Planning for MySQL & MariaDB

MariaDB Performance Tuning Crash Course

Performance Tuning Cheat Sheet for MongoDB

Advanced MySql Data-at-Rest Encryption in Percona Server

Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife

Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...

Webinar slides: An Introduction to Performance Monitoring for PostgreSQL

Recently uploaded

Mitigating the Impact of State Management in Cloud Stream Processing Systems

ScyllaDB

Stream processing is a crucial component of modern data infrastructure, but constructing an efficient and scalable stream processing system can be challenging. Decoupling compute and storage architecture has emerged as an effective solution to these challenges, but it can introduce high latency issues, especially when dealing with complex continuous queries that necessitate managing extra-large internal states. In this talk, we focus on addressing the high latency issues associated with S3 storage in stream processing systems that employ a decoupled compute and storage architecture. We delve into the root causes of latency in this context and explore various techniques to minimize the impact of S3 latency on stream processing performance. Our proposed approach is to implement a tiered storage mechanism that leverages a blend of high-performance and low-cost storage tiers to reduce data movement between the compute and storage layers while maintaining efficient processing. Throughout the talk, we will present experimental results that demonstrate the effectiveness of our approach in mitigating the impact of S3 latency on stream processing. By the end of the talk, attendees will have gained insights into how to optimize their stream processing systems for reduced latency and improved cost-efficiency.

BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf

Neo4j

Presented at Gartner Data & Analytics, London Maty 2024. BT Group has used the Neo4j Graph Database to enable impressive digital transformation programs over the last 6 years. By re-imagining their operational support systems to adopt self-serve and data lead principles they have substantially reduced the number of applications and complexity of their operations. The result has been a substantial reduction in risk and costs while improving time to value, innovation, and process automation. Join this session to hear their story, the lessons they learned along the way and how their future innovation plans include the exploration of uses of EKG + Generative AI.

Quality Patents: Patents That Stand the Test of Time

Aurora Consulting

Is your patent a vanity piece of paper for your office wall? Or is it a reliable, defendable, assertable, property right? The difference is often quality. Is your patent simply a transactional cost and a large pile of legal bills for your startup? Or is it a leverageable asset worthy of attracting precious investment dollars, worth its cost in multiples of valuation? The difference is often quality. Is your patent application only good enough to get through the examination process? Or has it been crafted to stand the tests of time and varied audiences if you later need to assert that document against an infringer, find yourself litigating with it in an Article 3 Court at the hands of a judge and jury, God forbid, end up having to defend its validity at the PTAB, or even needing to use it to block pirated imports at the International Trade Commission? The difference is often quality. Quality will be our focus for a good chunk of the remainder of this season. What goes into a quality patent, and where possible, how do you get it without breaking the bank? ** Episode Overview ** In this first episode of our quality series, Kristen Hansen and the panel discuss: ⦿ What do we mean when we say patent quality? ⦿ Why is patent quality important? ⦿ How to balance quality and budget ⦿ The importance of searching, continuations, and draftsperson domain expertise ⦿ Very practical tips, tricks, examples, and Kristen’s Musts for drafting quality applications https://www.aurorapatents.com/patently-strategic-podcast.html

Coordinate Systems in FME 101 - Webinar Slides

Safe Software

If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights. During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to: - Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value - Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems - Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors - Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported - Look Ahead: Gain insights into where FME is headed with coordinate systems in the future Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!

Password Rotation in 2024 is still Relevant

Bert Blevins

BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL

Liveplex

Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...

Chris Swan

Have you noticed the OpenSSF Scorecard badges on the official Dart and Flutter repos? It's Google's way of showing that they care about security. Practices such as pinning dependencies, branch protection, required reviews, continuous integration tests etc. are measured to provide a score and accompanying badge. You can do the same for your projects, and this presentation will show you how, with an emphasis on the unique challenges that come up when working with Dart and Flutter. The session will provide a walkthrough of the steps involved in securing a first repository, and then what it takes to repeat that process across an organization with multiple repos. It will also look at the ongoing maintenance involved once scorecards have been implemented, and how aspects of that maintenance can be better automated to minimize toil.

DealBook of Ukraine: 2024 edition

Yevgen Sysoyev

[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf

Kief Morris

Observability For You and Me with OpenTelemetry

Eric D. Schabell

Are you interested in dipping your toes in the cloud native observability waters, but as an engineer you are not sure where to get started with tracing problems through your microservices and application landscapes on Kubernetes? Then this is the session for you, where we take you on your first steps in an active open-source project that offers a buffet of languages, challenges, and opportunities for getting started with telemetry data. The project is called openTelemetry, but before diving into the specifics, we’ll start with de-mystifying key concepts and terms such as observability, telemetry, instrumentation, cardinality, percentile to lay a foundation. After understanding the nuts and bolts of observability and distributed traces, we’ll explore the openTelemetry community; its Special Interest Groups (SIGs), repositories, and how to become not only an end-user, but possibly a contributor.We will wrap up with an overview of the components in this project, such as the Collector, the OpenTelemetry protocol (OTLP), its APIs, and its SDKs. Attendees will leave with an understanding of key observability concepts, become grounded in distributed tracing terminology, be aware of the components of openTelemetry, and know how to take their first steps to an open-source contribution! Key Takeaways: Open source, vendor neutral instrumentation is an exciting new reality as the industry standardizes on openTelemetry for observability. OpenTelemetry is on a mission to enable effective observability by making high-quality, portable telemetry ubiquitous. The world of observability and monitoring today has a steep learning curve and in order to achieve ubiquity, the project would benefit from growing our contributor community.

Research Directions for Cross Reality Interfaces

Mark Billinghurst

20240702 Présentation Plateforme GenAI.pdf

Sally Laouacheria

Support en anglais diffusé lors de l'événement 100% IA organisé dans les locaux parisiens d'Iguane Solutions, le mardi 2 juillet 2024 : - Présentation de notre plateforme IA plug and play : ses fonctionnalités avancées, telles que son interface utilisateur intuitive, son copilot puissant et des outils de monitoring performants. - REX client : Cyril Janssens, CTO d’ easybourse, partage son expérience d’utilisation de notre plateforme IA plug & play.

Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops

Mydbops

This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization. Key Takeaways: * Understand why connection pooling is essential for high-traffic applications * Explore various connection poolers available for PostgreSQL, including pgbouncer * Learn the configuration options and functionalities of pgbouncer * Discover best practices for monitoring and troubleshooting connection pooling setups * Gain insights into real-world use cases and considerations for production environments This presentation is ideal for: * Database administrators (DBAs) * Developers working with PostgreSQL * DevOps engineers * Anyone interested in optimizing PostgreSQL performance Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services

What’s New in Teams Calling, Meetings and Devices May 2024

Stephanie Beckett

RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx

SynapseIndia

Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...

Bert Blevins

Today’s digitally connected world presents a wide range of security challenges for enterprises. Insider security threats are particularly noteworthy because they have the potential to cause significant harm. Unlike external threats, insider risks originate from within the company, making them more subtle and challenging to identify. This blog aims to provide a comprehensive understanding of insider security threats, including their types, examples, effects, and mitigation techniques.

20240702 QFM021 Machine Intelligence Reading List June 2024

Matthew Sinclair

Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...

Erasmo Purificato

WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf

ArgaBisma

Comparison Table of DiskWarrior Alternatives.pdf

Andrey Yasko

Recently uploaded (20)

Mitigating the Impact of State Management in Cloud Stream Processing Systems

BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf

Quality Patents: Patents That Stand the Test of Time

Coordinate Systems in FME 101 - Webinar Slides

Password Rotation in 2024 is still Relevant

BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL

Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...

DealBook of Ukraine: 2024 edition

[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf

Observability For You and Me with OpenTelemetry

Research Directions for Cross Reality Interfaces

20240702 Présentation Plateforme GenAI.pdf

Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops

What’s New in Teams Calling, Meetings and Devices May 2024

RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx

Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...

20240702 QFM021 Machine Intelligence Reading List June 2024

Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...

WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf

Comparison Table of DiskWarrior Alternatives.pdf

Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster

1. Migrating to MySQL, MariaDB Galera, and/or Percona XtraDB Cluster March 2014 Johan Andersson Severalnines AB johan@severalnines.com Mobile +46 73 073 60 99

2. Online Migration !  Existing MySQL Server !  E.g Master – Slave setup !  Single server !  Tired of slave lag and data loss? !  Easy scaling w/o read/write splits? !  Feasibility - Data set, queries, suits Galera 2 Copyright 2014 Severalnines AB

3. Online Migration 3 Copyright 2014 Severalnines AB Master – Slave RW R Galera Cluster m1 s1 gm1 gm2 gm3 Setup with http://www.severalnines.com/galera-configurator Existing setup (examples based on 5.5)

4. Online Migration !  On s1: !  Enable log-bin=binlog log-slave-updates=1 !  GRANT REPLICATION_SLAVE ON *.* TO ‘repl’@’gm1’ IDENTIFIED BY ‘repl’ !  Dump schema and data into two separate files. !  Easier to convert the schema !  Best: convert schema already on slave Copyright 2014 Severalnines AB 4 Master – Slave RW R m1 s1

5. Online Migration !  On gm1: !  Load in converted schema !  Load in data !  CHANGE MASTER TO MASTER_HOST=‘s1’, MASTER_USER=‘repl’, MASTER_PASSWORD=‘repl’; !  START SLAVE; Copyright 2014 Severalnines AB 5 Galera Cluster gm1 gm2 gm3

9. Demo Time! !  Setting up Replication from Master to Galera Cluster (acting as a slave cluster). !  Master – Percona Server 5.5 !  Slave - 3 Node Galera Cluster – PXC 5.6 9 Copyright 2014 Severalnines AB Master Galera Cluster

10. Operational Checklist !  Are queues building up? !  Slow queries? Tune queries in the Query Monitor. !  Are backups working? !  Reporting queries? !  Latency issue? !  Do you have random node restarts and failures? Time to upgrade. !  Did you test new code before putting in production? You worst enemy is the network administrator! 10 Copyright 2014 Severalnines AB

11. Belt and Suspenders !  Apply your backup procedures as normal !  mysqldump –single-transaction !  s9s_backup, front-end to xtrabackup http://johanandersson.blogspot.se/2012/10/hotbackup-of-galera-cluster-for- mysql.html !  http://www.severalnines.com/blog/full-restore-mysql-galera-cluster-backup !  You may still want to have an async slave connected to the cluster !  Reporting !  Disaster Recovery !  http://www.severalnines.com/blog/asynchronous-replication-galera-cluster- mysql-server-gtid’ !  Point in time recovery !  http://www.severalnines.com/blog/point-time-recovery-galera-cluster 11 Copyright 2014 Severalnines AB

Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (12)

Similar to Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster

Similar to Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster (20)

More from Severalnines

More from Severalnines (20)

Recently uploaded

Recently uploaded (20)

Webinar Slides : Migrating to MySQL, MariaDB Galera and/or Percona XtraDB Cluster