SlideShare a Scribd company logo
MySQL Cluster Training
                                 presented by severalnines.com




                                                                      Address:
 Contact:                                                      SeveralninesAB
 Jean-Jérôme Schmidt                                        c/o SICS, Box 1263
 Email: services@severalnines.com                             Isafjordsgatan22
                                                               SE-164-29 Kista


Copyright 2011 Severalnines AB                              Control your database infrastructure   1
Introduction

       • At Severalnines, we believe in sharing information
         and knowledge; we all come from an open source
         background
       • We know a lot of things about MySQL Cluster and
         think that MySQL Cluster is a great technology
       • These free MySQL Cluster Training slides are a
         contribution of ours to the knowledge and information
         sharing that‟s common practice in the open source
         community
       • If you have any questions on these slides or would
         like to book an actual training class, please contact
         us at: services@severalnines.com

Copyright 2011 Severalnines AB                   Control your database infrastructure   2
Training Slides - Concept

       • Over the coming weeks we will be chronologically
         releasing slides for the different sections of our
         MySQL Cluster Training program on our website.
       • The full agenda of the training with all of its modules
         is outlined in the next slides so that you can see what
         topics will be covered over the coming weeks.
       • Particularly specialised topics such as Cluster/J or
         NDB API are not fully covered in the slides. We
         recommend our instructor-led training classes for
         such topics.
       • Please contact us for more details:
         services@severalnines.com

Copyright 2011 Severalnines AB                    Control your database infrastructure   3
Full Training Agenda (1/4)

       •    MySQL Cluster Introduction
              –   MySQL eco system
              –   Scale up, scale out, and sharding
              –   MySQL Cluster Architecture
              –   Use cases
              –   Features
              –   Node types and Roles
       •    Detailed Concepts
              –   Data Distribution
              –   Verifying data distribution
              –   Access Methods
              –   Partitioning
              –   Node failures and failure detection
              –   Network Partitioning
              –   Transactions and Locking
              –   Consistency Model
              –   Redo logging and Checkpointing



Copyright 2011 Severalnines AB                          Control your database infrastructure   4

Recommended for you

Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...

This document discusses quorum nodes in Spectrum Scale clusters and recovery from failures. It describes how quorum nodes determine the active cluster and prevent partitioning. The document outlines best practices for quorum nodes and provides steps to recover from loss of a quorum node majority or failure of the primary and secondary configuration servers.

Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...

IBM Spectrum Scale can help achieve ILM efficiencies through policy-driven, automated tiered storage management. The ILM toolkit manages file sets and storage pools and automates data management. Storage pools group similar disks and classify storage within a file system. File placement and management policies determine file placement and movement based on rules.

Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdfDatabase & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf

This document discusses mixed workloads and why organizations consolidate servers and databases. It describes how instance caging can be used to partition CPU resources on a server among multiple database instances. Instance caging limits the number of Oracle processes that each database instance can use at one time, providing isolation. The document provides best practices for configuring instance caging and monitoring its throttling effects. It notes there may be additional aspects to consider for governing CPU usage within a consolidated database.

Agenda (2/4)

       •    Installing MySQL Cluster
              –   Setting up MySQL Cluster
              –   Starting/stopping nodes
              –   Recovery and restarts
              –   Upgrading configuration
              –   Upgrading Cluster
       •    Performance Tuning (instructor-led only; contact us at services@severalnines.com)
              –   Differences compared to Innodb/MyISAM
              –   Designing efficient and fast applications
              –   Identifying bottlenecks
              –   Tweaking configuration (OS and MySQL Cluster)
              –   Query Tuning
              –   Schema Design
              –   Index Tuning




Copyright 2011 Severalnines AB                                        Control your database infrastructure   5
Agenda (3/4)

       •    Management and Administration
              –   Backup and Restore
              –   Geographical Replication
              –   Online and offline operations
              –   Ndbinfo tables
              –   Reporting
              –   Single user mode
              –   Scaling Cluster
       •    Disk Data
              –   Use cases
              –   Limitations
              –   Best practice configuration
       •    Designing a Cluster
              –   Capacity Planning and Dimensioning
              –   Hardware recommendations
              –   Best practice Configuration
              –   Storage calculations



Copyright 2011 Severalnines AB                          Control your database infrastructure   6
Agenda (4/4)

       •    Resolving Issues
              –   Common problems
              –   Error logs and Tracefiles
              –   Recovery and Escalation procedures
       •    Connectivity Overview
              –   NDBAPI
              –   Cluster/J
              –   LDAP
       •    Severalnines Tools
              –   Monitoring and Management
              –   Benchmarking
              –   Sandboxes
              –   Configuration and capacity planning
       •    Conclusion




Copyright 2011 Severalnines AB                          Control your database infrastructure   7
Agenda: Lab Exercises
            (only applicable to instructor-led training classes)


       •    Lab Exercises
              –   Installing and Loading data into MySQL Cluster
              –   Starting/stopping nodes, recovery
              –   Query tuning
              –   Backup and Restore
              –   Configuration Upgrade


       •    Would you like to try something particular?
              –   This is possible too, speak with your instructor




Copyright 2011 Severalnines AB                                       Control your database infrastructure   8

Recommended for you

MySQL Cluster Basics
MySQL Cluster BasicsMySQL Cluster Basics
MySQL Cluster Basics

This presentation was written by Wagner Bianchi for the presentation on the Oracle Consulting Team/Professional Services meeting that took place in San Francisco/CA.

mysql cluster ndbd ndb sql mgm management ha engin
Ibm spectrum scale_backup_n_archive_v03_ash
Ibm spectrum scale_backup_n_archive_v03_ashIbm spectrum scale_backup_n_archive_v03_ash
Ibm spectrum scale_backup_n_archive_v03_ash

IBM Spectrum Scale can be used as both the source and destination for backup and archiving. As a source, Spectrum Scale data can be backed up to products like Spectrum Protect, Spectrum Archive, and third-party backup software. As a destination, Spectrum Protect can use Spectrum Scale and ESS storage for storing backed up or archived data, providing scalability, performance, and cost benefits over other solutions. Case studies demonstrate how large enterprises and regional hospital networks have consolidated backup infrastructure and improved availability, capacity, and backup/restore speeds by combining Spectrum Scale and Spectrum Protect.

archivehsmbackup
MySQL Enterprise Backup
MySQL Enterprise BackupMySQL Enterprise Backup
MySQL Enterprise Backup

MySQL Enterprise Backup provides fast, consistent, online backups of MySQL databases. It allows for full and incremental backups, compressed backups to reduce storage needs, and point-in-time recovery. MySQL Enterprise Backup works by backing up InnoDB data files, copying and compressing the files, and backing up the transaction log files from the time period when the data files were copied. This allows for consistent backups and point-in-time recovery of the database.

mysqlbackupmysql enterprise
Prerequisites
       •    Readers / Participants have understanding of SQL and basic database concepts.

       •    Laptops/PCs for hands-on exercises
       •    Linux: 1GB RAM
       •    Windows: 2GB RAM
       •    Approx. 20GB disk space and Virtualbox installed.
       •    Virtualbox can be downloaded for free at http://www.virtualbox.org/wiki/Downloads

       •    MySQL Cluster version 7.1 or later




Copyright 2011 Severalnines AB                                                  Control your database infrastructure   9
Part 2

                      Section 2: Detailed Concepts




Copyright 2011 Severalnines AB               Control your database infrastructure   10
Topics covered in Part 2


     • Data Distribution & Partitioning
     • Two Phase Commit Protocol
     • Transaction Resources




Copyright 2011 Severalnines AB                     Control your database infrastructure   11
Data Distribution and Partitioning




Copyright 2011 Severalnines AB            Control your database infrastructure   12

Recommended for you

Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...

The document provides instructions for installing and configuring Spectrum Scale 4.1. Key steps include: installing Spectrum Scale software on nodes; creating a cluster using mmcrcluster and designating primary/secondary servers; verifying the cluster status with mmlscluster; creating Network Shared Disks (NSDs); and creating a file system. The document also covers licensing, system requirements, and IBM and client responsibilities for installation and maintenance.

MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)

This document discusses optimizing MySQL performance as data and concurrency increase. It covers horizontal and vertical scaling techniques as well as improvements for I/O-bound, CPU-bound, and network-bound workloads. Specific tuning techniques are proposed for areas like replication, query tuning, indexing, and Linux configuration settings like CPU affinity. The goal is to scale the database with minimal infrastructure adjustments to control operational costs.

mysqlinnodbperformance
Spectrum Scale - Diversified analytic solution based on various storage servi...
Spectrum Scale - Diversified analytic solution based on various storage servi...Spectrum Scale - Diversified analytic solution based on various storage servi...
Spectrum Scale - Diversified analytic solution based on various storage servi...

This slides describe diversified analytic solutions based on Spectrum Scale with various deployment mode, such as storage rich-server, share storage, IBM DeepFlash 150 and Elastic Storage Server. It deep dives several advanced data management features and solutions for BD&A workload derived from Spectrum Scale.

spectrum scaleelastic storage serverhdfs transparancy
MySQL Cluster Architecture

                                 Application      Application      Application
                                   R/I/U/D          R/I/U/D          R/I/U/D




   Java, C++, LDAP

   Application
     R/I/U/D
    Native API
                                               DATA         DATA
                                               NODE         NODE
                                                                                             Management
                                                                                              Management
                                                                                               Server
                                               DATA         DATA
                                                                                                 Server
                                               NODE         NODE




Copyright 2011 Severalnines AB                                                   Control your database infrastructure   13
Data Distribution

       • MySQL Cluster automatically partitions tables and
         distributes the data on the partitions.
              – It is possible to use user-defined partitioning.
       • A table is divided into as many partitions as you have
         data nodes and data is “striped” on the partitions.
       • Hashing of the Primary Key determines the Partition
         that should hold the data - automatic distribution.
       • It is possible to hash on part of the primary key –
         great for sharding and locality of data!




Copyright 2011 Severalnines AB                                     Control your database infrastructure   14
Partitioning and Data Distribution
       • With two data nodes, data node 1 and data node 2,
         each table is divided into two Partitions.
       • Subidis the Primary Key.
       • Hashing on the Primary Key (subid) determines the
         Partition. It is also possible to hash on part of the PK.
              – Odd PKs Green
              – Even PKs Red
                                 STORAGE LAYER

                                                   subid   data
                          DATA             DATA
                         NODE 1           NODE 2   1       A                Partition 0
                                                   3       B
                                                   2       C                Partition 1
                           P0               P1     4       D




Copyright 2011 Severalnines AB                                 Control your database infrastructure   15
Replicas
       • To provide for redundancy and fast failover partitions
         are synchronouslyreplicated.
       • Two replicas (two copies of data) is most common
              – it is possible to have one (previous slide), two, three and four
                replicas.
              – NoOfReplicas=2

                                          STORAGE LAYER



                                  DATA                     DATA
                                 NODE 1                   NODE 2




                                  P0                        S0




Copyright 2011 Severalnines AB                                     Control your database infrastructure   16

Recommended for you

Exadata Backup
Exadata BackupExadata Backup
Exadata Backup

This document discusses backup and recovery strategies for Oracle Exadata systems. It outlines the fundamental principles of backups including having multiple copies of data stored on different media with one copy offsite. It then describes the various backup options for Exadata, including using additional Exadata storage cells for the fastest backups, using a ZFS storage appliance for flexibility, or backing up to tape for economical long-term storage with removable offline copies. Key metrics like backup and restore speeds are provided for each option.

oracelbackupexadata
Database as a Service on the Oracle Database Appliance Platform
Database as a Service on the Oracle Database Appliance PlatformDatabase as a Service on the Oracle Database Appliance Platform
Database as a Service on the Oracle Database Appliance Platform

Speaker: Marc Fielding, Co-speaker: Maris Elsins. Oracle Database Appliance provides a robust, highly-available, cost-effective, and surprisingly scalable platform for database as a service environment. By leveraging Oracle Enterprise Manager's self-service features, databases can be provisioned on a self-service basis to a cluster of Oracle Database Appliance machines. Discover how multiple ODA devices can be managed together to provide both high availability and incremental, cost-effective scalability. Hear real-world lessons learned from successful database consolidation implementations.

hardware & storagedbaasoracle database appliance
Intro to GlusterFS Webinar - August 2011
Intro to GlusterFS Webinar - August 2011Intro to GlusterFS Webinar - August 2011
Intro to GlusterFS Webinar - August 2011

In this Introduction to GlusterFS webinar, introduction and review of the GlusterFS architecture and key functionalities. Learn how GlusterFS is deployed in the datacenter, in the cloud, or between the two. We’ll also cover a brief update on GlusterFS v3.3 which is currently in beta.

nasfile systemglusterfs
Replicas
       • To provide for redundancy and fast failover partitions
         are synchronouslyreplicated from a PRIMARY to a
         SECONDARY partition.
              – When a change ( ) is made on P0 it is synchronously
                replicated to S0.
              – The change is persisted at transaction COMMIT.
              – Either both P0 or S0 is update or NOTHING AT ALL
                                          STORAGE LAYER



                                  DATA                     DATA
                                 NODE 1                   NODE 2




                                  P0                        S0




Copyright 2011 Severalnines AB                                     Control your database infrastructure   17
Data Distribution - disk logging

       • After the COMMIT, the data is in main memory.
              – But changes are REDO LOGGED, but the REDO LOG is
                synced to disk every xth ms (1000 ms is recommended).
                     • Controlled by TimeBetweenGlobalCheckpoints
                     • Similar to innodb-flush-log-at-trx_commit=2
              – The data is also checkpointed to disk.
                     • More on this later.
       • The disk logging makes it possible to recovery a
         completely failed cluster.




Copyright 2011 Severalnines AB                                   Control your database infrastructure   18
Replicas
       • To provide for redundancy and fast failover partitions
         are synchronouslyreplicated.
       • Two replicas (two copies of data) is most common
              – it is possible to have one (previous slide), two, three and four
                replicas.
              – NoOfReplicas=2
                             STORAGE LAYER

                                                    subid     data
                          DATA          DATA
                         NODE 1        NODE 2       1         A                  Partition 0
                                                    3         B
                                                    2         C                  Partition 1
                           P0           P1
                                                    4         D
                           S1           S0

                                                    Px == PRIMARY Partition x
                                                    Sx == SECONDARY Partition x


Copyright 2011 Severalnines AB                                       Control your database infrastructure   19
Node groups

       • Data Nodes sharing the same data data belongs to a
         node group.
       • A node group contains as many nodes as you have
         replicas (NoOfReplicas=2 is used in the picture
         below).
                             STORAGE LAYER

                                                         subid    data
                          DATA                   DATA
                         NODE 1                 NODE 2   1        A                  Partition 0
                                                         3        B
                                                         2        C                  Partition 1
                           P0                    P1
                                                         4        D
                           S1                    S0

                                 Node group 0            Px == PRIMARY Partition x
                                                         Sx == SECONDARY Parttionx


Copyright 2011 Severalnines AB                                           Control your database infrastructure   20

Recommended for you

Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS StorageWebinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage

Gluster has partnered with Redapt, Inc., an innovative data center architecture and infrastructure solutions provider, to integrate GlusterFS with hardware providing customers with highly-scalable NAS storage technology for on-premise, virtual and cloud environments. Gluster's storage technology enables Redapt to offer a comprehensive, cost-effective storage solution delivering the scalability, performance and reliability that companies need to effectively run their data centers. This webinar will provide an overview of the partnership, benefits of the joint solution, and include use cases of how customers today are deploying the joint solution. .

nasfile systemglusterfs
Best Practices of HA and Replication of PostgreSQL in Virtualized Environments
Best Practices of HA and Replication of PostgreSQL in Virtualized EnvironmentsBest Practices of HA and Replication of PostgreSQL in Virtualized Environments
Best Practices of HA and Replication of PostgreSQL in Virtualized Environments

This document discusses best practices for high availability (HA) and replication of PostgreSQL databases in virtualized environments. It covers enterprise needs for HA, technologies like VMware HA and replication that can provide HA, and deployment blueprints for HA, read scaling, and disaster recovery within and across datacenters. The document also discusses PostgreSQL's different replication modes and how they can be used for HA, read scaling, and disaster recovery.

postgresql
Best Practices for Becoming an Exceptional Postgres DBA
Best Practices for Becoming an Exceptional Postgres DBA Best Practices for Becoming an Exceptional Postgres DBA
Best Practices for Becoming an Exceptional Postgres DBA

Drawing from our teams who support hundreds of Postgres instances and production database systems for customers worldwide, this presentation provides real-real best practices from the nation's top DBAs. Learn top-notch monitoring and maintenance practices, get resource planning advice that can help prevent, resolve, or eliminate common issues, learning top database tuning tricks for increasing system performance and ultimately, gain greater insight into how to improve your effectiveness as a DBA.

 
by EDB
performance tuningenterprisedbdba
Two Replicas – Four Data Nodes

       • Four data nodes – four partitions – two replicas
       • Four data nodes and two replicas  two node groups
               – No of node groups = #data nodes / #replicas

                                    STORAGE LAYER                          subid          data
                                                                           1              A
                                                                                                          Partition 0
                                                                           2              B
        DATA                      DATA        DATA                 DATA
       NODE 1                    NODE 2      NODE 3               NODE 4   3              C
                                                                                                          Partition 1
                                                                           4              D

          P0                      P1          P2                   P3      5              E
                                                                                                          Partition 2
                                                                           6              F
          S1                      S0          S3                   S2
                                                                           7              G
                                                                                                          Partition 3
               Node group 0                        Node group 1            8              H


                                                                           Px == PRIMARY Partition x
                                                                           Sx == SECONDARY Parttionx


Copyright 2011 Severalnines AB                                                 Control your database infrastructure     21
Three Replicas – Three Data Nodes

       • Three data nodes – Three partitions
              – More replicas gives slower writes.
       • Three data nodes and three replicas  one node
         group. This is not common.
              – Two replicas is common practice/best practice
                          STORAGE LAYER

              DATA                    DATA       DATA      subid     data
             NODE 1                  NODE 2     NODE 3
                                                           1         A               Partition 0
                                                           2         B
               P0                     P1         P2        3         C               Partition 1
               S1                     S0         S0        4         D
               S2                      S2        S1        5         E                Partition
                                                           6         F                   2
                                 Node group 0
                                                         Px == PRIMARY Partition x
                                                         Sx == SECONDARY
                                                         Parttionx
Copyright 2011 Severalnines AB                                   Control your database infrastructure   22
Recommendations

       • Two Replicas recommended - gives best tradeoff
         between Performance and Availability
       • Three Replicas (or Four) will give slower writes (, is
         less tested (not so many deployments), and less
         deployments are made with this.
       • Cost of write (approx)
              – 1 replica (no redundancy): cost X
              – 2 replicas: cost 2X
              – 3 replicas: cost 3X




Copyright 2011 Severalnines AB                      Control your database infrastructure   23
Verifying Data Distribution

       • A helper program called ndb_desc shows how many
         records are in each partition:
       ndb_desc –c<mgmt_host:1186> –d<database>
         -p<tablename>




Copyright 2011 Severalnines AB                  Control your database infrastructure   24

Recommended for you

PostgreSQL and Benchmarks
PostgreSQL and BenchmarksPostgreSQL and Benchmarks
PostgreSQL and Benchmarks

The document summarizes several industry standard benchmarks for measuring database and application server performance including SPECjAppServer2004, EAStress2004, TPC-E, and TPC-H. It discusses PostgreSQL's performance on these benchmarks and key configuration parameters used. There is room for improvement in PostgreSQL's performance on TPC-E, while SPECjAppServer2004 and EAStress2004 show good performance. TPC-H performance requires further optimization of indexes and query plans.

postgresqlperformancebenchmarks
IBM Spectrum Scale for File and Object Storage
IBM Spectrum Scale for File and Object StorageIBM Spectrum Scale for File and Object Storage
IBM Spectrum Scale for File and Object Storage

This document provides information about a technical university presentation on IBM Spectrum Scale for file and object storage given by Tony Pearson. The presentation schedule lists topics such as software defined storage, converged and hyperconverged environments, big data architectures, and IBM storage integration with OpenStack. The document discusses challenges of islands of block, file, and object level data and how IBM Spectrum Scale provides a single global namespace and universal data access across various protocols. It describes features of IBM Spectrum Scale such as extreme scalability, high performance, reliability, and supported topologies.

spectrum storageibmgpfs
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql ClusterSanto Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster

tail -f /var/log/mysql/ndb_node_id_cluster.log § MySQL Error Log:

Two Phase Commit Protocol




Copyright 2011 Severalnines AB              Control your database infrastructure   25
View of the Data Node

       •     Each node has as active Transaction Coordinator
            (TC).
              – Every Transaction starts at the TC
              – One transaction consists of one or more Operations.
                     • Operation is SELECT, INSERT, UPDATE, DELETE
       • Each node has 1-4 Local Query Handlers (LQH)
              – Executes the operations
                                                                       TC
       • ACCess stores a hash table
                                                                      LQH
              – Primary Key and Unique
       • TUPle stores data records                      ACC                            TUP


              – ACC hash index links to record in TUP



Copyright 2011 Severalnines AB                                Control your database infrastructure   26
Two Phase Commit Protocol

       • 2PC facilitates the synchronous replication
              – To safeguard that both Primary and Secondary Partitions are
                modified in a Consistent Way
              – Locking (Row level)
       • 2PC consists of two phases
              – Prepare Phase
                     • Grab locks
                     • Make a update to a shadow copy
              – Commit Phase
                     • Make the shadow copy the real copy
                     • Release locks
       • 2PC protocol is only involved in
              – Update, Delete, Insert
       • Reads are not 2PC (would be very slow and
         pointless)
Copyright 2011 Severalnines AB                              Control your database infrastructure   27
Two Phase Commit Protocol

       • INSERT INTO t1(id, data) VALUES (1, „hello‟)
              – Two data nodes - PK hashes to Primary P0.
              – The same applies to UPDATES and DELETEs

                             TC                                    TC




                            LQH                                   LQH




              ACC                        TUP           ACC                            TUP
                       P0                      P0            S0                                 S0




          IndexMemory                 DataMemory    IndexMemory            DataMemory
                        DATA NODE 1                            DATA NODE 2
Copyright 2011 Severalnines AB                                    Control your database infrastructure   28

Recommended for you

Cloud Computing & Scaling Web Apps
Cloud Computing & Scaling Web AppsCloud Computing & Scaling Web Apps
Cloud Computing & Scaling Web Apps

The presentation discussed moving applications to the cloud for scalability, flexibility and pay-as-you-go pricing, noting key differences between RSAWEBCloud and AWS; challenges for developers include optimizing applications for production environments and handling scaling which requires separating concerns like data types and using caching, load balancing, and autoscaling tools.

web application developmenthostingscalability
Oracle my sql cluster cge
Oracle my sql cluster cgeOracle my sql cluster cge
Oracle my sql cluster cge

MySQL Cluster Carrier Grade Edition is a high availability, distributed database solution based on MySQL Cluster. It provides real-time performance with 99.999% uptime through a shared-nothing architecture across up to 255 nodes. Key applications include high-traffic ecommerce sites, telecom subscriber databases, and other systems requiring high scalability and availability.

Handling Massive Writes
Handling Massive WritesHandling Massive Writes
Handling Massive Writes

This document discusses handling massive writes for online transaction processing (OLTP) systems. It begins with an introduction and overview of the topics to be covered, including terminology, differences between massive reads versus writes, and potential solutions using relational databases, NoSQL databases, and code optimizations. Specific solutions discussed for massive writes include using memory, fast disks, caching, column-oriented databases, SQL tuning, database partitioning, reading from slaves, and sharding or splitting data across multiple databases. The document provides pros and cons of each approach and examples of performance improvements observed.

mongodbhibernatemysql
Phase 1 - Prepare Phase

       • INSERT INTO t1(id, data) VALUES (1, „hello‟)
       • The protocol starts at the TC that has the Primary
         Partition for the PK
                             TC                                    TC




                            LQH                                   LQH




              ACC                        TUP           ACC                            TUP
                       P0                      P0            S0                                 S0




          IndexMemory                 DataMemory    IndexMemory            DataMemory
                        DATA NODE 1                            DATA NODE 2
Copyright 2011 Severalnines AB                                    Control your database infrastructure   29
Phase 1 - Prepare Phase

       • TC starts by calculating a hash (md5sum) on the
         Entire Primary key.
              – md5sum(PK)
              – This gives 128 bit hash value, divided up in 2 x 64-bit
                                 INDEX_HASH        PARTITION_HASH
              – Actually further calculations are made
                     • PARTITION= PARTITION_HASH % NO_OF_PARTITIONS
                     • INDEX_POS=INDEX_HASH % NO_OF_BUCKETS
              – LH*3 Algorithm is what is really being used.
       • Now MySQL Cluster will know what nodes and
         partitions are involved.
       • INSERT INTO t1(id, data) VALUES (1, „hello‟)
              – INDEX_POS=23
              – PARTITION=P0

Copyright 2011 Severalnines AB                                 Control your database infrastructure   30
Phase 1 - Prepare Phase

       • INSERT INTO t1(id, data) VALUES (1, „hello‟)
       • Prepare on the local LQH


                             TC                                    TC




                            LQH                                   LQH




              ACC                        TUP           ACC                            TUP
                       P0                      P0            S0                                 S0




          IndexMemory                 DataMemory    IndexMemory            DataMemory
                        DATA NODE 1                            DATA NODE 2
Copyright 2011 Severalnines AB                                    Control your database infrastructure   31
Phase 1 - Prepare Phase

         • Insert into the hash table in ACC and write record in
           TUP (allocate space for the record).
                – The Index Entry is locked now

                               TC                                          TC

                                    PREPARE


                              LQH                                         LQH




                ACC                           TUP              ACC                            TUP
                         P0                            P0            S0                                 S0
                                          1    hello

POS=23


            IndexMemory                  DataMemory         IndexMemory            DataMemory
                          DATA NODE 1                                  DATA NODE 2
  Copyright 2011 Severalnines AB                                          Control your database infrastructure   32

Recommended for you

MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 Updates

This document provides an overview and summary of updates and new features in MySQL 5.6: - MySQL 5.6 improves performance, scalability, instrumentation, transactional throughput, availability, and flexibility compared to previous versions. - Key areas of focus include improvements to InnoDB for transactional workloads, replication for high availability and data integrity, and the optimizer for better performance and diagnostics. - New features in MySQL 5.6 include enhanced replication utilities for high availability, improved subquery and index optimizations in the query optimizer, and expanded performance schema instrumentation for database profiling.

Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014

The document discusses Oracle MySQL Enterprise Edition. It provides an overview of Oracle's investment and innovation in the MySQL ecosystem over the past 5 years. It then covers various features and components of MySQL Enterprise Edition including replication, storage engines, scalability, high availability, security, monitoring, backup and integration with Oracle technologies.

mysqloracleopen source software
02 -my_sql_roma-may2011
02  -my_sql_roma-may201102  -my_sql_roma-may2011
02 -my_sql_roma-may2011

The document discusses MySQL Enterprise Monitor, a tool that provides centralized monitoring of MySQL environments. It allows users to get a single consolidated view of an entire MySQL infrastructure, including automated monitoring, alerts, query analysis, and visualizations. It also features integrated replication monitoring, security advisors to detect issues, and integration with support to help troubleshoot problems. The goal is to help DBAs more easily manage MySQL performance, scale their work, and spend less time on tasks like writing custom monitoring scripts.

Phase 1 - Prepare Phase

       • Send PREPARE message to the other LQH for the
         secondary Partition (S0), and do exactly the same
         thing.

                             TC                                                    TC

                                  PREPARE

                                                          PREPARE
                            LQH                                                   LQH




              ACC                           TUP                        ACC                              TUP
                       P0                            P0                      S0                                  S0
                                        1    hello                                                  1    hello




          IndexMemory                  DataMemory                   IndexMemory            DataMemory
                        DATA NODE 1                                            DATA NODE 2
Copyright 2011 Severalnines AB                                                    Control your database infrastructure   33
Phase 1 - Prepare Phase

       • Send back PREPARE OK to TC



                             TC                   PREPARE OK                       TC

                                  PREPARE

                                                          PREPARE
                            LQH                                                   LQH




              ACC                           TUP                        ACC                              TUP
                       P0                            P0                      S0                                  S0
                                        1    hello                                                  1    hello




          IndexMemory                  DataMemory                   IndexMemory            DataMemory
                        DATA NODE 1                                            DATA NODE 2
Copyright 2011 Severalnines AB                                                    Control your database infrastructure   34
Phase 2 - Commit Phase

       • Send COMMIT message to REMOTE LQH first
              – Release locks, simplifies error handling, ops waiting on lock
                can resume faster.

                             TC                  COMMIT                  TC




                            LQH                                         LQH




              ACC                          TUP               ACC                              TUP
                       P0                           P0             S0                                  S0
                                       1    hello                                         1    hello




          IndexMemory                 DataMemory          IndexMemory            DataMemory
                        DATA NODE 1                                  DATA NODE 2
Copyright 2011 Severalnines AB                                          Control your database infrastructure   35
Phase 2 - Commit Phase

       • Send COMMIT to LQH of P0
              – Release locks


                             TC                  COMMIT                     TC



                                                    COMMIT
                            LQH                                            LQH




              ACC                          TUP                  ACC                              TUP
                       P0                           P0                S0                                  S0
                                       1    hello                                            1    hello




          IndexMemory                 DataMemory             IndexMemory            DataMemory
                        DATA NODE 1                                     DATA NODE 2
Copyright 2011 Severalnines AB                                             Control your database infrastructure   36

Recommended for you

MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAs

The objective of this presentation is to give Oracle DBAs the necessary background information to understand what is doable with MySQL and how to integrate MySQL instances into the Oracle world.

dbabackuporacle
Fb talk arch_summit
Fb talk arch_summitFb talk arch_summit
Fb talk arch_summit

The document describes the evolution of Facebook's big data architectures from 2007 to 2011. It started with a traditional data warehouse using MySQL and grew significantly over time. Facebook moved to Hadoop and Hive in 2008 to enable data science at scale and store all data online. In 2009, they further democratized data with tools to make it accessible. Later improvements focused on isolation, efficiency, utilization and monitoring to control the growing chaos. By 2011, they developed Puma for real-time analytics and Peregrine for fast queries to go beyond Hadoop.

Lessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Lessons Learned: Novell Open Enterprise Server Upgrades Made EasyLessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Lessons Learned: Novell Open Enterprise Server Upgrades Made Easy

You've read the documentation, played in the lab, and now you're ready to jump in and upgrade your NetWare environment to Novell Open Enterprise Server 2 on Linux. Attend this session to glean a final few best practices and to learn how to make the most of the migration tools included in the product. You'll also learn about the various pitfalls encountered during real-world upgrades, as well as the solutions used to resolve them.

Phase 2 - Commit Phase

       • Send COMMIT OK to TC



                             TC                    COMMIT                     TC

                                 COMMIT OK
                                                      COMMIT
                            LQH                                              LQH




              ACC                            TUP                  ACC                              TUP
                       P0                             P0                S0                                  S0
                                        1     hello                                            1    hello




          IndexMemory                  DataMemory              IndexMemory            DataMemory
                        DATA NODE 1                                       DATA NODE 2
Copyright 2011 Severalnines AB                                               Control your database infrastructure   37
Phase 2 - Commit Phase

       • Send COMMIT ACK to application


                                 COMMIT ACK


                             TC                    COMMIT                     TC

                                 COMMIT OK
                                                      COMMIT
                            LQH                                              LQH




              ACC                            TUP                  ACC                              TUP
                       P0                             P0                S0                                  S0
                                        1     hello                                            1    hello




          IndexMemory                  DataMemory              IndexMemory            DataMemory
                        DATA NODE 1                                       DATA NODE 2
Copyright 2011 Severalnines AB                                               Control your database infrastructure   38
Failure Handling

       • If the Transaction Coordinator fails another TC will
         take over.
       • The new TC will ask the nodes “Send me a list of
         outstanding transactions from the failed TC”
       • The new TC will
              – ABORT transactions in the Prepare Phase
              – Force COMMIT of transactions IFF another node has seen a
                COMMIT message.
                     • The Node that has failed will get the changes when it recovers.




Copyright 2011 Severalnines AB                                       Control your database infrastructure   39
Transaction Timers

       • Deadlock detection – waiting for lock
              – If a transaction is waiting too long time for a lock it is aborted
                     • TransactionDeadLockDetectionTimeout=3000 [ms]
       • Inactive Transactions – holding a lock
              – If a transaction is holding a lock too long it is aborted
                     • TransactionInactiveTimeout=60000 [ms]
              – Never set TransactioInactiveTimeout=0




Copyright 2011 Severalnines AB                                   Control your database infrastructure   40

Recommended for you

MySQL Intro JSON NoSQL
MySQL Intro JSON NoSQLMySQL Intro JSON NoSQL
MySQL Intro JSON NoSQL

This document provides an overview of MySQL and how to get the most out of it. It discusses when MySQL is a good choice, how to scale MySQL for different use cases, and how to ensure high availability and performance. It also covers MySQL Fabric for sharding and high availability, and new features in MySQL like support for JSON and key-value stores. The presentation aims to help users understand how to choose and optimize MySQL for their needs.

mysqljsonnosql
Novell File Management Suite Use Cases
Novell File Management Suite Use CasesNovell File Management Suite Use Cases
Novell File Management Suite Use Cases

The Novell File Management Suite is a solution that helps organizations intelligently manage file storage using identity-driven policies. It utilizes Novell Storage Manager to automate storage policies connected to user identity, Novell File Reporter for file discovery and reporting, and Novell Dynamic File Services for auto-tiering of data without impacting users. The suite helps control storage costs, understand data better, automate administration, and unlock hidden value in file systems.

Novell File Management Suite Use Cases
Novell File Management Suite Use CasesNovell File Management Suite Use Cases
Novell File Management Suite Use Cases

The new Novell File Management Suite is drawing accolades from customers, analysts and industry watchers alike. This session will help you dive in and see exactly what the product can do for your organization. We'll focus on the product's capabilities and its many use cases. We'll also explore the way it can help you better understand your organization's storage usage and give you the tools to begin automating the management of storage resources.

Locking

       • Committed Read Isolation level is used
       • This means that a transaction
              – Will read last committed data unless it has itself modified this
                data.
       • Locks are acquired in the Prepare Phase and
         released in the Commit Phase.




Copyright 2011 Severalnines AB                                 Control your database infrastructure   41
Transaction Resources




Copyright 2011 Severalnines AB                      Control your database infrastructure   42
Transaction and Operation Records

       • Each transaction requires on Transaction Record
         (TR)
              – When it was started
              – Controlled by MaxNoOfConcurrentTransactions
       • Also each Operation requires one Operation Record
         (OR) in TC and one Local Operation Record (LOR)
         in LQH
              –   What transaction it belongs to
              –   Operation Type
              –   Controlled by MaxNoOfConcurrentOperations
              –   and MaxNoOfLocalOperations



Copyright 2011 Severalnines AB                            Control your database infrastructure   43
Transaction and Operation Records

       • Assume
              – MaxNoOfConcurrentTransactions=3
              – MaxNoOfConcurrentOperations=3
              – MaxNoOfLocalOperations=4
                     • By default there are 10% more Local Ops than Conc Ops.
       • Query
              – INSERT INTO t1 (id,data) VALUES(1,‟x‟);
                     • One transaction
                     • One operation




Copyright 2011 Severalnines AB                                   Control your database infrastructure   44

Recommended for you

Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...

The document discusses NoSQL, NewSQL, and other database technologies that are emerging to address limitations of relational databases in scaling to meet demands for performance, availability, and flexibility. It provides an overview of different categories of NoSQL databases and NewSQL solutions, and analyzes drivers like scalability, performance, relaxed consistency, agility, and complexity of data that are contributing to adoption of these new database approaches.

cassandraeuapache cassandracassandra
Storage Systems For Scalable systems
Storage Systems For Scalable systemsStorage Systems For Scalable systems
Storage Systems For Scalable systems

Haytham ElFadeel presented on next-generation storage systems and key-value stores. He began with an overview of scalable systems and the need for both vertical and horizontal scalability. He discussed the limitations of traditional databases in scaling, including complexity, wasted features, and multi-step query processing. Key-value stores were presented as an alternative, offering simple interfaces and designs optimized for scaling across hundreds of machines. Performance comparisons showed key-value stores significantly outperforming databases. Systems discussed included Amazon Dynamo, Facebook Cassandra, and Redis.

databasescaling
MySQL高可用
MySQL高可用MySQL高可用
MySQL高可用

This document discusses MySQL high availability. It begins with some questions to consider regarding high availability needs. It then covers key high availability concepts and terms. The main part describes various MySQL high availability solutions, including replication, clustering, heartbeat with replication, DRBD with replication, and shared storage with clustering agents. It concludes by mentioning some additional solutions and resources for MySQL high availability.

mongodbmysqlthinkinginlamp
Transaction Starts (prepare phase)

       • INSERT INTO t1 (id,data) VALUES(1,‟x‟);



TR
                                     TC                                          TC
OR
                                      PREPARE

                                                        PREPARE
LOR                                 LQH                                         LQH                                    LOR




                    ACC                           TUP                ACC                            TUP
                             P0                         P0                 S0                                 S0




                IndexMemory                    DataMemory         IndexMemory            DataMemory
                                 DATA NODE 1                                 DATA NODE 2
Copyright 2011 Severalnines AB                                                  Control your database infrastructure    45
Transaction Starts (prepare phase)

       • Allocate a Transaction Record at TC



TR
                                     TC                                          TC
OR
                                      PREPARE

                                                        PREPARE
LOR                                 LQH                                         LQH                                    LOR




                    ACC                           TUP                ACC                            TUP
                             P0                         P0                 S0                                 S0




                IndexMemory                    DataMemory         IndexMemory            DataMemory
                                 DATA NODE 1                                 DATA NODE 2
Copyright 2011 Severalnines AB                                                  Control your database infrastructure    46
Transaction Starts (prepare phase)

       • Allocate a Operation Record at TC



TR
                                     TC                                          TC
OR
                                      PREPARE

                                                        PREPARE
LOR                                 LQH                                         LQH                                    LOR




                    ACC                           TUP                ACC                            TUP
                             P0                         P0                 S0                                 S0




                IndexMemory                    DataMemory         IndexMemory            DataMemory
                                 DATA NODE 1                                 DATA NODE 2
Copyright 2011 Severalnines AB                                                  Control your database infrastructure    47
Transaction Starts (prepare phase)

       • Allocate a Local Operation Record at LQH



TR
                                     TC                                          TC
OR
                                      PREPARE

                                                        PREPARE
LOR                                 LQH                                         LQH                                    LOR




                    ACC                           TUP                ACC                            TUP
                             P0                         P0                 S0                                 S0




                IndexMemory                    DataMemory         IndexMemory            DataMemory
                                 DATA NODE 1                                 DATA NODE 2
Copyright 2011 Severalnines AB                                                  Control your database infrastructure    48

Recommended for you

Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...

See how the popular Novell Storage Manager can help you manage file storage and user administration like never before. Leveraging user identities and roles, you can customize policies based on your business rules, thereby automating redundant tasks and reducing the heavy manual effort typically required for file management. Attend this session to hear from the experts on architecture, deployment patterns and how to get the most bang for your buck!

Oracle to MySQL 2012
Oracle to MySQL  2012 Oracle to MySQL  2012
Oracle to MySQL 2012

Pythian is a recognized leader in database administration and consulting services for Oracle, MySQL, and SQL Server. They employ over 7 Oracle ACEs and have expertise managing complex database deployments for over 165 companies globally. Pythian provides 24/7 remote DBA support and consulting services to help customers with database administration, systems administration, projects, and emergency response.

mysql oracle migration
Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015

Avi Jain has over 3 years of experience in IT with expertise in database administration, software development, big data analytics, and virtualization. He has worked extensively with Oracle, MySQL, MongoDB, and other databases. Notable projects include developing a music recommendation engine using Mahout on Hadoop, building a distributed service using Zookeeper, and designing virtual machine disaster recovery and power management systems on VMware. Avi holds an MS in Software Engineering from San Jose State University and seeks new opportunities as a database administrator or big data engineer.

Transaction Starts (prepare phase)

       • With many parallel transactions



TR                                                                                                    TR
                                     TC                                          TC
OR                                                                                                    OR
                                      PREPARE

                                                        PREPARE
LOR                                 LQH                                         LQH                                    LOR




                    ACC                           TUP                ACC                            TUP
                             P0                         P0                 S0                                 S0




                IndexMemory                    DataMemory         IndexMemory            DataMemory
                                 DATA NODE 1                                 DATA NODE 2
Copyright 2011 Severalnines AB                                                  Control your database infrastructure    49
Transaction Starts (prepare phase)

       • Wrongly dimensioned for failover
       • Not enough TRs / ORs

TR                                                                                                     TR
                                    TC                                           TC
OR                                                                                                     OR
                                         PREPARE

                                                         PREPARE
LOR                                LQH                                           LQH             LOR




                    ACC                            TUP                ACC                            TUP
                             P0                          P0                 S0                                 S0




                IndexMemory                    DataMemory          IndexMemory            DataMemory
                                 DATA NODE 1                                  DATA NODE 2
Copyright 2011 Severalnines AB                                                   Control your database infrastructure   50
Transaction and Operation Records

       • Define
              – MaxNoOfConcurrentTransactions= 2 x<max_threads>
              – MaxNoOfConcurrentOperations=
                MaxConcurrentTransactionsx<ops in trans>
              – MaxNoOfLocalOperations=1.1 x
                MaxNoOfConcurrentOperations
                     • 1.1x is by default
                     • Seldom needed to change this.




Copyright 2011 Severalnines AB                         Control your database infrastructure   51
Coming next in Part 3:

                                  Detailed Concepts

                                     Access Methods
                             Redo Logging and Check-pointing
                                         Recovery
                             Node Failures and Error Detection
                                   Network Partitioning


Copyright 2011 Severalnines AB                             Control your database infrastructure   52

Recommended for you

Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015

Avi Jain has over 3 years of experience in IT with expertise in database administration, software development, big data analytics, and virtualization. He has worked extensively with Oracle, MySQL, MongoDB, and other databases. Notable projects include developing a music recommendation engine using Mahout on Hadoop, building a distributed service using Zookeeper, and designing virtual machine disaster recovery systems on VMware. Avi holds an MS in Software Engineering from San Jose State University and seeks new opportunities as a database administrator or big data engineer.

WEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service ProvidersWEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service Providers

Browse the slides from our recent webinar hosted by Divine Odazie, our tech evangelist.

cloudccxcloud services
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solutionLIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution

This webinar aims to equip Cloud Service Providers (CSPs) with the knowledge and tools to differentiate themselves from hyperscalers by offering a Database-as-a-Service (DBaaS) solution. The session will introduce and demonstrate CCX, a drop-in, premium DBaaS designed for rapid adoption. Learn more about CCX for CSPs here: https://bit.ly/3VabiDr

ccxcloudcloud service providers
We hope these training slides are
                        useful to you!

            Please visit our website to view the
               next section of this training.

       For any questions, comments, feedback or to
        book a training class, please contact us at:

                        services@severalnines.com

                                 Thank you!

Copyright 2011 Severalnines AB                Control your database infrastructure   53
Disclaimer

 © Copyright 2011 Severalnines AB. All rights reserved.

 Severalnines& the Severalnineslogo(s) are trademarks of Severalnines AB.

 MySQL is a registered trademark of Oracle and/or its affiliates.

 Other names may be trademarks of their respective owners.




Copyright 2011 Severalnines AB                           Control your database infrastructure   54

More Related Content

What's hot

Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
xKinAnx
 
MySQL :What's New #GIDS16
MySQL :What's New #GIDS16MySQL :What's New #GIDS16
MySQL :What's New #GIDS16
Sanjay Manwani
 
MySQL Performance Tuning
MySQL Performance TuningMySQL Performance Tuning
MySQL Performance Tuning
FromDual GmbH
 
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
xKinAnx
 
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
xKinAnx
 
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdfDatabase & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
InSync2011
 
MySQL Cluster Basics
MySQL Cluster BasicsMySQL Cluster Basics
MySQL Cluster Basics
Wagner Bianchi
 
Ibm spectrum scale_backup_n_archive_v03_ash
Ibm spectrum scale_backup_n_archive_v03_ashIbm spectrum scale_backup_n_archive_v03_ash
Ibm spectrum scale_backup_n_archive_v03_ash
Ashutosh Mate
 
MySQL Enterprise Backup
MySQL Enterprise BackupMySQL Enterprise Backup
MySQL Enterprise Backup
Mario Beck
 
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
xKinAnx
 
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
Mirko Ortensi
 
Spectrum Scale - Diversified analytic solution based on various storage servi...
Spectrum Scale - Diversified analytic solution based on various storage servi...Spectrum Scale - Diversified analytic solution based on various storage servi...
Spectrum Scale - Diversified analytic solution based on various storage servi...
Wei Gong
 
Exadata Backup
Exadata BackupExadata Backup
Exadata Backup
Fran Navarro
 
Database as a Service on the Oracle Database Appliance Platform
Database as a Service on the Oracle Database Appliance PlatformDatabase as a Service on the Oracle Database Appliance Platform
Database as a Service on the Oracle Database Appliance Platform
Maris Elsins
 
Intro to GlusterFS Webinar - August 2011
Intro to GlusterFS Webinar - August 2011Intro to GlusterFS Webinar - August 2011
Intro to GlusterFS Webinar - August 2011
GlusterFS
 
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS StorageWebinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
GlusterFS
 
Best Practices of HA and Replication of PostgreSQL in Virtualized Environments
Best Practices of HA and Replication of PostgreSQL in Virtualized EnvironmentsBest Practices of HA and Replication of PostgreSQL in Virtualized Environments
Best Practices of HA and Replication of PostgreSQL in Virtualized Environments
Jignesh Shah
 
Best Practices for Becoming an Exceptional Postgres DBA
Best Practices for Becoming an Exceptional Postgres DBA Best Practices for Becoming an Exceptional Postgres DBA
Best Practices for Becoming an Exceptional Postgres DBA
EDB
 
PostgreSQL and Benchmarks
PostgreSQL and BenchmarksPostgreSQL and Benchmarks
PostgreSQL and Benchmarks
Jignesh Shah
 
IBM Spectrum Scale for File and Object Storage
IBM Spectrum Scale for File and Object StorageIBM Spectrum Scale for File and Object Storage
IBM Spectrum Scale for File and Object Storage
Tony Pearson
 

What's hot (20)

Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
Ibm spectrum scale fundamentals workshop for americas part 5 ess gnr-usecases...
 
MySQL :What's New #GIDS16
MySQL :What's New #GIDS16MySQL :What's New #GIDS16
MySQL :What's New #GIDS16
 
MySQL Performance Tuning
MySQL Performance TuningMySQL Performance Tuning
MySQL Performance Tuning
 
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
Ibm spectrum scale fundamentals workshop for americas part 2 IBM Spectrum Sca...
 
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
Ibm spectrum scale fundamentals workshop for americas part 3 Information Life...
 
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdfDatabase & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
Database & Technology 2 _ Marting Lambert _ Mixed Workloads Why and How.pdf
 
MySQL Cluster Basics
MySQL Cluster BasicsMySQL Cluster Basics
MySQL Cluster Basics
 
Ibm spectrum scale_backup_n_archive_v03_ash
Ibm spectrum scale_backup_n_archive_v03_ashIbm spectrum scale_backup_n_archive_v03_ash
Ibm spectrum scale_backup_n_archive_v03_ash
 
MySQL Enterprise Backup
MySQL Enterprise BackupMySQL Enterprise Backup
MySQL Enterprise Backup
 
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
Ibm spectrum scale fundamentals workshop for americas part 1 components archi...
 
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
 
Spectrum Scale - Diversified analytic solution based on various storage servi...
Spectrum Scale - Diversified analytic solution based on various storage servi...Spectrum Scale - Diversified analytic solution based on various storage servi...
Spectrum Scale - Diversified analytic solution based on various storage servi...
 
Exadata Backup
Exadata BackupExadata Backup
Exadata Backup
 
Database as a Service on the Oracle Database Appliance Platform
Database as a Service on the Oracle Database Appliance PlatformDatabase as a Service on the Oracle Database Appliance Platform
Database as a Service on the Oracle Database Appliance Platform
 
Intro to GlusterFS Webinar - August 2011
Intro to GlusterFS Webinar - August 2011Intro to GlusterFS Webinar - August 2011
Intro to GlusterFS Webinar - August 2011
 
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS StorageWebinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
Webinar Sept 22: Gluster Partners with Redapt to Deliver Scale-Out NAS Storage
 
Best Practices of HA and Replication of PostgreSQL in Virtualized Environments
Best Practices of HA and Replication of PostgreSQL in Virtualized EnvironmentsBest Practices of HA and Replication of PostgreSQL in Virtualized Environments
Best Practices of HA and Replication of PostgreSQL in Virtualized Environments
 
Best Practices for Becoming an Exceptional Postgres DBA
Best Practices for Becoming an Exceptional Postgres DBA Best Practices for Becoming an Exceptional Postgres DBA
Best Practices for Becoming an Exceptional Postgres DBA
 
PostgreSQL and Benchmarks
PostgreSQL and BenchmarksPostgreSQL and Benchmarks
PostgreSQL and Benchmarks
 
IBM Spectrum Scale for File and Object Storage
IBM Spectrum Scale for File and Object StorageIBM Spectrum Scale for File and Object Storage
IBM Spectrum Scale for File and Object Storage
 

Similar to Severalnines Self-Training: MySQL® Cluster - Part II

Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql ClusterSanto Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto
 
Cloud Computing & Scaling Web Apps
Cloud Computing & Scaling Web AppsCloud Computing & Scaling Web Apps
Cloud Computing & Scaling Web Apps
Mark Slingsby
 
Oracle my sql cluster cge
Oracle my sql cluster cgeOracle my sql cluster cge
Oracle my sql cluster cge
seungdon1
 
Handling Massive Writes
Handling Massive WritesHandling Massive Writes
Handling Massive Writes
Liran Zelkha
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 Updates
Dave Stokes
 
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Manuel Contreras
 
02 -my_sql_roma-may2011
02  -my_sql_roma-may201102  -my_sql_roma-may2011
02 -my_sql_roma-may2011
testfank
 
MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAs
Mario Beck
 
Fb talk arch_summit
Fb talk arch_summitFb talk arch_summit
Fb talk arch_summit
drewz lin
 
Lessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Lessons Learned: Novell Open Enterprise Server Upgrades Made EasyLessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Lessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Novell
 
MySQL Intro JSON NoSQL
MySQL Intro JSON NoSQLMySQL Intro JSON NoSQL
MySQL Intro JSON NoSQL
Mark Swarbrick
 
Novell File Management Suite Use Cases
Novell File Management Suite Use CasesNovell File Management Suite Use Cases
Novell File Management Suite Use Cases
Novell
 
Novell File Management Suite Use Cases
Novell File Management Suite Use CasesNovell File Management Suite Use Cases
Novell File Management Suite Use Cases
Novell
 
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Acunu
 
Storage Systems For Scalable systems
Storage Systems For Scalable systemsStorage Systems For Scalable systems
Storage Systems For Scalable systems
elliando dias
 
MySQL高可用
MySQL高可用MySQL高可用
MySQL高可用
thinkinlamp
 
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell
 
Oracle to MySQL 2012
Oracle to MySQL  2012 Oracle to MySQL  2012
Oracle to MySQL 2012
Marco Tusa
 
Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015
AVI JAIN
 
Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015
AVI JAIN
 

Similar to Severalnines Self-Training: MySQL® Cluster - Part II (20)

Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql ClusterSanto Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
Santo Leto - MySQL Connect 2012 - Getting Started with Mysql Cluster
 
Cloud Computing & Scaling Web Apps
Cloud Computing & Scaling Web AppsCloud Computing & Scaling Web Apps
Cloud Computing & Scaling Web Apps
 
Oracle my sql cluster cge
Oracle my sql cluster cgeOracle my sql cluster cge
Oracle my sql cluster cge
 
Handling Massive Writes
Handling Massive WritesHandling Massive Writes
Handling Massive Writes
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 Updates
 
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
Oracle MySQL Tutorial -- MySQL NoSQL Cloud Buenos Aires Nov, 13 2014
 
02 -my_sql_roma-may2011
02  -my_sql_roma-may201102  -my_sql_roma-may2011
02 -my_sql_roma-may2011
 
MySQL for Oracle DBAs
MySQL for Oracle DBAsMySQL for Oracle DBAs
MySQL for Oracle DBAs
 
Fb talk arch_summit
Fb talk arch_summitFb talk arch_summit
Fb talk arch_summit
 
Lessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Lessons Learned: Novell Open Enterprise Server Upgrades Made EasyLessons Learned: Novell Open Enterprise Server Upgrades Made Easy
Lessons Learned: Novell Open Enterprise Server Upgrades Made Easy
 
MySQL Intro JSON NoSQL
MySQL Intro JSON NoSQLMySQL Intro JSON NoSQL
MySQL Intro JSON NoSQL
 
Novell File Management Suite Use Cases
Novell File Management Suite Use CasesNovell File Management Suite Use Cases
Novell File Management Suite Use Cases
 
Novell File Management Suite Use Cases
Novell File Management Suite Use CasesNovell File Management Suite Use Cases
Novell File Management Suite Use Cases
 
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
 
Storage Systems For Scalable systems
Storage Systems For Scalable systemsStorage Systems For Scalable systems
Storage Systems For Scalable systems
 
MySQL高可用
MySQL高可用MySQL高可用
MySQL高可用
 
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
Novell Storage Manager: Your Secret Weapon for Simplified File and User Manag...
 
Oracle to MySQL 2012
Oracle to MySQL  2012 Oracle to MySQL  2012
Oracle to MySQL 2012
 
Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015
 
Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015Avi Jain - Resume Descriptive 2015
Avi Jain - Resume Descriptive 2015
 

More from Severalnines

WEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service ProvidersWEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service Providers
Severalnines
 
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solutionLIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
Severalnines
 
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale:  Going Multi-Cluster  with IstioKubernetes at Scale:  Going Multi-Cluster  with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
Severalnines
 
DIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaSDIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaS
Severalnines
 
Cloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaSCloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaS
Severalnines
 
Tips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloudTips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloud
Severalnines
 
Working with the Moodle Database: The Basics
Working with the Moodle Database: The BasicsWorking with the Moodle Database: The Basics
Working with the Moodle Database: The Basics
Severalnines
 
SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB
SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDBSysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB
SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB
Severalnines
 
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
Severalnines
 
Webinar slides: How to Migrate from Oracle DB to MariaDB
Webinar slides: How to Migrate from Oracle DB to MariaDBWebinar slides: How to Migrate from Oracle DB to MariaDB
Webinar slides: How to Migrate from Oracle DB to MariaDB
Severalnines
 
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControlWebinar slides: How to Automate & Manage PostgreSQL with ClusterControl
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl
Severalnines
 
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Severalnines
 
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Severalnines
 
Disaster Recovery Planning for MySQL & MariaDB
Disaster Recovery Planning for MySQL & MariaDBDisaster Recovery Planning for MySQL & MariaDB
Disaster Recovery Planning for MySQL & MariaDB
Severalnines
 
MariaDB Performance Tuning Crash Course
MariaDB Performance Tuning Crash CourseMariaDB Performance Tuning Crash Course
MariaDB Performance Tuning Crash Course
Severalnines
 
Performance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDBPerformance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDB
Severalnines
 
Advanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona ServerAdvanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona Server
Severalnines
 
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket KnifePolyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Severalnines
 
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Severalnines
 
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQLWebinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Severalnines
 

More from Severalnines (20)

WEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service ProvidersWEBINAR SLIDES: CCX for Cloud Service Providers
WEBINAR SLIDES: CCX for Cloud Service Providers
 
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solutionLIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
LIVE DEMO: CCX for CSPs, a drop-in DBaaS solution
 
Kubernetes at Scale: Going Multi-Cluster with Istio
Kubernetes at Scale:  Going Multi-Cluster  with IstioKubernetes at Scale:  Going Multi-Cluster  with Istio
Kubernetes at Scale: Going Multi-Cluster with Istio
 
DIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaSDIY DBaaS: A guide to building your own full-featured DBaaS
DIY DBaaS: A guide to building your own full-featured DBaaS
 
Cloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaSCloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaS
 
Tips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloudTips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloud
 
Working with the Moodle Database: The Basics
Working with the Moodle Database: The BasicsWorking with the Moodle Database: The Basics
Working with the Moodle Database: The Basics
 
SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB
SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDBSysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB
SysAdmin Working from Home? Tips to Automate MySQL, MariaDB, Postgres & MongoDB
 
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
 
Webinar slides: How to Migrate from Oracle DB to MariaDB
Webinar slides: How to Migrate from Oracle DB to MariaDBWebinar slides: How to Migrate from Oracle DB to MariaDB
Webinar slides: How to Migrate from Oracle DB to MariaDB
 
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControlWebinar slides: How to Automate & Manage PostgreSQL with ClusterControl
Webinar slides: How to Automate & Manage PostgreSQL with ClusterControl
 
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
 
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
 
Disaster Recovery Planning for MySQL & MariaDB
Disaster Recovery Planning for MySQL & MariaDBDisaster Recovery Planning for MySQL & MariaDB
Disaster Recovery Planning for MySQL & MariaDB
 
MariaDB Performance Tuning Crash Course
MariaDB Performance Tuning Crash CourseMariaDB Performance Tuning Crash Course
MariaDB Performance Tuning Crash Course
 
Performance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDBPerformance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDB
 
Advanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona ServerAdvanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona Server
 
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket KnifePolyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
 
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL ...
 
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQLWebinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
 

Recently uploaded

Mitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing SystemsMitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing Systems
ScyllaDB
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
Andrey Yasko
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Bert Blevins
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
Eric D. Schabell
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
Yevgen Sysoyev
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
Aurora Consulting
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
huseindihon
 
20240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 202420240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 2024
Matthew Sinclair
 
WPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide DeckWPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide Deck
Lidia A.
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
BookNet Canada
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
shanthidl1
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Bert Blevins
 
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdfWhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
ArgaBisma
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
Stephanie Beckett
 
20240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 202420240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 2024
Matthew Sinclair
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
BookNet Canada
 

Recently uploaded (20)

Mitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing SystemsMitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing Systems
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly DetectionAdvanced Techniques for Cyber Security Analysis and Anomaly Detection
Advanced Techniques for Cyber Security Analysis and Anomaly Detection
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
 
20240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 202420240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 2024
 
WPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide DeckWPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide Deck
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
 
Cookies program to display the information though cookie creation
Cookies program to display the information though cookie creationCookies program to display the information though cookie creation
Cookies program to display the information though cookie creation
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
 
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdfWhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
 
20240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 202420240705 QFM024 Irresponsible AI Reading List June 2024
20240705 QFM024 Irresponsible AI Reading List June 2024
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
 

Severalnines Self-Training: MySQL® Cluster - Part II

  • 1. MySQL Cluster Training presented by severalnines.com Address: Contact: SeveralninesAB Jean-Jérôme Schmidt c/o SICS, Box 1263 Email: services@severalnines.com Isafjordsgatan22 SE-164-29 Kista Copyright 2011 Severalnines AB Control your database infrastructure 1
  • 2. Introduction • At Severalnines, we believe in sharing information and knowledge; we all come from an open source background • We know a lot of things about MySQL Cluster and think that MySQL Cluster is a great technology • These free MySQL Cluster Training slides are a contribution of ours to the knowledge and information sharing that‟s common practice in the open source community • If you have any questions on these slides or would like to book an actual training class, please contact us at: services@severalnines.com Copyright 2011 Severalnines AB Control your database infrastructure 2
  • 3. Training Slides - Concept • Over the coming weeks we will be chronologically releasing slides for the different sections of our MySQL Cluster Training program on our website. • The full agenda of the training with all of its modules is outlined in the next slides so that you can see what topics will be covered over the coming weeks. • Particularly specialised topics such as Cluster/J or NDB API are not fully covered in the slides. We recommend our instructor-led training classes for such topics. • Please contact us for more details: services@severalnines.com Copyright 2011 Severalnines AB Control your database infrastructure 3
  • 4. Full Training Agenda (1/4) • MySQL Cluster Introduction – MySQL eco system – Scale up, scale out, and sharding – MySQL Cluster Architecture – Use cases – Features – Node types and Roles • Detailed Concepts – Data Distribution – Verifying data distribution – Access Methods – Partitioning – Node failures and failure detection – Network Partitioning – Transactions and Locking – Consistency Model – Redo logging and Checkpointing Copyright 2011 Severalnines AB Control your database infrastructure 4
  • 5. Agenda (2/4) • Installing MySQL Cluster – Setting up MySQL Cluster – Starting/stopping nodes – Recovery and restarts – Upgrading configuration – Upgrading Cluster • Performance Tuning (instructor-led only; contact us at services@severalnines.com) – Differences compared to Innodb/MyISAM – Designing efficient and fast applications – Identifying bottlenecks – Tweaking configuration (OS and MySQL Cluster) – Query Tuning – Schema Design – Index Tuning Copyright 2011 Severalnines AB Control your database infrastructure 5
  • 6. Agenda (3/4) • Management and Administration – Backup and Restore – Geographical Replication – Online and offline operations – Ndbinfo tables – Reporting – Single user mode – Scaling Cluster • Disk Data – Use cases – Limitations – Best practice configuration • Designing a Cluster – Capacity Planning and Dimensioning – Hardware recommendations – Best practice Configuration – Storage calculations Copyright 2011 Severalnines AB Control your database infrastructure 6
  • 7. Agenda (4/4) • Resolving Issues – Common problems – Error logs and Tracefiles – Recovery and Escalation procedures • Connectivity Overview – NDBAPI – Cluster/J – LDAP • Severalnines Tools – Monitoring and Management – Benchmarking – Sandboxes – Configuration and capacity planning • Conclusion Copyright 2011 Severalnines AB Control your database infrastructure 7
  • 8. Agenda: Lab Exercises (only applicable to instructor-led training classes) • Lab Exercises – Installing and Loading data into MySQL Cluster – Starting/stopping nodes, recovery – Query tuning – Backup and Restore – Configuration Upgrade • Would you like to try something particular? – This is possible too, speak with your instructor Copyright 2011 Severalnines AB Control your database infrastructure 8
  • 9. Prerequisites • Readers / Participants have understanding of SQL and basic database concepts. • Laptops/PCs for hands-on exercises • Linux: 1GB RAM • Windows: 2GB RAM • Approx. 20GB disk space and Virtualbox installed. • Virtualbox can be downloaded for free at http://www.virtualbox.org/wiki/Downloads • MySQL Cluster version 7.1 or later Copyright 2011 Severalnines AB Control your database infrastructure 9
  • 10. Part 2 Section 2: Detailed Concepts Copyright 2011 Severalnines AB Control your database infrastructure 10
  • 11. Topics covered in Part 2 • Data Distribution & Partitioning • Two Phase Commit Protocol • Transaction Resources Copyright 2011 Severalnines AB Control your database infrastructure 11
  • 12. Data Distribution and Partitioning Copyright 2011 Severalnines AB Control your database infrastructure 12
  • 13. MySQL Cluster Architecture Application Application Application R/I/U/D R/I/U/D R/I/U/D Java, C++, LDAP Application R/I/U/D Native API DATA DATA NODE NODE Management Management Server DATA DATA Server NODE NODE Copyright 2011 Severalnines AB Control your database infrastructure 13
  • 14. Data Distribution • MySQL Cluster automatically partitions tables and distributes the data on the partitions. – It is possible to use user-defined partitioning. • A table is divided into as many partitions as you have data nodes and data is “striped” on the partitions. • Hashing of the Primary Key determines the Partition that should hold the data - automatic distribution. • It is possible to hash on part of the primary key – great for sharding and locality of data! Copyright 2011 Severalnines AB Control your database infrastructure 14
  • 15. Partitioning and Data Distribution • With two data nodes, data node 1 and data node 2, each table is divided into two Partitions. • Subidis the Primary Key. • Hashing on the Primary Key (subid) determines the Partition. It is also possible to hash on part of the PK. – Odd PKs Green – Even PKs Red STORAGE LAYER subid data DATA DATA NODE 1 NODE 2 1 A Partition 0 3 B 2 C Partition 1 P0 P1 4 D Copyright 2011 Severalnines AB Control your database infrastructure 15
  • 16. Replicas • To provide for redundancy and fast failover partitions are synchronouslyreplicated. • Two replicas (two copies of data) is most common – it is possible to have one (previous slide), two, three and four replicas. – NoOfReplicas=2 STORAGE LAYER DATA DATA NODE 1 NODE 2 P0 S0 Copyright 2011 Severalnines AB Control your database infrastructure 16
  • 17. Replicas • To provide for redundancy and fast failover partitions are synchronouslyreplicated from a PRIMARY to a SECONDARY partition. – When a change ( ) is made on P0 it is synchronously replicated to S0. – The change is persisted at transaction COMMIT. – Either both P0 or S0 is update or NOTHING AT ALL STORAGE LAYER DATA DATA NODE 1 NODE 2 P0 S0 Copyright 2011 Severalnines AB Control your database infrastructure 17
  • 18. Data Distribution - disk logging • After the COMMIT, the data is in main memory. – But changes are REDO LOGGED, but the REDO LOG is synced to disk every xth ms (1000 ms is recommended). • Controlled by TimeBetweenGlobalCheckpoints • Similar to innodb-flush-log-at-trx_commit=2 – The data is also checkpointed to disk. • More on this later. • The disk logging makes it possible to recovery a completely failed cluster. Copyright 2011 Severalnines AB Control your database infrastructure 18
  • 19. Replicas • To provide for redundancy and fast failover partitions are synchronouslyreplicated. • Two replicas (two copies of data) is most common – it is possible to have one (previous slide), two, three and four replicas. – NoOfReplicas=2 STORAGE LAYER subid data DATA DATA NODE 1 NODE 2 1 A Partition 0 3 B 2 C Partition 1 P0 P1 4 D S1 S0 Px == PRIMARY Partition x Sx == SECONDARY Partition x Copyright 2011 Severalnines AB Control your database infrastructure 19
  • 20. Node groups • Data Nodes sharing the same data data belongs to a node group. • A node group contains as many nodes as you have replicas (NoOfReplicas=2 is used in the picture below). STORAGE LAYER subid data DATA DATA NODE 1 NODE 2 1 A Partition 0 3 B 2 C Partition 1 P0 P1 4 D S1 S0 Node group 0 Px == PRIMARY Partition x Sx == SECONDARY Parttionx Copyright 2011 Severalnines AB Control your database infrastructure 20
  • 21. Two Replicas – Four Data Nodes • Four data nodes – four partitions – two replicas • Four data nodes and two replicas  two node groups – No of node groups = #data nodes / #replicas STORAGE LAYER subid data 1 A Partition 0 2 B DATA DATA DATA DATA NODE 1 NODE 2 NODE 3 NODE 4 3 C Partition 1 4 D P0 P1 P2 P3 5 E Partition 2 6 F S1 S0 S3 S2 7 G Partition 3 Node group 0 Node group 1 8 H Px == PRIMARY Partition x Sx == SECONDARY Parttionx Copyright 2011 Severalnines AB Control your database infrastructure 21
  • 22. Three Replicas – Three Data Nodes • Three data nodes – Three partitions – More replicas gives slower writes. • Three data nodes and three replicas  one node group. This is not common. – Two replicas is common practice/best practice STORAGE LAYER DATA DATA DATA subid data NODE 1 NODE 2 NODE 3 1 A Partition 0 2 B P0 P1 P2 3 C Partition 1 S1 S0 S0 4 D S2 S2 S1 5 E Partition 6 F 2 Node group 0 Px == PRIMARY Partition x Sx == SECONDARY Parttionx Copyright 2011 Severalnines AB Control your database infrastructure 22
  • 23. Recommendations • Two Replicas recommended - gives best tradeoff between Performance and Availability • Three Replicas (or Four) will give slower writes (, is less tested (not so many deployments), and less deployments are made with this. • Cost of write (approx) – 1 replica (no redundancy): cost X – 2 replicas: cost 2X – 3 replicas: cost 3X Copyright 2011 Severalnines AB Control your database infrastructure 23
  • 24. Verifying Data Distribution • A helper program called ndb_desc shows how many records are in each partition: ndb_desc –c<mgmt_host:1186> –d<database> -p<tablename> Copyright 2011 Severalnines AB Control your database infrastructure 24
  • 25. Two Phase Commit Protocol Copyright 2011 Severalnines AB Control your database infrastructure 25
  • 26. View of the Data Node • Each node has as active Transaction Coordinator (TC). – Every Transaction starts at the TC – One transaction consists of one or more Operations. • Operation is SELECT, INSERT, UPDATE, DELETE • Each node has 1-4 Local Query Handlers (LQH) – Executes the operations TC • ACCess stores a hash table LQH – Primary Key and Unique • TUPle stores data records ACC TUP – ACC hash index links to record in TUP Copyright 2011 Severalnines AB Control your database infrastructure 26
  • 27. Two Phase Commit Protocol • 2PC facilitates the synchronous replication – To safeguard that both Primary and Secondary Partitions are modified in a Consistent Way – Locking (Row level) • 2PC consists of two phases – Prepare Phase • Grab locks • Make a update to a shadow copy – Commit Phase • Make the shadow copy the real copy • Release locks • 2PC protocol is only involved in – Update, Delete, Insert • Reads are not 2PC (would be very slow and pointless) Copyright 2011 Severalnines AB Control your database infrastructure 27
  • 28. Two Phase Commit Protocol • INSERT INTO t1(id, data) VALUES (1, „hello‟) – Two data nodes - PK hashes to Primary P0. – The same applies to UPDATES and DELETEs TC TC LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 28
  • 29. Phase 1 - Prepare Phase • INSERT INTO t1(id, data) VALUES (1, „hello‟) • The protocol starts at the TC that has the Primary Partition for the PK TC TC LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 29
  • 30. Phase 1 - Prepare Phase • TC starts by calculating a hash (md5sum) on the Entire Primary key. – md5sum(PK) – This gives 128 bit hash value, divided up in 2 x 64-bit INDEX_HASH PARTITION_HASH – Actually further calculations are made • PARTITION= PARTITION_HASH % NO_OF_PARTITIONS • INDEX_POS=INDEX_HASH % NO_OF_BUCKETS – LH*3 Algorithm is what is really being used. • Now MySQL Cluster will know what nodes and partitions are involved. • INSERT INTO t1(id, data) VALUES (1, „hello‟) – INDEX_POS=23 – PARTITION=P0 Copyright 2011 Severalnines AB Control your database infrastructure 30
  • 31. Phase 1 - Prepare Phase • INSERT INTO t1(id, data) VALUES (1, „hello‟) • Prepare on the local LQH TC TC LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 31
  • 32. Phase 1 - Prepare Phase • Insert into the hash table in ACC and write record in TUP (allocate space for the record). – The Index Entry is locked now TC TC PREPARE LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello POS=23 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 32
  • 33. Phase 1 - Prepare Phase • Send PREPARE message to the other LQH for the secondary Partition (S0), and do exactly the same thing. TC TC PREPARE PREPARE LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello 1 hello IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 33
  • 34. Phase 1 - Prepare Phase • Send back PREPARE OK to TC TC PREPARE OK TC PREPARE PREPARE LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello 1 hello IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 34
  • 35. Phase 2 - Commit Phase • Send COMMIT message to REMOTE LQH first – Release locks, simplifies error handling, ops waiting on lock can resume faster. TC COMMIT TC LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello 1 hello IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 35
  • 36. Phase 2 - Commit Phase • Send COMMIT to LQH of P0 – Release locks TC COMMIT TC COMMIT LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello 1 hello IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 36
  • 37. Phase 2 - Commit Phase • Send COMMIT OK to TC TC COMMIT TC COMMIT OK COMMIT LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello 1 hello IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 37
  • 38. Phase 2 - Commit Phase • Send COMMIT ACK to application COMMIT ACK TC COMMIT TC COMMIT OK COMMIT LQH LQH ACC TUP ACC TUP P0 P0 S0 S0 1 hello 1 hello IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 38
  • 39. Failure Handling • If the Transaction Coordinator fails another TC will take over. • The new TC will ask the nodes “Send me a list of outstanding transactions from the failed TC” • The new TC will – ABORT transactions in the Prepare Phase – Force COMMIT of transactions IFF another node has seen a COMMIT message. • The Node that has failed will get the changes when it recovers. Copyright 2011 Severalnines AB Control your database infrastructure 39
  • 40. Transaction Timers • Deadlock detection – waiting for lock – If a transaction is waiting too long time for a lock it is aborted • TransactionDeadLockDetectionTimeout=3000 [ms] • Inactive Transactions – holding a lock – If a transaction is holding a lock too long it is aborted • TransactionInactiveTimeout=60000 [ms] – Never set TransactioInactiveTimeout=0 Copyright 2011 Severalnines AB Control your database infrastructure 40
  • 41. Locking • Committed Read Isolation level is used • This means that a transaction – Will read last committed data unless it has itself modified this data. • Locks are acquired in the Prepare Phase and released in the Commit Phase. Copyright 2011 Severalnines AB Control your database infrastructure 41
  • 42. Transaction Resources Copyright 2011 Severalnines AB Control your database infrastructure 42
  • 43. Transaction and Operation Records • Each transaction requires on Transaction Record (TR) – When it was started – Controlled by MaxNoOfConcurrentTransactions • Also each Operation requires one Operation Record (OR) in TC and one Local Operation Record (LOR) in LQH – What transaction it belongs to – Operation Type – Controlled by MaxNoOfConcurrentOperations – and MaxNoOfLocalOperations Copyright 2011 Severalnines AB Control your database infrastructure 43
  • 44. Transaction and Operation Records • Assume – MaxNoOfConcurrentTransactions=3 – MaxNoOfConcurrentOperations=3 – MaxNoOfLocalOperations=4 • By default there are 10% more Local Ops than Conc Ops. • Query – INSERT INTO t1 (id,data) VALUES(1,‟x‟); • One transaction • One operation Copyright 2011 Severalnines AB Control your database infrastructure 44
  • 45. Transaction Starts (prepare phase) • INSERT INTO t1 (id,data) VALUES(1,‟x‟); TR TC TC OR PREPARE PREPARE LOR LQH LQH LOR ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 45
  • 46. Transaction Starts (prepare phase) • Allocate a Transaction Record at TC TR TC TC OR PREPARE PREPARE LOR LQH LQH LOR ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 46
  • 47. Transaction Starts (prepare phase) • Allocate a Operation Record at TC TR TC TC OR PREPARE PREPARE LOR LQH LQH LOR ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 47
  • 48. Transaction Starts (prepare phase) • Allocate a Local Operation Record at LQH TR TC TC OR PREPARE PREPARE LOR LQH LQH LOR ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 48
  • 49. Transaction Starts (prepare phase) • With many parallel transactions TR TR TC TC OR OR PREPARE PREPARE LOR LQH LQH LOR ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 49
  • 50. Transaction Starts (prepare phase) • Wrongly dimensioned for failover • Not enough TRs / ORs TR TR TC TC OR OR PREPARE PREPARE LOR LQH LQH LOR ACC TUP ACC TUP P0 P0 S0 S0 IndexMemory DataMemory IndexMemory DataMemory DATA NODE 1 DATA NODE 2 Copyright 2011 Severalnines AB Control your database infrastructure 50
  • 51. Transaction and Operation Records • Define – MaxNoOfConcurrentTransactions= 2 x<max_threads> – MaxNoOfConcurrentOperations= MaxConcurrentTransactionsx<ops in trans> – MaxNoOfLocalOperations=1.1 x MaxNoOfConcurrentOperations • 1.1x is by default • Seldom needed to change this. Copyright 2011 Severalnines AB Control your database infrastructure 51
  • 52. Coming next in Part 3: Detailed Concepts Access Methods Redo Logging and Check-pointing Recovery Node Failures and Error Detection Network Partitioning Copyright 2011 Severalnines AB Control your database infrastructure 52
  • 53. We hope these training slides are useful to you! Please visit our website to view the next section of this training. For any questions, comments, feedback or to book a training class, please contact us at: services@severalnines.com Thank you! Copyright 2011 Severalnines AB Control your database infrastructure 53
  • 54. Disclaimer © Copyright 2011 Severalnines AB. All rights reserved. Severalnines& the Severalnineslogo(s) are trademarks of Severalnines AB. MySQL is a registered trademark of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. Copyright 2011 Severalnines AB Control your database infrastructure 54

Editor's Notes

  1. Dear Jury, Just as the electric grid revolutionized access to electricity 100 years ago, we at Severalnines believe that Cloud Computing will revolutionize IT where organizations will be able to plug into extremely powerful computing resources over the network. We have already seen the beginnings of this new wave, where the current infrastructure stack is being challenged and disrupted by a whole set of new technologies. For instance, in the database market, over 40 startups have received funding over the past 18 months. Severalnines is not building yet another database product, we believe there are already a lot of good technologies available. To manage a database costs 4 times the purchase price, and yet, very few companies are addressing this problem. Severalnines focuses on solutions to address this underserved segment. The founders of the company have a solid background in databases, having been at MySQL since 2003. The company develops a management platform which is database and cloud agnostic.We are database independent since we do not know who, if anybody, will be the next MySQL of the cloud.We are cloud independent, since we do not want to depend on any cloud vendor (e.g. Amazon or Rackspace) to avoid vendor lock-in. After the Amazon EC2 downtime during the Easter break, hundreds of affected companies have realized the importance of this. There is also a commercial aspect for avoiding vendor lock-in. Severalnines enhances productivity of organizations by attacking the biggest cost associated with database systems. We are a Swedish startup, hosted by SICS in Kista. There is also a small but very efficient development capacity in Singapore. Just as MySQL became a major brand and placed Sweden on the global software infrastructure map, we believe Severalnines can become a serious global player in the emerging Cloud space. We are very thankful that an organization like Eurocloud exists, and would like to thank the jury for considering our application. Kind regards,Vinay Joosery Severalnines AB
  2. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  3. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  4. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  5. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  6. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  7. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  8. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  9. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  10. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  11. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  12. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  13. Dear Jury, Just as the electric grid revolutionized access to electricity 100 years ago, we at Severalnines believe that Cloud Computing will revolutionize IT where organizations will be able to plug into extremely powerful computing resources over the network. We have already seen the beginnings of this new wave, where the current infrastructure stack is being challenged and disrupted by a whole set of new technologies. For instance, in the database market, over 40 startups have received funding over the past 18 months. Severalnines is not building yet another database product, we believe there are already a lot of good technologies available. To manage a database costs 4 times the purchase price, and yet, very few companies are addressing this problem. Severalnines focuses on solutions to address this underserved segment. The founders of the company have a solid background in databases, having been at MySQL since 2003. The company develops a management platform which is database and cloud agnostic.We are database independent since we do not know who, if anybody, will be the next MySQL of the cloud.We are cloud independent, since we do not want to depend on any cloud vendor (e.g. Amazon or Rackspace) to avoid vendor lock-in. After the Amazon EC2 downtime during the Easter break, hundreds of affected companies have realized the importance of this. There is also a commercial aspect for avoiding vendor lock-in. Severalnines enhances productivity of organizations by attacking the biggest cost associated with database systems. We are a Swedish startup, hosted by SICS in Kista. There is also a small but very efficient development capacity in Singapore. Just as MySQL became a major brand and placed Sweden on the global software infrastructure map, we believe Severalnines can become a serious global player in the emerging Cloud space. We are very thankful that an organization like Eurocloud exists, and would like to thank the jury for considering our application. Kind regards,Vinay Joosery Severalnines AB
  14. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  15. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  16. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  17. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  18. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  19. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  20. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  21. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  22. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  23. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  24. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  25. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  26. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  27. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  28. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  29. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  30. Dear Jury, Just as the electric grid revolutionized access to electricity 100 years ago, we at Severalnines believe that Cloud Computing will revolutionize IT where organizations will be able to plug into extremely powerful computing resources over the network. We have already seen the beginnings of this new wave, where the current infrastructure stack is being challenged and disrupted by a whole set of new technologies. For instance, in the database market, over 40 startups have received funding over the past 18 months. Severalnines is not building yet another database product, we believe there are already a lot of good technologies available. To manage a database costs 4 times the purchase price, and yet, very few companies are addressing this problem. Severalnines focuses on solutions to address this underserved segment. The founders of the company have a solid background in databases, having been at MySQL since 2003. The company develops a management platform which is database and cloud agnostic.We are database independent since we do not know who, if anybody, will be the next MySQL of the cloud.We are cloud independent, since we do not want to depend on any cloud vendor (e.g. Amazon or Rackspace) to avoid vendor lock-in. After the Amazon EC2 downtime during the Easter break, hundreds of affected companies have realized the importance of this. There is also a commercial aspect for avoiding vendor lock-in. Severalnines enhances productivity of organizations by attacking the biggest cost associated with database systems. We are a Swedish startup, hosted by SICS in Kista. There is also a small but very efficient development capacity in Singapore. Just as MySQL became a major brand and placed Sweden on the global software infrastructure map, we believe Severalnines can become a serious global player in the emerging Cloud space. We are very thankful that an organization like Eurocloud exists, and would like to thank the jury for considering our application. Kind regards,Vinay Joosery Severalnines AB
  31. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  32. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  33. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  34. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  35. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  36. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  37. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  38. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com
  39. Severalnines has been offering its products free of charge since 2007, while the founders were employed at MySQL. These products are the de-facto standard tools to assist MySQL customers and users in deploying their MySQL clusters. More information about Severalnines at www.severalnines.com