MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - A Close Up Look
•
3 likes•1,617 views
The document discusses various load balancing options for MySQL databases, including application connectors, reverse proxies, and SQL-aware proxies. It provides an overview of popular load balancers like HAProxy, MaxScale, ProxySQL, MySQL Router, and Nginx. These load balancers aim to improve high availability, performance, and scalability. They handle tasks like health checking, failover, read/write splitting, and query routing. The document analyzes the key features and limitations of each type of load balancer.
Report
Share
MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - A Close Up Look
- 1. Copyright 2017 Severalnines AB Krzysztof Książek, Senior Support Engineer @Severalnines krzysztof@severalnines.com Presenter MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - a close up look September, 26th 2017
- 2. Copyright 2017 Severalnines AB Why load balancers? Types of load balancers •Application connectors •Reverse proxies •SQL-aware proxies Health checks used with proxies Agenda
- 3. Copyright 2017 Severalnines AB High availability •Detect node health •Route traffic away from failed nodes Performance •Scale out by routing traffic to multiple nodes •Minimize number of connections to databases Why load balancers? Keep complexity away from the application •Monitor node state •Understand replication topology •Failover client connections Additional features •Collect performance data from cluster •Rewrite queries as they pass the proxy •Route queries depending on some rules (e.g. Read/write split)
- 4. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB Application connectors
- 5. Copyright 2017 Severalnines AB mysqlnd_ms Native driver for MySQL in PHP •Default since PHP 5.4 mysqlnd_ms adds option to implement read/write split and load balancing to PHP application Supports failover handling Supports query routing modifications through SQL hints Application connectors MySQL Connector/J Adds great deal of flexibility to Java applications when it comes to database layer handling Failover handling Live reconfiguration of replication topology Advanced routing options
- 6. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB Reverse proxies
- 7. Copyright 2017 Severalnines AB Industry standard - thousands of installations across the world 1.7 released in November, 2016 •1.7.9 released on August, 18th, 2017 Reverse proxies - HAProxy Reverse proxy •Load balancing, scaling out, failover •Lack of advanced internal support for MySQL backends
- 8. Copyright 2017 Severalnines AB Lack of ability to perform read/write split on a single port •Two backends on two different ports are required •Could be a blocker if an application can’t split reads from writes Reverse proxies - HAProxy No understanding of MySQL state •Only simple check on port 3306: handshake or authentication Workaround exists: clustercheck •HTTP check, xinetd, external script to monitor MySQL/Galera states
- 9. Copyright 2017 Severalnines AB Reverse proxies - HAProxy
- 10. Copyright 2017 Severalnines AB Designed to detect failed nodes and move VIP around One single VIP for connections, no load balancing is possible •Might be useful to build high availability if you connect only to a single node Potential use cases: •Galera cluster (for HA only) •Master - standby replication •pair of hosts connected through DRBD Reverse proxies - Keepalived
- 11. Copyright 2017 Severalnines AB Example config for Galera cluster of three nodes •Keepalived should be installed on all hosts •All hosts should be using this configuration Leverage mysqlchk script deployed by ClusterControl •Percona’s clustercheck can also be used Can also be configured to use multicast Reverse proxies - Keepalived
- 12. Copyright 2017 Severalnines AB A HTTP server and a HTTP reverse proxy Since 1.9 can be used as a TCP reverse proxy Limited features in free (NGINX) version •No configurable port for health checks •Not possible to integrate with clustercheck scripts More features in paid (NGINX Plus) version •Advanced health checks •Custom port for checking the health of the backend Reverse proxies - NGINX
- 13. Copyright 2017 Severalnines AB Functionality similar to HAProxy (with regards to MySQL) •Read/write split could be done using two ports •Backup servers work differently though - all at once •No understanding of MySQL and Galera states Has to be used with clustercheck-iptables Reverse proxies - NGINX
- 14. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB SQL-aware proxies - MaxScale
- 15. Copyright 2017 Severalnines AB Created by MariaDB Corporation, currently in version 2.1.7 Tool designed to solve load balancing needs of DBA’s •Handles read/write split •Automatically tracks health of backend nodes •Understands MySQL and Galera states •Master or slave? Synced or donor? SQL-aware proxies - MaxScale
- 16. Copyright 2017 Severalnines AB Support for SSL Support for replication, Galera and MySQL Cluster Statement hinting •Where to route •Maximum replication lag Nagios integration Query mirroring SQL-aware proxies - MaxScale Caching mechanism Result set masking Result set limiting Consistent Critical Reads
- 17. Copyright 2017 Severalnines AB Several types of routers are available: •readwritesplit - performs read/write split •readconnroute - round-robin access •dbfwfilter - filters queries based on regex •schemarouter - implements schema- based sharding •binlogrouter - MaxScale as a binlog server SQL-aware proxies - MaxScale Design decisions •Read queries are routed to master if executed within a transaction •Stored procedures, UDF’s, prepared statements are sent to the master only •Session variables and settings are sent to all hosts •No connection multiplexing
- 18. Copyright 2017 Severalnines AB Lack of real-time traffic statistics (slightly improved in 2.1) No remote admin interface (available in 1.4.x, removed in 2.0) Some of the configuration settings require restart (improved in 2.1) Lack of more advanced routing configuration •Route to master or slave, using hints •No regex-based routing SQL-aware proxies - MaxScale Performance regression when using more than 8 threads for MaxScale Non-GPL license starting from 2.0 •Up to two nodes free (more - paid) •GPL fork of 1.3 branch - AirBnB MaxScale
- 19. Copyright 2017 Severalnines AB SQL-aware proxies - MaxScale
- 20. Copyright 2017 Severalnines AB SQL-aware proxies - MaxScale
- 21. Copyright 2017 Severalnines AB SQL-aware proxies - MaxScale
- 22. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB SQL-aware proxies - ProxySQL
- 23. Copyright 2017 Severalnines AB Created by René Cannaò, currently in version 1.4.3 Designed to handle complex topologies •Implements read write split •Support for multiple hostgroups •Tracks health of backends on per-query basis •Advanced routing based on query rules SQL-aware proxies - ProxySQL
- 24. Copyright 2017 Severalnines AB Admin interface uses SQL •INSERT INTO mysql_servers … •SET mysql-query_retries_on_failure=…; Cisco-like configuration approach •LOAD MYSQL QUERY RULES TO RUNTIME; •SAVE MYSQL USERS TO DISK; Virtually every setting can be changed dynamically SQL-aware proxies - ProxySQL Query rules mechanism for great flexibility •Match queries using regex, digest hash, user, schema, IP, port •Route queries based on above conditions •Query rewrite and query mirroring •Query caching - TTL and memory limit ClickHouse support added in 1.4.3
- 25. Copyright 2017 Severalnines AB Connection multiplexing - minimizes number of connections to backends Support for MySQL replication and Group Replication Support for Galera Cluster using external scripts •Example monitoring script is provided with the ProxySQL SQL-aware proxies - ProxySQL Non-standard approach to backend health monitoring •Health check happens when traffic is sent •Monitor module extends functionality Detailed statistics about traffic handled by the ProxySQL
- 26. Copyright 2017 Severalnines AB No client side SSL support - in the roadmap Lack of out-of-the-box support for explicit transactions •You may need to enable persistent transactions for app user Session variables are tricky to support •You have to make sure they are routed to a single, writable node (i.e. replication master) SQL-aware proxies - ProxySQL Lack of direct nagios integration Lack of internal support for Galera •Although support via external script gives you more options for customization No advanced logging options (JSON, Kafka)
- 27. Copyright 2017 Severalnines AB In version 1.4.2 ProxySQL introduced an experimental support for clustering •A group of ProxySQL instances can form a cluster to share common configuration •Configuration change made on a one node will be replicated thorough the cluster •New nodes can join the cluster and sync configuration SQL-aware proxies - ProxySQL Helps to solve one of the issues with proxy management - how to sync configuration on multiple ProxySQL nodes? No quorum support as of now •It’s in a roadmap though No complex conflict resolution mechanism •It’s timestamp-based, you should allow some time between changes Replication is asynchronous, you should be making changes to couple ProxySQL instances
- 28. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB SQL-aware proxies - MySQL Router
- 29. Copyright 2017 Severalnines AB Created by Oracle, currently in version 2.1.4 Designed to provide high availability and scalability to your MySQL backends Supports external plugins using MySQL Harness Integrates well with MySQL Fabric for high availability setups Used as a part of MySQL InnoDB Cluster SQL-aware proxies - MySQL Router
- 30. Copyright 2017 Severalnines AB Two modes for routing •read-only - read-only connections routed in round-robin fashion •read-write - read-write connections routed to the first working node from the list Support for MySQL Fabric: •Can route traffic to given HA group •Topology detection via Fabric SQL-aware proxies - MySQL Router
- 31. Copyright 2017 Severalnines AB Support for MySQL InnoDB Cluster - a solution based on MySQL group replication •Deployable via MySQL Shell •Provides a support for InnoDB Cluster Metadata Schema •Caches metadata of the InnoDB Cluster and improves high availability SQL-aware proxies - MySQL Router
- 32. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB Health checks used with proxies
- 33. Copyright 2017 Severalnines AB HTTP check for HAProxy •Will work with any other proxy which supports http checks on custom port Script itself is a bash script which checks MySQL status •Designed for Galera but can be easily modified to use with replication •Checks wsrep_local_state for Galera states •Configurable Donor/Desync state handling Health checks used with proxies - clustercheck Script returns HTTP codes •HTTP/1.1 200 OK - if node is available •HTTP/1.1 503 Service Unavailable - otherwise Clustercheck should be installed on all databases nodes •It’s executed by xinetd, listening on custom port (9200 by default) •Make sure to configure it in /etc/services
- 34. Copyright 2017 Severalnines AB By default, script is executed directly from xinetd •Could become a problem if it’s executed too often Numerous forks are available out there •One of nice modifications was to execute script via cron and store result in shared memory •xinetd executes another script which reads the status - minimizing impact on MySQL Health checks used with proxies - clustercheck
- 35. Copyright 2017 Severalnines AB Derived from Percona’s clustercheck Created by Severalnines’ Ashraf Sharif Designed to work with proxies which can do only simple check on port used for service •For example, NGINX Idea is simple - use iptables to open or close port, depending on node’s state Health checks used with proxies - clustercheck-iptables Run script in a background, as a daemon Setup redirection from port 3308 to port 3306 in PREROUTING chain Every second checks the state of a node •If node is deemed unhealthy, remove redirection rule from PREROUTING chain Similar approach to health detection as in Percona’s clustercheck •Checks wsrep_local_state for Galera states
- 36. Copyright 2017 Severalnines AB Copyright 2017 Severalnines AB Summary
- 37. Copyright 2017 Severalnines AB Great deal of options to pick from •Everyone can choose a suitable solution Do you use NGINX in your setup? Why not to leverage your knowledge of it and use it for databases too? •You’d need clustercheck-iptables or NGINX Plus, though Do you want to build all database handling logic in your application? •PHP and Java give you great opportunities for that Summary Or maybe you prefer to move complexity of database layer from the application? •MaxScale or ProxySQL is there for you Maybe you want to use advanced features like query rewriting or sharding? •Again, ProxySQL or MaxScale will work great for you Do you work with MySQL Fabric or MySQL InnoDB Cluster and want some integration? •MySQL Router could be a great choice
- 38. Copyright 2012 Severalnines AB Thank You! Contact: krzysztof@severalnines.com Q&A