SlideShare a Scribd company logo

the tooling of a modern and agile oracle dba

•
•
B
BertrandDrouvot

This presentation discusses tools for automating database operations and monitoring databases. It introduces Ansible for automation, and Telegraf, Influxdb, Grafana, Logstash, Elasticsearch, Kibana, and Kapacitor for collecting, storing, and visualizing metrics, logs, and alerts. The presentation includes a live demo of using these tools to provision an Oracle database, create performance dashboards, generate alerts, and view logs and audits. The goal is to provide a modern, agile approach to database administration.

Related slideshows

DevOps, Yet Another IT Revolution
DevOps, Yet Another IT RevolutionDevOps, Yet Another IT Revolution
DevOps, Yet Another IT Revolution
 
xPatterns - Spark Summit 2014
xPatterns - Spark Summit 2014xPatterns - Spark Summit 2014
xPatterns - Spark Summit 2014
 
Using heka
Using hekaUsing heka
Using heka
 
1 of 18
Download to read offline
The tooling of a modern and agile Oracle DBA Bertrand Drouvot Expert Database Engineer bertrand.drouvot@digora.com
About me 2 • Oracle DBA since about 20 years (currently focusing on PostgreSQL) • OCP • RAC certified Expert • Exadata certified implementation specialist • Kubernetes Administrator • Blogger since 2012 • Oracle ACE • Oak table member • @bertranddrouvot • BasketBall fan
Challenge 3 • DBaaS with automation for: • Software installation • Database creation • Patching • Upgrade • Standby creation
Challenge 4 • End user should access performance dashboards • End user should access logs • Security Team should access audit and logs • Monitoring and alerting • Same toold for all SGBD (oracle, postgres, mssql)
Tools 5 • Ansible for automation • Telegraf, Influxdb and grafana to collect, store and display performance metrics • Logstash, elasticsearch and kibana to collect, store and display logs and audit • Kapacitor for monitoring and alerting
What is this presentation about? 6 • Brief overview of Ansible • Brief overview of Telegraf, Influxdb and grafana • Brief overview of Logstash, elasticsearch and kibana • Brief overview of Kapacitor for monitoring and alerting • Live demo
What this presentation is not? 7 • In depth overview of Ansible • In depth overview of Telegraf, Influxdb and grafana • In depth overview of Logstash, elasticsearch and kibana • In depth overview of Kapacitor for monitoring and alerting
Ansible 8 • Ansible is a radically simple IT automation engine • it uses no agents • it's easy to deploy • it uses a very simple language (YAML, in the form of Ansible Playbooks)
Telegraf, Influxdb, Kapacitor and Grafana 9 • Telegraf is a plugin-driven server agent for collecting and reporting metrics • Telegraf has integrations to source a variety of metrics, events, and logs • InfluxDB is used as a data store for time-stamped data • Kapacitor can process both stream and batch data from InfluxDB. It lets you plug in your own custom logic or user-defined functions to process alerts with dynamic thresholds, match metrics for patterns, compute statistical anomalies, and perform specific actions based on these alerts • Grafana allows you to query, visualize, alert on and understand your metrics
Telegraf, Influxdb, Kapacitor and Grafana 10
Logstash, Elasticsearch and Kibana 11 • Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite “stash.” • Elasticsearch is a distributed, RESTful search and analytics engine (lucene) • Kibana lets you visualize your Elasticsearch data
Logstash, Elasticsearch and Kibana 12
DBaaS 13 • Let’s prepare the system • Let’s install the 12.1.0.2 software • Let’s create a 12.1.0.2 database
Performance dashboards 14 • Telegraf is installed • Influxdb exists • Grafana exists • Let’s deploy telegraf configuration files • Let’s generate some load (SLOB) • Let’s see the performance dashboard
Alerting 15 • Telegraf configuration files are deployed • Kapacitor is installed • Let’s deploy Kapacitor configuration files • Let’s see the alerts
Logs and Audit 16 • Elasticsearch exists • Kibana exists • Let’s deploy logstash • Let’s generate some activity (logon, stop/start, ORA-) • Let’s see the kibana dashboard
Questions
Siège : 98 rue de Hochfelden F-67200 STRASBOURG Standard : +33 388 10 49 20 Fax : +33 388 10 82 27 www.digora.com www.digora.com

More Related Content

the tooling of a modern and agile oracle dba

  • 1. The tooling of a modern and agile Oracle DBA Bertrand Drouvot Expert Database Engineer bertrand.drouvot@digora.com
  • 2. About me 2 • Oracle DBA since about 20 years (currently focusing on PostgreSQL) • OCP • RAC certified Expert • Exadata certified implementation specialist • Kubernetes Administrator • Blogger since 2012 • Oracle ACE • Oak table member • @bertranddrouvot • BasketBall fan
  • 3. Challenge 3 • DBaaS with automation for: • Software installation • Database creation • Patching • Upgrade • Standby creation
  • 4. Challenge 4 • End user should access performance dashboards • End user should access logs • Security Team should access audit and logs • Monitoring and alerting • Same toold for all SGBD (oracle, postgres, mssql)
  • 5. Tools 5 • Ansible for automation • Telegraf, Influxdb and grafana to collect, store and display performance metrics • Logstash, elasticsearch and kibana to collect, store and display logs and audit • Kapacitor for monitoring and alerting
  • 6. What is this presentation about? 6 • Brief overview of Ansible • Brief overview of Telegraf, Influxdb and grafana • Brief overview of Logstash, elasticsearch and kibana • Brief overview of Kapacitor for monitoring and alerting • Live demo
  • 7. What this presentation is not? 7 • In depth overview of Ansible • In depth overview of Telegraf, Influxdb and grafana • In depth overview of Logstash, elasticsearch and kibana • In depth overview of Kapacitor for monitoring and alerting
  • 8. Ansible 8 • Ansible is a radically simple IT automation engine • it uses no agents • it's easy to deploy • it uses a very simple language (YAML, in the form of Ansible Playbooks)
  • 9. Telegraf, Influxdb, Kapacitor and Grafana 9 • Telegraf is a plugin-driven server agent for collecting and reporting metrics • Telegraf has integrations to source a variety of metrics, events, and logs • InfluxDB is used as a data store for time-stamped data • Kapacitor can process both stream and batch data from InfluxDB. It lets you plug in your own custom logic or user-defined functions to process alerts with dynamic thresholds, match metrics for patterns, compute statistical anomalies, and perform specific actions based on these alerts • Grafana allows you to query, visualize, alert on and understand your metrics
  • 11. Logstash, Elasticsearch and Kibana 11 • Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite “stash.” • Elasticsearch is a distributed, RESTful search and analytics engine (lucene) • Kibana lets you visualize your Elasticsearch data
  • 13. DBaaS 13 • Let’s prepare the system • Let’s install the 12.1.0.2 software • Let’s create a 12.1.0.2 database
  • 14. Performance dashboards 14 • Telegraf is installed • Influxdb exists • Grafana exists • Let’s deploy telegraf configuration files • Let’s generate some load (SLOB) • Let’s see the performance dashboard
  • 15. Alerting 15 • Telegraf configuration files are deployed • Kapacitor is installed • Let’s deploy Kapacitor configuration files • Let’s see the alerts
  • 16. Logs and Audit 16 • Elasticsearch exists • Kibana exists • Let’s deploy logstash • Let’s generate some activity (logon, stop/start, ORA-) • Let’s see the kibana dashboard
  • 18. Siège : 98 rue de Hochfelden F-67200 STRASBOURG Standard : +33 388 10 49 20 Fax : +33 388 10 82 27 www.digora.com www.digora.com