DevOps, Yet Another IT Revolution
•Download as PPTX, PDF•
0 likes•275 views
This document provides an overview of DevOps and the Elastic Stack. It defines IT operations (Ops) and describes the historical separation between development and operations teams. This led to bottlenecks and slow delivery. DevOps aims to break down barriers through practices like continuous integration, monitoring, and automation. The Elastic Stack is a suite of open source tools for logging, monitoring, and security including Elasticsearch, Kibana, Logstash, Beats, and X-Pack. It allows users to collect and analyze logs and metrics from multiple sources in real-time.
Report
Share
DevOps, Yet Another IT Revolution
- 1. Yet Another IT Revolution
- 3. INTRO
- 4. Ops? You’ve said Ops? • Ops stands for “IT Operations” • Ops are responsible for the smooth functioning of the infrastructure and operational environments that support application deployment such as: • network infrastructure; • server and device management; • computer operations; • IT infrastructure library (ITIL) management; • help desk services for an organization. Source: https://en.wikipedia.org/wiki/Information_technology_operations#
- 5. Ops? You’ve said Ops? Source: http://www.fcoos.net/index.php/services/it-infrastructure##
- 6. Some History Source: Brahim@CLD@Alithya DEV QA OPS OPS DEV QA OPS DEV QA **
- 10. Before DevOps *
- 11. *
- 12. Google Trends **
- 13. Rise of DevOps Source: https://en.wikipedia.org/wiki/DevOps#
- 14. Tear down that wall! #
- 15. What DevOps Aims At? Source: http://www.slideshare.net/Dynatrace/how-to-better-manage-technical-debt-while-innovating-on-devops ##
- 16. *
- 18. The Definition, finally! Put simply, DevOps is the culture, principles, and processes that automate and streamline the end- to-end flow from code development to delivering the features/changes to users in production. *
- 19. **
- 20. Configuration Automation (*) Core Coding Monitoring Software Engineering (*) or Infrastructure as Code (yet another exciting stuff)#
- 21. DevOps Tools Market Map #
- 22. CD Processes and Practices • Monitor everything • Put all production artifacts into version control • Developers to continually integrate new changes • Automated tests • Automate the configuration of environments • Code Review • Release smaller changes • Institute blameless postmortems • Use dashboards to promote communication Source: https://en.wikipedia.org/wiki/Information_technology_operations#
- 23. What DevOps Aims At? Source: http://www.slideshare.net/Dynatrace/how-to-better-manage-technical-debt-while-innovating-on-devops #
- 24. Monitoring tool: Elastic Stack • Reliably and securely take data from any source, in any format, and search, analyze, and visualize it in real time. #
- 25. Elastic Stack Components (Kibana) • Kbania is a visualization tool for data on top of elasticsearch. #
- 26. Elastic Stack Components (Elasticsearch) • Distributed, JSON-based search and analytics engine designed for horizontal scalability, maximum reliability, and easy management. • It centrally stores your data so you can discover the expected and uncover the unexpected. #
- 27. Elastic Stack Components (Logstash) • Is a data processing pipeline that ingests data (events and logs) from a multitude of sources simultaneously, transforms it, and then sends it to Elasticsearch. • As data travels from source to store, Logstash filters parse each event, identify named fields to build structure, and transform them to converge on a common format. #
- 28. Elastic Stack Components (Logstash) • Example of Logstash Configuration File: #
- 29. Elastic Stack Components (Logstash) • Assume the following log line from Apache: 127.0.0.1 - - [11/Dec/2013:00:01:45 -0800] "GET /xampp/status.php HTTP/1.1" 200 3891 "http://cadenza/xampp/navi.php" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:25.0) Gecko/20100101 Firefox/25.0 • Result of the parsing: #
- 30. Elastic Stack Components (Beats) • Platform for sending data from edge machines to Logstash and Elasticsearch. • Installed on your servers as lightweight agents and send data to Logstash (for transformation) or Elasticsearch. #
- 31. Elastic Stack Component (X-Pack) • Extends Elastic Stack: • Security • Alerting • Monitoring • Graph • Reporting ##
- 34. *# Merci!
Editor's Notes
- Source Code Management Tracking and controlling changes in the software, part of the larger cross-disciplinary field of configuration management.[2] SCM practices include revision control and the establishment of baselines. If something goes wrong, SCM can determine what was changed and who changed it. Git - An open source version control system (VCS) that’s distributed, so you can check in code and merge it while you are working offline. Subversion - An open source version control system. Continuous integration Jenkins - An open source continuous integration tool with automated continuous build and monitoring of externally-run jobs (for example, cron jobs). Maven- dependencies management Testing Unit testing, integration testing, functional testing (end to end) JUnit Selenium Containers Docker Configuration Management Puppet Chef Ansible Monitoring • Graphite - for storing data and rendering it graphically. • Logstash - for managing logs and other event data from your systems. • Nagios - A monitoring and alerting tool for servers, switches, applications and services. • Splunk - A tool for monitoring and visualizing data from your website, applications, servers, networks and other devices. Code review Gerrit - A web-based code review system that enables online code review for projects using the Git version control system. GitHub - An online system for collaboration, code review and and code management. Stash - A proprietary tool from Atlassian for reviewing code in Git, with enhanced security and other features for enterprise use.
- Monitor everything Collect and analyze data on production and test environment. Need to know the baseline performance, so we can see where to make improvement. Put all production artifacts into version control Code, infrastructure configuration Developers to continually integrate new changes Using CI tool, integrate all changes, and trigger automated tests on every build. Get build report. Automated tests Triggered by code check-in. Type: Performance, scalability, security, etc. Automate the configuration of environments Single process for creating environments Code Review Detect flaws early. Release smaller changes Institute blameless postmortems Use dashboards to promote communication
- Logstash (with help from the grok filter) was able to parse the log line (which happens to be in Apache "combined log" format) and break it up into many different discrete bits of information.
- Security (formerly Shield): Protect your data across the Elastic Stack. Alerting (via Watcher) Get notifications about changes in your data. Monitoring (formerly Marvel) Keep a pulse on the health of your stack. Graph Query and visualize meaningful relationships in your data. Reporting Generate, schedule, and email PDF reports.
- A few examples of Beats: Packetbeat is a network packet analyzer that ships information about the transactions exchanged between your application servers. Filebeat ships log files from your servers. Metricbeat is a server monitoring agent that periodically collects metrics from the operating systems and services running on your servers. Winlogbeat ships Windows event logs.