SlideShare a Scribd company logo

How to create custom dashboards in Elastic Search / Kibana with Performance Vision Data

•
•
PerformanceVision (previously SecurActive)
PerformanceVision (previously SecurActive)

Great contribution from our partner Splitpoints solutions on how to collect and format Performance Vision data into Elastic Search / Kibana. Potential applications are: - NPM or APM custom dashboards - Dashboards mixing Performance Vision data with other ITSM tools / sources - Alerting and baselining.

Related slideshows

Microservices: Breaking Apart the Monolith
Microservices: Breaking Apart the Monolith Microservices: Breaking Apart the Monolith
Microservices: Breaking Apart the Monolith
 
In the Spotlight WSO2 App Factory
In the Spotlight WSO2 App FactoryIn the Spotlight WSO2 App Factory
In the Spotlight WSO2 App Factory
 
Getting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-convergedGetting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-converged
 
1 of 18
Download to read offline
Performance Vision and Elastic Search / Hotrod Brett Airey September 2015
Products we use
What we do ! • Network Performance analysis. • Application Performance analysis. • Build Big Data Systems (Splunk & Hotrod) • Troubleshooting IT incidents full stack. • Manage and traffic-shape networks for maximum performance. ( Bandwidth still issue outside of major cities) • Custom Logging pipeline for Clients
The Challenges • Securactive - Technical Tool for the Tech’s • Disparate systems all have own Reporting • No Central point for Correlation and Collaboration. • Aggregation of Data , lose the ability to drill in to the fine resolution in a reasonable time period. Need more transparency of key Metrics
The Dream for resolving Incidents all stakeholders metrics in one place Incident COMMON TIME SERIES NETWORK METRICS ALL DEVICE ACCESS LOGS CHANGE CONTROL EVENTS SERVER RESOURCE METRICS APPLICATION METRICS / LOGS STORAGE PERFORMANCE METRICS APM NPM (Securactive )
Why we believe tools like Elasticsearch is the way • Open-source (Important community for us) • In memory searching, so it’s fast, scalable. • Has proven performance. • Hardware requirements low spec. • Works well with Docker “ Micro Services”
How we are doing it • HTML “API” into Securactive • Program ….. • Import • Naming convention - Std names ie Host,ipadd • HOTROD “ Panoptix”
Why HotRod into Elasticsearch • Authentication as standard. • Reader app to track highwatermark. • Alerting on variances to baseline. • Limit user view through role based access. • Loosley coupled, ability to change components with relative ease.
So how does it all work.. I am sure in the future versions we will get nicely formatted JSON. Performance Vision Elastic DB Hotrod/Elastic Interface
How it all fits Together
Harvesting Data from Securactive
The Elasticsearch Query
HotRod RESTful endpoint (API)
Displaying the Chart
Screen Shots Quick select periods and aggregation as well as Refresh interval for Dashboards
Screen Shots Visualise your key metrics
Screen Shots Visualise your Data using the extensive graphs available
HotRod is Opensource panoptix-za/HotRod · GitHub

More Related Content

How to create custom dashboards in Elastic Search / Kibana with Performance Vision Data

  • 1. Performance Vision and Elastic Search / Hotrod Brett Airey September 2015
  • 3. What we do ! • Network Performance analysis. • Application Performance analysis. • Build Big Data Systems (Splunk & Hotrod) • Troubleshooting IT incidents full stack. • Manage and traffic-shape networks for maximum performance. ( Bandwidth still issue outside of major cities) • Custom Logging pipeline for Clients
  • 4. The Challenges • Securactive - Technical Tool for the Tech’s • Disparate systems all have own Reporting • No Central point for Correlation and Collaboration. • Aggregation of Data , lose the ability to drill in to the fine resolution in a reasonable time period. Need more transparency of key Metrics
  • 5. The Dream for resolving Incidents all stakeholders metrics in one place Incident COMMON TIME SERIES NETWORK METRICS ALL DEVICE ACCESS LOGS CHANGE CONTROL EVENTS SERVER RESOURCE METRICS APPLICATION METRICS / LOGS STORAGE PERFORMANCE METRICS APM NPM (Securactive )
  • 6. Why we believe tools like Elasticsearch is the way • Open-source (Important community for us) • In memory searching, so it’s fast, scalable. • Has proven performance. • Hardware requirements low spec. • Works well with Docker “ Micro Services”
  • 7. How we are doing it • HTML “API” into Securactive • Program ….. • Import • Naming convention - Std names ie Host,ipadd • HOTROD “ Panoptix”
  • 8. Why HotRod into Elasticsearch • Authentication as standard. • Reader app to track highwatermark. • Alerting on variances to baseline. • Limit user view through role based access. • Loosley coupled, ability to change components with relative ease.
  • 9. So how does it all work.. I am sure in the future versions we will get nicely formatted JSON. Performance Vision Elastic DB Hotrod/Elastic Interface
  • 10. How it all fits Together
  • 11. Harvesting Data from Securactive
  • 15. Screen Shots Quick select periods and aggregation as well as Refresh interval for Dashboards
  • 17. Screen Shots Visualise your Data using the extensive graphs available