SlideShare a Scribd company logo
PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
« Observability »
To speed-up application performance
Stijn Schepers
PAC 2020 Santorin - Stijn Schepers
Photography: Chris Titze
P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Defenition: To Observe
Cambridge
Dictionary
Observe
to watch carefully the way something happens or the way someone does something, especially in
order to learn more about it.
https://dictionary.cambridge.org/dictionary/english/observe

Recommended for you

Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar

Join us to learn how to tune your web performance by combining synthetic, real-user, and competitive benchmarking metrics to give you the most complete dataset needed to optimize your site – and beat your competitors. You will learn: -Choosing the right tool for the job -Using competitive benchmarking data -Mine key performance analytics that matter -Putting performance in the context of your business

synthetic monitoringreal user monitoringreal user measurement
Recommended .conf21 Sessions
Recommended .conf21 SessionsRecommended .conf21 Sessions
Recommended .conf21 Sessions

This document provides recommendations for Splunk platform, dashboard studio, connected experience, and real-world customer use case recordings and readings. It lists specific recording IDs and titles that cover new features in the Splunk cloud platform and data ingestion, data visualization with dashboard studio, using anomaly detection with dashboard studio, enabling mobile access, and examples of how McLaren and a home training rig use Splunk.

best-of-conf21bestofconf21boc21
06/21 Raytheon North Texas Career Fair - IIS Req listin
06/21 Raytheon North Texas Career Fair - IIS Req listin06/21 Raytheon North Texas Career Fair - IIS Req listin
06/21 Raytheon North Texas Career Fair - IIS Req listin

Join Raytheon hiring teams that support open needs across North Texas! Attached is an open req list of positions we are looking to fill locally and across the world - stop by and talk to our teams! Thursday, June 21st, 3:00pm-7:00pm Courtyard Marriott 210 E Stacy Rd Allen, TX 75002

raytheoncareercareers
P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Defenition: Observability
Observability
In control theory, observability is a measure of how well internal states of a system can be
inferred from knowledge of its external outputs. The observability and controllability of a system
are mathematical duals.
https://en.wikipedia.org/wiki/Observability
P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Observability redefined for PE
Observe
In Performance Engineering: To watch carefully the behavior of an application – using response
metrics as primary measurement and resource utilization as secondary metrics – with the prime
goal to understand the digital end-user experience and pro-actively take actions if the experience is
unacceptable or degrading.
Digital User Experience
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
https://www.computerweekly.com/news/252477078/Millions-lost-due-to-lack-of-
effective-IT-operations-monitoring
Can’t see the wood for the trees
 Too much …
• Data .. OVERLOAD
• Errors and Warnings
• False positives (false alarms, a fire drill)
• False negatives (test that shows a woman is not pregnant,
a few months later she delivers a beautiful baby).
• Divercity of Monitoring Tools (log, system, apm, database,
network)
 Too little …
• Knowledge and understanding
• Context (business, application, changes, …)
• Communication and collaboration
• Ownership of Ops

Recommended for you

Dill may-2008
Dill may-2008Dill may-2008
Dill may-2008

The document discusses three major problems in verification: specifying properties to check, specifying the environment, and computational complexity. It then presents several approaches to addressing these problems, including using coverage metrics tailored to detection ability, sequential equivalence checking to avoid testbenches, and "perspective-based verification" using minimal abstract models focused on specific property classes. This allows verification earlier in design when changes are more tractable and catches bugs before implementation.

O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major EventsO'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events

This document discusses how to prepare a website for holidays and major events by focusing on performance. It recommends taking a continuous improvement approach of analyzing site usage data, testing for performance issues, and monitoring site performance during events. Key steps include studying past events to understand customer impacts, projecting future usage, contingency planning, and building a feedback loop between development, product management, and engineering. The goal is to adopt a culture where performance is a key feature and the site is always being prepared through continuous delivery, instrumentation, and addressing issues before they affect customers.

web performanceweb performance testingperformance testing
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTAThriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA

VerbalizeIt, a human-powered translation platform for businesses, was selected to appear on the popular Shark Tank TV show. Launching a completely revamped website, and recognizing the opportunity to convert six million viewers into customers, VerbalizeIt turned to SOASTA for cloud testing to ensure that their technology held up under the heavy spike in traffic. In this webinar, Kunal Sarda, COO of VerbalizeIt, will be discussing: VerbalizeIt’s road to Shark Tank and SOASTA How quickly they were able to test for the anticipated increase in Website Traffic Samples of user scenarios and tests conducted How web performance bottlenecks were uncovered and fixed Don’t miss this important webinar on performance testing

performance testingmobile trafficverbalizeit
Deployment History / Release Management
 Cross value streams and functionality
 Including infrastructure upgrades (a.k.a maintenance)
 Integrated with APM
 Provides context
 Problem resolution
Plan your marketing campaign
carefully.
Don’t let the BUSINESS be the
cause of DOWNTIME and POOR
performance
Marketing Campaign
PAC 2020 Santorin - Stijn Schepers
INSTRUMENTLEFT OBSERVE RIGHT
OBSERVABILITY

Recommended for you

Key Measurements For Testers
Key Measurements For TestersKey Measurements For Testers
Key Measurements For Testers

This document discusses key measurements for testers, including precision vs accuracy, goals for testing (SMART goals), the GQM methodology for defining test goals and questions, and various metrics for evaluating projects, products, and releases such as defect rates and trends. It provides examples of defining test plans and resources needed, tracking reported vs resolved defects, and criteria for determining when a release is ready.

Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present

Load testing approaches of the past support application delivery of the past. Times have changed. Today’s leading companies do more testing in less time with higher coverage of their web and mobile applications, everyday. In this webinar you’ll learn: - Why user experience is king - How to do front-to-back performance testing for mobile and web apps - How to deploy web and mobile load tests with global scale and distribution - Live production testing enabled with real-time analysis and control - How real user monitoring drives test creation and guides production testing The time is now to move your testing from the past to the present! Join us for tips and tricks to get you there.

load testingmobile testingcontinuous integration
Preparing for Enterprise Continuous Delivery - 5 Critical Steps
Preparing for Enterprise Continuous Delivery - 5 Critical StepsPreparing for Enterprise Continuous Delivery - 5 Critical Steps
Preparing for Enterprise Continuous Delivery - 5 Critical Steps

Slides from the July 31st, 2013 webinar "Preparing for Enterprise Continuous Delivery - 5 Critical Steps" by XebiaLabs

deployment automationdeployitxebialabs
Synthetic Monitoring
 Use a robot (script) to simulate at low load
(single user - thread) a specific business
transaction flow.
 Active monitoring
Application Performance Monitoring (APM)
 Monitor the performance of real users
 Passive Monitoring
Load Testing in production
 No issue with inconsistency of data, version
software, configuration and integration
 Know what you are doing!
 Minimise impact on real-end users.
 Be careful with “mutations” .
Use case
 Financial client
 2 deployments a week (SAFe)
 Hardware on premise
Tools:
 NeoLoad: daily automated load test (API)
 AppDynamics: APM Solution
 Dexter: Integration framework between AppD and
NeoLoad for metric dumps
 Robotic Analytical Framework (#Acnt_RAF):
Automatic Result Gathering & Automatic Analysis &
Reporting
 Tableau: Bi tool for Analytical Dashboards
Question:
How to observe the performance of the core business
application?
Definition:
 Daily Automated Load test in
Production with APM
enabled for metric collection
to Observe Application
behaviour.
Goal:
• Observe the performance of
your applications
PAC 2020 Santorin - Stijn Schepers

Recommended for you

Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15

Real-time Anomaly Detection for Real-time Data Needs: Much of the world’s data is becoming streaming, time-series data, where anomalies give significant information in often-critical situations. Examples abound in domains such as finance, IT, security, medical, and energy. Yet detecting anomalies in streaming data is a difficult task, requiring detectors to process data in real-time, not batches, and learn while simultaneously making predictions. Are there algorithms up for the challenge? Which are the most capable? The Numenta Anomaly Detection Benchmark (NAB) attempts to provide a controlled and repeatable environment of open-source tools to test and measure anomaly detection algorithms on streaming data. The perfect detector would detect all anomalies as soon as possible, trigger no false alarms, work with real-world time-series data across a variety of domains, and automatically adapt to changing statistics. These characteristics are formalized in NAB, using a custom scoring algorithm to evaluate the detectors on a benchmark dataset with labeled, real-world time-series data. We present these components, and describe the end-to-end scoring process. We give results and analyses for several algorithms to illustrate NAB in action. The goal for NAB is to provide a standard, open-source framework for which we can compare and evaluate different algorithms for detecting anomalies in streaming data.

#machinelearning#mlconf#subutaiahmad
JavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont DeliveryJavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont Delivery

These are the slides of my JavaOne presentation. The abstract goes like this: How do companies developing business-critical Java enterprise Web applications increase releases from 40 to 300 per year and still remain confident about a spike of 1,800 percent in traffic during key events such as Super Bowl Sunday or Cyber Monday? It takes a fundamental change in culture. Although DevOps is often seen as a mechanism for taming the chaos, adopting an agile methodology across all teams is only the first step. This session explores best practices for continuous delivery with higher quality for improving collaboration between teams by consolidating tools and for reducing overhead to fix issues. It shows how to build a performance-focused culture with tools such as Hudson, Jenkins, Chef, Puppet, Selenium, and Compuware APM/dynaTrace

javadevopsapplication performance management
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...

This presentation was given at StarWest 2013 in Anaheim, CA and also broadcasted through the Virtual Conference. It shows how important it is to focus on performance throughout continuous delivery in order to avoid the most common performance problem patterns that still cause applications to crash and engineers spending their weekends and nights in a firefighting/war room situation

application performance managementdevopscontinuous delivery
R
E
S
P
O
N
S
E
R6: No EHCache
R
E
S
P
O
N
S
E
R7: Implementation EHCache
maxElementsInMemory: 5000
R
E
S
P
O
N
S
E
R8
R
E
S
P
O
N
S
E

Recommended for you

Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...

The FDA is advising use of data standards as early as possible in the study lifecycle. As a result, Data Management centers are using the Study Data Tabulation Model (SDTM) to drive operations from First Patient In till Database Lock. Many tools on the market allow for the creation of SDTM datasets via intuitive user interfaces. However, targeted tools are needed to manage nightly jobs taking care of data source downloads (eCRF, ePRO, Lab, etc), data uploads in a staging database, converting to SDTM and running edit checks before the Clinical Data Manager arrives in the morning.

 
by SGS
clinical researchsdtm modellife science
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery

Accelerating Web and Mobile Testing for Continuous Delivery Automated load and performance testing of your web and mobile apps can ensure quality throughout the application lifecycle. Automated and continuous testing can increase the speed and accuracy of application readiness, and eliminate time-consuming, error-prone manual processes. In this webinar, led by SOASTA experts, you will learn: • How to create a continuous load and performance testing framework • How to trigger testing every time code changes are delivered • How to use TouchTest for mobile apps functional testing • How to use CloudTest for load testing

continuous deliverycloud testingjenkins plugin
ESC - More than Great Software
ESC -  More than Great SoftwareESC -  More than Great Software
ESC - More than Great Software

ESC was founded in 1969 and is the #1 supplier of CEMS software. It has the largest installed base, monitoring over 2,200 units at 600 plants. ESC provides extensive software and services to help customers manage emissions monitoring and reporting requirements. This includes StackVision software, engineering support, training, and responsive customer support. Upcoming events were highlighted to help customers stay up to date on regulations and learn how to optimize their emissions data management and reporting.

cems dahscems datacems das
R8.4: Fix: EHCACHE:
maxElementsInMemory: 0R
E
S
P
O
N
S
E
Fix: EHCACHE:
maxElementsInMemory: 1000
R
E
S
P
O
N
S
E
R
E
S
P
O
N
S
E
Metrics:
 Use Raw Data
 Include release_ID into your metrics to provide context
 Use a central repository to store metrics
Graphs:
 Different views of same data provide different insights
• Percentiles, logaritmic scale, averages and trends
 Do not (only) use averages
 Consider the usage of BI toolings for the analysis of results
Data
EXTraction
And
Enhanced
Reporting
https://github.com/Appdynamics/
AppDynamics.DEXTER/releases
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
METHOD 1

Recommended for you

SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with SplunkSplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk

Presented at SplunkLive! Munich 2018, gaining insight on both the experience, and the "why" behind the experience.

splunklivemunich18splunklivebig data
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with SplunkSplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk

Presented at SplunkLive! Frankfurt 2018: Monitoring App Experience...And the App Splunk and APM Demo/Customer Stories Key Takeaways

splunklivesplunklivefrankfurt18splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with SplunkSplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk

This document discusses using Splunk to gain insights into end user experience and the factors that influence experience. Splunk provides a platform approach to monitor applications across the full technology stack from networks to databases. It can ingest data from various sources, including APM tools, and provide visibility into both instrumented and non-instrumented applications and environments. Splunk also offers predictive analytics capabilities and allows various stakeholders like operations and business teams to access and analyze data. The document demonstrates how Splunk can help organizations improve user experience, application performance, and collaboration between teams.

splunksplunklivesplunklivezurich18
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller

Recommended for you

Workshop for newcomers
Workshop for newcomersWorkshop for newcomers
Workshop for newcomers

The document discusses improving web performance at Telefonica Digital through establishing practices like continuous performance integration, monitoring real user behavior, addressing non-functional requirements earlier, and establishing a performance testing culture. It notes current problems like a lack of tools, performance testing late in the process, and negative user feedback. The future involves integrating performance tests earlier, automating reports, and using real user monitoring for faster feedback.

Sfeldman performance bb_worldemea07
Sfeldman performance bb_worldemea07Sfeldman performance bb_worldemea07
Sfeldman performance bb_worldemea07

The document discusses performance engineering at Blackboard, including defining key concepts like performance, scalability, and the application performance index (Apdex). It outlines Blackboard's performance engineering process and methodology, including using tools like LoadRunner for testing and establishing performance archetype ratios to measure scalability. Planned performance engineering projects for 2007 are also mentioned, such as virtualization testing and monitoring initiatives.

Mapping vendor solutions to emmm capability map
Mapping vendor solutions to emmm capability mapMapping vendor solutions to emmm capability map
Mapping vendor solutions to emmm capability map

The document discusses application portfolio management in mining and presents a classification reference model mapping vendor solutions to business capabilities. It begins by covering application portfolio management and the need for an industry reference model given the specialized nature of mining applications. An application classification model is then developed by researching 91 vendors and 323 applications. The model maps applications across 5 levels based on their purpose. Finally, the document explores how the reference model can be used for customer rationalization, analyzing vendor solution spread, and vendor comparison.

realirmemmmopengroup
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller
Integration
NeoLoad
With
Dexter
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
NL: LOAD
TEST
Start Time
NL: DEXTER
Stop Time
Specifies what to extract
and what to report on.
Window:
Start Time - Stop Tme
System Under Test
Flamegraph
AppD
Appl.
Agent
A
P
I
AppDynamics
Controller
REST
CALLS
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E REST
CALLS
METHOD 2

Recommended for you

DevOps Kata Modern Debugging
DevOps Kata Modern DebuggingDevOps Kata Modern Debugging
DevOps Kata Modern Debugging

Visual Studio provides integrated tools to support DevOps practices like continuous integration, delivery, deployment and monitoring across the development and production environments. It allows teams to plan, develop, test and release applications while optimizing resources, managing technical debt, and gaining insights from evidence in production to refine future work.

Pre-Con Education: What's New in CA Application Performance Management 10.1
Pre-Con Education: What's New in CA Application Performance Management 10.1Pre-Con Education: What's New in CA Application Performance Management 10.1
Pre-Con Education: What's New in CA Application Performance Management 10.1

CA Application Performance Management (CA APM) 10 brings three all new patent pending features to change the way you triage and diagnose problems in your apps: a task-based perspectives view, an all new timeline that clearly shows the impact of change and differential analysis to reduce noise in automatic alerting. Learn about these features and how they will dramatically streamline your time to resolution. For more information, please visit http://cainc.to/Nv2VOe

application performance managementca world 15 devops agile opsperformance management
PAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis ChatzinasiosPAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis Chatzinasios

The document discusses how to automate performance testing in DevOps. It outlines an automated analysis workflow involving defining metrics, comparing metrics to thresholds and baselines, pattern analysis, and test results. It also discusses script automation, reducing false positives, and integrating different types of performance tests like load, stress, and spike tests. The goal is to automate performance testing to support the rapid delivery cycles of DevOps.

R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
Dahsboards include metrics from AppDynamics APM :
Response time of the load test in live production and
the response time of business transactions from
AppD (real user load + load from load test).
Additional secundair “System Resource”
dashboards
No captain for Ops …
…. not in DevOps
“Don’t go too much T”
Performance Engineering does require
experience and is not straightforward.
Same counts for operational monitoring

Recommended for you

KAVITHA SRINIVASAN UPDATED
KAVITHA SRINIVASAN UPDATEDKAVITHA SRINIVASAN UPDATED
KAVITHA SRINIVASAN UPDATED

The document provides a resume for Kavitha Srinivasan summarizing her career objective, professional experience, technical skills, education, strengths and work experience. She has over 3 years of experience in application support and maintenance. Her technical skills include languages like C, C#, Java and technologies like SQL Server, Oracle, .NET and she is currently pursuing an MCA degree. She has worked on projects for clients like Royal Bank of Scotland, Agilent Technologies and Walt Disney Parks providing support, maintenance and development services.

Asset Performance Management in Oil and Gas Industry
Asset Performance Management in Oil and Gas Industry Asset Performance Management in Oil and Gas Industry
Asset Performance Management in Oil and Gas Industry

This document provides an overview of asset performance management (APM) for oil and gas assets. It discusses how APM can improve efficiency by facilitating better data flow across departments. The document also outlines how APM can be applied at different stages including design, operations, and maintenance. It describes tools like reliability centered maintenance, risk-based inspection, and digital twins that are part of APM. The goal of APM is to optimize asset performance over the entire lifecycle and increase profits.

apmasset managementasset performance management
Software Testing and Quality Assurance Assignment 2
Software Testing and Quality Assurance Assignment 2Software Testing and Quality Assurance Assignment 2
Software Testing and Quality Assurance Assignment 2

The document discusses various software testing concepts and terms. It contains 10 short questions with explanations of stress testing, cyclomatic complexity, object oriented testing, regression testing, loop testing vs path testing, client server environment, graph based testing, security testing benefits, characteristics of real-time systems, and benefits of data flow testing. It also includes 4 longer questions about designing test cases, discussing factors for testing a real-time system, testing in a multiplatform environment, and explaining graph based testing in detail.

stqaassignment
QUESTION
How do you see that Performance Engineering should
be organised when delivering projects based on
Agile Delivery methods?
Where does the responsibility of performance,
stability and operational monitoring lie? One team ,
several specialised teams or is this the responsability
of the DevOps teams?
Note: Take the constraints of knowledge and resource shortage into
account.
Digital Delivery Center (DDC)
Business
(campaigs, communication,
public relations)
Release Management
(Applications, Infrastructure,
Security, DB, Network)
Value stream 1 Value stream 2 Value stream n
DevOps Team
Digital Delivery Center (DDC)
Responsible for:
 Operational Monitoring with a focus on Digital
Experience and from a wholistic point of view
 High Level Operational Strategy
 Operational Innovation and though leadership
 Primary support for business apps
 Bridge to secundair support in the value streams
 Supports the Value Streams with their monitoring
questions (e.g dashboards)
Team consists of:
 Performance Engineers / Architects
 Site Reliability Engineers
 Solution Architects
 Security Experts
Call Center
SIS
The best doctors will look at their patients from a
holistic point of view. They know their patient’s
history and understand their personal situation.
They do not put plasters on a wound but threat the
injury, so it heals.
ICT systems are similar….
You need to understand the systems; the current
state and the past state of the systems so you can
interpret metrics from a holistic point of view and
remediate if need be. Tools can be extremely
helpful, but the wisdom of the good doctor is still
required.
Monitoring should continuously be improved so
we can better threat the applications and let these
run as smoothly as possible, all the time.
CONCLUSION
P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
APPENDIX: Useful links
Agile Performance Testing in a CI/CD pipeline:
https://www.accenture-insights.nl/en-us/articles/test-your-agile-performance-with-raf
Robotic Analytical Framework (RAF)
https://www.linkedin.com/pulse/robotic-analytical-framework-raf-stijn-schepers
Performance Testing in a Devops World
https://www.linkedin.com/pulse/performance-testing-devops-world-stijn-schepers/
AppDynamics Dexter:
https://www.appdynamics.com/community/exchange/extension/appdynamics-dexter-data-extraction-enhanced-reporting/
https://github.com/Appdynamics/AppDynamics.DEXTER
The power of Bi Tools for Performance Engineering
https://www.youtube.com/watch?time_continue=108&v=7Zz2be4U_f0&feature=emb_logo
Millions lost due to lack of effective IT operations monitoring
https://www.computerweekly.com/news/252477078/Millions-lost-due-to-lack-of-effective-IT-operations-monitoring
From 0 to DevOps in 80 days
https://assets.dynatrace.com/en/docs/fs/from-0-to-devops-80-days-blog-reprint.pdf

Recommended for you

Slides chapter 15
Slides chapter 15Slides chapter 15
Slides chapter 15

The document discusses various metrics that can be used to measure different aspects of software quality. It describes McCall's quality factors triangle which identifies key attributes like correctness, reliability, efficiency etc. It then discusses different types of metrics like function-based metrics which measure functionality, design metrics which measure complexity, and class-oriented metrics which measure characteristics of object-oriented design like coupling and cohesion. The document provides examples of metrics that can measure code, interfaces, testing and more.

Resume_AmitJain_Testing_7YrsExp
Resume_AmitJain_Testing_7YrsExpResume_AmitJain_Testing_7YrsExp
Resume_AmitJain_Testing_7YrsExp

The document is a curriculum vitae for Amit Fatehchand Jain. It summarizes his professional experience, skills, education, and certifications. He has over 7 years of experience in automation testing and manual web testing. He is certified in principles of life insurance and foundation level testing. His skills include SQL, various programming languages, testing tools like UFT and QC. He has worked on projects for Tata Consultancy Services, Principal Financial Group, and Wipro Technologies testing applications in banking, finance, and insurance domains.

Data analytics to improve home broadband cx & network insight
Data analytics to improve home broadband cx & network insightData analytics to improve home broadband cx & network insight
Data analytics to improve home broadband cx & network insight

Collection of my ideas on #broadband Services #cxtransformation. I feel #dataandanalytics will definitely help in close loop systems, not only in #networks but also the business processes. #customerexperience is the key for ISPs & CSPs for retention and loyal customer base. The current network are improving the data set availability by using #telemetry #USP and #netconf, but still lot more standardisation is needed in this area, iOAM can be great protocol to implement. The Linux Foundation is also there in data analysis and AI, really thankful to them for democratisation of technology. #PNDA #ACUMOS #aiforeveryone #dataanalytics #closedloop #broadbandnetworks #ftth #NLP #predictiveanalytics #prescriptiveanalytics #analytics #analyticsplatform

broadbandbig dataanalytics
P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
APPENDIX: RAF (#Acnt_RAF)
R>A>F
Integration
NeoLoad
With
Dexter
----------------
Details
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
To give DEXTER instructions
on what to report, you create
a job parameter file in JSON
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
Shared Queue to share “the start time – 300
seconds” (pre-monitoring) of the automated load
test from 1 User Path (Business Transactions) to
another User Path (DXTR_ExtractMetrics_Appd).

Recommended for you

Proceedings of the 2015 Industrial and Systems Engineering Res.docx
Proceedings of the 2015 Industrial and Systems Engineering Res.docxProceedings of the 2015 Industrial and Systems Engineering Res.docx
Proceedings of the 2015 Industrial and Systems Engineering Res.docx

Proceedings of the 2015 Industrial and Systems Engineering Research Conference S. Cetinkaya and J. K. Ryan, eds. Use of Symbolic Regression for Lean Six Sigma Projects Daniel Moreno-Sanchez, MSc. Jacobo Tijerina-Aguilera, MSc. Universidad de Monterrey San Pedro Garza Garcia, NL 66238, Mexico Arlethe Yari Aguilar-Villarreal, MEng. Universidad Autonoma de Nuevo Leon San Nicolas de los Garza, NL 66451, Mexico Abstract Lean Six Sigma projects and the quality engineering profession have to deal with an extensive selection of tools most of them requiring specialized training. The increased availability of standard statistical software motivates the use of advanced data science techniques to identify relationships between potential causes and project metrics. In these circumstances, Symbolic Regression has received increased attention from researchers and practitioners to uncover the intrinsic relationships hidden within complex data without requiring specialized training for its implementation. The objective of this paper is to evaluate the advantages and drawbacks of using computer assisted Symbolic Regression within the Analyze phase of a Lean Six Sigma project. An application of this approach in a service industry project is also presented. Keywords Symbolic Regression, Data Science, Lean Six Sigma 1. Introduction Lean Six Sigma (LSS) has become a well-known hybrid methodology for quality and productivity improvement in organizations. Its wide adoption in several industries has shaped Process Innovation and Operational Excellence initiatives, enabling LSS to become a main topic in quality practitioner sites of interest [1], recognized Six Sigma (SS) certification body of knowledge contents [2], and professional society conferences [3]. However LSS projects and the quality engineering profession have to deal with an extensive selection of tools most of them requiring specialized training. To assist LSS practitioners it is common to categorize tools based on the traditional DMAIC model which stands for Define, Measure, Analyze, Improve, and Control phases. Table 1 presents an overview of the main tools that are commonly used in each phase of a LSS project, allowing team members to progressively develop an understanding between realizing each phase’s intent and how the selected tools can contribute to that purpose. This paper focuses on the Analyze phase where tools for statistical model building are most likely to be selected. The increased availability of standard statistical software motivates the use of advanced data science techniques to identify relationships between potential causes and project metrics. In these circumstances Symbolic Regression (SR) has received increased attention from researchers and practitioners even though SR is still in an early stage of commercial availability. The objective of this paper is to evaluate the advantages and drawbacks o ...

big-book-of-data-science-2ndedition.pdf
big-book-of-data-science-2ndedition.pdfbig-book-of-data-science-2ndedition.pdf
big-book-of-data-science-2ndedition.pdf

This document describes a solution accelerator for monitoring overall equipment effectiveness (OEE) and key performance indicators (KPIs) across multiple manufacturing factories in near real-time. It discusses how the Databricks lakehouse platform can be used to ingest sensor and operational technology data from devices, clean and structure the data, integrate it with data from ERP systems, calculate OEE and other metrics through streaming aggregations, and surface the outcomes through dashboards. The solution implements a data architecture pattern called medallion to incrementally move data from raw to aggregated layers for analysis.

Implementing error-proof, business-critical Machine Learning, presentation by...
Implementing error-proof, business-critical Machine Learning, presentation by...Implementing error-proof, business-critical Machine Learning, presentation by...
Implementing error-proof, business-critical Machine Learning, presentation by...

This presentation by Deevid De Meyer outlines how Brainjar uses human-centric design and explainability to create machine learning systems that work together with humans to improve efficiency while reducing error rate.

machine learningfairnesshuman-centric design
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E
R
E
S
P
O
N
S
E
R
E
S
O
U
R
C
E

More Related Content

What's hot

PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux
Neotys
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 
SRE vs DevOps
SRE vs DevOpsSRE vs DevOps
SRE vs DevOps
Levon Avakyan
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
SOASTA
 
Recommended .conf21 Sessions
Recommended .conf21 SessionsRecommended .conf21 Sessions
Recommended .conf21 Sessions
Splunk
 
06/21 Raytheon North Texas Career Fair - IIS Req listin
06/21 Raytheon North Texas Career Fair - IIS Req listin06/21 Raytheon North Texas Career Fair - IIS Req listin
06/21 Raytheon North Texas Career Fair - IIS Req listin
Toni Havlik
 
Dill may-2008
Dill may-2008Dill may-2008
Dill may-2008
Obsidian Software
 
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major EventsO'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
SOASTA
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTAThriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
SOASTA
 
Key Measurements For Testers
Key Measurements For TestersKey Measurements For Testers
Key Measurements For Testers
QA Programmer
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
Preparing for Enterprise Continuous Delivery - 5 Critical Steps
Preparing for Enterprise Continuous Delivery - 5 Critical StepsPreparing for Enterprise Continuous Delivery - 5 Critical Steps
Preparing for Enterprise Continuous Delivery - 5 Critical Steps
XebiaLabs
 
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
MLconf
 
JavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont DeliveryJavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont Delivery
Andreas Grabner
 
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
Andreas Grabner
 
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
SGS
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
SOASTA
 
ESC - More than Great Software
ESC -  More than Great SoftwareESC -  More than Great Software
ESC - More than Great Software
Environmental Systems Corporation
 

What's hot (18)

PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux PAC 2019 virtual Bruno Audoux
PAC 2019 virtual Bruno Audoux
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
 
SRE vs DevOps
SRE vs DevOpsSRE vs DevOps
SRE vs DevOps
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
Recommended .conf21 Sessions
Recommended .conf21 SessionsRecommended .conf21 Sessions
Recommended .conf21 Sessions
 
06/21 Raytheon North Texas Career Fair - IIS Req listin
06/21 Raytheon North Texas Career Fair - IIS Req listin06/21 Raytheon North Texas Career Fair - IIS Req listin
06/21 Raytheon North Texas Career Fair - IIS Req listin
 
Dill may-2008
Dill may-2008Dill may-2008
Dill may-2008
 
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major EventsO'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTAThriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
 
Key Measurements For Testers
Key Measurements For TestersKey Measurements For Testers
Key Measurements For Testers
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Preparing for Enterprise Continuous Delivery - 5 Critical Steps
Preparing for Enterprise Continuous Delivery - 5 Critical StepsPreparing for Enterprise Continuous Delivery - 5 Critical Steps
Preparing for Enterprise Continuous Delivery - 5 Critical Steps
 
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
Subutai Ahmad, VP of Research, Numenta at MLconf SF - 11/13/15
 
JavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont DeliveryJavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont Delivery
 
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
 
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
Automated SDTM Creation and Discrepancy Detection Jobs: The Numbers Tell The ...
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
 
ESC - More than Great Software
ESC -  More than Great SoftwareESC -  More than Great Software
ESC - More than Great Software
 

Similar to PAC 2020 Santorin - Stijn Schepers

SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with SplunkSplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
Splunk
 
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with SplunkSplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
Splunk
 
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with SplunkSplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
Splunk
 
Workshop for newcomers
Workshop for newcomersWorkshop for newcomers
Workshop for newcomers
Almudena Vivanco
 
Sfeldman performance bb_worldemea07
Sfeldman performance bb_worldemea07Sfeldman performance bb_worldemea07
Sfeldman performance bb_worldemea07
Steve Feldman
 
Mapping vendor solutions to emmm capability map
Mapping vendor solutions to emmm capability mapMapping vendor solutions to emmm capability map
Mapping vendor solutions to emmm capability map
Magdalena Bezuidenhout
 
DevOps Kata Modern Debugging
DevOps Kata Modern DebuggingDevOps Kata Modern Debugging
DevOps Kata Modern Debugging
James Tramel
 
Pre-Con Education: What's New in CA Application Performance Management 10.1
Pre-Con Education: What's New in CA Application Performance Management 10.1Pre-Con Education: What's New in CA Application Performance Management 10.1
Pre-Con Education: What's New in CA Application Performance Management 10.1
CA Technologies
 
PAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis ChatzinasiosPAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis Chatzinasios
Neotys
 
KAVITHA SRINIVASAN UPDATED
KAVITHA SRINIVASAN UPDATEDKAVITHA SRINIVASAN UPDATED
KAVITHA SRINIVASAN UPDATED
Kavitha Srinivasan
 
Asset Performance Management in Oil and Gas Industry
Asset Performance Management in Oil and Gas Industry Asset Performance Management in Oil and Gas Industry
Asset Performance Management in Oil and Gas Industry
Arrelic
 
Software Testing and Quality Assurance Assignment 2
Software Testing and Quality Assurance Assignment 2Software Testing and Quality Assurance Assignment 2
Software Testing and Quality Assurance Assignment 2
Gurpreet singh
 
Slides chapter 15
Slides chapter 15Slides chapter 15
Slides chapter 15
Priyanka Shetty
 
Resume_AmitJain_Testing_7YrsExp
Resume_AmitJain_Testing_7YrsExpResume_AmitJain_Testing_7YrsExp
Resume_AmitJain_Testing_7YrsExp
AMIT JAIN
 
Data analytics to improve home broadband cx & network insight
Data analytics to improve home broadband cx & network insightData analytics to improve home broadband cx & network insight
Data analytics to improve home broadband cx & network insight
Ravi Sharma
 
Proceedings of the 2015 Industrial and Systems Engineering Res.docx
Proceedings of the 2015 Industrial and Systems Engineering Res.docxProceedings of the 2015 Industrial and Systems Engineering Res.docx
Proceedings of the 2015 Industrial and Systems Engineering Res.docx
wkyra78
 
big-book-of-data-science-2ndedition.pdf
big-book-of-data-science-2ndedition.pdfbig-book-of-data-science-2ndedition.pdf
big-book-of-data-science-2ndedition.pdf
ssuserd397dd
 
Implementing error-proof, business-critical Machine Learning, presentation by...
Implementing error-proof, business-critical Machine Learning, presentation by...Implementing error-proof, business-critical Machine Learning, presentation by...
Implementing error-proof, business-critical Machine Learning, presentation by...
Patrick Van Renterghem
 
#rstats lessons for #measure
#rstats lessons for #measure#rstats lessons for #measure
#rstats lessons for #measure
Mark Edmondson
 
ERP presentation ejaz ahmed bhatti
ERP  presentation  ejaz ahmed bhattiERP  presentation  ejaz ahmed bhatti
ERP presentation ejaz ahmed bhatti
Ejaz Bhatti
 

Similar to PAC 2020 Santorin - Stijn Schepers (20)

SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with SplunkSplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
SplunkLive! Munich 2018: Monitoring the End-User Experience with Splunk
 
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with SplunkSplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
SplunkLive! Frankfurt 2018 - Monitoring the End User Experience with Splunk
 
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with SplunkSplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
SplunkLive! Zurich 2018: Monitoring the End User Experience with Splunk
 
Workshop for newcomers
Workshop for newcomersWorkshop for newcomers
Workshop for newcomers
 
Sfeldman performance bb_worldemea07
Sfeldman performance bb_worldemea07Sfeldman performance bb_worldemea07
Sfeldman performance bb_worldemea07
 
Mapping vendor solutions to emmm capability map
Mapping vendor solutions to emmm capability mapMapping vendor solutions to emmm capability map
Mapping vendor solutions to emmm capability map
 
DevOps Kata Modern Debugging
DevOps Kata Modern DebuggingDevOps Kata Modern Debugging
DevOps Kata Modern Debugging
 
Pre-Con Education: What's New in CA Application Performance Management 10.1
Pre-Con Education: What's New in CA Application Performance Management 10.1Pre-Con Education: What's New in CA Application Performance Management 10.1
Pre-Con Education: What's New in CA Application Performance Management 10.1
 
PAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis ChatzinasiosPAC 2020 Santorin - Vasilis Chatzinasios
PAC 2020 Santorin - Vasilis Chatzinasios
 
KAVITHA SRINIVASAN UPDATED
KAVITHA SRINIVASAN UPDATEDKAVITHA SRINIVASAN UPDATED
KAVITHA SRINIVASAN UPDATED
 
Asset Performance Management in Oil and Gas Industry
Asset Performance Management in Oil and Gas Industry Asset Performance Management in Oil and Gas Industry
Asset Performance Management in Oil and Gas Industry
 
Software Testing and Quality Assurance Assignment 2
Software Testing and Quality Assurance Assignment 2Software Testing and Quality Assurance Assignment 2
Software Testing and Quality Assurance Assignment 2
 
Slides chapter 15
Slides chapter 15Slides chapter 15
Slides chapter 15
 
Resume_AmitJain_Testing_7YrsExp
Resume_AmitJain_Testing_7YrsExpResume_AmitJain_Testing_7YrsExp
Resume_AmitJain_Testing_7YrsExp
 
Data analytics to improve home broadband cx & network insight
Data analytics to improve home broadband cx & network insightData analytics to improve home broadband cx & network insight
Data analytics to improve home broadband cx & network insight
 
Proceedings of the 2015 Industrial and Systems Engineering Res.docx
Proceedings of the 2015 Industrial and Systems Engineering Res.docxProceedings of the 2015 Industrial and Systems Engineering Res.docx
Proceedings of the 2015 Industrial and Systems Engineering Res.docx
 
big-book-of-data-science-2ndedition.pdf
big-book-of-data-science-2ndedition.pdfbig-book-of-data-science-2ndedition.pdf
big-book-of-data-science-2ndedition.pdf
 
Implementing error-proof, business-critical Machine Learning, presentation by...
Implementing error-proof, business-critical Machine Learning, presentation by...Implementing error-proof, business-critical Machine Learning, presentation by...
Implementing error-proof, business-critical Machine Learning, presentation by...
 
#rstats lessons for #measure
#rstats lessons for #measure#rstats lessons for #measure
#rstats lessons for #measure
 
ERP presentation ejaz ahmed bhatti
ERP  presentation  ejaz ahmed bhattiERP  presentation  ejaz ahmed bhatti
ERP presentation ejaz ahmed bhatti
 

More from Neotys

PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner
Neotys
 
PAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur JainPAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur Jain
Neotys
 
PAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen TownshendPAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen Townshend
Neotys
 
PAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro MelendezPAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro Melendez
Neotys
 
PAC 2019 virtual Stephen Townshend
PAC 2019 virtual Stephen TownshendPAC 2019 virtual Stephen Townshend
PAC 2019 virtual Stephen Townshend
Neotys
 
PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo   PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo
Neotys
 
PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez
Neotys
 
PAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark TomlinsonPAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark Tomlinson
Neotys
 
PAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli AparnaPAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli Aparna
Neotys
 
PAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan GeorgePAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan George
Neotys
 
PAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van GaalenPAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van Gaalen
Neotys
 
PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan  PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan
Neotys
 
PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg  PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg
Neotys
 
PAC 2019 virtual Antoine Toulme
PAC 2019 virtual Antoine ToulmePAC 2019 virtual Antoine Toulme
PAC 2019 virtual Antoine Toulme
Neotys
 
PAC 2019 virtual Scott Moore
PAC 2019  virtual   Scott Moore PAC 2019  virtual   Scott Moore
PAC 2019 virtual Scott Moore
Neotys
 
PAC 2019 virtual Stefano Doni
PAC 2019 virtual Stefano Doni   PAC 2019 virtual Stefano Doni
PAC 2019 virtual Stefano Doni
Neotys
 
PAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRAN
PAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRANPAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRAN
PAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRAN
Neotys
 
PAC 2019 virtual Stijn Schepers
PAC 2019 virtual Stijn SchepersPAC 2019 virtual Stijn Schepers
PAC 2019 virtual Stijn Schepers
Neotys
 
PAC 2019 virtual Philip Webb
PAC 2019 virtual Philip Webb PAC 2019 virtual Philip Webb
PAC 2019 virtual Philip Webb
Neotys
 
PAC 2019 virtual Christoph NEUMÜLLER
PAC 2019 virtual Christoph NEUMÜLLERPAC 2019 virtual Christoph NEUMÜLLER
PAC 2019 virtual Christoph NEUMÜLLER
Neotys
 

More from Neotys (20)

PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner PAC 2020 Santorin - Andreas Grabner
PAC 2020 Santorin - Andreas Grabner
 
PAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur JainPAC 2020 Santorin - Ankur Jain
PAC 2020 Santorin - Ankur Jain
 
PAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen TownshendPAC 2020 Santorin - Stephen Townshend
PAC 2020 Santorin - Stephen Townshend
 
PAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro MelendezPAC 2020 Santorin - Leandro Melendez
PAC 2020 Santorin - Leandro Melendez
 
PAC 2019 virtual Stephen Townshend
PAC 2019 virtual Stephen TownshendPAC 2019 virtual Stephen Townshend
PAC 2019 virtual Stephen Townshend
 
PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo   PAC 2019 virtual Federico Toledo
PAC 2019 virtual Federico Toledo
 
PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez PAC 2019 virtual Leandro Melendez
PAC 2019 virtual Leandro Melendez
 
PAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark TomlinsonPAC 2019 virtual Mark Tomlinson
PAC 2019 virtual Mark Tomlinson
 
PAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli AparnaPAC 2019 virtual Srivalli Aparna
PAC 2019 virtual Srivalli Aparna
 
PAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan GeorgePAC 2019 virtual Reuben Rajan George
PAC 2019 virtual Reuben Rajan George
 
PAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van GaalenPAC 2019 virtual Joerek Van Gaalen
PAC 2019 virtual Joerek Van Gaalen
 
PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan  PAC 2019 virtual Hemalatha Murugesan
PAC 2019 virtual Hemalatha Murugesan
 
PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg  PAC 2019 virtual Arjan Van Den Berg
PAC 2019 virtual Arjan Van Den Berg
 
PAC 2019 virtual Antoine Toulme
PAC 2019 virtual Antoine ToulmePAC 2019 virtual Antoine Toulme
PAC 2019 virtual Antoine Toulme
 
PAC 2019 virtual Scott Moore
PAC 2019  virtual   Scott Moore PAC 2019  virtual   Scott Moore
PAC 2019 virtual Scott Moore
 
PAC 2019 virtual Stefano Doni
PAC 2019 virtual Stefano Doni   PAC 2019 virtual Stefano Doni
PAC 2019 virtual Stefano Doni
 
PAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRAN
PAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRANPAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRAN
PAC 2019 virtual Uma Malini ; Hari Krishnan RAMACHANDRAN
 
PAC 2019 virtual Stijn Schepers
PAC 2019 virtual Stijn SchepersPAC 2019 virtual Stijn Schepers
PAC 2019 virtual Stijn Schepers
 
PAC 2019 virtual Philip Webb
PAC 2019 virtual Philip Webb PAC 2019 virtual Philip Webb
PAC 2019 virtual Philip Webb
 
PAC 2019 virtual Christoph NEUMÜLLER
PAC 2019 virtual Christoph NEUMÜLLERPAC 2019 virtual Christoph NEUMÜLLER
PAC 2019 virtual Christoph NEUMÜLLER
 

Recently uploaded

GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdfGUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
ProexportColombia1
 
Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and PreventionUnderstanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Bert Blevins
 
Vernier Caliper and How to use Vernier Caliper.ppsx
Vernier Caliper and How to use Vernier Caliper.ppsxVernier Caliper and How to use Vernier Caliper.ppsx
Vernier Caliper and How to use Vernier Caliper.ppsx
Tool and Die Tech
 
Rotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptxRotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptx
surekha1287
 
How to Manage Internal Notes in Odoo 17 POS
How to Manage Internal Notes in Odoo 17 POSHow to Manage Internal Notes in Odoo 17 POS
How to Manage Internal Notes in Odoo 17 POS
Celine George
 
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-IDUNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
GOWSIKRAJA PALANISAMY
 
Exploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative ReviewExploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative Review
sipij
 
Development of Chatbot Using AI/ML Technologies
Development of  Chatbot Using AI/ML TechnologiesDevelopment of  Chatbot Using AI/ML Technologies
Development of Chatbot Using AI/ML Technologies
maisnampibarel
 
Online music portal management system project report.pdf
Online music portal management system project report.pdfOnline music portal management system project report.pdf
Online music portal management system project report.pdf
Kamal Acharya
 
MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme
MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K SchemeMSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme
MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme
Anwar Patel
 
Conservation of Taksar through Economic Regeneration
Conservation of Taksar through Economic RegenerationConservation of Taksar through Economic Regeneration
Conservation of Taksar through Economic Regeneration
PriyankaKarn3
 
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
VICTOR MAESTRE RAMIREZ
 
Introduction to IP address concept - Computer Networking
Introduction to IP address concept - Computer NetworkingIntroduction to IP address concept - Computer Networking
Introduction to IP address concept - Computer Networking
Md.Shohel Rana ( M.Sc in CSE Khulna University of Engineering & Technology (KUET))
 
OCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdf
OCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdfOCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdf
OCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdf
Muanisa Waras
 
Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...
Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...
Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...
Miss Khusi #V08
 
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model SafeBangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
bookhotbebes1
 
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.docCCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
Dss
 
21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY
21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY
21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY
PradeepKumarSK3
 
PMSM-Motor-Control : A research about FOC
PMSM-Motor-Control : A research about FOCPMSM-Motor-Control : A research about FOC
PMSM-Motor-Control : A research about FOC
itssurajthakur06
 
LeetCode Database problems solved using PySpark.pdf
LeetCode Database problems solved using PySpark.pdfLeetCode Database problems solved using PySpark.pdf
LeetCode Database problems solved using PySpark.pdf
pavanaroshni1977
 

Recently uploaded (20)

GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdfGUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
GUIA_LEGAL_CHAPTER_4_FOREIGN TRADE CUSTOMS.pdf
 
Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and PreventionUnderstanding Cybersecurity Breaches: Causes, Consequences, and Prevention
Understanding Cybersecurity Breaches: Causes, Consequences, and Prevention
 
Vernier Caliper and How to use Vernier Caliper.ppsx
Vernier Caliper and How to use Vernier Caliper.ppsxVernier Caliper and How to use Vernier Caliper.ppsx
Vernier Caliper and How to use Vernier Caliper.ppsx
 
Rotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptxRotary Intersection in traffic engineering.pptx
Rotary Intersection in traffic engineering.pptx
 
How to Manage Internal Notes in Odoo 17 POS
How to Manage Internal Notes in Odoo 17 POSHow to Manage Internal Notes in Odoo 17 POS
How to Manage Internal Notes in Odoo 17 POS
 
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-IDUNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
UNIT I INCEPTION OF INFORMATION DESIGN 20CDE09-ID
 
Exploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative ReviewExploring Deep Learning Models for Image Recognition: A Comparative Review
Exploring Deep Learning Models for Image Recognition: A Comparative Review
 
Development of Chatbot Using AI/ML Technologies
Development of  Chatbot Using AI/ML TechnologiesDevelopment of  Chatbot Using AI/ML Technologies
Development of Chatbot Using AI/ML Technologies
 
Online music portal management system project report.pdf
Online music portal management system project report.pdfOnline music portal management system project report.pdf
Online music portal management system project report.pdf
 
MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme
MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K SchemeMSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme
MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme MSBTE K Scheme
 
Conservation of Taksar through Economic Regeneration
Conservation of Taksar through Economic RegenerationConservation of Taksar through Economic Regeneration
Conservation of Taksar through Economic Regeneration
 
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
Advances in Detect and Avoid for Unmanned Aircraft Systems and Advanced Air M...
 
Introduction to IP address concept - Computer Networking
Introduction to IP address concept - Computer NetworkingIntroduction to IP address concept - Computer Networking
Introduction to IP address concept - Computer Networking
 
OCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdf
OCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdfOCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdf
OCS Training - Rig Equipment Inspection - Advanced 5 Days_IADC.pdf
 
Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...
Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...
Phone Us ❤ X000XX000X ❤ #ℂall #gIRLS In Chennai By Chenai @ℂall @Girls Hotel ...
 
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model SafeBangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
Bangalore @ℂall @Girls ꧁❤ 0000000000 ❤꧂@ℂall @Girls Service Vip Top Model Safe
 
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.docCCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
CCS367-STORAGE TECHNOLOGIES QUESTION BANK.doc
 
21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY
21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY
21EC63_Module1B.pptx VLSI design 21ec63 MOS TRANSISTOR THEORY
 
PMSM-Motor-Control : A research about FOC
PMSM-Motor-Control : A research about FOCPMSM-Motor-Control : A research about FOC
PMSM-Motor-Control : A research about FOC
 
LeetCode Database problems solved using PySpark.pdf
LeetCode Database problems solved using PySpark.pdfLeetCode Database problems solved using PySpark.pdf
LeetCode Database problems solved using PySpark.pdf
 

PAC 2020 Santorin - Stijn Schepers

  • 1. PERFORMANCE IS NOT A MYTH P E R F O R M A N C E A D V I S O R Y C O U N C I L SANTORINI GREECE FEBRUARY 26 - 27 2020 « Observability » To speed-up application performance Stijn Schepers
  • 4. P E R F O R M A N C E A D V I S O R Y C O U N C I L byP E R F O R M A N C E A D V I S O R Y C O U N C I L Defenition: To Observe Cambridge Dictionary Observe to watch carefully the way something happens or the way someone does something, especially in order to learn more about it. https://dictionary.cambridge.org/dictionary/english/observe
  • 5. P E R F O R M A N C E A D V I S O R Y C O U N C I L byP E R F O R M A N C E A D V I S O R Y C O U N C I L Defenition: Observability Observability In control theory, observability is a measure of how well internal states of a system can be inferred from knowledge of its external outputs. The observability and controllability of a system are mathematical duals. https://en.wikipedia.org/wiki/Observability
  • 6. P E R F O R M A N C E A D V I S O R Y C O U N C I L byP E R F O R M A N C E A D V I S O R Y C O U N C I L Observability redefined for PE Observe In Performance Engineering: To watch carefully the behavior of an application – using response metrics as primary measurement and resource utilization as secondary metrics – with the prime goal to understand the digital end-user experience and pro-actively take actions if the experience is unacceptable or degrading. Digital User Experience R E S P O N S E R E S O U R C E
  • 8. Can’t see the wood for the trees  Too much … • Data .. OVERLOAD • Errors and Warnings • False positives (false alarms, a fire drill) • False negatives (test that shows a woman is not pregnant, a few months later she delivers a beautiful baby). • Divercity of Monitoring Tools (log, system, apm, database, network)  Too little … • Knowledge and understanding • Context (business, application, changes, …) • Communication and collaboration • Ownership of Ops
  • 9. Deployment History / Release Management  Cross value streams and functionality  Including infrastructure upgrades (a.k.a maintenance)  Integrated with APM  Provides context  Problem resolution
  • 10. Plan your marketing campaign carefully. Don’t let the BUSINESS be the cause of DOWNTIME and POOR performance Marketing Campaign
  • 13. Synthetic Monitoring  Use a robot (script) to simulate at low load (single user - thread) a specific business transaction flow.  Active monitoring Application Performance Monitoring (APM)  Monitor the performance of real users  Passive Monitoring Load Testing in production  No issue with inconsistency of data, version software, configuration and integration  Know what you are doing!  Minimise impact on real-end users.  Be careful with “mutations” .
  • 14. Use case  Financial client  2 deployments a week (SAFe)  Hardware on premise Tools:  NeoLoad: daily automated load test (API)  AppDynamics: APM Solution  Dexter: Integration framework between AppD and NeoLoad for metric dumps  Robotic Analytical Framework (#Acnt_RAF): Automatic Result Gathering & Automatic Analysis & Reporting  Tableau: Bi tool for Analytical Dashboards Question: How to observe the performance of the core business application?
  • 15. Definition:  Daily Automated Load test in Production with APM enabled for metric collection to Observe Application behaviour. Goal: • Observe the performance of your applications
  • 23. R E S P O N S E Metrics:  Use Raw Data  Include release_ID into your metrics to provide context  Use a central repository to store metrics Graphs:  Different views of same data provide different insights • Percentiles, logaritmic scale, averages and trends  Do not (only) use averages  Consider the usage of BI toolings for the analysis of results
  • 25. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 26. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 27. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 28. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 29. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 30. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 31. Integration NeoLoad With Dexter R E S P O N S E R E S O U R C E NL: LOAD TEST Start Time NL: DEXTER Stop Time Specifies what to extract and what to report on. Window: Start Time - Stop Tme System Under Test Flamegraph AppD Appl. Agent A P I AppDynamics Controller
  • 34. Dahsboards include metrics from AppDynamics APM : Response time of the load test in live production and the response time of business transactions from AppD (real user load + load from load test). Additional secundair “System Resource” dashboards
  • 35. No captain for Ops … …. not in DevOps
  • 36. “Don’t go too much T” Performance Engineering does require experience and is not straightforward. Same counts for operational monitoring
  • 37. QUESTION How do you see that Performance Engineering should be organised when delivering projects based on Agile Delivery methods? Where does the responsibility of performance, stability and operational monitoring lie? One team , several specialised teams or is this the responsability of the DevOps teams? Note: Take the constraints of knowledge and resource shortage into account.
  • 38. Digital Delivery Center (DDC) Business (campaigs, communication, public relations) Release Management (Applications, Infrastructure, Security, DB, Network) Value stream 1 Value stream 2 Value stream n DevOps Team Digital Delivery Center (DDC) Responsible for:  Operational Monitoring with a focus on Digital Experience and from a wholistic point of view  High Level Operational Strategy  Operational Innovation and though leadership  Primary support for business apps  Bridge to secundair support in the value streams  Supports the Value Streams with their monitoring questions (e.g dashboards) Team consists of:  Performance Engineers / Architects  Site Reliability Engineers  Solution Architects  Security Experts Call Center SIS
  • 39. The best doctors will look at their patients from a holistic point of view. They know their patient’s history and understand their personal situation. They do not put plasters on a wound but threat the injury, so it heals. ICT systems are similar…. You need to understand the systems; the current state and the past state of the systems so you can interpret metrics from a holistic point of view and remediate if need be. Tools can be extremely helpful, but the wisdom of the good doctor is still required. Monitoring should continuously be improved so we can better threat the applications and let these run as smoothly as possible, all the time. CONCLUSION
  • 40. P E R F O R M A N C E A D V I S O R Y C O U N C I L byP E R F O R M A N C E A D V I S O R Y C O U N C I L APPENDIX: Useful links Agile Performance Testing in a CI/CD pipeline: https://www.accenture-insights.nl/en-us/articles/test-your-agile-performance-with-raf Robotic Analytical Framework (RAF) https://www.linkedin.com/pulse/robotic-analytical-framework-raf-stijn-schepers Performance Testing in a Devops World https://www.linkedin.com/pulse/performance-testing-devops-world-stijn-schepers/ AppDynamics Dexter: https://www.appdynamics.com/community/exchange/extension/appdynamics-dexter-data-extraction-enhanced-reporting/ https://github.com/Appdynamics/AppDynamics.DEXTER The power of Bi Tools for Performance Engineering https://www.youtube.com/watch?time_continue=108&v=7Zz2be4U_f0&feature=emb_logo Millions lost due to lack of effective IT operations monitoring https://www.computerweekly.com/news/252477078/Millions-lost-due-to-lack-of-effective-IT-operations-monitoring From 0 to DevOps in 80 days https://assets.dynatrace.com/en/docs/fs/from-0-to-devops-80-days-blog-reprint.pdf
  • 41. P E R F O R M A N C E A D V I S O R Y C O U N C I L byP E R F O R M A N C E A D V I S O R Y C O U N C I L APPENDIX: RAF (#Acnt_RAF)
  • 42. R>A>F
  • 44. To give DEXTER instructions on what to report, you create a job parameter file in JSON R E S P O N S E R E S O U R C E Shared Queue to share “the start time – 300 seconds” (pre-monitoring) of the automated load test from 1 User Path (Business Transactions) to another User Path (DXTR_ExtractMetrics_Appd).

Editor's Notes

  1. Shit LEFT