SlideShare a Scribd company logo
Performance Testing Highlights  Sharad Jain Date – 07 th  Feb 2011
What is Performance Testing Performance testing  – refers to test activities on checking system performance The major objectives of performance testing: To confirm and validate the specified system performance requirements. To check the current product capacity to answer the questions from customers and marketing people. To identify performance issues and performance degradation in a given system
Differences b/w Performance, Load and Stress Test Performance   Test  determine the run time “ behavior ” of the application and its supporting infrastructure, under certain conditions. Performance testing is used to measure several system characteristics, such as processing speed, response time, resource consumption, throughput and efficiency. Load  Test  determine the applications “ behavior under load” , up to and including its limits (not just as its limits). Load tests specifically refers to the load size (number of concurrent users) and related values. Stress Test  determines the application  ability  to handle large amount of data  Stress testing can be much more successful with the full load applied to the server.
Why Performance Testing? Scalability  – Will the application handle the expected load and beyond?  Stability  – Is the application stable under expected and unexpected user loads?  Availability  – Is the application available to the end user without any interruption? Serviceability  – Can the system quickly recover from a Failure? Speed  - Does the application respond quickly. Confidence  – Are you sure that clients will have a positive experience on go-live day?

Recommended for you

Getting start with Performance Testing
Getting start with Performance Testing Getting start with Performance Testing
Getting start with Performance Testing

The document discusses performance testing. It defines performance testing as determining how fast and stable a system is. It outlines why performance testing is important to identify problems early, prevent revenue and credibility loss from poor performance, and ensure systems meet expectations. It also discusses various performance testing terms, metrics, processes, limitations of manual testing, and benefits of automation using tools like LoadRunner and JMeter.

Types of performance testing
Types of performance testingTypes of performance testing
Types of performance testing

Performance testing validates an application's responsiveness, stability, and other quality attributes under various workloads. It involves load testing, stress testing, endurance testing, spike testing, volume testing, availability testing, and scalability testing. The key parameters analyzed are response time, throughput, and memory utilization. Performance testing helps determine an application's speed, scalability, stability, and ability to handle changes in load and traffic over time.

performance testingspike testingperformance testing types
QA. Load Testing
QA. Load TestingQA. Load Testing
QA. Load Testing

Load testing is done to determine system limits, verify response times under high load, check stability, and predict future needs. Open source tools like JMeter, Yandex Tank, and Taurus can be used. With JMeter, a test plan is created with thread groups, HTTP requests, and listeners to start load testing. Issues like slow responses or server crashes are identified. Short term fixes include restarting servers or tuning configurations, while long term solutions involve moving to the cloud, using caching, or splitting applications into microservices. Other commercial load testing tools are also available from companies like SOASTA and BlazeMeter.

testingloadblazemeter
Performance Requirements Following are some representative  performance requirements  which system would be expected to meet  The system should support peak load of x active users and y transactions/sec. (for web based application it could be requests/sec)  At peak load, system response to the X% of users should be Y Sec. System should be able to support 24 X 7 operation (reliability) System should be scalable to meet growth in demand. The response time requirement could vary based on Geographical location of users Connection bandwidth (especially true for Internet users) Transaction complexity.
Performance parameters to consider  Throughput : The number of requests processed per unit time (per second) Latency : The time taken in establishing the network handshake. Efficiency : Throughput - Latency Degradation : The Throughput of the application when the concurrent requests are gradually increased – Test to see if the performance of the application degrades when the number of concurrent requests is increased. Longevity   :  Execute tests for a pre-determined time interval with a pre-determined load. Monitor the health of the application throughout the test execution and check for memory leaks and analyze the GC dump
What Performance Problem may arise ? Memory-related problems: Application uses more memory than it should.  Memory leaks.  Excessive garbage allocation, i.e. application creates a lot of temporary objects.  Code-related problems: Application algorithms are not optimal, and there are performance bottlenecks.  Hardware/Software related Problem:  Hardware you select for your database is not in vendor Hardware Compatibility List
Scalability  This section talks about the impact of scaling up the Hardware resources from the suggested minimum Hardware requirements  Processor impact Database impact I/O impact Network bandwidth Impact

Recommended for you

Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter intro

Why performance testing is important? Introduction to performance testing. Load profiles, metrics Performance testing tools Implementation process Performance testing engineer skills JMeter intro LINKS: About performance testing: http://docplayer.net/29696161-Performance-matters-key-consumer-insights.html http://www.softwaretestingclass.com/what-is-performance-testing/ https://www.blazemeter.com/blog http://revolutionit.com.au/performance-testing-digital-projects-dont-leave-it-to-the-developers/ https://www.youtube.com/embed/61Kkgnx-zF8?list=PLSjEh0z5QH9lKpMO4Nf3buFiP7tt0gTRN Concurrent users calculation: https://blog.xceptance.com/2013/07/26/concurrent-users-the-art-of-calculation/ https://techbeacon.com/how-many-virtual-users-do-i-need-load-testing https://www.webperformance.com/library/tutorials/CalculateNumberOfLoadtestUsers/ Browser performance: https://www.slideshare.net/nicjansma/measuring-real-user-performance-in-the-browser Books for start: “Web Load Testing For Dummies”, Scott Barber with Colin Mason “JMeter Cookbook”, Bayo Erinle

performance testingloadperformance
Load Testing Best Practices
Load Testing Best PracticesLoad Testing Best Practices
Load Testing Best Practices

Load Testing Best Practices: Application complexity is increasing, yet the stringent requirements for web performance is increasing exponentially. Learn more about the three major types of load testing, determine which you need and how to conduct them.

load testingweb performanceweb application
Performance testing
Performance testing Performance testing
Performance testing

BugRaptors Perform performance testing using different types of tools helps determining how fast some aspect of a system performs under a particular workload. It can help different purposes like it demonstrates that the system meets performance criteria in any condition.

performance testingstress testingrecovery testing
Processor Impact Single Processor v/s Multi Processor   The  response time  for  searching or archiving  a document decreased by  50 - 80%  on adding an additional processor in a multi-threaded scenario (info based on assumptions)
Data base Impact Single Processor v/s Multi Processor  As the number of concurrent users using application services are increased, it is  observed  that Oracle performs better than MS SQL Server with a 5 - 8% improvement in the performance (info based on assumptions)
I/O Impact I/O has considerable impact on the performance of the Application with 15% to 18% reduction in the response time especially when there are huge reports to be generated on the system .
Network bandwidth Impact A good Network connectivity between the Client, Application Server and database  improves the performance considerably. There was 40% (approx)  improvement in the throughput of the application when the Network Connectivity between Database system and Application Server system was increased from 100 mbps to  1Gbps  (info based on assumptions).

Recommended for you

Performance testing with JMeter
Performance testing with JMeterPerformance testing with JMeter
Performance testing with JMeter

This document discusses performance testing tools and techniques. It defines performance from the perspectives of developers, infrastructure, and end users. Key aspects covered include defining realistic user scenarios, available tools like JMeter, ApacheBench, Gatling and Locust, and the importance of continuous performance testing. The document recommends using the Apdex score as part of your definition of done, specifying good test scenarios, running tests simultaneously, choosing the right tool for your needs, and considering tools like Taurus that enable continuous performance testing.

drupaljmeterperformance
JMeter
JMeterJMeter
JMeter

- JMeter is an open source load testing tool that can test web applications and other services. It uses virtual users to simulate real user load on a system. - JMeter tests are prepared by recording HTTP requests using a proxy server. Tests are organized into thread groups and loops to simulate different user behaviors and loads. - Tests can be made generic by using variables and default values so the same tests can be run against different environments. Assertions are added to validate responses. - Tests are run in non-GUI mode for load testing and can be distributed across multiple machines for high user loads. Test results are analyzed using aggregated graphs and result trees.

Performance Requirement Gathering
Performance Requirement GatheringPerformance Requirement Gathering
Performance Requirement Gathering

The document discusses gathering requirements for performance testing an application. It lists questions to ask about the application type and architecture, test environment, workload model, and performance goals. Key information needs include the application technology, database and server used, network details, protocols, user sessions and load over time, and goals for response times and system utilization under load. The requirements gathered will help determine the appropriate performance tests and pass/fail criteria.

performance testingjmeterloadrunner
Identify the Performance issues Application Code Application Design. JVM settings Application server configuration and usage Web Server Configuration and usage   Database Schema, design, configurations, resource usage, SQLs, Indexes etc OS Resources – CPU, Network, Disk, Memory, OS kernel, Storage etc   Browser settings, Client system, Page size, amount of  data displayed
Performance Bottleneck Sources
Database Server Causes
App Server Causes

Recommended for you

Performance Test Plan - Sample 1
Performance Test Plan - Sample 1Performance Test Plan - Sample 1
Performance Test Plan - Sample 1

This document outlines a performance test plan for Sakai 2.5.0. It describes the objectives, approach, test types, metrics, goals, tools, and data preparation. The objectives are to validate Sakai meets minimum performance standards and test any new or changed tools. Tests include capacity, consistent load, and single function stress tests. Metrics like response time, CPU utilization, and errors will be measured. Goals include average response time under 2.5s and max under 30s, CPU under 75%, and 500 concurrent users supported. Silk Performer will be used to run tests against a Sakai/Tomcat/Oracle environment. Over 92,000 students and 1,557 instructors of data will be preloaded

performance testingjmeterapache jmeter
Jmeter Performance Testing
Jmeter Performance TestingJmeter Performance Testing
Jmeter Performance Testing

The document discusses performance testing using Apache JMeter. It covers topics like an overview of performance testing, the purpose of performance testing, key types of performance testing like load testing and stress testing. It also discusses pre-requisites of performance testing, the performance testing life cycle, challenges of performance testing and how to record and playback tests using JMeter.

jmeterapache jmeterperformance testing
Manual testing concepts course 1
Manual testing concepts course 1Manual testing concepts course 1
Manual testing concepts course 1

Testing software is conducted to ensure the system meets user needs and requirements. The primary objectives of testing are to verify that the right system was built according to specifications and that it was built correctly. Testing helps instill user confidence, ensures functionality and performance, and identifies any issues where the system does not meet specifications. Different types of testing include unit, integration, system, and user acceptance testing, which are done at various stages of the software development life cycle.

Network Causes
Software and Hardware Requirements Hardware Requirement Details of system to be tested Workstation required for load simulation Workstation required for running monitoring utilities Network Equipment (e.g. Router, Firewall, Modems etc.) Software Requirement System Software Load Testing Tools Performance Monitoring utilities Miscellaneous utilities like graph generation etc.
Performance Testing Process Understand system and identify performance requirements Identify performance test objectives. Define performance test strategy: Identify the needs of performance test tools and define performance test environment Write performance test plan Set up the target system and performance test beds Design performance test cases and test suite Performance test execution and data collection Performance analysis and reporting
Performance Testing Approach Performance testing: (during production) Measure and analyze the system performance based on performance test data and results Performance simulation: (pre-production) Study and estimate system performance using a simulation approach Performance measurement at the customer site: (post-production) Measure and evaluate system performance during system operations

Recommended for you

Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter

This document provides an agenda and overview for a performance testing training with JMeter. It begins with an introduction to performance testing, including the purpose and types of performance testing. It then covers getting started with JMeter, including installation, setup, and running JMeter. The remainder of the document outlines the content to be covered, including building test plans with JMeter, load and performance testing of websites, parameterization, adding assertions, and best practices. The goal is to teach participants how to use JMeter to perform various types of performance testing of applications and websites.

jmeterperformanceperformance testing best practices
Performance testing interview questions and answers
Performance testing interview questions and answersPerformance testing interview questions and answers
Performance testing interview questions and answers

In software engineering, performance testing is in general testing performed to determine how a system performs in terms of responsiveness and stability under a particular workload. It can also serve to investigate, measure, validate or verify other quality attributes of the system, such as scalability, reliability and resource usage.

performance testing interview questions and answersoftware testing interview questions and answerstesting tools interview question
QA process Presentation
QA process PresentationQA process Presentation
QA process Presentation

The Heuristic Test Strategy Model provides a framework for designing effective test strategies. It involves considering four key areas: 1) the project environment including resources, constraints, and other factors; 2) the product elements to be tested; 3) quality criteria such as functionality, usability, and security; and 4) appropriate test techniques to apply. Some common test techniques include functional testing, domain testing, stress testing, flow testing, and scenario testing.

Performance Modeling Project Overview In order to   analyze performance behavior, improve product performance, and serve as the foundation for capacity planning   The overall goal was to design and develop a model that would be: realistic  and  general  enough to be widely applicable across a variety of customer configuration and application scenarios in Altair target market. simple  enough to be easily usable by the field sales and support organizations to assist customers make system configuration decisions possible to  validate  so that it could be applied with confidence.
What  is the resultant deliverable  The resultant of this performance testing exercise is a “ Performance and Scalability document ” with results of the tests performed and hardware recommendations. The document would not be a sizing guide per se but will have: Throughput and scalability numbers for the end users to consume  Test metrics - numbers and graphs related to the tests executed And an internally consumable document containing performance recommendations for the developers to work on. Also, note that the resultant document is not a Sizing guide. But this document will definitely be a good input to the performance team to come up with a sizing guide for the future releases.
Thank You

More Related Content

What's hot

Introduction to performance testing
Introduction to performance testingIntroduction to performance testing
Introduction to performance testing
Tharinda Liyanage
 
Infographic: Importance of Performance Testing
Infographic: Importance of Performance TestingInfographic: Importance of Performance Testing
Infographic: Importance of Performance Testing
KiwiQA
 
Performance testing
Performance testingPerformance testing
Performance testing
Jyoti Babbar
 
Getting start with Performance Testing
Getting start with Performance Testing Getting start with Performance Testing
Getting start with Performance Testing
Yogesh Deshmukh
 
Types of performance testing
Types of performance testingTypes of performance testing
Types of performance testing
NaveenKumar Namachivayam
 
QA. Load Testing
QA. Load TestingQA. Load Testing
QA. Load Testing
Alex Galkin
 
Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter intro
Mykola Kovsh
 
Load Testing Best Practices
Load Testing Best PracticesLoad Testing Best Practices
Load Testing Best Practices
Apica
 
Performance testing
Performance testing Performance testing
Performance testing
BugRaptors
 
Performance testing with JMeter
Performance testing with JMeterPerformance testing with JMeter
Performance testing with JMeter
Mikael Kundert
 
JMeter
JMeterJMeter
Performance Requirement Gathering
Performance Requirement GatheringPerformance Requirement Gathering
Performance Requirement Gathering
Atul Pant
 
Performance Test Plan - Sample 1
Performance Test Plan - Sample 1Performance Test Plan - Sample 1
Performance Test Plan - Sample 1
Atul Pant
 
Jmeter Performance Testing
Jmeter Performance TestingJmeter Performance Testing
Jmeter Performance Testing
Atul Pant
 
Manual testing concepts course 1
Manual testing concepts course 1Manual testing concepts course 1
Manual testing concepts course 1
Raghu Kiran
 
Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter
Prashanth Kumar
 
Performance testing interview questions and answers
Performance testing interview questions and answersPerformance testing interview questions and answers
Performance testing interview questions and answers
Garuda Trainings
 
QA process Presentation
QA process PresentationQA process Presentation
QA process Presentation
Nadeeshani Aththanagoda
 
Performance Testing Using JMeter | Edureka
Performance Testing Using JMeter | EdurekaPerformance Testing Using JMeter | Edureka
Performance Testing Using JMeter | Edureka
Edureka!
 
Load Testing and JMeter Presentation
Load Testing and JMeter PresentationLoad Testing and JMeter Presentation
Load Testing and JMeter Presentation
Neill Lima
 

What's hot (20)

Introduction to performance testing
Introduction to performance testingIntroduction to performance testing
Introduction to performance testing
 
Infographic: Importance of Performance Testing
Infographic: Importance of Performance TestingInfographic: Importance of Performance Testing
Infographic: Importance of Performance Testing
 
Performance testing
Performance testingPerformance testing
Performance testing
 
Getting start with Performance Testing
Getting start with Performance Testing Getting start with Performance Testing
Getting start with Performance Testing
 
Types of performance testing
Types of performance testingTypes of performance testing
Types of performance testing
 
QA. Load Testing
QA. Load TestingQA. Load Testing
QA. Load Testing
 
Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter intro
 
Load Testing Best Practices
Load Testing Best PracticesLoad Testing Best Practices
Load Testing Best Practices
 
Performance testing
Performance testing Performance testing
Performance testing
 
Performance testing with JMeter
Performance testing with JMeterPerformance testing with JMeter
Performance testing with JMeter
 
JMeter
JMeterJMeter
JMeter
 
Performance Requirement Gathering
Performance Requirement GatheringPerformance Requirement Gathering
Performance Requirement Gathering
 
Performance Test Plan - Sample 1
Performance Test Plan - Sample 1Performance Test Plan - Sample 1
Performance Test Plan - Sample 1
 
Jmeter Performance Testing
Jmeter Performance TestingJmeter Performance Testing
Jmeter Performance Testing
 
Manual testing concepts course 1
Manual testing concepts course 1Manual testing concepts course 1
Manual testing concepts course 1
 
Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter
 
Performance testing interview questions and answers
Performance testing interview questions and answersPerformance testing interview questions and answers
Performance testing interview questions and answers
 
QA process Presentation
QA process PresentationQA process Presentation
QA process Presentation
 
Performance Testing Using JMeter | Edureka
Performance Testing Using JMeter | EdurekaPerformance Testing Using JMeter | Edureka
Performance Testing Using JMeter | Edureka
 
Load Testing and JMeter Presentation
Load Testing and JMeter PresentationLoad Testing and JMeter Presentation
Load Testing and JMeter Presentation
 

Similar to Performance testing : An Overview

performancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfperformancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdf
MAshok10
 
Less11 3 e_loadmodule_1
Less11 3 e_loadmodule_1Less11 3 e_loadmodule_1
Less11 3 e_loadmodule_1
Suresh Mishra
 
Performance Testing using LoadRunner
Performance Testing using LoadRunnerPerformance Testing using LoadRunner
Performance Testing using LoadRunner
Kumar Gupta
 
QSpiders - Introduction to HP Load Runner
QSpiders - Introduction to HP Load RunnerQSpiders - Introduction to HP Load Runner
QSpiders - Introduction to HP Load Runner
Qspiders - Software Testing Training Institute
 
Performance testing basics
Performance testing basicsPerformance testing basics
Performance testing basics
Charu Anand
 
Performance Testing With Loadrunner
Performance Testing With LoadrunnerPerformance Testing With Loadrunner
Performance Testing With Loadrunner
vladimir zaremba
 
PerformanceTestingWithLoadrunner
PerformanceTestingWithLoadrunnerPerformanceTestingWithLoadrunner
PerformanceTestingWithLoadrunner
techgajanan
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
Anu Shaji
 
Performance testing wreaking balls
Performance testing wreaking ballsPerformance testing wreaking balls
Performance testing wreaking balls
Leonid Grinshpan, Ph.D.
 
Neev Load Testing Services
Neev Load Testing ServicesNeev Load Testing Services
Neev Load Testing Services
Neev Technologies
 
T3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of ExcellenceT3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of Excellence
veehikle
 
QSpiders - Introduction to JMeter
QSpiders - Introduction to JMeterQSpiders - Introduction to JMeter
QSpiders - Introduction to JMeter
Qspiders - Software Testing Training Institute
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
Impetus Technologies
 
Performance testing methodologies and tools
Performance testing methodologies and toolsPerformance testing methodologies and tools
Performance testing methodologies and tools
Alexander Decker
 
11.performance testing methodologies and tools
11.performance testing methodologies and tools11.performance testing methodologies and tools
11.performance testing methodologies and tools
Alexander Decker
 
Performance testing and rpt
Performance testing and rptPerformance testing and rpt
Performance testing and rpt
SivaprasanthRentala1975
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
Future Simmons
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
Future Simmons
 
Performance testing
Performance testingPerformance testing
Performance testing
Chalana Kahandawala
 
Magical Performance tuning with Gomez
Magical Performance tuning with GomezMagical Performance tuning with Gomez
Magical Performance tuning with Gomez
mcsaha
 

Similar to Performance testing : An Overview (20)

performancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfperformancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdf
 
Less11 3 e_loadmodule_1
Less11 3 e_loadmodule_1Less11 3 e_loadmodule_1
Less11 3 e_loadmodule_1
 
Performance Testing using LoadRunner
Performance Testing using LoadRunnerPerformance Testing using LoadRunner
Performance Testing using LoadRunner
 
QSpiders - Introduction to HP Load Runner
QSpiders - Introduction to HP Load RunnerQSpiders - Introduction to HP Load Runner
QSpiders - Introduction to HP Load Runner
 
Performance testing basics
Performance testing basicsPerformance testing basics
Performance testing basics
 
Performance Testing With Loadrunner
Performance Testing With LoadrunnerPerformance Testing With Loadrunner
Performance Testing With Loadrunner
 
PerformanceTestingWithLoadrunner
PerformanceTestingWithLoadrunnerPerformanceTestingWithLoadrunner
PerformanceTestingWithLoadrunner
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
Performance testing wreaking balls
Performance testing wreaking ballsPerformance testing wreaking balls
Performance testing wreaking balls
 
Neev Load Testing Services
Neev Load Testing ServicesNeev Load Testing Services
Neev Load Testing Services
 
T3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of ExcellenceT3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of Excellence
 
QSpiders - Introduction to JMeter
QSpiders - Introduction to JMeterQSpiders - Introduction to JMeter
QSpiders - Introduction to JMeter
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
 
Performance testing methodologies and tools
Performance testing methodologies and toolsPerformance testing methodologies and tools
Performance testing methodologies and tools
 
11.performance testing methodologies and tools
11.performance testing methodologies and tools11.performance testing methodologies and tools
11.performance testing methodologies and tools
 
Performance testing and rpt
Performance testing and rptPerformance testing and rpt
Performance testing and rpt
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
 
Performance testing
Performance testingPerformance testing
Performance testing
 
Magical Performance tuning with Gomez
Magical Performance tuning with GomezMagical Performance tuning with Gomez
Magical Performance tuning with Gomez
 

Recently uploaded

TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Chris Swan
 
Best Programming Language for Civil Engineers
Best Programming Language for Civil EngineersBest Programming Language for Civil Engineers
Best Programming Language for Civil Engineers
Awais Yaseen
 
Mitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing SystemsMitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing Systems
ScyllaDB
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
Bert Blevins
 
WPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide DeckWPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide Deck
Lidia A.
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
Andrey Yasko
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
Stephanie Beckett
 
UiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs ConferenceUiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs Conference
UiPathCommunity
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
Safe Software
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
Mark Billinghurst
 
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfINDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
jackson110191
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
welrejdoall
 
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfBT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
Neo4j
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Bert Blevins
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
Toru Tamaki
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 

Recently uploaded (20)

TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...
 
Best Programming Language for Civil Engineers
Best Programming Language for Civil EngineersBest Programming Language for Civil Engineers
Best Programming Language for Civil Engineers
 
Mitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing SystemsMitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing Systems
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
Password Rotation in 2024 is still Relevant
Password Rotation in 2024 is still RelevantPassword Rotation in 2024 is still Relevant
Password Rotation in 2024 is still Relevant
 
WPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide DeckWPRiders Company Presentation Slide Deck
WPRiders Company Presentation Slide Deck
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
 
What's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptxWhat's New in Copilot for Microsoft365 May 2024.pptx
What's New in Copilot for Microsoft365 May 2024.pptx
 
UiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs ConferenceUiPath Community Day Kraków: Devs4Devs Conference
UiPath Community Day Kraków: Devs4Devs Conference
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
 
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfINDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
 
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdfBT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
BT & Neo4j: Knowledge Graphs for Critical Enterprise Systems.pptx.pdf
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 

Performance testing : An Overview

  • 1. Performance Testing Highlights Sharad Jain Date – 07 th Feb 2011
  • 2. What is Performance Testing Performance testing – refers to test activities on checking system performance The major objectives of performance testing: To confirm and validate the specified system performance requirements. To check the current product capacity to answer the questions from customers and marketing people. To identify performance issues and performance degradation in a given system
  • 3. Differences b/w Performance, Load and Stress Test Performance Test determine the run time “ behavior ” of the application and its supporting infrastructure, under certain conditions. Performance testing is used to measure several system characteristics, such as processing speed, response time, resource consumption, throughput and efficiency. Load Test determine the applications “ behavior under load” , up to and including its limits (not just as its limits). Load tests specifically refers to the load size (number of concurrent users) and related values. Stress Test determines the application ability to handle large amount of data Stress testing can be much more successful with the full load applied to the server.
  • 4. Why Performance Testing? Scalability – Will the application handle the expected load and beyond? Stability – Is the application stable under expected and unexpected user loads? Availability – Is the application available to the end user without any interruption? Serviceability – Can the system quickly recover from a Failure? Speed - Does the application respond quickly. Confidence – Are you sure that clients will have a positive experience on go-live day?
  • 5. Performance Requirements Following are some representative performance requirements which system would be expected to meet The system should support peak load of x active users and y transactions/sec. (for web based application it could be requests/sec) At peak load, system response to the X% of users should be Y Sec. System should be able to support 24 X 7 operation (reliability) System should be scalable to meet growth in demand. The response time requirement could vary based on Geographical location of users Connection bandwidth (especially true for Internet users) Transaction complexity.
  • 6. Performance parameters to consider Throughput : The number of requests processed per unit time (per second) Latency : The time taken in establishing the network handshake. Efficiency : Throughput - Latency Degradation : The Throughput of the application when the concurrent requests are gradually increased – Test to see if the performance of the application degrades when the number of concurrent requests is increased. Longevity : Execute tests for a pre-determined time interval with a pre-determined load. Monitor the health of the application throughout the test execution and check for memory leaks and analyze the GC dump
  • 7. What Performance Problem may arise ? Memory-related problems: Application uses more memory than it should. Memory leaks. Excessive garbage allocation, i.e. application creates a lot of temporary objects. Code-related problems: Application algorithms are not optimal, and there are performance bottlenecks. Hardware/Software related Problem: Hardware you select for your database is not in vendor Hardware Compatibility List
  • 8. Scalability This section talks about the impact of scaling up the Hardware resources from the suggested minimum Hardware requirements Processor impact Database impact I/O impact Network bandwidth Impact
  • 9. Processor Impact Single Processor v/s Multi Processor The response time for searching or archiving a document decreased by 50 - 80% on adding an additional processor in a multi-threaded scenario (info based on assumptions)
  • 10. Data base Impact Single Processor v/s Multi Processor As the number of concurrent users using application services are increased, it is observed that Oracle performs better than MS SQL Server with a 5 - 8% improvement in the performance (info based on assumptions)
  • 11. I/O Impact I/O has considerable impact on the performance of the Application with 15% to 18% reduction in the response time especially when there are huge reports to be generated on the system .
  • 12. Network bandwidth Impact A good Network connectivity between the Client, Application Server and database improves the performance considerably. There was 40% (approx) improvement in the throughput of the application when the Network Connectivity between Database system and Application Server system was increased from 100 mbps to 1Gbps (info based on assumptions).
  • 13. Identify the Performance issues Application Code Application Design. JVM settings Application server configuration and usage Web Server Configuration and usage Database Schema, design, configurations, resource usage, SQLs, Indexes etc OS Resources – CPU, Network, Disk, Memory, OS kernel, Storage etc Browser settings, Client system, Page size, amount of data displayed
  • 18. Software and Hardware Requirements Hardware Requirement Details of system to be tested Workstation required for load simulation Workstation required for running monitoring utilities Network Equipment (e.g. Router, Firewall, Modems etc.) Software Requirement System Software Load Testing Tools Performance Monitoring utilities Miscellaneous utilities like graph generation etc.
  • 19. Performance Testing Process Understand system and identify performance requirements Identify performance test objectives. Define performance test strategy: Identify the needs of performance test tools and define performance test environment Write performance test plan Set up the target system and performance test beds Design performance test cases and test suite Performance test execution and data collection Performance analysis and reporting
  • 20. Performance Testing Approach Performance testing: (during production) Measure and analyze the system performance based on performance test data and results Performance simulation: (pre-production) Study and estimate system performance using a simulation approach Performance measurement at the customer site: (post-production) Measure and evaluate system performance during system operations
  • 21. Performance Modeling Project Overview In order to analyze performance behavior, improve product performance, and serve as the foundation for capacity planning The overall goal was to design and develop a model that would be: realistic and general enough to be widely applicable across a variety of customer configuration and application scenarios in Altair target market. simple enough to be easily usable by the field sales and support organizations to assist customers make system configuration decisions possible to validate so that it could be applied with confidence.
  • 22. What is the resultant deliverable The resultant of this performance testing exercise is a “ Performance and Scalability document ” with results of the tests performed and hardware recommendations. The document would not be a sizing guide per se but will have: Throughput and scalability numbers for the end users to consume Test metrics - numbers and graphs related to the tests executed And an internally consumable document containing performance recommendations for the developers to work on. Also, note that the resultant document is not a Sizing guide. But this document will definitely be a good input to the performance team to come up with a sizing guide for the future releases.

Editor's Notes

  1. Master Title: Font – Arial, Size - 22pt, Color – Orange (R:255/G:102/B:0) Subtitle: Font – Arial, Size - 16pt, Color – Grey (R:77/G:77/B:77)
  2. Master Title: Font – Arial, Size - 22pt, Color – Orange (R:244/G:185/B:85) Master Text Style: Font – Arial, Size - 20pt, Color – Grey (R:77/G:77/B:77) Second Level: Font – Arial, Size - 18pt, Color – Grey (R:77/G:77/B:77) Third Level: Font – Arial, Size - 16pt, Color – Grey (R:77/G:77/B:77) Fourth Level: Font – Arial, Size - 16pt, Color – Grey (R:77/G:77/B:77) Fifth Level: Font – Arial, Size - 16pt, Color – Grey (R:77/G:77/B:77)