QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхронных систем

•

0 likes•297 views

Обычно в процессе нагрузочного тестирование необходимые app-side метрики(response time, throughput, ..) можно получить прямо в генераторе нагрузки. Мы шлем запрос, получаем респонс и зачастую время выполнения запроса это и есть то что нам нужно. Но что если после того как сервер отдал вам ответ происходит еще ряд асинхронных операций, время выполнения которых нам необходимо проверить? Как замерить время выполнения этих запросов? Какая часть системы является узким местом в производительности? В докладе рассмотрим какие челенжи появляются в такой ситуации и как их можно решить.

Тема доклада
Тема доклада
Тема доклада
KYIV 2019
Нагрузочное тестирование
распределенных асинхронных систем
QA CONFERENCE #1 IN UKRAINE

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Senior Performance Analyst - Epam Systems
Performance testing courses - StartIT Training Center
Conducting performance testing workshops
Winner of several TestUaStartups testathones, Dev Challenge
and UaWebChallenge competitions
Anton Serputko

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Application  
server
Database  
server
75
April May June July
0
50
100
May July
Классическая ситуация

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Добавим асинхронности
Database  
server
Inbound
Outbound
Application  
server
Microservices
Some  
other 
clients

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Задачи на “протестировать”
• Создание обьекта в приложении(Capacity, load, stress, …) 
- Время/пропускная способность создания обьекта в приложении
• Тестирование Outbound очереди(Mock микросервисов) 
- Время обработки/пропускная способность outbound(ожидание в
очереди, отправка на микросервисы)
• Тестирование Inbound очереди(Mock kafka) 
- Время обработки/пропускная способность inbound

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Задачи на “протестировать”
• Тестирование отдельных микросервисов
• Тестирование интеграции Outbound -> Microservices 
Время обработки/пропускная способность outbound(ожидание в очереди,
отправка на микросервисы и обработка на микросервисах)
• Тестирование всей системы целиком

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Database  
server
Inbound
Outbound
Application  
server
Microservices
75
April May June July
0
75
May July

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Тестирование outbound очереди

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Database  
server
Inbound
Outbound
Application  
server
75
April May June July
0
75
May July
Microservices 
mock

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Структура jmeter сценария для outbound

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Мониторинг очереди через jmx

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Тестирование inbound очереди

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Тестирование отдельных микросервисов

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Microservices
75
April May June July
0
75
May July

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Интеграционное тестирование 
Тестирование всей системы

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Логгирование времени обработки на
серверах

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Дашборды с визуализацией времени
обработки

WITH PASSION TO QUALITY QA CONFERENCE #1 IN UKRAINE KYIV 2019
Фейсбук Performance testing framework
Вопросы?

What's hot

Agile Network India | Understanding the importance of a full featured CI/CD p...

AgileNetwork

Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...

Cigniti Technologies Ltd

This document summarizes a presentation about testing e-commerce websites for Black Friday. It discusses: - Best practices for retail e-commerce testing including having a testing strategy, understanding user behavior, and testing in production. - How SOASTA CloudTest can help with testing including global test locations, automated scaling, and a "kill switch" to stop tests without fear. - A case study of how Cigniti helped a large US retailer improve customer experience by addressing challenges like outdated technology, siloed teams, and a lack of comprehensive testing strategy. Outcomes included improved performance, scalability, and user experience.

Software Defect Prevention via Continuous Inspection

Josh Gough

Dan Tilkens Experience and Certs

Daniel Tilkens

Daniel Tilkens has over 26 years of experience in quality control for precast and prestressed concrete. He holds numerous certifications from organizations like PCI, ACI, APA, NPCA, and OSHA. As Quality Control Manager at Speed Fab-Crete, he has helped the company achieve a perfect score of 100% on their NPCA and APA plant certification audits every year since being employed. He is detail-oriented and focused on ensuring quality and smooth operations through multi-tasking and excellent record keeping.

DevOps: Continous Delivery - Como os feedbacks são importantes

Erik Etsushi Miyashita

The document discusses strategies for continuous delivery, integration, and testing in a DevOps workflow. It emphasizes establishing continuous feedback loops from production to development through metrics collection and monitoring. This allows using real user and performance data to inform development and ensure new releases meet expectations before being deployed. Continuous assessment is highlighted as a way to continuously improve applications based on operational insights from production.

Continuous Testing- A Key Ingredient for Success in Agile & DevOps

SmartBear

This document discusses the importance of continuous testing in Agile and DevOps environments. It describes key elements of continuous testing including unit testing, static analysis, automation of functional and non-functional tests, service virtualization, continuous integration and delivery pipelines. The document also discusses how a collaborative DevTest platform can help by providing visibility into the testing process and enabling continuous feedback through automated reporting of test results and metrics.

Definition Driven API Development: How OAS & Swagger Help Teams Streamline Th...

SmartBear

The OpenAPI Specification (formerly known as the Swagger Specification) has emerged as the world’s standard for defining RESTful interfaces at a time when the API economy is ripe for disruption. In this webinar, we discussed exactly why and how to use the OpenAPI Specification to accelerate your API development in various phases of the API lifecycle including API design, development, documentation, testing and virtualization. We cover trends in the API landscape that have led to the adoption of API definitions, like OpenAPI, and look at real-world examples of how API teams are using definitions to address challenges at each of the different phases of the lifecycle of their APIs. And finally, we walk through a live demo showing tools like Swagger Inspector for generating API definitions, SwaggerHub for designing, documenting, and developing your APIs, and SoapUI and ServiceV for testing and virtualizing your API.

Test armada integration with sauce labs

Test Armada

This document discusses a presentation about testing Armada integration with Sauce Labs. The key points are: 1) The agenda includes requirements, solution, architecture, benefits, spotlights on metrics, a demo, and a Q&A session. 2) The requirements include operation efficiency and scale/time savings. The solution involves parallelization and a resource manager to run tests across multiple shards/browsers/devices. 3) Benefits include testing over 1,000 browser, device, and platform combinations to improve homepage load times by 50% and save developers 25% of their time.

Test Automation in Agile

Agile Testing Alliance

The document discusses test automation in agile environments. It covers Capgemini's World Quality Report on automation, the evolution of business models and IT ecosystems, and challenges with agile automation. Key topics include testing being embedded within the Scrum process with no separate schedule for testing, the importance of test-driven development and behavior-driven development, achieving high levels of automation coverage, and using tools like Cucumber, JUnit, and Selenium to support test automation. The document emphasizes that automation is necessary to achieve faster time to market and increased productivity in agile.

Tale of the journey of an agile team - From dependency to freedom

Ignazio Dadduzio

This is a journey of an Agile Team within Hotels.com (Expedia Group). The journey departs from the prison of the dependency to the freedom of the autonomy. We're not talking about a type of drug... We're talking about Continuous Delivery. We'll take you through our experience of nearly a decade, narrating joys and sorrows of our road, what we've done to reach happiness and because we never have enough, what we have in plan for the future.

Evolving API Testing into API Monitoring by Patrick Poulin

QA or the Highway

The document discusses evolving from API testing to API monitoring. It notes that constant deployment through CI/CD platforms requires monitoring APIs in production to ensure uptime and functionality. While automated testing software can check APIs, monitoring is needed to catch issues that tests miss by observing real-world usage. The document argues that API monitoring provides more intelligence than testing alone by continuously evaluating performance and user behavior.

The Journey to Devops: From Waterfall to Continuous Integration

Sauce Labs

The document discusses the journey from traditional waterfall development processes to continuous delivery using DevOps principles. It describes how the software delivery chain is evolving to emphasize automation, faster releases, and shifting testing left into the development process. QA's role also evolves from separate and manual testing to becoming more technical and integrating testing automation into the continuous integration and delivery pipelines. The presentation provides strategies for organizations adopting these changes and shares examples from companies that have made the transition.

Serena DevOps Drive-in: Leading the Agile and DevOps transformation with Gary...

Serena Software

DevOps is not just for start-ups! However, scaling DevOps in large enterprises requires shifting of culture, coordination of work across teams, reinvention of legacy applications and much more. Before you undertake any change to improve your software development processes, you would want to learn from the person who has gone before you and tasted success. Join the conversation with Gary Gruver on our next DevOps drive-in webcast. Gary will share his best practices and recommendations from his groundbreaking work at HP and Macy's and talk about how to lead a successful DevOps transformation.

Ryanair presentation- Future of BDD in Ryanair

Cigniti Technologies Ltd

The document discusses improving software development practices at a technology company with an airline division. It recommends slowing down development to speed up in the long run, adopting a common behavior-driven development language to standardize testing, defining projects as "Done" only when fully automated and production-ready, and transitioning test frameworks from Jasmine to Cucumber to Typescript to improve maintainability. It also notes that the company should focus on adopting more DevOps practices to streamline development and operations.

Shifting Left: The Evolution of Test Automation

TechWell

As the software development lifecycle shifts toward agile and lean methodologies, quality in every build becomes critical. Continuous integration allows development teams to receive immediate feedback on their code, creating more efficiency and higher quality. After exploring the differences in continuous integration, continuous delivery, and continuous deployment, Jennifer Bonine and Michael Faulise discuss what is needed for their successful implementation, including the technologies and resources required at each stage of the process. Jennifer and Mike share models that show where your organization is on the continuous integration/continuous delivery path, the required technical skills needed to implement them, and how to decide if this strategy is right for you. They describe the inevitable “shifting left” of testing, and what your projects will need to optimize quality and increase velocity. Jennifer an Mike share a perspective of what has been successful and what has not worked in companies from start-ups to Fortune 100.

Continuous Testing at Scale the Walmart Way with Test Armada

Sauce Labs

Salesforce apex hours azure dev ops

Amit Singh

1 - What is DevOps:- DevOps is a culture and a set of Process that bring development and operations teams together to complete software development. It allows the organization to develop and improve the product in a faster way that they can do with other software development approaches. 2 - Why DevOps:- Shorter Development Cycles, Faster Innovation Reduced Deployment Failures, Rollbacks, and Time to Recover Improved Communication and Collaboration Increased Efficiencies

DevOps - Its just Agile done right

Tomas Riha

Testing Your APIs: Postman, Newman, and Beyond

Postman

The document discusses testing APIs with Postman and Newman. It covers the goals of API testing such as validating inputs/outputs and interface behavior. It demonstrates using simple request tests with cURL, testing with Postman and ChaiJS assertions, and automating tests with Newman CLI. It provides an overview of putting these techniques together in a "mini-pipeline" for building, local testing, deploying, and remote testing APIs.

Enforcing Your Organization's API Design Standards with SwaggerHub

SmartBear

What's hot (20)

Agile Network India | Understanding the importance of a full featured CI/CD p...

Cigniti joint webinar with Soasta - Agile DevOps: Test-driven IT Environment ...

Software Defect Prevention via Continuous Inspection

Dan Tilkens Experience and Certs

DevOps: Continous Delivery - Como os feedbacks são importantes

Continuous Testing- A Key Ingredient for Success in Agile & DevOps

Definition Driven API Development: How OAS & Swagger Help Teams Streamline Th...

Test armada integration with sauce labs

Test Automation in Agile

Tale of the journey of an agile team - From dependency to freedom

Evolving API Testing into API Monitoring by Patrick Poulin

The Journey to Devops: From Waterfall to Continuous Integration

Serena DevOps Drive-in: Leading the Agile and DevOps transformation with Gary...

Ryanair presentation- Future of BDD in Ryanair

Shifting Left: The Evolution of Test Automation

Continuous Testing at Scale the Walmart Way with Test Armada

Salesforce apex hours azure dev ops

DevOps - Its just Agile done right

Testing Your APIs: Postman, Newman, and Beyond

Enforcing Your Organization's API Design Standards with SwaggerHub

Similar to QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхронных систем

QA Fest 2019. Катерина Овеченко. Тестирование безопасности API

QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхронных систем

More Related Content

What's hot

What's hot (20)

Similar to QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхронных систем

Similar to QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхронных систем (20)

More from QAFest

More from QAFest (20)

Recently uploaded

Recently uploaded (20)

QA Fest 2019. Антон Серпутько. Нагрузочное тестирование распределенных асинхронных систем