DevOps Testing: Delivering quality product faster!!!
This talk is aimed at developers, testers, consultants, operations – anyone who is involved in frequent releases and particularly involved in automated functional and non-functional testing in a CI/CD (Continuous Integration and Continuous Delivery) workflow.
Over the years software testing has evolved. In its initial days it was just manual testing and then came automated functional testing. Then there is non-functional testing in performance, security, visual-automation, accessibility and other types of testing like A/B testing. Generally though, most of these non-functional testing is carried out by external teams and hardly ever included in CI/CD workflow. This might increase the risk for not getting the feedback early and delay the release.
In a DevOps environment, testing should include all the above mentioned different types of testing in a CI/CD to deliver quality product faster. The talk will cover how all the above different types of testing is carried out from a risk perspective to deliver quality product faster.
Amit is a test automation specialist and has over 10 years of experience delivering quality product for clients in Australia, Europe, Japan and USA. Amit is passionate about test automation for both functional and non-functional including security and performance testing. Amit has a diversified experience in Semiconductor technology, Embedded and Software industry in the field of Banking, Healthcare and Consumer Electronics working for companies such as Fujitsu, Mitsubishi, Qualcomm and Telstra.
12. Why Non-functional Testing ?
Can cause serious damages – privacy violation,
financial, reputation
Slow response time, handle concurrent users,
Application crashes if stressed
Quality
Not only Security and Performance Testers
responsibility
Early Implementation – CI/CD
24 AUG 2018 @amtoya
14. What is Security testing ?
Process intended to identify weakness in the
security mechanisms of an application
Immune to SQL Injections, Cross-Site
Scripting, Sensitive Data Exposure
OWASP-ZAP
24 AUG 2018 @amtoya
15. ZAP UI
Uses the concept of attack proxy to scan for vulnerabilities
24 AUG 2018 @amtoya
21. Performance Testing
Server Side
Client Side
24 AUG 2018 @amtoya
2
8
AVERAGE LOADING TIME OF A
WEBSITE
Server Side 10-20 %
Client Side 80-90 %
Source: https://developer.yahoo.com/performance/rules.html
23. Manual Performance Testing
Analyses web apps and web pages
Modern performance metrics and insights
Can run in Chrome DevTools
24 AUG 2018 @amtoya
24. Automated Performance Testing
Using the Node CLI
Installation: npm install -g lighthouse
Command
Lighthouse can produce a report as JSON or HTML
24 AUG 2018 @amtoya
26. Functional Test Automation
UI – Service – Unit
Security
Testing
Performance
Testing
Other Testing – Visual, Accessibility, A/B
Any
Other
Testing
27. Visual UI Testing
Automate the testing of how software looks
Verify - Icon Size, Padding, Color, Layout,
Text, Element position etc.
24 AUG 2018 @amtoya
29. Visual UI Testing - Result
24 AUG 2018 @amtoya
Source: https://github.com/yahoo/blink-diff
30. Accessibility Testing
What ?
Subset of Usability Testing
Usable by people with disabilities
Why ?
Provide everyone with equal access
Meeting WCAG 2.0 at level AA
24 AUG 2018 @amtoya
37. Manual/Exploratory Testing
Key to high quality software
Highly intellectual
Time consuming
Investigative – Discovering New Information
24 AUG 2018 @amtoya