SlideShare a Scribd company logo
Best Practices for
End-to-End Quality Management
Dan Goodstein – SAP Quality Assurance Solutions
© 2015 SAP SE or an SAP affiliate company. All rights reserved. 2Confidential
Agenda
 Introductions
 Customer Background
– SAP landscape
– Upcoming Project Roadmap
– Quality Vision
 Current Testing Process & Tools
 SAP End to End Testing Roadmap
 Deep Dive Focus areas
 Wrap up and next steps
© 2015 SAP SE or an SAP affiliate company. All rights reserved. 3Confidential
CURRENT TESTING PROCESS
© 2015 SAP SE or an SAP affiliate company. All rights reserved. 4Confidential
 No documented
QA processes
Level 1
Project Testing
Project
Focus
Quality Management Maturity Roadmap
 Project based People,
Processes & Tech.
 Majority Manual
Testing
Level 0
Manual Testing
Level 2
Product Utility
 Centralized &
Standardized Testing
Administration
 QA processes but for
individual projects
 Security, Policy &
Compliance Testing
 Centralized &
Standardized Tech.
 Best Practices
Adoption
 Service Bureau
 Integrated Testing &
Remediation for
Security/Compliance
Level 3
Service Utility
Process
Standards
 Centralized People,
Process & Tech.
 Process Governance
for Testing & Quality
 Thought-leadership for
Enterprise Influence
 Full-lifecycle approach
for security &
integration between
apps & Ops
Level 4
Center of
Excellence
Center of ExcellenceReactive to Predictable
Requirements
BusinessProjectsUpdates/Releases
Test Cases Test Execution Defects Reporting
MANUAL TESTING
 Manual Testing is very resource intensive
and expensive as every test cycle requires
the same level of effort
 Minimizing “what to test” is essential
PERFORMANCE TESTING
 Performance Testing is key for modern
application, especially customer facing
applications
 Performance Testing is not a viable manual
testing process
AUTOMATED TESTING
 Creation of automated test can be very time
consuming. Many test tools tout ease of test
creation but ignore that 80% of test
automation effort is test script maintenance
TEST DATA
 Quality test data is typically the
biggest single cause of testing
problems
 Refreshing non-production
systems is time consuming and
expensive
 Sensitive data needs to be
protected
INTEGRATION TESTING
 Today’s composite applications
are highly integrated: legacy
apps, external services and non-
SAP
 Access issues to integration
points for end-to-end scenario
testing results in delays
 How do I know what to
test?
 What has changed
since I last tested the
system
 What are the most
critical areas that entail
the highest risk to the
business?
 How do I optimize my
testing time and
resources?
DEFECTS AND REPORTING
 How do I correlate the
requirements, test cases,
execution history and defects
to give me a clear picture of
the status of my testing?
 Once I have my application
quality where I want, how do I
ensure hackers don’t mess it
up?
Security
Business
Requirements
ProjectsUpdates/Releases
Automated
Testing
Test
Data
Integration
Testing
Test Cases Test Execution Defects ReportingRequirements Test Cases Test Execution Defects Reporting
Test
Team
Test
Lab
Load &
Performance
Testing
HP LR
Analytics
Manual
Testing
Dash
Boards
Work
Flow
SOX & Regulated Industry Compliant
Security
© 2015 SAP SE or an SAP affiliate company. All rights reserved. 7Confidential
SAP Solution Manager
Business Blueprint
 Business Processes Documented
 Solution Documentation Assistant
for semi-automatic setup
 Technical view: involved SAP and
non-SAP systems, Transactions,…
 Starting point for customizing
 Linked training material
Quality Assurance Solutions – with updated SolMan
Sprinter Manual Testing
 Streamline manual testing by reuse and by
simplifying repetitive work
QuickTest Professional
 Test Automation
 SAP and non-SAP
Test Acceleration & Optimization
 Generation of Test Case and BPT
components for the SAP GUI Based
Business Processes
 Leverages BPCA Analysis for automated
maintenance of BPT test component and
test cases
Test Data Management Server (TDMS)
 Reduce SAP data volume of non-production landscape
 Scramble sensitive data according to your needs
Build & Test Deploy Operate OptimizeDesignRequirements
SAP Quality Center
Quality Center (QC)
 Test Requirements
 Test Plans
 Test Execution
 Business Process Testing
 Defect management
SolutionManager
Adapterfor
QualityCenter
SAP Solution Manager
Business Process Change
Analyzer (BPCA)
 Identification of business
processes affected by code /
customizing changes / Support &
Enhancement Packages
SAP LoadRunner
 Application performance validation
 Virtual User load simulation
8© 2014 SAP SE or an SAP affiliate company. All rights reserved.
Traceability Reporting Dashboard Governance
• Accurate, filtered requirements based on what you are using in SAP via Sol Man
• Requirements traceability of Test cases tied to specific requirements and defects
• Workflow allocation of test cases to your testing resources from the developer to the tester and back
• Real-time status report of work load, test case execution, pass/fail rates, requirements and project readiness
• A shared repository for all your Manual and Automated Test Cases
• Sprinter to automate and audit your manual testing effort
• Business Impact analysis to determine any changes required to test cases based on changes made to SAP
• Ability to test SAP and non-SAP areas with QC, QTP and TAO.
• Performance Testing based on load simulation scenarios
• Ability to mimic outside calls via Virtualized Stub files for more efficient testing cycles
• Security Vulnerability assessment and corrective action.
HP Sprinter
HP Service
Virtualization
HP UFT
HP LoadRunner
HP Performance
Center
Best Practices for End-to-End Quality Management
Value Statements
© 2015 SAP SE or an SAP affiliate company. All rights reserved. 9Confidential
SAP Fortify by HP – Components “NEW”
including SAP NetWeaver Application Server, add-on for code vulnerability analysis (CVA)
Audit Workbench
© 2014 SAP SE or an SAP affiliate company. All rights reserved.
Thank You
Contact information:
Daniel Goodstein
SAP QAS Solutions
daniel.goodstein@sap.com

More Related Content

QAS 2015 Overview Abbreviated Deck

  • 1. Best Practices for End-to-End Quality Management Dan Goodstein – SAP Quality Assurance Solutions
  • 2. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 2Confidential Agenda  Introductions  Customer Background – SAP landscape – Upcoming Project Roadmap – Quality Vision  Current Testing Process & Tools  SAP End to End Testing Roadmap  Deep Dive Focus areas  Wrap up and next steps
  • 3. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 3Confidential CURRENT TESTING PROCESS
  • 4. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 4Confidential  No documented QA processes Level 1 Project Testing Project Focus Quality Management Maturity Roadmap  Project based People, Processes & Tech.  Majority Manual Testing Level 0 Manual Testing Level 2 Product Utility  Centralized & Standardized Testing Administration  QA processes but for individual projects  Security, Policy & Compliance Testing  Centralized & Standardized Tech.  Best Practices Adoption  Service Bureau  Integrated Testing & Remediation for Security/Compliance Level 3 Service Utility Process Standards  Centralized People, Process & Tech.  Process Governance for Testing & Quality  Thought-leadership for Enterprise Influence  Full-lifecycle approach for security & integration between apps & Ops Level 4 Center of Excellence Center of ExcellenceReactive to Predictable
  • 5. Requirements BusinessProjectsUpdates/Releases Test Cases Test Execution Defects Reporting MANUAL TESTING  Manual Testing is very resource intensive and expensive as every test cycle requires the same level of effort  Minimizing “what to test” is essential PERFORMANCE TESTING  Performance Testing is key for modern application, especially customer facing applications  Performance Testing is not a viable manual testing process AUTOMATED TESTING  Creation of automated test can be very time consuming. Many test tools tout ease of test creation but ignore that 80% of test automation effort is test script maintenance TEST DATA  Quality test data is typically the biggest single cause of testing problems  Refreshing non-production systems is time consuming and expensive  Sensitive data needs to be protected INTEGRATION TESTING  Today’s composite applications are highly integrated: legacy apps, external services and non- SAP  Access issues to integration points for end-to-end scenario testing results in delays  How do I know what to test?  What has changed since I last tested the system  What are the most critical areas that entail the highest risk to the business?  How do I optimize my testing time and resources? DEFECTS AND REPORTING  How do I correlate the requirements, test cases, execution history and defects to give me a clear picture of the status of my testing?  Once I have my application quality where I want, how do I ensure hackers don’t mess it up? Security
  • 6. Business Requirements ProjectsUpdates/Releases Automated Testing Test Data Integration Testing Test Cases Test Execution Defects ReportingRequirements Test Cases Test Execution Defects Reporting Test Team Test Lab Load & Performance Testing HP LR Analytics Manual Testing Dash Boards Work Flow SOX & Regulated Industry Compliant Security
  • 7. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 7Confidential SAP Solution Manager Business Blueprint  Business Processes Documented  Solution Documentation Assistant for semi-automatic setup  Technical view: involved SAP and non-SAP systems, Transactions,…  Starting point for customizing  Linked training material Quality Assurance Solutions – with updated SolMan Sprinter Manual Testing  Streamline manual testing by reuse and by simplifying repetitive work QuickTest Professional  Test Automation  SAP and non-SAP Test Acceleration & Optimization  Generation of Test Case and BPT components for the SAP GUI Based Business Processes  Leverages BPCA Analysis for automated maintenance of BPT test component and test cases Test Data Management Server (TDMS)  Reduce SAP data volume of non-production landscape  Scramble sensitive data according to your needs Build & Test Deploy Operate OptimizeDesignRequirements SAP Quality Center Quality Center (QC)  Test Requirements  Test Plans  Test Execution  Business Process Testing  Defect management SolutionManager Adapterfor QualityCenter SAP Solution Manager Business Process Change Analyzer (BPCA)  Identification of business processes affected by code / customizing changes / Support & Enhancement Packages SAP LoadRunner  Application performance validation  Virtual User load simulation
  • 8. 8© 2014 SAP SE or an SAP affiliate company. All rights reserved. Traceability Reporting Dashboard Governance • Accurate, filtered requirements based on what you are using in SAP via Sol Man • Requirements traceability of Test cases tied to specific requirements and defects • Workflow allocation of test cases to your testing resources from the developer to the tester and back • Real-time status report of work load, test case execution, pass/fail rates, requirements and project readiness • A shared repository for all your Manual and Automated Test Cases • Sprinter to automate and audit your manual testing effort • Business Impact analysis to determine any changes required to test cases based on changes made to SAP • Ability to test SAP and non-SAP areas with QC, QTP and TAO. • Performance Testing based on load simulation scenarios • Ability to mimic outside calls via Virtualized Stub files for more efficient testing cycles • Security Vulnerability assessment and corrective action. HP Sprinter HP Service Virtualization HP UFT HP LoadRunner HP Performance Center Best Practices for End-to-End Quality Management Value Statements
  • 9. © 2015 SAP SE or an SAP affiliate company. All rights reserved. 9Confidential SAP Fortify by HP – Components “NEW” including SAP NetWeaver Application Server, add-on for code vulnerability analysis (CVA) Audit Workbench
  • 10. © 2014 SAP SE or an SAP affiliate company. All rights reserved. Thank You Contact information: Daniel Goodstein SAP QAS Solutions daniel.goodstein@sap.com