Rational Quality Manager
•Download as PPT, PDF•
4 likes•4,360 views
The document describes Rational Quality Manager software which helps mitigate business risks, improve efficiency, and provide visibility into metrics. It demonstrates how the software facilitates test management, planning, creation, execution, and reporting through a series of labs. These labs cover activities like requirements tracing, importing requirements from other tools, and executing automated tests from Rational Quality Manager. The goal is to show how the software streamlines quality processes and collaboration across teams.
Report
Share
Rational Quality Manager
- 2. “ Doing it right is no excuse for not meeting the schedule”
- 3. Objectives Demonstrate how Rational Quality Manager: Mitigates business risk Improves operational efficiency Provides greater visibility of metrics Protect existing investments and deliver greater predictability
- 4. Run Down Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager Rational Quality Manager Overview The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 5. Rational Quality Manager Overview
- 6. The increasing costs of fixing a defect 80% of development costs are spent identifying and correcting defects! During the requirements phase During the design phase Once released as a product During the QA/Testing phase Source: GBS Industry standard study Defect cost derived in assuming it takes 8 hrs to find, fix and repair a defect when found in code and unit test. Defect FFR cost for other phases calculated by using the multiplier on a blended rate of $80/hr. $80/defect $240/defect $960/defect $7,600/defect
- 7. Process-led Automation yields real savings Examples of automation capabilities Source: GBS Test Practices study over 855 projects Average per project saving with automation and collaboration best practices calculated on a per asset task and process savings Estimated hours saved per project: 4700 hours Integrating end to end processes Developing repeated test process models applicable to future projects Advanced Defect Analysis Developing repeatable industry test solutions Asset Test cases copied Manual scripts copied Manual script parts reused Prevent and Block duplicate Defects Baseline & migrate documentation Baseline artifacts Leveraging component Reuse Dynamic updates of test assets Quantity 290 296 1,178 765 1,154 1,711 870 1,883 Hours saved 141 148 589 Discovery in 4 Hr 1,484 577 855 435 470 Value $11, 600 $11,850 $47,000 $857,000 $46,200 $68,000 $34,800 $37,700
- 8. IBM® Rational raises the bar for Quality management Scenarios that show the difference Mitigate Business Risk Improve Operational Efficiency Make confident decisions Collaborate Automate Report
- 9. Mitigate business risk in an environment of constant change Rational Quality Manager What is needed: impact analysis with lifecycle collaboration Requirement modified with business stakeholder Development: Catch performance issues at code early Deployment: Version history by project prevents starting from scratch.. Live update across lifecycle assets across 4 projects Review and approvals of tasks across projects Out of the box requirements integration Asset versioning with dynamic updates Advanced defect analysis prevents duplicates Upstream quality- Static code analysis Comprehensive risk mitigation and reduced rework cost by $900/defect Requirement work item traceability
- 10. Improve operational efficiency What is needed: team awareness of activities Requirements, Application security Individual Task List Team event log Test Objectives, Case assignment and Signoff Test iterations Rational Quality Manager Process guidance Team and individual task workflow Easy to visualize commitments Monitor asset ownership and events Web 2.0 anytime, anywhere access
- 11. Make confident decisions What is needed: real time metrics On demand reporting for vital project information customizable by role Rational Quality Manager Process and asset based predictive analytics
- 12. Full lifecycle support across all types of testing and platforms JAZZ TEAM SERVER Manage Test Lab Create Plan Build Tests Report Results Test Management and Execution Rational Quality Manager Quality Dashboard Open Lifecycle Service Integrations Best Practice Processes homegrown Open Platform Java System z, i SAP .NET Third party vendors IBM Collaborative Application Lifecycle Management Functional Testing Performance Testing Web Service Quality Code Quality Security and Compliance Defect Management Requirements Management
- 13. Lab #1 Test Management
- 14. Collaboration to synchronize team efficiency People, not organizations, make great software Promoting team synergy Clearly define roles and responsibilities Manage team activities with customized interface Create dynamic test plans Communicate project status efficiently Collaborate
- 15. Up to date work progress information Task management for individual and team Challenge: Assigning and coordinating test plan ownership and events across distributed teams Solution: Visualize commitments, reduce rework, track tasks and monitor events Testing Individual Task List Team event log Know what others are doing, know what others expect from you
- 16. Proof of process All project stakeholders can review, refine and sign-off on all quality related artifacts Analyst Project Manager Lab Manager Artifact Versioning Challenge: Centralized QA team works with multiple stakeholders across lines of business Solution: Keeping version history and managing approval process at different phases QA team maintains accurate project history with detailed artifact versioning Requirements Signoff Quality Certification Ready for Release Project A Project B Project C Artifact Reviews and Approvals
- 17. Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 Import Requirements from Requisite Pro Lab 8 Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 18. Complete Lab 1 Identify the Lab Workbook and where to start (page 7), where to stop (page 19) 15 mins
- 19. Lab #2 Test Planning
- 20. A quality contract for the entire software delivery team Comprehensive rich test plan Collect and track all test data Defined Responsibilities Goal Oriented Extensible Keep track of changes QA Manager Quality Asset Infrastructure Central hub captures everything that matters for quality releases Security Officer Project Manager Tester Business Stakeholder Test Cases Skill Availability Project Logs Use Cases Requirements Security Mandates Defect Logs Business Objectives
- 21. Comprehensive dynamic planning and updates Process flow, not artifacts drives team activities Live dynamic documentation Defines test process and strategy Defines responsibilities Activity based versus hierarchy Business level reporting against quality objectives Word based Test Plan Other Test Plans Rational Quality Manager Plan
- 22. Collaborative and adaptive test plan management Test plans that are easy to create and evolve with our projects Structured test plan with multiple user defined sections Track test plan history with version snapshots Individual ownership for every section
- 23. PoT Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 24. Complete Lab 2 Identify the Lab Workbook and where to start (page 20), where to stop (page 28) 20 mins
- 25. Lab #3 Test Creation
- 26. Automate to accelerate test creation and execution Quality at the speed of business Streamline manual testing Automated data collection Enhance reuse Traceability Automate
- 27. Integrated manual test authoring and execution Track execution results and defects from manual test efforts Manual test author and execute Step by step capture and execution of manual tests Keyword support for integrated manual and automated testing Rich defect capture during execution, including screenshot and attachments Simple intuitive interface for quick test execution Manual Test Execution
- 28. PoT Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 29. Complete Lab 3 Identify the Lab Workbook and where to start (page 29), where to stop (page 47) 20 mins Break – 20 mins
- 31. Question: How many software testers does it take to change a light bulb? Question: How many programmers does it take to change a light bulb? Answer: None. Software testers just noticed that the room was dark. Testers don't fix the problems, they just find them. Answer: What's the problem? The bulb at my desk works fine!
- 32. Lab #4 Test Execution
- 33. Configuration aware testing Test the right cases instead of everything. Plan optimal execution Configuration awareness Less than 20 Combinations Plan for test execution across all of your target environments 800 Total Combinations Pairwise Optimizations 10 different CPU Types Windows® XP Win XP SP2 Win Vista SLES 10 Win 2003 DB2® Oracle® MySql® Derby
- 34. IBM Rational Test Lab Manager Save 30-40% test time with integrated test lab management Manage Verify that I have the resources required to fulfill my test plan Deploy Deliver the configurations my teams require for test Optimize Analyze patterns to minimize cost and maximize utilization QA Teams spend more than 36% of their time configuring machines to make them ready for testing – IBM Survey
- 35. PoT Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 36. Complete lab 4 Identify the Lab Workbook and where to start (page 48), where to stop (page 60) 20 mins
- 37. Lab #5 Test Reporting
- 38. On demand reporting for instant project status Moment by moment grasp of project information for decision making Measure progress with extensive query, reporting facilities and dashboard Address needs of QA and stakeholders Report
- 39. Reduce risk with constant access to quality metrics Lifecycle quality perspective to proactively manage risk Performance risks are always visible and quickly resolved Security risks are monitored continuously to ensure business continuity Manual and functional test automation results available Testing of requirements can be tracked to assure business needs are realized Change management and defect tracking fully integrated to assure all changes to production are tested Quality Manager Dashboard
- 40. On demand reporting Snapshot views of project status from multiple perspectives Customizable reporting enables sharing and communication of vital project information
- 41. Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 42. Complete Lab 5 Identify the Lab Workbook and where to start (page 61), where to stop (page 69) 10 mins
- 43. Lab #6 Requirements Coverage and Impact Analysis
- 44. PoT Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 - Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 45. Complete Lab 6 Identify the Lab Workbook and where to start (page 70), where to stop (page 71) 3 mins
- 46. Lab #7 Importing Requirements from Requisite Pro
- 47. Traceable requirements definition and management Rational Requirement Composer Rational Quality Manager Requirements Management Identify and manage requirements across their lifecycle Align team collaboration around business objectives and outcomes Rational RequisitePro v7.1 Accelerate project delivery with history and context that team members need Challenge: Managing a shared understanding of requirements, business and delivery risks Solution: Reduce rework, focus meetings, and reuse requirements artifacts on future projects Business processes Sketches and storyboards Use cases Rich text
- 48. Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 49. Complete Lab 7 Identify the Lab Workbook and where to start (page 72), where to stop (page 74) 15 mins
- 50. Lab #8 Executing Rational Functional Tests from RQM
- 51. Execution of RFT Tests from Rational Quality Manager JAZZ TEAM SERVER Manage Test Lab Create Plan Build Tests Report Results Test Management and Execution Rational Quality Manager Quality Dashboard Open Lifecycle Service Integrations Best Practice Processes homegrown Open Platform Java System z, i SAP .NET Ability to execute Rational Performance Tester (RPT), Web Service Tests, Security Tests, etc Third party vendors IBM Collaborative Application Lifecycle Management Functional Testing Performance Testing Web Service Quality Code Quality Security and Compliance Defect Management Requirements Management
- 52. Lab Overview Lab 1 – Test Management Lab 2 – Test Planning Lab 3 – Test Creation Lab 4 – Test Execution Lab 5 – Test Reporting Quality Management Lifecycle User Dashboard Review and Approval Process Entering Test Plan Information Adding Requirements to Test Plan Generating Test Environment Customizing Dashboard Creating Test Cases Setting up traceability of Test Cases to Requirements Creating Manual Test Case Leverage Data Driven Testing Keyword Driven Testing Create Test Execution Record Test Suite Creation Test Execution Automated Manual Testing Assisted Data Entry Data Driven manual testing Test Results Weights Entering Test Defect Out of the box reports Defect Reporting Test Plan Versioning - Creating Baselines Lab 6 – Requirements Coverage Lab 7 – Import Requirements from Requisite Pro Lab 8 – Executing Rational Functional Tests from Rational Quality Manager The QM Manager Mary The QM Manager Mary The QM Manager Mary The Tester Tony The Tester Tony
- 53. Complete Lab 8 Identify the Lab Workbook and where to start (page 75), where to stop (page 83) 15 mins
- 54. Session summary
- 55. Session summary Rational Quality Manager: Mitigates business risk Improves operational efficiency Provides greater visibility of metrics Protect existing investments and deliver greater predictability
- 56. “ Doing it right is no excuse for not meeting the schedule”
- 57. Collaborative Quality Management with IBM Rational Quality is a Team Sport Integrated Requirements Management and Quality Management IBM Rational DOORS and IBM Rational Quality Manager Securing your Web Applications using IBM Rational AppScan Standard Edition Hacking 101 Hacking 102 – Integrating Application Security Testing into Development http://www.ibm.com/events/au/innovation09/
- 59. We appreciate your feedback. Please fill out the survey form in order to improve this educational event. Jono Massy-Greene , Rational Brand Manager [email_address] Alan Kan , Rational Technical Specialist [email_address]
Editor's Notes
- Demonstrate how Rational Quality Manager: Mitigates business risk: Catch defects earlier and keep the team in synch with dynamic process and activity-based workflows Improves operational efficiency: Automate labor-intensive lifecycle processes and determine optimal plans addressing wide range of platforms and requirements Provides greater visibility of metrics: Make reliable decisions with constant access to prioritized metrics tailored for individuals and teams Protect existing investments and deliver greater predictability: Adopt successful deployment patterns and map to operational Key Performance Indicators (KPIs), platforms and requirements
- If we don’t catch a bug at the testing phase, then it can take the organisation 8 times as much cost to fix the same bug later. We need a process or some tools to help us to catch these bugs early.
- These are numbers that are collected using an Internal GBS Solution collected over 4 years (2005 – 2008) for Test Management capabilities also being incorporated into RQM. Test Cases Copied – number of Test cases in tool that would be copied to create other Test Cases Manual Scripts Copied – Creation of Manual Scripts while starting with a copy of a current script Manual Script Reuse – Reusing portions of Manual Scripts Blocking Defect – identifying and preventing the creation of duplicate defects. This provide cost in terms of it took 4 hours effort to discover it was a duplicate of 10 hours. The longer it is worked, the more costly. Seeded Testware – Migrate Documentation over to tool to seed efforts moving forward for a test project Archived Testware – Completed phases of testing and want to base lining artifacts. The tool supporting this. Leveraging Reuse – This takes advantage of when using reusable components one can make a change and that change propogates to all things using the reusable conmponent.
- Collaborate -Promoting team synergy Clearly define roles Keep team in synch with dynamic plans Communicate project status efficiently Accelerate Execution Automate manual tests for rapid cycles Execute locally or remotely Determine optimal plans to save effort and infrastructure Report- Instant project status Customized information Measure progress with dashboard Address needs of business stakeholders
- Anyone never worked on a project with requirement change? Fact of life. Our role in the test team is to catch up with those req changes, although they aren’t always communicated on time. Integration with up stream, automated notification. Asset versioning – one click of a button and the whole set of test plans, test cases etc can be versioned/reproduced.
- You keep track of test team work, they keep track of it too. Don’t necessarily match. Task list shared between test lead and test team will make life easier, one version of truth, no repeated data entry (or keeping track) Teams know what each other is doing so that no 2 people does the same job, or they can remind each other if things fall through cracks. Centralised test asset registry to enhance reuse.
- You want to know what’s going on – current project info (is all requirements covered, how many sev 1 defects are outstanding, etc) as well as Trends (how is my test execution compared to planned)
- In Lab 1 you generated one test environment. Read about pairwise optimisations. Will make less configurations for execution.
- Talking about execution – test environment management. Not in our labs today but very useful if you have multiple test environments to manage.
- Reporting needs to be timely, accurate, and relevant for you to make a decision.
- Dashboard can be customised to provide exactly what you need.
- RQM provides you with real time information, collected automatically, so that it is always timely and accurate.
- Remember this slide from earlier….. Rational Quality Manager is built with an open execution engine with gives you the ability to execute any number of external tools you might use for testing. We provide pre-built adapters for IBMs tools including RFT. RPT, RST, AppScan additional adapters will be provided by partners to execute 3 rd party tools such as HP. If you have homegrown tools you can even build your own adapter.
- Mitigate business risk: Faciliate collaboration within the team – everyone knows what is expected of them, and what others are doing Help collaboration across lifecycle – e.g. requirement changes gets flaged Approval process Repeatable process Improves effeciency Faciliate reuse such as key words Automation of tasks Automated data collection Reduce number of configurations Helps to manage (and even automate provisioning) of test environments Provides greater visibility of metrics Dashboard provides relevant information for your decision Real time reporting provides timely and accurate info Protect existing investements and deliver greater predictability 1.
- 3-day workshop packed with industry case studies, future forward innovation sessions, technical workshops and product information