This document discusses the process of test planning and control for software testing. It describes the major tasks involved in test planning such as determining scope and risks, developing a test approach, and scheduling tests. It also covers test control which includes measuring results, monitoring progress, and making decisions. Test implementation and execution are outlined as transforming test conditions into test cases, executing tests, and reporting discrepancies. Evaluating exit criteria and test closure are the final stages discussed.
The document outlines the software testing process, which includes defining test policies and strategies, preparing test plans, establishing testing objectives, designing test scenarios and cases, executing test cases, analyzing test results, and performing retesting and regression testing. Key steps involve writing test cases, defining test data, creating a test bed for execution, and logging and analyzing results to identify errors or missing requirements. The overall goal is to check if actual results match expected outcomes and ensure the software is defect-free.
The document provides guidance on how to write an effective test plan. It explains that a test plan is a written document that describes the methodology, parameters, tools, and timetable for testing a software solution or system. It ensures the software fulfills requirements for functionality and quality. The document outlines key components that should be included in a test plan such as test coverage, test methods, test responsibilities, resources needed, dependencies and risks. It emphasizes the importance of planning testing activities and having the necessary resources. Different types of test plans are discussed for different testing levels and types.
The document describes the fundamental test process, which can be divided into 5 basic steps: test planning and control, test analysis and design, test implementation and execution, test evaluating exit criteria and reporting, and test closure activities. It provides details on the main tasks for each step, including developing test plans, analyzing test basis, designing and implementing tests, executing tests, evaluating whether exit criteria are met, and closing test activities.
The correct answer is c. The quality of the information used to develop the tests is a factor that influences the test effort involved in most projects. Factors like requirements documentation, software size, life cycle model used, process maturity, time constraints, availability of skilled resources, and test results all impact the test effort.
The document outlines the key phases of the Software Testing Life Cycle (STLC) process. It describes 6 phases: 1) Requirement Analysis/Review to understand requirements, 2) Test Planning to develop the test plan, 3) Test Designing to create test cases and scripts, 4) Test Environment Setup to prepare the test environment, 5) Test Execution to run the test cases and report bugs, and 6) Test Closure to finalize testing and complete documentation. The goal of STLC is to systematically test software through a planned process to improve quality.
The document discusses test planning and documentation. It defines test planning as creating test cases and strategies to control and communicate testing. A test plan scope, approach, resources, schedule and identifies items to test. Objectives are to design verification, manage efforts, and find bugs. It recommends types of tests to cover and provides a template for test plans with components like lists, tables, and matrices.
This document outlines the test approach, scope, objectives, assumptions, and methodology for testing applications. It describes unit, integration, system, regression, and user acceptance testing. The primary objective is to ensure all requirements are met and the system functions as intended. The secondary objective is to identify and address all issues before release. Test deliverables include documents like the test approach, plan, and specifications as well as test cases, bug reports, and status reports.
The document describes the software testing life cycle (STLC) process which includes test planning, test development, test execution, result analysis, defect management, and summarized reports. It then provides more details on each step, including objectives, participants, and deliverables. It also defines test strategy and test plan documents, describing their purpose and typical components.
This document discusses the software testing life cycle (STLC). The STLC is a systematic process that follows a series of phases to ensure software quality. It aims to identify defects early. The main phases discussed are test planning, test case development, test execution, and test closure. A test plan is a key document that describes testing areas and activities. It outlines the test strategy, objectives, schedule, resources, and deliverables. The test plan serves as a guide for testing and helps determine timelines, estimate resources, and avoid issues.
The document provides an overview of the software testing life cycle (STLC) which includes test planning, test development, test execution, result analysis, defect management, and summarized reports. It then describes each phase in more detail, outlining key activities, participants, and deliverables. For example, test planning involves preparing test strategies and plans, estimating effort, and identifying risks. Test development consists of writing test cases and scripts, setting up environments, and reviewing test artifacts. The document also defines common testing terms like test plans, test cases, defect priority and severity levels.
- Software testing is usually carried out at different levels including unit testing, integration testing, system testing, and acceptance testing.
- Unit testing focuses on testing individual software components in isolation. Integration testing checks for defects in component interactions. System testing evaluates attributes of the entire system like usability, reliability, and performance. Acceptance testing shows that software meets client requirements.
- Testing object-oriented software requires strategies to test components and their interactions, as well as issues like inheritance. Testing procedural code focuses on generating input data to pass to functions.
In this section, we will describe the fundamental test process and activities. These start with test planning and continue through to test closure. For each part of the test process, we'll discuss the main tasks of each test activity.
backlink:
http://sif.uin-suska.ac.id/
http://fst.uin-suska.ac.id/
http://www.uin-suska.ac.id/
Software Engineering (Testing Activities, Management, and Automation)
The document discusses software testing activities, management, and automation. It covers major testing activities including test planning, execution, and analysis. Test planning involves goal setting, test case preparation, and test procedure preparation. Test execution allocates test time and resources, runs tests, and identifies failures. Test analysis evaluates results and provides feedback. The document also discusses test management roles and structures, including vertical, horizontal, and mixed test team models. Test automation tools can help improve testing efficiency.
This document discusses software test documentation standards and processes. It describes the IEEE 829 standard for software test documentation, which includes a test planning and control process involving test plans, analysis and design involving test cases and procedures, implementation and execution involving bug reports and test procedures, and evaluation and reporting involving status reports and test logs. It provides details on various test documentation artifacts like test plans, test designs, test cases, test procedures, and reports. It explains the purpose, structure, and contents of each artifact to provide documentation at different stages of the testing process.
The document outlines the software testing life cycle (STLC) which includes 10 phases: 1) requirement analysis, 2) prepare test plan, 3) test case designing, 4) design review, 5) code review, 6) test case execution, 7) bug reporting and regression testing, 8) inspection and release, 9) client acceptance, and 10) test summary analysis. It then provides details on requirement analysis, preparing the test plan, roles and responsibilities, and guidelines for developing an effective test plan. The test plan is a strategic document that defines the testing objectives, scope, approach, resources, and schedules to ensure software quality.
Have you ever built a sandcastle at the beach, only to see it crumble when the tide comes in? In the digital world, our information is like that sandcastle, constantly under threat from waves of cyberattacks. A cybersecurity course is like learning to build a fortress for your information!
This course will teach you how to protect yourself from sneaky online characters who might try to steal your passwords, photos, or even mess with your computer. You'll learn about things like:
* **Spotting online traps:** Phishing emails that look real but could steal your info, and websites that might be hiding malware (like tiny digital monsters).
* **Building strong defenses:** Creating powerful passwords and keeping your software up-to-date, like putting a big, strong lock on your digital door.
* **Fighting back (safely):** Learning how to identify and avoid threats, and what to do if something does go wrong.
By the end of this course, you'll be a cybersecurity champion, ready to defend your digital world and keep your information safe and sound!
The document provides an overview of fundamentals of testing including the testing process, psychology of testing, and exams. It describes the typical activities in a test process including test planning, monitoring and control, analysis, design, implementation, execution, and completion. For each activity, it outlines the common tasks and work products. It also discusses how human psychology and the different mindsets of testers and developers can impact testing. The document emphasizes the importance of independence in testing to avoid author bias and more effectively find defects.
The document outlines the key activities in a fundamental test process, including test planning and control, test analysis and design, test implementation and execution, evaluating exit criteria and reporting, and test closure activities. It describes the major tasks within each activity in the order they are typically performed, such as determining test scope and objectives in test planning, reviewing requirements and designing tests in test analysis and design, implementing test cases and executing tests, assessing whether exit criteria are met, and archiving testware upon completion.
The document outlines a test plan, which describes the scope, approach, resources, and schedule for software testing activities. It defines key elements like test items, features to be tested, test tasks, roles and responsibilities, deliverables, environment needs, tools, defect management process, risks, and exit criteria. The test plan provides a blueprint to guide testing in a structured and organized manner.
This document discusses the process of test planning and control for software testing. It describes the major tasks involved in test planning such as determining scope and risks, developing a test approach, and scheduling tests. It also covers test control which includes measuring results, monitoring progress, and making decisions. Test implementation and execution are outlined as transforming test conditions into test cases, executing tests, and reporting discrepancies. Evaluating exit criteria and test closure are the final stages discussed.
The document outlines the software testing process, which includes defining test policies and strategies, preparing test plans, establishing testing objectives, designing test scenarios and cases, executing test cases, analyzing test results, and performing retesting and regression testing. Key steps involve writing test cases, defining test data, creating a test bed for execution, and logging and analyzing results to identify errors or missing requirements. The overall goal is to check if actual results match expected outcomes and ensure the software is defect-free.
The document provides guidance on how to write an effective test plan. It explains that a test plan is a written document that describes the methodology, parameters, tools, and timetable for testing a software solution or system. It ensures the software fulfills requirements for functionality and quality. The document outlines key components that should be included in a test plan such as test coverage, test methods, test responsibilities, resources needed, dependencies and risks. It emphasizes the importance of planning testing activities and having the necessary resources. Different types of test plans are discussed for different testing levels and types.
The document describes the fundamental test process, which can be divided into 5 basic steps: test planning and control, test analysis and design, test implementation and execution, test evaluating exit criteria and reporting, and test closure activities. It provides details on the main tasks for each step, including developing test plans, analyzing test basis, designing and implementing tests, executing tests, evaluating whether exit criteria are met, and closing test activities.
The correct answer is c. The quality of the information used to develop the tests is a factor that influences the test effort involved in most projects. Factors like requirements documentation, software size, life cycle model used, process maturity, time constraints, availability of skilled resources, and test results all impact the test effort.
The document outlines the key phases of the Software Testing Life Cycle (STLC) process. It describes 6 phases: 1) Requirement Analysis/Review to understand requirements, 2) Test Planning to develop the test plan, 3) Test Designing to create test cases and scripts, 4) Test Environment Setup to prepare the test environment, 5) Test Execution to run the test cases and report bugs, and 6) Test Closure to finalize testing and complete documentation. The goal of STLC is to systematically test software through a planned process to improve quality.
The document discusses test planning and documentation. It defines test planning as creating test cases and strategies to control and communicate testing. A test plan scope, approach, resources, schedule and identifies items to test. Objectives are to design verification, manage efforts, and find bugs. It recommends types of tests to cover and provides a template for test plans with components like lists, tables, and matrices.
This document outlines the test approach, scope, objectives, assumptions, and methodology for testing applications. It describes unit, integration, system, regression, and user acceptance testing. The primary objective is to ensure all requirements are met and the system functions as intended. The secondary objective is to identify and address all issues before release. Test deliverables include documents like the test approach, plan, and specifications as well as test cases, bug reports, and status reports.
The document describes the software testing life cycle (STLC) process which includes test planning, test development, test execution, result analysis, defect management, and summarized reports. It then provides more details on each step, including objectives, participants, and deliverables. It also defines test strategy and test plan documents, describing their purpose and typical components.
This document discusses the software testing life cycle (STLC). The STLC is a systematic process that follows a series of phases to ensure software quality. It aims to identify defects early. The main phases discussed are test planning, test case development, test execution, and test closure. A test plan is a key document that describes testing areas and activities. It outlines the test strategy, objectives, schedule, resources, and deliverables. The test plan serves as a guide for testing and helps determine timelines, estimate resources, and avoid issues.
The document provides an overview of the software testing life cycle (STLC) which includes test planning, test development, test execution, result analysis, defect management, and summarized reports. It then describes each phase in more detail, outlining key activities, participants, and deliverables. For example, test planning involves preparing test strategies and plans, estimating effort, and identifying risks. Test development consists of writing test cases and scripts, setting up environments, and reviewing test artifacts. The document also defines common testing terms like test plans, test cases, defect priority and severity levels.
- Software testing is usually carried out at different levels including unit testing, integration testing, system testing, and acceptance testing.
- Unit testing focuses on testing individual software components in isolation. Integration testing checks for defects in component interactions. System testing evaluates attributes of the entire system like usability, reliability, and performance. Acceptance testing shows that software meets client requirements.
- Testing object-oriented software requires strategies to test components and their interactions, as well as issues like inheritance. Testing procedural code focuses on generating input data to pass to functions.
In this section, we will describe the fundamental test process and activities. These start with test planning and continue through to test closure. For each part of the test process, we'll discuss the main tasks of each test activity.
backlink:
http://sif.uin-suska.ac.id/
http://fst.uin-suska.ac.id/
http://www.uin-suska.ac.id/
Software Engineering (Testing Activities, Management, and Automation)ShudipPal
The document discusses software testing activities, management, and automation. It covers major testing activities including test planning, execution, and analysis. Test planning involves goal setting, test case preparation, and test procedure preparation. Test execution allocates test time and resources, runs tests, and identifies failures. Test analysis evaluates results and provides feedback. The document also discusses test management roles and structures, including vertical, horizontal, and mixed test team models. Test automation tools can help improve testing efficiency.
This document discusses software test documentation standards and processes. It describes the IEEE 829 standard for software test documentation, which includes a test planning and control process involving test plans, analysis and design involving test cases and procedures, implementation and execution involving bug reports and test procedures, and evaluation and reporting involving status reports and test logs. It provides details on various test documentation artifacts like test plans, test designs, test cases, test procedures, and reports. It explains the purpose, structure, and contents of each artifact to provide documentation at different stages of the testing process.
The document outlines the software testing life cycle (STLC) which includes 10 phases: 1) requirement analysis, 2) prepare test plan, 3) test case designing, 4) design review, 5) code review, 6) test case execution, 7) bug reporting and regression testing, 8) inspection and release, 9) client acceptance, and 10) test summary analysis. It then provides details on requirement analysis, preparing the test plan, roles and responsibilities, and guidelines for developing an effective test plan. The test plan is a strategic document that defines the testing objectives, scope, approach, resources, and schedules to ensure software quality.
Have you ever built a sandcastle at the beach, only to see it crumble when the tide comes in? In the digital world, our information is like that sandcastle, constantly under threat from waves of cyberattacks. A cybersecurity course is like learning to build a fortress for your information!
This course will teach you how to protect yourself from sneaky online characters who might try to steal your passwords, photos, or even mess with your computer. You'll learn about things like:
* **Spotting online traps:** Phishing emails that look real but could steal your info, and websites that might be hiding malware (like tiny digital monsters).
* **Building strong defenses:** Creating powerful passwords and keeping your software up-to-date, like putting a big, strong lock on your digital door.
* **Fighting back (safely):** Learning how to identify and avoid threats, and what to do if something does go wrong.
By the end of this course, you'll be a cybersecurity champion, ready to defend your digital world and keep your information safe and sound!
2. Test Plan:
• A document describing the scope, approach,
resources and schedule of intended test activities.
It identifies amongst others test items, the features
to be tested, the testing tasks, who will do each
task, degree of tester independence, the test
environment, the test design techniques and entry
and exit criteria to be used, and the rationale for
their choice, and any risks requiring contingency
planning. It is a record of the test planning
process.
3. Steps for preparing a test plan
• Analyze the product (learn product thoroughly)
• Develop test strategy -define scope of testing ,risk
and issues
• Define objective of test
• Define test criteria
• Planning the resources
• Plan test environment
• Schedule and cost
• Test deliverables
4. • Test deliverables includes
Scope
Methodology
Requirements
Criteria for pass-fail
schedule
5. TEST PLAN TYPES
• Master Test Plan: A single high-level test plan for a
project/product that unifies all other test plans.
• Testing Level Specific Test Plans :Plans for each level
of testing.
– Unit Test Plan
– Integration Test Plan
– System Test Plan
– Acceptance Test Plan
• Testing Type Specific Test Plans: Plans for major
types of testing like Performance Test Plan and Security
Test Plan.
6. TEST PLAN GUIDELINES
• Make the plan concise. Avoid redundancy and
superfluousness. If you think you do not need a section that
has been mentioned in the template above, go ahead and delete
that section in your test plan.
• Be specific. For example, when you specify an operating
system as a property of a test environment, mention the OS
Edition/Version as well, not just the OS Name.
• Make use of lists and tables wherever possible. Avoid
lengthy paragraphs.
• Have the test plan reviewed a number of times prior to
base lining it or sending it for approval. The quality of your
test plan speaks volumes about the quality of the testing you or
your team is going to perform.
• Update the plan as and when necessary. An out-dated and
unused document stinks and is worse than not having the
document in the first place.
7. TEST PLAN TEMPLATE
• The format and content of a software test plan vary depending on
the processes, standards, and test management tools being
implemented. Nevertheless, the following format, which is based on
IEEE standard for software test documentation, provides a summary
of what a test plan can/should contain.
• Test Plan Identifier:
• Provide a unique identifier for the document. (Adhere to the
Configuration Management System if you have one.)
• Introduction:
Provide an overview of the test plan.
Specify the goals/objectives.
Specify any constraints.
• References:
List the related documents, with links to them if available, including the
following:
1. Project Plan
2. Configuration Management Plan
8. • Test Items:
List the test items (software/products) and their versions.
• Features to be Tested:
1. List the features of the software/product to be tested.
2. Provide references to the Requirements and/or Design
specifications of the features to be tested
• Features Not to Be Tested:
1. List the features of the software/product which will
not be tested.
2. Specify the reasons these features won’t be tested.
• Approach:
1. Mention the overall approach to testing.
2. Specify the testing levels [if it’s a Master Test Plan],
the testing types, and the testing methods
[Manual/Automated; White Box/Black Box/Gray
Box]
9. • Item Pass/Fail Criteria:
1. Specify the criteria that will be used to determine whether
each test item (software/product) has passed or failed
testing.
• Suspension Criteria and Resumption Requirements:
1. Specify criteria to be used to suspend the testing activity.
2. Specify testing activities which must be redone when
testing is resumed.
• Test Deliverables:
List test deliverables, and links to them if available,
including the following:
– Test Plan (this document itself)
– Test Cases
– Test Scripts
– Defect/Enhancement Logs
– Test Reports
10. • Test Environment:
1. Specify the properties of test environment: hardware,
software, network etc.
2. List any testing or related tools.
• Estimate:
Provide a summary of test estimates (cost or effort)
and/or provide a link to the detailed estimation.
• Schedule:
Provide a summary of the schedule, specifying key
test milestones, and/or provide a link to the detailed
schedule.
• Staffing and Training Needs:
1. Specify staffing needs by role and required skills.
2. Identify training that is necessary to provide those
skills, if not already acquired.
11. • Responsibilities:
List the responsibilities of each team/role/individual.
• Risks:
1. List the risks that have been identified.
2. Specify the mitigation plan and the contingency plan
for each risk.
• Assumptions and Dependencies:
1. List the assumptions that have been made during the
preparation of this plan.
2. List the dependencies.
• Approvals:
1. Specify the names and roles of all persons who must
approve the plan.
2. Provide space for signatures and dates. (If the
document is to be printed.)
12. Risk Management During Test
Planning
The risk management process occurs twice, during:
• Test planning
• Test case design(end) or sometimes in the test execution phase
13. • Risk identification
As it is said, the first step to solving a problem is
identifying it. This stage involves making a list of
everything that might potentially come up and disrupt
the normal flow of events.
• Risk Analysis in software testing: All the risks are
quantified and prioritized in this step. Every risk’s
probability (the chance of occurrence) and impact
(amount of loss that it would cause when this risk
materializes) are determined systematically.
High – medium – low, values are assigned to both the
probability and impact of each risk. The risks with
“high” probability and “High” impact are taken care of
first and then the order follows.
14. • Risk Mitigation
The final step in this Risk Based Testing
(RBT) process is to find solutions to plan how
to handle each one of these situations. These
plans can differ from company to company,
project to project and even person to person.
15. Deciding test approach
• Like any project, the testing also should be driven by a plan.
The test plan acts as the anchor
• for the execution, tracking and reporting of the entire testing
project. Activities of test plan:
1. Scope Management: Deciding what features to be tested and
not to be tested.
2. Deciding Test approach /strategy: Which type of testing shall
be done like configuration, integration, localization etc.
3. Setting up criteria for testing: There must be clear entry and
exit criteria for different phases of testing. The test strategies
for the various features and combinations determined how
these features and combinations would be tested.
4. Identifying responsibilities, staffing and training needs
5. Identifying resource requirements
6. Identifying test deliverables
7. Testing tasks: size and effort estimation
16. Setting up criteria for testing
• There must be clear entry and exit criteria, pass or fail
criteria , suspend criteria, Resume criteria for different
phases of testing. The test strategies for the various
features and combinations determined how these
features and combinations would be tested.
Pass or fail :- Specify the criteria that will be used to
determine whether each test item has passed or failed
testing.
Suspend Criteria :- Specify the criteria to be used to
suspend test activity.
Resume Criteria :- Specify the criteria which must be
redone when testing is resumed.
17. Identifying Responsibilities
• A testing project requires different people to play different roles.
There are roles of test engineers, test leads and test managers. There
is also role definition on the dimensions of the modules being tested
or the type of testing. These different roles should complement each
other.
• The different role definition should -
Ensure there is clear accountability for a given task, so that each
person knows what he or she has to do,
Clearly list the responsibilities for various functions to various
people, so that everyone knows how his or her work fits into the
entire project.
Complement each other, ensuring no one steps on an others‟ toes
Supplement each other, so that no task is left unassigned. Role
definition should not only address technical roles, but also list the
management and reporting responsibilities. This includes frequency,
format and recipients of status reports and other project-tracking
mechanism.
18. Various hardware and software required /
recommended by project manager
1. At the most basic level, project management products will help your
organization to manage projects from start to finish, and allow
employees at different levels to have an input into the process.
2. Project management software has been around for a number of years
now and as a result, it does far more than just manage the projects
themselves.
3. Project applications can also carry out scheduling, cost control and
budget management, resource allocation, collaboration,
communication, quality management and documentation or
administration.
4. The aim with these is to handle all aspects and complexities of larger
projects and help keep costs down.
19. Test Deliverables and Milestones
• Test Deliverables are the artifacts which are given to the stakeholders of
software project during the software development lifecycle. There are
different test deliverables at every phase of the software development
lifecycle. Some test deliverables are provided before testing phase, some
are provided during the testing phase and some after the testing cycles is
over.
• The different types of Test deliverables are:
Test cases Documents
Test Plan
Testing Strategy
Test Scripts
Test Data
Test Traceability Matrix
Test Results/reports
Test summary report
Install/config guides
Defect Reports
Release notes
20. 1. The test plan describes the overall method to be used to verify that
the software meets the product specification and the customer's
needs. It includes the quality objectives, resource needs, schedules,
assignments, methods, and so forth.
2. Test cases list the specific items that will be tested and describe the
detailed steps that will be followed to verify the software.
3. Bug reports describe the problems found as the test cases are
followed. These could be done on paper but are often tracked in a
database.
4. Test tools and automation are listed and described which are used
to test the software. If the team is using automated methods to test
software, the tools used, either purchased or written in-house, must
be documented.
5. Metrics, statistics, and summaries convey the progress being made
as the test work progresses. They take the form of graphs, charts,
and written reports.
• Milestones: milestones are the dates of completion given for
various tasks to be performed in testing. These are thoroughly
tracked by the test manager and are kept in the documents such as
Gantt charts, etc.
21. Test Management
• It concerned with both test resource and test
environment management. It is the role of test
management to ensure that new or modified
service products meet business requirements
for which they have been developed or
enhanced.
22. Test Infrastructure
The top, or project level, test plan, the process of creating it is more important
than the resulting document. The next three levels, the test design specification,
the test case specification, and the test procedure specification are described in
detail in the following sections.
As you can see in Figure, moving further away from the top-level test plan
puts less emphasis on the process of creation and more on the resulting written
document. The reason is that these plans become useful on a daily, sometimes
hourly, basis by the testers performing the testing. At the lowest level they
become step-by-step instructions for executing a test, making it key that they‘re
clear, concise, and organized how they got that way isn‘t nearly as important.
This standard is what many testing teams have adopted as their test planning
documentation intentional or not—because it represents a logical and common-
sense method for test planning.
The important thing to realize about this standard is that unless tester is bound
to follow it to the letter because of the type of software he is testing or by your
corporate or industry policy, tester should use it as a guideline and not a
standard.
23. Test Design
The overall project test plan is written at a very
high level. It breaks out the software into specific
features and testable items and assigns them to
individual testers, but it doesn‘t specify exactly
how those features will be tested. There may be a
general mention of using automation or black-
box or white-box testing, but the test plan doesn‘t
get into the details of exactly where and how they
will be used. This next level of detail that defines
the testing approach for individual software
features is the test design specification.
24. Test Cases
Dissecting a specification, code, and software to derive the minimal
amount of test cases that would effectively test the software. The test
case specification ―documents the actual values used for input
along with the anticipated outputs. A test case also identifies any
constraints on the test
procedure resulting from use of that specific test case.‖ Essentially,
the details of a test case should explain exactly what values or
conditions will be sent to the software and what result is expected.
It can be referenced by one or more test design specs and may
reference more than one test procedure. The ANSI/IEEE 829
standard also lists some other important information that should be
included:
• Identifiers.
• Test item.
• Input specification.
• Output specification.
• Environmental needs.
• Special procedural requirements.
• Intercase dependencies.
25. Test Procedures
After tester documents the test designs and test
cases, what remains are the procedures that
need to be followed to execute the test cases.
The test procedure specification ―identifies
all the steps required to operate the system and
exercise the specified test cases in order to
implement the associated test design. The test
procedure or test script spec defines the step-
by-step details of exactly how to perform the
test cases. Here‘s the information that needs to
be defined:
26. • Identifier. A unique identifier that ties the test procedure to the associated test
cases and test design.
• Purpose. The purpose of the procedure and reference to the test cases that it will
exe-cute.
• Special requirements. Other procedures, special testing skills, or special
equipment needed to run the procedure.
• Procedure steps. Detailed description of how the tests are to be run:
• Log. Tells how and by what method the results and observations will be
recorded.
• Setup. Explains how to prepare for the test.
• Start. Explains the steps used to start the test.
• Procedure. Describes the steps used to run the tests.
• Measure. Describes how the results are to be determined for example, with a
stopwatch or visual determination.
• Shut down. Explains the steps for suspending the test for unexpected reasons.
• Restart. Tells the tester how to pick up the test at a certain point if there‘s a
failure or after shutting down.
• Stop. Describes the steps for an orderly halt to the test.
• Wrap up. Explains how to restore the environment to its pre-test condition.
• Contingencies. Explains what to do if things don‘t go as planned.
27. Test Process in Software Testing
• Testing is a process rather than a single activity.
Testing must be planned and it requires discipline
to act upon it. The quality and effectiveness of
software testing are primarily determined by the
quality of the test processes used.
The activities of testing can be divided into the
following basic steps:
• Planning and Control
• Analysis and Design
• Implementation and Execution
• Evaluating exit criteria and Reporting
• Test Closure activities
28. 1) Planning and Control
Test Planning : Test planning involves producing a document that
describes an overall approach and test objectives. It involves
reviewing the test basis, identifying the test conditions based on
analysis of test items, writing test cases and Designing the test
environment. Completion or exit criteria must be specified so that
we know when testing (at any stage) is complete.
Purpose
To determine the scope and risks and identify the objectives of testing.
To determine the required test resources like people, test environments
etc.
To schedule test analysis and design tasks, test implementation,
execution and evaluation.
Control
This is the activity of comparing actual progress against the plan,
and reporting the status, including deviations from the plan. It
involves taking actions necessary to meet the mission and
objectives of the project.
29. 2) Analysis and Design
Test analysis and Test Design has the following major tasks:
• To review the test basis. The test basis is the information on which test cases are
based, such as requirements, design specifications, product risk
analysis, architecture and interfaces
• To identify test conditions
• To design the tests
• To design the test environment set-up and identify the required infrastructure and
tools
3) Implementation and Execution
Test execution involves actually running the specified test on a computer system either
manually or by using an automated test tool. It is a Fundamental Test Process in
which actual work is done.
Test implementation has the following major task:
• To develop and prioritize test cases by using techniques and create test data for
those tests.
• To create test suites from the test cases for efficient test execution. Test suite is a
collection of test cases that are used to test a software program
• To re-execute the tests that previously failed in order to confirm a fix.
• To log the outcome of the test execution. A test log is the status of the test case
(pass/fail).
• To Compare actual results with expected result.
30. 4) Evaluating Exit criteria and Reporting
Evaluating exit criteria is a process defining when to stop testing. It depends on coverage
of code, functionality or risk. Basically it also depends on business risk, cost and time
and vary from project to project. Exit criteria come into picture, when:
• Maximum test cases are executed with certain pass percentage
• Bug rate falls below certain level
• When we achieve the deadlines
Evaluating exit criteria has the following major tasks:
• To assess if more test are needed or if the exit criteria specified should be changed
• To write a test summary report for stakeholders
5) Test Closure activities:
Test closure activities are done when software is ready to be delivered. The testing can be
closed for the other reasons also like:
• When a project is cancelled
• When some target is achieved
• When a maintenance release or update is done
Test closure activities have the following major tasks:
• To check which planned deliverables are actually delivered and to ensure that all
incident reports have been resolved
• To finalize and archive test ware such as scripts, test environments, etc. for later reuse
• To handover the test ware to the maintenance organization. They will give support to
the software
• To evaluate how the testing went and learn lessons for future releases and projects
31. Test Case Specification
The test case specifications should be developed from the test plan and are the second phase of
the test development life cycle. The test specification should explain "how" to implement
the test cases described in the test plan. Test case specifications are useful as it
enlists the specification details of the items.
Test Specification Items are must for each test specification should contain the following
items:
1. Case No.: The test case number should be a three digit identifier of the following form:c.s.t,
where: c- is the chapter number, s- is the section number, and t- is the test case number.
2. Title: is the title of the test.
3. Programme: is the program name containing the test.
4. Author: is the person who wrote the test specification.
5. Date: is the date of the last revision to the test case.
6. Background: (Objectives, Assumptions, References, Success Criteria): Describes in
words how to conduct the test.
7. Expected Error(s): Describes any errors expected
8. Reference(s): Lists reference documentation used to design the specification.
9. Data: (Tx Data, Predicted Rx Data): Describes the data flows between the Implementation
under Test (IUT) and the test engine.
10. Script: (Pseudo Code for Coding Tests): Pseudo code (or real code) used to conduct the
test.
32. Test Summary Report
Test reporting is a means of achieving communication through the testing cycle.
There are 3 types of test reporting.
1. Test incident report:
A test incident report is communication that happens through the testing cycle as
and when defects are encountered .A test incident report is an entry made in the
defect repository each defect has a unique id to identify incident .The high impact
test incident are highlighted in the test summary report.
2. Test cycle report:
A test cycle entails planning and running certain test in cycle, each cycle using a
different build of the product .As the product progresses through the various cycles
it is expected to stabilize.
Test cycle report gives
• A summary of the activities carried out during that cycle.
• Defects that are uncovered during that cycle based on severity and impact
• Progress from the previous cycle to the current cycle in terms of defect fixed
• Outstanding defects that not yet to be fixed in cycle
• Any variation observed in effort or schedule
33. 3. Test summary report:
The final step in a test cycle is to recommend the suitability
of a product for release. A report that summarizes the result
of a test cycle is the test summary report.
There are two types of test summary report:
Phase wise test summary, which is produced at the end of
every phase Final test summary report. A Summary report
should present Test Summary report Identifier Description
Identify the test items being reported in this report with test
id
1). Variances: Mention any deviation from test plans, test
procedures, if any.
2). Summary of results: All the results are mentioned here with
the resolved incidents and their solutions.
3). Comprehensive assessment and recommendation for
release should include Fit for release assessment and
recommendation of release
34. Test Reporting
Test reporting is a means of achieving
communication through the testing cycle. There
are 3 types of test reporting.
1. Test incident report:
A test incident report is communication that
happens through the testing cycle as and when
defects are encountered .A test incident report is
an entry made in the defect repository each defect
has a unique id to identify incident .The high
impact test incident are highlighted in the test
summary report.
35. 2. Test cycle report:
A test cycle entails planning and running certain test in
cycle , each cycle using a different build of the product
.As the product progresses through the various cycles it
is expected to stabilize.
Test cycle report gives
1. A summary of the activities carried out during that
cycle.
2. Defects that are uncovered during that cycle based on
severity and impact
3. Progress from the previous cycle to the current cycle in
terms of defect fixed
4. Outstanding defects that not yet to be fixed in cycle
5. Any variation observed in effort or schedule
36. 3 Test summary report:
The final step in a test cycle is to recommend the suitability of a
product for release. A report that summarizes the result of a test cycle is
the test summary report.
There are two types of test summary report:
1.Phase wise test summary ,which is produced at the end of every phase
2. Final test summary report .
A Summary report should present
1. Test Summary report Identifier
2 Description:- Identify the test items being reported in this report with
test id
3 Variances:- Mention any deviation from test plans, test procedures, if
any.
4 Summary of results:- All the results are mentioned here with the
resolved incidents and their solutions.
5 Comprehensive assessment and recommendation for release should
include
Fit for release assessment and recommendation of release