SlideShare a Scribd company logo
Thought on Effective Testing

             By Qingsong Yao
1. User Scenario driven testing
When writing test plan, separate what with How
  – First, only think about the user scenario
  – Then, think about how you to test the scenario
When write tests, separate what with how
  – First, write use scenario
  – Second, implement the test cases which test the
    scenario
User Scenario Example
• Scenario – Block of upgrade SQL Express during VS
  2010 Installation (Priority 0)
• Action:
   – When a use install VS 2010 on a AMD64 machine with SSE
     2005 install, existing SSE instance can’t upgrade SSE 2008
• Success criteria:
   – Make sure that Setup program detect existing SSE instance
     correctly.
   – Make sure that Setup program disable the upgrade/install
     of SSE correctly.
   – Make sure SSE is not upgraded if upgrade is not needed.
   – Existing SSE instance works after setup.
2. Understand the feature
Knowing:
  – how the feature will be implemented.
  – the risks in term of implementation.
  – the risks in term of the impact on customer.

Recommended for you

Test plan
Test planTest plan
Test plan

A Test Plan is a document describing software testing scope and activities. It is the basis for formally testing any software/product in a project.

software testingtest casetesting
03 software test-plan-template
03 software test-plan-template03 software test-plan-template
03 software test-plan-template

This software test plan document provides details on testing for a software project called XXX. It describes the test environment, identification of planned tests, schedules, and traceability of requirements to tests. Tests are divided into phases and categories and will verify requirements from the software requirements specification document for XXX.

Software Test Planning and Design
Software Test Planning and DesignSoftware Test Planning and Design
Software Test Planning and Design

The test planning stage involves identifying standards and protocols for test procedure creation, hardware and software requirements for the test environment, test data needs, a preliminary test schedule, and defect tracking procedures. The test plan will outline roles and responsibilities, the test project schedule, planning and design activities, test environment setup, risks and issues, and the required level of thoroughness. Test design addresses defining the number and types of tests, test paths and functions, and required test conditions. Test requirements must be clearly defined and documented before test design so that the basis for test efforts is understood. During test planning, the test team estimates the number and types of test techniques and procedures needed.

Example of “Risk Factors and
        Mitigation strategies”
• We are testing product which is not shipped
  by SQL Group.
• Setup is sensitive to change, and easy to be
  broken.
• Dependence of SSE, such as MSI 4.5 is one of
  the main factors of causing setup failing.
• Huge Test Matrix
3. Define your Test Strategy
• Test Strategy
  – How to address the risk areas?
  – Manual Test v.s. Automation Test?
• Examples:
  – Align Test tasks with Dev tasks.
  – For larger dev check-ins, test with a private build
    before checking-in.
  – Encourage writing programming based tests
    instead of writing static Meta tests.
Example of Test Strategy
• Manual Testing during Improvement Phase
   – Avoid huge investigation of test automation
   – We define high-level user scenario Success criteria
     and China VAT team help us to verify
• Run test as a real customer to find usability issue.
   – Verify UI, setup option, and no. reboots
   – Verify localized strings
• For bug fix, we drive user scenario and test
  dimension from the nature of the fix
• Long term, will take advance of VS setup
  automation in SQL Lab
4. Define test patterns
• Test Types:
   – Recorded tests, Scripted tests or Data Driven tests, Declarative
     Tests
   – Model-based or static tests
• Design Patterns:
   – Layer Tests
   – Repository Pattern, Factory Patterns, Visitor pattern
• Test Dimensions:
   – Pair wise or all combination; Parameterized Tests
• Verification Pattern:
   – State Verification; Oracle based Verification; Custom Assertion
• Deal with Dependence:
   – Dependence Injection
   – Mock Object

Recommended for you

Test plan presentation
Test plan presentationTest plan presentation
Test plan presentation

This document outlines the testing strategy and process for a software project. It includes details about sprint timelines, testing artifacts, test methods, test types, definitions of done, and bug prioritization. The testing process involves smoke testing, unit/selenium tests, main testing, regression testing, and testing reports. Test methods include manual functional testing and automated functional testing. Test types cover new features, risk, interfaces, compatibility, permissions, and notifications. Bugs are prioritized as blocker, critical, major, or minor.

Test Documentation Based On Ieee829 155261
Test Documentation Based On Ieee829 155261Test Documentation Based On Ieee829 155261
Test Documentation Based On Ieee829 155261

This document provides templates for test documentation including test plans, test design specifications, test procedure specifications, test cases, and test reports. The templates are based on the IEEE 829 standard and are intended to help ensure that test documentation includes essential information and supports testing activities. The templates can be adapted as needed for different projects and contexts.

Test plan
Test planTest plan
Test plan

This document provides a template for a test plan that includes sections for test plan identification, references, introduction/scope, test items, risks, features to be tested, approach/strategy, pass/fail criteria, deliverables, schedule, responsibilities, and approvals. The template can be used to create a test plan that outlines what will be tested, how it will be tested, and manages the test process.

test planningtest caseieee test plan
From User Scenario to Test Case
Test Case Example
Test Case: Mismatch between SSE language with VS language
  if the language of installed SSE instance does not match
   with the localized SSE 2008, we should not provide options
   to install SSE.
Test Dimension
   – VS Language: ENU
   – SSE: SSE 2005, SSE 2008
   – SSE Language: JPN
Test Case:
  use pict tool to use generate 3 test cases
Verification:
• Verify that user can not choose SSE during VS Setup
• Verify that VS setup succeed without any error
Conclusion
1.   User Scenario driven testing
2.   Understand the Feature to Be Tested
3.   Define Test Strategy
4.   From User Scenario to Test Case
5.   Write good Tests
6.   Define measurable success critical
Reference: Test Strategy
• http://en.wikipedia.org/wiki/Test_strategy
• http://www.projectperfect.com.au/info_test_
  strategy.php
• http://www.satisfice.com/presentations/strat
  egy.pdf

Recommended for you

02 test planning
02   test planning02   test planning
02 test planning

The document discusses test planning and outlines the key phases and activities in a test planning process. It emphasizes that an important part of planning is creating a test plan that is derived from an overall master test plan. The planning phase involves determining what will be tested based on business needs and risks, and managing the test process and different test types. It stresses the importance of coordination across test levels, phases, and types using a master test plan to avoid duplicative testing.

almmicrosoftmtm
06 template test plan
06 template test plan06 template test plan
06 template test plan

This document provides guidelines and templates for creating a Quality Assurance Test Plan. It outlines the purpose, scope, objectives, and goals of testing. It describes the overall test methodology including entrance and exit criteria. It also covers test execution approaches, test scenarios, environments, assumptions/risks, roles and responsibilities, and defect tracking. The plan is intended to document the testing strategy for an application to ensure requirements are met.

Test planning
Test planningTest planning
Test planning

Aliaa delivered a session in the topic of “Test planning” using a new technique of delivering content through games and knowledge sharing instead of instructive technique. The session covered all test planning activities including defining test items, risk assessment techniques, testing strategies, planning for testing resources, testing scheduling, and test deliverables and the final test plan documents. The session introduced to quality team at ITWorx (June , 2013)

software testingqualityplanning

More Related Content

What's hot

test plan
test plan test plan
test plan
rosh26
 
Test plan
Test planTest plan
Test plan
ranhasan
 
Ieee829mtp
Ieee829mtpIeee829mtp
Ieee829mtp
sephalika
 
Test plan
Test planTest plan
Test plan
lakshitha perera
 
03 software test-plan-template
03 software test-plan-template03 software test-plan-template
03 software test-plan-template
Andrei Hortúa
 
Software Test Planning and Design
Software Test Planning and DesignSoftware Test Planning and Design
Software Test Planning and Design
EffOne_Technologies
 
Test plan presentation
Test plan presentationTest plan presentation
Test plan presentation
Peter Lebedevv
 
Test Documentation Based On Ieee829 155261
Test Documentation Based On Ieee829 155261Test Documentation Based On Ieee829 155261
Test Documentation Based On Ieee829 155261
tonynavy
 
Test plan
Test planTest plan
Test plan
G Chandra Reddy
 
02 test planning
02   test planning02   test planning
02 test planning
Clemens Reijnen
 
06 template test plan
06 template test plan06 template test plan
06 template test plan
Andrei Hortúa
 
Test planning
Test planningTest planning
Test planning
Aliaa Monier Ismaail
 
Testing strategies
Testing strategiesTesting strategies
Testing strategies
Satish Bhutawale
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
muhammad afif
 
How to create a 'Master Test Plan'
How to create a 'Master Test Plan'How to create a 'Master Test Plan'
How to create a 'Master Test Plan'
PractiTest
 
Test Plan Template
Test Plan TemplateTest Plan Template
Test Plan Template
H2Kinfosys
 
Qa documentation pp
Qa documentation ppQa documentation pp
Qa documentation pp
Bohdana Shaleva
 
TestPlan for IIT website
TestPlan for IIT websiteTestPlan for IIT website
TestPlan for IIT website
Muksitul M Tanim Hasan
 
Paper review
Paper reviewPaper review
Paper review
Nadia Nahar
 
Ieee 829 1998-a3
Ieee 829 1998-a3Ieee 829 1998-a3
Ieee 829 1998-a3
Paritosh Mohanty
 

What's hot (20)

test plan
test plan test plan
test plan
 
Test plan
Test planTest plan
Test plan
 
Ieee829mtp
Ieee829mtpIeee829mtp
Ieee829mtp
 
Test plan
Test planTest plan
Test plan
 
03 software test-plan-template
03 software test-plan-template03 software test-plan-template
03 software test-plan-template
 
Software Test Planning and Design
Software Test Planning and DesignSoftware Test Planning and Design
Software Test Planning and Design
 
Test plan presentation
Test plan presentationTest plan presentation
Test plan presentation
 
Test Documentation Based On Ieee829 155261
Test Documentation Based On Ieee829 155261Test Documentation Based On Ieee829 155261
Test Documentation Based On Ieee829 155261
 
Test plan
Test planTest plan
Test plan
 
02 test planning
02   test planning02   test planning
02 test planning
 
06 template test plan
06 template test plan06 template test plan
06 template test plan
 
Test planning
Test planningTest planning
Test planning
 
Testing strategies
Testing strategiesTesting strategies
Testing strategies
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
How to create a 'Master Test Plan'
How to create a 'Master Test Plan'How to create a 'Master Test Plan'
How to create a 'Master Test Plan'
 
Test Plan Template
Test Plan TemplateTest Plan Template
Test Plan Template
 
Qa documentation pp
Qa documentation ppQa documentation pp
Qa documentation pp
 
TestPlan for IIT website
TestPlan for IIT websiteTestPlan for IIT website
TestPlan for IIT website
 
Paper review
Paper reviewPaper review
Paper review
 
Ieee 829 1998-a3
Ieee 829 1998-a3Ieee 829 1998-a3
Ieee 829 1998-a3
 

Viewers also liked

English Language Learners and NCLB testing
English Language Learners and NCLB testingEnglish Language Learners and NCLB testing
English Language Learners and NCLB testing
Taren Parsons
 
Mattias Ratert - Incremental Scenario Testing
Mattias Ratert - Incremental Scenario TestingMattias Ratert - Incremental Scenario Testing
Mattias Ratert - Incremental Scenario Testing
TEST Huddle
 
Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...
Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...
Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...
The University of Western Australia
 
Role+Of+Testing+In+Sdlc
Role+Of+Testing+In+SdlcRole+Of+Testing+In+Sdlc
Role+Of+Testing+In+Sdlc
mahendra singh
 
Test 1
Test 1Test 1
14.2. курс лекций афу
14.2. курс лекций афу14.2. курс лекций афу
14.2. курс лекций афу
GKarina707
 
Embedded software development using BDD
Embedded software development using BDDEmbedded software development using BDD
Embedded software development using BDD
Itamar Hassin
 
Testing and Test Construction
Testing and Test ConstructionTesting and Test Construction
Testing and Test Construction
songoten77
 
Test Case Design
Test Case DesignTest Case Design
Test Case Design
acatalin
 
Test plan
Test planTest plan
Test plan
Sanjai San
 
Test Case, Use Case and Test Scenario
Test Case, Use Case and Test ScenarioTest Case, Use Case and Test Scenario
Test Case, Use Case and Test Scenario
Lokesh Agrawal
 
Writing Test Cases 20110808
Writing Test Cases 20110808Writing Test Cases 20110808
Writing Test Cases 20110808
slovejoy
 
Qualities of a good test (1)
Qualities of a good test (1)Qualities of a good test (1)
Qualities of a good test (1)
kimoya
 
Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
ALMA HERMOGINO
 
Characteristics of a good test
Characteristics of a good test Characteristics of a good test
Characteristics of a good test
Arash Yazdani
 
Kinds of testing (2nd)
Kinds of testing (2nd)Kinds of testing (2nd)
Kinds of testing (2nd)
Harry Subagyo
 
Test construction edited
Test construction editedTest construction edited
Test construction edited
Arnel Rivera
 
Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
Boyet Aluan
 
stages of test construction
stages of test constructionstages of test construction
stages of test construction
irshad narejo
 
Language Testing
Language TestingLanguage Testing
Language Testing
Teguh Ekosetio
 

Viewers also liked (20)

English Language Learners and NCLB testing
English Language Learners and NCLB testingEnglish Language Learners and NCLB testing
English Language Learners and NCLB testing
 
Mattias Ratert - Incremental Scenario Testing
Mattias Ratert - Incremental Scenario TestingMattias Ratert - Incremental Scenario Testing
Mattias Ratert - Incremental Scenario Testing
 
Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...
Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...
Scenario Testing and Sensitivity Analysis for 3-D Kinematic Models and Geophy...
 
Role+Of+Testing+In+Sdlc
Role+Of+Testing+In+SdlcRole+Of+Testing+In+Sdlc
Role+Of+Testing+In+Sdlc
 
Test 1
Test 1Test 1
Test 1
 
14.2. курс лекций афу
14.2. курс лекций афу14.2. курс лекций афу
14.2. курс лекций афу
 
Embedded software development using BDD
Embedded software development using BDDEmbedded software development using BDD
Embedded software development using BDD
 
Testing and Test Construction
Testing and Test ConstructionTesting and Test Construction
Testing and Test Construction
 
Test Case Design
Test Case DesignTest Case Design
Test Case Design
 
Test plan
Test planTest plan
Test plan
 
Test Case, Use Case and Test Scenario
Test Case, Use Case and Test ScenarioTest Case, Use Case and Test Scenario
Test Case, Use Case and Test Scenario
 
Writing Test Cases 20110808
Writing Test Cases 20110808Writing Test Cases 20110808
Writing Test Cases 20110808
 
Qualities of a good test (1)
Qualities of a good test (1)Qualities of a good test (1)
Qualities of a good test (1)
 
Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
 
Characteristics of a good test
Characteristics of a good test Characteristics of a good test
Characteristics of a good test
 
Kinds of testing (2nd)
Kinds of testing (2nd)Kinds of testing (2nd)
Kinds of testing (2nd)
 
Test construction edited
Test construction editedTest construction edited
Test construction edited
 
Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
 
stages of test construction
stages of test constructionstages of test construction
stages of test construction
 
Language Testing
Language TestingLanguage Testing
Language Testing
 

Similar to Writing good test plan and writing good tests

Test case management with MTM 2013
Test case management with MTM 2013Test case management with MTM 2013
Test case management with MTM 2013
Raluca Suditu
 
Test Case Management with MTM 2013
Test Case Management with MTM 2013Test Case Management with MTM 2013
Test Case Management with MTM 2013
Raluca Suditu
 
Mt s11 test_design
Mt s11 test_designMt s11 test_design
Mt s11 test_design
TestingGeeks
 
Visual Studio 2010 for testers
Visual Studio 2010 for testersVisual Studio 2010 for testers
Visual Studio 2010 for testers
Arpit Dubey
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
Moataz Nabil
 
Software automation
Software automationSoftware automation
Software automation
gokilabrindha
 
Automation testing
Automation testingAutomation testing
Automation testing
Vivin Chityappa
 
Automated testing overview
Automated testing overviewAutomated testing overview
Automated testing overview
Alex Pop
 
Meetup TestingUy 2017 - Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017 - Automating the Viewer: a cross-functional team approachMeetup TestingUy 2017 - Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017 - Automating the Viewer: a cross-functional team approach
TestingUy
 
Meetup TestingUy 2017: Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017: Automating the Viewer: a cross-functional team approachMeetup TestingUy 2017: Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017: Automating the Viewer: a cross-functional team approach
Claudia Badell
 
VCS_QAPerformanceSlides
VCS_QAPerformanceSlidesVCS_QAPerformanceSlides
VCS_QAPerformanceSlides
Michael Cowan
 
Software testing part
Software testing partSoftware testing part
Software testing part
Preeti Mishra
 
Object Oriented Testing(OOT) presentation slides
Object Oriented Testing(OOT) presentation slidesObject Oriented Testing(OOT) presentation slides
Object Oriented Testing(OOT) presentation slides
Punjab University
 
Automated Testing Tutorial
Automated Testing TutorialAutomated Testing Tutorial
Automated Testing Tutorial
John Liebenau
 
Implementing test scripting Ian McDonald updated (minor changes) 26-04-2013
Implementing test scripting   Ian McDonald updated (minor changes) 26-04-2013Implementing test scripting   Ian McDonald updated (minor changes) 26-04-2013
Implementing test scripting Ian McDonald updated (minor changes) 26-04-2013
Ian McDonald
 
Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
ClareMcLennan
 
10-Testing-system.pdf
10-Testing-system.pdf10-Testing-system.pdf
10-Testing-system.pdf
n190212
 
Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012
Imaginet
 
Chowdappa Resume
Chowdappa ResumeChowdappa Resume
Chowdappa Resume
chowdappa o
 
Chowdappa Resume
Chowdappa ResumeChowdappa Resume
Chowdappa Resume
chowdappa o
 

Similar to Writing good test plan and writing good tests (20)

Test case management with MTM 2013
Test case management with MTM 2013Test case management with MTM 2013
Test case management with MTM 2013
 
Test Case Management with MTM 2013
Test Case Management with MTM 2013Test Case Management with MTM 2013
Test Case Management with MTM 2013
 
Mt s11 test_design
Mt s11 test_designMt s11 test_design
Mt s11 test_design
 
Visual Studio 2010 for testers
Visual Studio 2010 for testersVisual Studio 2010 for testers
Visual Studio 2010 for testers
 
Testing Frameworks
Testing FrameworksTesting Frameworks
Testing Frameworks
 
Software automation
Software automationSoftware automation
Software automation
 
Automation testing
Automation testingAutomation testing
Automation testing
 
Automated testing overview
Automated testing overviewAutomated testing overview
Automated testing overview
 
Meetup TestingUy 2017 - Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017 - Automating the Viewer: a cross-functional team approachMeetup TestingUy 2017 - Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017 - Automating the Viewer: a cross-functional team approach
 
Meetup TestingUy 2017: Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017: Automating the Viewer: a cross-functional team approachMeetup TestingUy 2017: Automating the Viewer: a cross-functional team approach
Meetup TestingUy 2017: Automating the Viewer: a cross-functional team approach
 
VCS_QAPerformanceSlides
VCS_QAPerformanceSlidesVCS_QAPerformanceSlides
VCS_QAPerformanceSlides
 
Software testing part
Software testing partSoftware testing part
Software testing part
 
Object Oriented Testing(OOT) presentation slides
Object Oriented Testing(OOT) presentation slidesObject Oriented Testing(OOT) presentation slides
Object Oriented Testing(OOT) presentation slides
 
Automated Testing Tutorial
Automated Testing TutorialAutomated Testing Tutorial
Automated Testing Tutorial
 
Implementing test scripting Ian McDonald updated (minor changes) 26-04-2013
Implementing test scripting   Ian McDonald updated (minor changes) 26-04-2013Implementing test scripting   Ian McDonald updated (minor changes) 26-04-2013
Implementing test scripting Ian McDonald updated (minor changes) 26-04-2013
 
Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
 
10-Testing-system.pdf
10-Testing-system.pdf10-Testing-system.pdf
10-Testing-system.pdf
 
Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012Streamlining Testing with Visual Studio 2012
Streamlining Testing with Visual Studio 2012
 
Chowdappa Resume
Chowdappa ResumeChowdappa Resume
Chowdappa Resume
 
Chowdappa Resume
Chowdappa ResumeChowdappa Resume
Chowdappa Resume
 

Recently uploaded

How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
Stephanie Beckett
 
20240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 202420240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 2024
Matthew Sinclair
 
Mitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing SystemsMitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing Systems
ScyllaDB
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
BookNet Canada
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
Mark Billinghurst
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
Eric D. Schabell
 
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALLBLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
Liveplex
 
7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf
Enterprise Wired
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
welrejdoall
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
Aurora Consulting
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
Safe Software
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfINDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
jackson110191
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Erasmo Purificato
 
20240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 202420240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 2024
Matthew Sinclair
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
BookNet Canada
 

Recently uploaded (20)

How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-InTrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
TrustArc Webinar - 2024 Data Privacy Trends: A Mid-Year Check-In
 
What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024What’s New in Teams Calling, Meetings and Devices May 2024
What’s New in Teams Calling, Meetings and Devices May 2024
 
20240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 202420240704 QFM023 Engineering Leadership Reading List June 2024
20240704 QFM023 Engineering Leadership Reading List June 2024
 
Mitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing SystemsMitigating the Impact of State Management in Cloud Stream Processing Systems
Mitigating the Impact of State Management in Cloud Stream Processing Systems
 
Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...Transcript: Details of description part II: Describing images in practice - T...
Transcript: Details of description part II: Describing images in practice - T...
 
Research Directions for Cross Reality Interfaces
Research Directions for Cross Reality InterfacesResearch Directions for Cross Reality Interfaces
Research Directions for Cross Reality Interfaces
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
 
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALLBLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
BLOCKCHAIN FOR DUMMIES: GUIDEBOOK FOR ALL
 
7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf7 Most Powerful Solar Storms in the History of Earth.pdf
7 Most Powerful Solar Storms in the History of Earth.pdf
 
Manual | Product | Research Presentation
Manual | Product | Research PresentationManual | Product | Research Presentation
Manual | Product | Research Presentation
 
Quality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of TimeQuality Patents: Patents That Stand the Test of Time
Quality Patents: Patents That Stand the Test of Time
 
Coordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar SlidesCoordinate Systems in FME 101 - Webinar Slides
Coordinate Systems in FME 101 - Webinar Slides
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdfINDIAN AIR FORCE FIGHTER PLANES LIST.pdf
INDIAN AIR FORCE FIGHTER PLANES LIST.pdf
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...
 
20240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 202420240702 QFM021 Machine Intelligence Reading List June 2024
20240702 QFM021 Machine Intelligence Reading List June 2024
 
Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024Details of description part II: Describing images in practice - Tech Forum 2024
Details of description part II: Describing images in practice - Tech Forum 2024
 

Writing good test plan and writing good tests

  • 1. Thought on Effective Testing By Qingsong Yao
  • 2. 1. User Scenario driven testing When writing test plan, separate what with How – First, only think about the user scenario – Then, think about how you to test the scenario When write tests, separate what with how – First, write use scenario – Second, implement the test cases which test the scenario
  • 3. User Scenario Example • Scenario – Block of upgrade SQL Express during VS 2010 Installation (Priority 0) • Action: – When a use install VS 2010 on a AMD64 machine with SSE 2005 install, existing SSE instance can’t upgrade SSE 2008 • Success criteria: – Make sure that Setup program detect existing SSE instance correctly. – Make sure that Setup program disable the upgrade/install of SSE correctly. – Make sure SSE is not upgraded if upgrade is not needed. – Existing SSE instance works after setup.
  • 4. 2. Understand the feature Knowing: – how the feature will be implemented. – the risks in term of implementation. – the risks in term of the impact on customer.
  • 5. Example of “Risk Factors and Mitigation strategies” • We are testing product which is not shipped by SQL Group. • Setup is sensitive to change, and easy to be broken. • Dependence of SSE, such as MSI 4.5 is one of the main factors of causing setup failing. • Huge Test Matrix
  • 6. 3. Define your Test Strategy • Test Strategy – How to address the risk areas? – Manual Test v.s. Automation Test? • Examples: – Align Test tasks with Dev tasks. – For larger dev check-ins, test with a private build before checking-in. – Encourage writing programming based tests instead of writing static Meta tests.
  • 7. Example of Test Strategy • Manual Testing during Improvement Phase – Avoid huge investigation of test automation – We define high-level user scenario Success criteria and China VAT team help us to verify • Run test as a real customer to find usability issue. – Verify UI, setup option, and no. reboots – Verify localized strings • For bug fix, we drive user scenario and test dimension from the nature of the fix • Long term, will take advance of VS setup automation in SQL Lab
  • 8. 4. Define test patterns • Test Types: – Recorded tests, Scripted tests or Data Driven tests, Declarative Tests – Model-based or static tests • Design Patterns: – Layer Tests – Repository Pattern, Factory Patterns, Visitor pattern • Test Dimensions: – Pair wise or all combination; Parameterized Tests • Verification Pattern: – State Verification; Oracle based Verification; Custom Assertion • Deal with Dependence: – Dependence Injection – Mock Object
  • 9. From User Scenario to Test Case
  • 10. Test Case Example Test Case: Mismatch between SSE language with VS language if the language of installed SSE instance does not match with the localized SSE 2008, we should not provide options to install SSE. Test Dimension – VS Language: ENU – SSE: SSE 2005, SSE 2008 – SSE Language: JPN Test Case: use pict tool to use generate 3 test cases Verification: • Verify that user can not choose SSE during VS Setup • Verify that VS setup succeed without any error
  • 11. Conclusion 1. User Scenario driven testing 2. Understand the Feature to Be Tested 3. Define Test Strategy 4. From User Scenario to Test Case 5. Write good Tests 6. Define measurable success critical
  • 12. Reference: Test Strategy • http://en.wikipedia.org/wiki/Test_strategy • http://www.projectperfect.com.au/info_test_ strategy.php • http://www.satisfice.com/presentations/strat egy.pdf