SlideShare a Scribd company logo
Manage a Complex
Test Effort
with Lean
and Kanban
(and cherry flavor PEZ)
Mike Duskis
Testbot Wrangler
The Hills West of Denver
http://www.mikeduskis.com/
Disneyland Hotel
September 30, 2015
INTRODUCTIONS
INTRODUCTIONS
INTRODUCTIONS
INTRODUCTIONS
INTRODUCTIONS
INTRODUCTIONS
INTRODUCTIONS
INTRODUCTIONS
TODAY’S OBJECTIVES
Equip you to
1. Tune your workflow to maximize throughput
2. Empower your management with clear choices
3. Empower your team to improve the process
PRESENTATION MAP
Why it Works
Our Complex Problem
Introductions
Kanban in
60 Seconds
Anatomy of a
Simple Solution
Taking it to the Cloud
KANBAN IN 60 SECONDS
Ach! The boss
sent us
another rush
job. Priority 1!
KANBAN IN 60 SECONDS
Ach! The boss
sent us
another rush
job. Priority 1!
Which of the27 rush jobs in
progress
should we
suspend?
KANBAN IN 60 SECONDS
We might get more
done if we finished
what we started.
KANBAN IN 60 SECONDS
KANBAN IN 60 SECONDS
Ready In Progress Done
KANBAN IN 60 SECONDS
Ready In Progress Done
KANBAN IN 60 SECONDS
Ready In Progress Done
KANBAN IN 60 SECONDS
Ready In Progress Done
KANBAN IN 60 SECONDS
Ready In Progress Done
KANBAN IN 60 SECONDS
Ready In Progress Done
KANBAN IN 60 SECONDS
Ready In Progress Done!
WHY IT WORKS
WHY IT WORKS
WHY IT WORKS
WHY IT WORKS
WHY IT WORKS
Single pull queue
WHY IT WORKS
Ready Single pull queue
WHY IT WORKS
Ready Single pull queue
➔ Exactly one way to request service
WHY IT WORKS
Ready Single pull queue
➔ Exactly one way to request service
➔ Exactly one answer to “what should I do
next?”
WHY IT WORKS
Ready Single pull queue
➔ Exactly one way to request service
➔ Exactly one answer to “what should I do
next?”
➔ Naturally balances load within the
team
WHY IT WORKS
Ready Single pull queue
➔ Exactly one way to request service
➔ Exactly one answer to “what should I do
next?”
➔ Naturally balances load within the
team
➔ Simple for management to prioritize
WHY IT WORKS
Work-in-progress (WIP) limit
WHY IT WORKS
In Progress Work-in-progress (WIP) limit
WHY IT WORKS
In Progress Work-in-progress (WIP) limit
➔ Shortens cycle time
WHY IT WORKS
In Progress Work-in-progress (WIP) limit
➔ Shortens cycle time
➔ Clarifies status
WHY IT WORKS
In Progress Work-in-progress (WIP) limit
➔ Shortens cycle time
➔ Clarifies status
➔ Forces management to make
the hard choices
WHY IT WORKS
In Progress Work-in-progress (WIP) limit
➔ Shortens cycle time
➔ Clarifies status
➔ Forces management to make
the hard choices
➔ Boosts team morale (really!)
WHY IT WORKS
Capacity signal (“kanban”)
WHY IT WORKS
Ready
Capacity signal (“kanban”)
WHY IT WORKS
Ready
Capacity signal (“kanban”)
➔ Created by pull action
WHY IT WORKS
Ready
Capacity signal (“kanban”)
➔ Created by pull action
➔ Informs upstream process
about downstream slack
WHY IT WORKS
Ready
Capacity signal (“kanban”)
➔ Created by pull action
➔ Informs upstream process
about downstream slack
➔ The flow control mechanism
Ready In Progress Done
kanban
kanban
WHY IT WORKS
OUR COMPLEX PROBLEM
Feature Team
dev
test UAT
Deployment Team
test
OUR COMPLEX PROBLEM
Feature Team
dev
test
Feature Team
dev
test
UAT
Deployment Team
test
OUR COMPLEX PROBLEM
Feature Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
More roles than individuals
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
More roles than individuals
Radically varying skill levels
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
More roles than individuals
Radically varying skill levels
Uneven workloads
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
More roles than individuals
Radically varying skill levels
Uneven workloads
11.5 hour time zone difference
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
More roles than individuals
Radically varying skill levels
Uneven workloads
11.5 hour time zone difference
Holidays out of sync
OUR COMPLEX PROBLEM
Feature Team
dev
test
Maintenance Team
dev
test
Feature Team
dev
test
Integration Team
test
UAT
Deployment Team
test
More roles than individuals
Radically varying skill levels
Uneven workloads
11.5 hour time zone difference
Holidays out of sync
Testing is the bottleneck
ANATOMY OF A SIMPLE SOLUTION
Step 1: Map your (actual!) process
ANATOMY OF A SIMPLE SOLUTION
Step 1: Map your (actual!) process
user story
ATDD
definitions
feature
test plan
exploratory
test
scripted test
automated
test
test results
risk assessment
process
metrics
ANATOMY OF A SIMPLE SOLUTION
Step 2: Identify your value stream
user story
ATDD
definitions
feature
test plan
exploratory
test
scripted test
automated
test
test results
risk assessment
process
metrics
1. Plan
2. Develop
3. Execute
4. Analyze
ANATOMY OF A SIMPLE SOLUTION
Step 3: Model your value stream as queues
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Step 4: Set initial WIP limits
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Step 4: Set initial WIP limits
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
ANATOMY OF A SIMPLE SOLUTION
Execute, Learn, Adjust
Planning
Exploration and
Development
Execution Analysis
Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
SHIFT TO THE CLOUD!
http://www.trello.com/
SHIFT TO THE CLOUD!
SHIFT TO THE CLOUD!
Maintain trace references to external systems
SHIFT TO THE CLOUD!
Unified “Blocked” list
SHIFT TO THE CLOUD!
Queues identify individuals who may pull
SHIFT TO THE CLOUD!
Limit WIP: Identify the worker(s). Ban multitasking.
SHIFT TO THE CLOUD!
“Plus for Trello” extension measures WIP
SHIFT TO THE CLOUD!
Labels categorize tasks for filtering and metrics
SHIFT TO THE CLOUD!
A month of “done” reveals recent trends
SHIFT TO THE CLOUD!
History board maintains longer trends
SUGGESTED READING
SUGGESTED ORGANIZATIONS
http://www.asq.org/
SUMMARY / CHEAT SHEET
SUMMARY / CHEAT SHEET
Kanban is a simple flow control
technique which leverages pull queues and
work-in-progress limits to
1. Maximize throughput (get stuff done!)
2. Empower your management by
clarifying decisions
3. Empower your team with freedom to
improve
SUMMARY / CHEAT SHEET
Trello is a flexible and cloud-based platform which
you can transform into a fast, simple, and clear
management system (or management system
overlay) leveraging kanban principles.
SUMMARY / CHEAT SHEET
DONE!
CREDITSStratocumuli by de:Benutzer:
LivingShadow
Creative Commons https://commons.wikimedia.org/wiki/File:
Sc_2.jpg
Commodore PET 4032 by Steve Gray http://www.6502.
org/users/sjgray/collections/commodore/c_4032.jpg. Licensed under CC BY-SA 3.0 via Wikimedia
Commons
Cure for the Hiccoughs by Rube Goldberg (1917)
Public domain. Copyright lapsed. http://images.tcj.com/2014/02/19170416-invention-
hicough.jpg
CREDITS
Welcome to Orangeview! by Yvonne Tran
Creative Commons https://vimeo.com/119590100
Mechanische Stopwatch by Wouterhagens
Creative Commons
https://commons.wikimedia.org/wiki/File:Stopwatch_A.jpg
Back to the Future DeLorean Time Machine by Terabass
Creative Commons http://commons.wikimedia.org/wiki/File:TeamTimeCar.com-
BTTF_DeLorean_Time_Machine-OtoGodfrey.com-JMortonPhoto.com-07.jpg
CREDITS
Public Domain Clip Art
http://www.pdclipart.org/
Special thanks to all the people who made and released these
awesome resources for free:
▸ Simple line icons by Mirko Monti
▸ E-commerce icons by Virgil Pana
▸ Streamline iconset by Webalys
▸ Presentation template by SlidesCarnival
▸ Photographs by Death to the Stock Photo (license)
CREDITS

More Related Content

Manage a Complex Test Effort with Lean and Kanban

  • 1. Manage a Complex Test Effort with Lean and Kanban (and cherry flavor PEZ) Mike Duskis Testbot Wrangler The Hills West of Denver http://www.mikeduskis.com/ Disneyland Hotel September 30, 2015
  • 10. TODAY’S OBJECTIVES Equip you to 1. Tune your workflow to maximize throughput 2. Empower your management with clear choices 3. Empower your team to improve the process
  • 11. PRESENTATION MAP Why it Works Our Complex Problem Introductions Kanban in 60 Seconds Anatomy of a Simple Solution Taking it to the Cloud
  • 12. KANBAN IN 60 SECONDS Ach! The boss sent us another rush job. Priority 1!
  • 13. KANBAN IN 60 SECONDS Ach! The boss sent us another rush job. Priority 1! Which of the27 rush jobs in progress should we suspend?
  • 14. KANBAN IN 60 SECONDS We might get more done if we finished what we started.
  • 15. KANBAN IN 60 SECONDS
  • 16. KANBAN IN 60 SECONDS Ready In Progress Done
  • 17. KANBAN IN 60 SECONDS Ready In Progress Done
  • 18. KANBAN IN 60 SECONDS Ready In Progress Done
  • 19. KANBAN IN 60 SECONDS Ready In Progress Done
  • 20. KANBAN IN 60 SECONDS Ready In Progress Done
  • 21. KANBAN IN 60 SECONDS Ready In Progress Done
  • 22. KANBAN IN 60 SECONDS Ready In Progress Done!
  • 27. WHY IT WORKS Single pull queue
  • 28. WHY IT WORKS Ready Single pull queue
  • 29. WHY IT WORKS Ready Single pull queue ➔ Exactly one way to request service
  • 30. WHY IT WORKS Ready Single pull queue ➔ Exactly one way to request service ➔ Exactly one answer to “what should I do next?”
  • 31. WHY IT WORKS Ready Single pull queue ➔ Exactly one way to request service ➔ Exactly one answer to “what should I do next?” ➔ Naturally balances load within the team
  • 32. WHY IT WORKS Ready Single pull queue ➔ Exactly one way to request service ➔ Exactly one answer to “what should I do next?” ➔ Naturally balances load within the team ➔ Simple for management to prioritize
  • 34. WHY IT WORKS In Progress Work-in-progress (WIP) limit
  • 35. WHY IT WORKS In Progress Work-in-progress (WIP) limit ➔ Shortens cycle time
  • 36. WHY IT WORKS In Progress Work-in-progress (WIP) limit ➔ Shortens cycle time ➔ Clarifies status
  • 37. WHY IT WORKS In Progress Work-in-progress (WIP) limit ➔ Shortens cycle time ➔ Clarifies status ➔ Forces management to make the hard choices
  • 38. WHY IT WORKS In Progress Work-in-progress (WIP) limit ➔ Shortens cycle time ➔ Clarifies status ➔ Forces management to make the hard choices ➔ Boosts team morale (really!)
  • 39. WHY IT WORKS Capacity signal (“kanban”)
  • 40. WHY IT WORKS Ready Capacity signal (“kanban”)
  • 41. WHY IT WORKS Ready Capacity signal (“kanban”) ➔ Created by pull action
  • 42. WHY IT WORKS Ready Capacity signal (“kanban”) ➔ Created by pull action ➔ Informs upstream process about downstream slack
  • 43. WHY IT WORKS Ready Capacity signal (“kanban”) ➔ Created by pull action ➔ Informs upstream process about downstream slack ➔ The flow control mechanism
  • 44. Ready In Progress Done kanban kanban WHY IT WORKS
  • 45. OUR COMPLEX PROBLEM Feature Team dev test UAT Deployment Team test
  • 46. OUR COMPLEX PROBLEM Feature Team dev test Feature Team dev test UAT Deployment Team test
  • 47. OUR COMPLEX PROBLEM Feature Team dev test Feature Team dev test Integration Team test UAT Deployment Team test
  • 48. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test
  • 49. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test More roles than individuals
  • 50. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test More roles than individuals Radically varying skill levels
  • 51. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test More roles than individuals Radically varying skill levels Uneven workloads
  • 52. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test More roles than individuals Radically varying skill levels Uneven workloads 11.5 hour time zone difference
  • 53. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test More roles than individuals Radically varying skill levels Uneven workloads 11.5 hour time zone difference Holidays out of sync
  • 54. OUR COMPLEX PROBLEM Feature Team dev test Maintenance Team dev test Feature Team dev test Integration Team test UAT Deployment Team test More roles than individuals Radically varying skill levels Uneven workloads 11.5 hour time zone difference Holidays out of sync Testing is the bottleneck
  • 55. ANATOMY OF A SIMPLE SOLUTION Step 1: Map your (actual!) process
  • 56. ANATOMY OF A SIMPLE SOLUTION Step 1: Map your (actual!) process user story ATDD definitions feature test plan exploratory test scripted test automated test test results risk assessment process metrics
  • 57. ANATOMY OF A SIMPLE SOLUTION Step 2: Identify your value stream user story ATDD definitions feature test plan exploratory test scripted test automated test test results risk assessment process metrics 1. Plan 2. Develop 3. Execute 4. Analyze
  • 58. ANATOMY OF A SIMPLE SOLUTION Step 3: Model your value stream as queues Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 59. ANATOMY OF A SIMPLE SOLUTION Step 4: Set initial WIP limits Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 60. ANATOMY OF A SIMPLE SOLUTION Step 4: Set initial WIP limits Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 61. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 62. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 63. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 64. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 65. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 66. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 67. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 68. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 69. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 70. ANATOMY OF A SIMPLE SOLUTION Execute, Learn, Adjust Planning Exploration and Development Execution Analysis Ready Doing Blocked Ready Doing Blocked Ready Doing Ready Doing Done!
  • 71. SHIFT TO THE CLOUD! http://www.trello.com/
  • 72. SHIFT TO THE CLOUD!
  • 73. SHIFT TO THE CLOUD! Maintain trace references to external systems
  • 74. SHIFT TO THE CLOUD! Unified “Blocked” list
  • 75. SHIFT TO THE CLOUD! Queues identify individuals who may pull
  • 76. SHIFT TO THE CLOUD! Limit WIP: Identify the worker(s). Ban multitasking.
  • 77. SHIFT TO THE CLOUD! “Plus for Trello” extension measures WIP
  • 78. SHIFT TO THE CLOUD! Labels categorize tasks for filtering and metrics
  • 79. SHIFT TO THE CLOUD! A month of “done” reveals recent trends
  • 80. SHIFT TO THE CLOUD! History board maintains longer trends
  • 84. SUMMARY / CHEAT SHEET Kanban is a simple flow control technique which leverages pull queues and work-in-progress limits to 1. Maximize throughput (get stuff done!) 2. Empower your management by clarifying decisions 3. Empower your team with freedom to improve
  • 85. SUMMARY / CHEAT SHEET Trello is a flexible and cloud-based platform which you can transform into a fast, simple, and clear management system (or management system overlay) leveraging kanban principles.
  • 87. DONE!
  • 88. CREDITSStratocumuli by de:Benutzer: LivingShadow Creative Commons https://commons.wikimedia.org/wiki/File: Sc_2.jpg Commodore PET 4032 by Steve Gray http://www.6502. org/users/sjgray/collections/commodore/c_4032.jpg. Licensed under CC BY-SA 3.0 via Wikimedia Commons Cure for the Hiccoughs by Rube Goldberg (1917) Public domain. Copyright lapsed. http://images.tcj.com/2014/02/19170416-invention- hicough.jpg
  • 89. CREDITS Welcome to Orangeview! by Yvonne Tran Creative Commons https://vimeo.com/119590100 Mechanische Stopwatch by Wouterhagens Creative Commons https://commons.wikimedia.org/wiki/File:Stopwatch_A.jpg Back to the Future DeLorean Time Machine by Terabass Creative Commons http://commons.wikimedia.org/wiki/File:TeamTimeCar.com- BTTF_DeLorean_Time_Machine-OtoGodfrey.com-JMortonPhoto.com-07.jpg
  • 90. CREDITS Public Domain Clip Art http://www.pdclipart.org/
  • 91. Special thanks to all the people who made and released these awesome resources for free: ▸ Simple line icons by Mirko Monti ▸ E-commerce icons by Virgil Pana ▸ Streamline iconset by Webalys ▸ Presentation template by SlidesCarnival ▸ Photographs by Death to the Stock Photo (license) CREDITS