1. Agile testing involves testers being involved early in projects to help define testable acceptance criteria for user stories. 2. Test automation is important, with testers working with developers to automate tests that provide value and identify risks. 3. Effective testing in agile projects requires testers to be involved at all stages, contributing to strategy and planning to ensure quality objectives are achieved. Testing artifacts are maintained alongside code.

1. The
Speed to Cool:
Agile Testing Craig Smith
& Building Adrian Smith
Quality In

2. Welcome…
“Eyyy!”
Image: © Fuzzy Door Productions / 20th Century Fox Television C A

3. Welcome…
Not
Related…
Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg C

4. Not
Australian
for Beer!
Image:http://techfreep.com/images/fosters.jpg C

5. The
speed
to
cool…
Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ C

6. Thumbs
up…
Cool!
Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 C

7. Choke...
Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg C

8. So, What is a
Tester?
Image: http://rnstechnologies.com/content_images/small_image_2.jpg/ A

9. Look
left…
Look
right…
A

10. Look
up…
Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif A

11. CSI:
Software
Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg C

12. Agile &
Testing
Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG C

13. To Do Analysis Develop Test Done
We
reflect
work
like
this...
C

14. To Do
Analysis
Develop
Test
Done
Which is
really
working
like this...
C

15. Remind you
of
something?
Image: Craig Smith C

16. Testers
in an Analyst /
agile
team Customer
Project
Elaboration /
Specification
Acceptance
Criteria
Manager
High
Performing
AGILE
Developer Automation
Tester
C

17. Testers in
an agile
team Analysts need more
testing involvement
Analyst
Testers need more
technical involvement Tester
Developer Developers need
more testing involvement
More Less
Requirements
Functional /
Exploratory
Technical Technical
Automated
Customer
Specialist
Unit Test
Manual
Design
Collab.
Code
Tests
Test
Test
C

18. Definition of
Quality…
(noun) the standard of something as measured
against other things of a similar kind; the degree
of excellence of something oxforddictionaries.com
Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg / A

19. Quality
means
different
things
Image: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg A

20. Implicit /
Explicit
Quality
Image: http://s3.amazonaws.com/integral-life-home/iceberg.jpg A

21. Testing
≠
Quality
A

22. Building
Quality
In
Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg C

23. Quality is
everyone’s
responsibility
Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg C

24. Everyone
likes to be
seen to
value
quality
Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg C

25. Quality
from kickoff
Image: © United Feature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view&current=NovemberPics115.jpg&newest=1 C

26. Success
sliders
Cost Scope Quality Time
Fixed
1 X
2 X
3 X
Flexible 4 X
C

27. Cost Scope Quality Time
Your Fixed
1 X
Turn! 2 X
3 X
Flexible 4 X
Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A

28. Quality
almost
always at
number 3
Cost Scope Quality Time
Fixed
1 X
2 X
3 X
Flexible 4 X
A

29. Correctness
A

30. Quality
Interoperability
Maintainability
Robustness
Trade-
Reusability
Availability
Testability
Portability
Efficiency
Reliability
Flexibility
Usability
Integrity
offs
Reliability
+ + + + - + +
Robustness
+ + + -
Availability
+ +
Integrity
- - - - -
Flexibility
+ - - + + +
Usability
+ - -
Interoperability
- + - +
Efficiency
- - - - - - - -
Testability
+ + + + - +
Maintainability
+ + + - +
Reusability
- - + + - + + +
Portability
+ - + - + - +
A

31. What does quality mean
Defining 1 Quality
Advocates
to the different roles in
the team?
Quality
2 Quality
Taxonomy
What are quality
attributes?
Quality How do we know what
3 Prioritisation
quality attributes to
include?
What are risks with the
4 Quality
Tradeoff Risks
quality attributes we are
trading off?
5 Quality
Measurement
How do we test and
measure quality?
6 Success
Sliders
How does quality relate
to the sliders?
7 Quality
Definition
What does quality
mean?
8 Next Steps How do we apply
quality to our work
C

32. Quality
Definition
C

33. Shared
understanding
of quality
Image: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg C

34. Strategy
& Plan
Image: http://www.thechildmindingshop.co.uk/ekmps/shops/thecs/images/table-chalkboard-and-white-board-in-one-%5B2%5D-5540-p.jpg A

35. Simple
test
strategy
& plans
A

36. Simple
test
strategy
A

37. Reporting
& Metrics
Image: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg C

38. Understand
continuous
integration
Image: http://confluence.atlassian.com/download/attachments/229837908/bamboo-dashboard.png?version=2&modificationDate=1297756308930 C

39. Understand
code
metrics
Image: http://docs.codehaus.org/download/attachments/111706381/dashboard.png?version=2&modificationDate=1267794480088 C

40. Report
how
testing
is going
Image: http://1.bp.blogspot.com/-46_MdfmjelA/TVa-kb3lTJI/AAAAAAAAABU/JU38qkUXf2c/s1600/half-full-glass.jpg C

41. Your
Turn! #1
Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A

42. BVC
PROJECT TESTING
9 25
7 5
8
New Risks & Issues Raised
Number of Risks & Issues
6 7 20
Number of Defects
4
Number of Tests
5 6
15
3 5
4
4
3 10
2 3
2 2 5
1
1 1
0 0 0 0
1 2 3 4 5 6 7 8
HEALTH 1 2 3 4 5 6 7 8 TEST
Iteration Iteration
COVERAGE
OVERALL
DEVELOPMENT USER
5700 1800 9 $30
5600 1600 8
5500 $25
1400 7
Number of Features
Lines of Test Code
5400
Business Value
Lines of Code
1200 6 $20
5300
1000 5
5200 $15
800 4
5100
600 3 $10
5000
4900 400 2
$5
4800 200 1
4700 0 0 $-
MAINTAINABILITY 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 PERFORMANCE
Iteration Iteration
A

43. Agile Testing
Practices
Image: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg C

44. Low Value vs
High Value
Image: © The Curiosity Company / 20th Century Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg C

45. Good:
Basic
Automation
Image: http://seleniumhq.org/projects/ide/ C

46. Better:
ATDD / BDD
Plain text test
Step definition
Production code
Image: http://cukes.info/ C

47. Best:
Specification
by example
Image: http://www.concordion.org/ C

48. Quality
Maturity
Image: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg A

49. Agile
Quality
Practices
A

50. Team
Self-
Assessment
A

51. Quality
Requirements
A

52. Quality
Development
A

53. Quality
Testing
A

54. Quality
Team
Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png A

55. Your
Turn!
Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg C A

56.  Test artifacts are treated with the same importance as code and are
4 properly maintained and refactored
 The relevant ____ility and security tests form part of the test strategy
 Non-functional requirements are agreed and included in the test
strategy
3  Test planning is based on risk (technical complexity and business
impact)
 Test strategy is agreed and understood by the team and includes
2 targets (coverage, defects, …)
 Test strategy is documented and visible as a BVC used by the team
 An agreed approach to testing that is aligned to a definition of quality
1  Tests are considered a valuable asset that can be reused as features
are progressively implemented
 No agreed approach to testing Test
-1  Tests are not considered a valuable asset Planning
C A

57. ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF
Empowering
RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O
F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH
Testing
Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg C

58. Collaboration: Estimating:
Recruitment & Development:
I work with analysts and SMEs to I am involved in developing
I am attracted to the organisation
ensure that testable acceptance estimates for projects at a story
because testing is a cool career path
criteria are created for all stories level, for tools and infrastructure
that offers heaps of opportunities and a
and also for deployment/release
way of continually developing my skills
activities
Automation:
I work with developers to
automate tests that provide Reporting:
business value and identify I provide metrics that give
system risks insight into project health and
system quality
Strategy & Planning:
I am involved in the project at all Agile:
stages to ensure that testing I understand Agile project delivery
provides the greatest value and and the differences between testing
quality objectives are achieved in the different phases of an phase
Qualifications & Training:
Tools & Techniques: I have recognised qualifications in
I use both manual and testing and continually update and
automated techniques using the maintain my skills
preferred testing tools based on
the situation
Architecture:
I have an understanding of the system
architecture and can create tests that
Community & Teams: verify individual components and the
I am part of a community of Development:
system as a whole
testers that are embedded I take an interest in
within teams but share development practices and
common values monitor code quality metrics
Future tester C A

59. Testing
Skills
Image: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg A

60. Architecture
Skills
Image: http://www.invermodels.co.uk/portfolios/sheriff.jpg C

61. Technical
Skills
Image: http://www.logicalnetworking.net/wp-content/uploads/2010/02/TuxInSchoolComputerLab.jpg A

62. Share
with
community
Image: http://www.linkline.org.uk/poster/images/Banner.png C

63. Tools &
Automation
Image: Martha (Picasa) http://lh3.ggpht.com/_9kYHVyqm3zs/S70g1BiNILI/AAAAAAAADho/A4vuRNMTs50/IMG_7956.JPG A

64. Get
Involved
Early
Image: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg C

65. Queue
To
Join
Image: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg C

66. Wrap
Up
Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg C

67. Do you have a
testing skillset
(or are you
just doing
testing)?
C
Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Phot

68. Does
everybody
understand
their role in
quality?
Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg A

69. Are you
building
quality in
from the
start?
Image: © HiT Entertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg A

70. Are you
measuring
testing and
assessing
quality?
Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423 C

71. Are you
hunting
down best
practices?
Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg A

72. Are you
testers
empowered?
Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg A

73. Don’t forget
to use
(or improve)
our quality
templates
C

74. Testing
is cool…
Image: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard# C

75. ...but I love it
when quality
comes
together
Image: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg C

76. Craig Smith
http://www.suncorp.com.au Questions
http://www.agileacademy.com.au
http://www.craigsmith.id.au ???
craig.smith@suncorp.com.au
@smithcdau
Dr. Adrian Smith
http://www.ennova.com.au
http://www.agileengineeringdesign.com
adrian.smith@ennova.com.au
@adrianlsmith

77. Suncorp is one of Australia and New Zealand's largest diversified financial services
providers, supplying banking, insurance and wealth management products to around
9 million customers through well-established and recognised brands such as AAMI,
Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, as
well as Suncorp and GIO. Today, Suncorp is Australia's fifth largest bank and second
largest domestic general insurance group, with over 16,000 staff. Suncorp has
representation in 450 offices, branches and agencies throughout Australia and New
Zealand. (http://www.suncorp.com.au)
Ennova is a software development company that specialises in helping businesses
optimise their use of technology. We are passionate about what we do and have
embedded Agile and Lean thinking into our approach to everything. This enables us
to rapidly deliver high quality software solutions that provide long term business
value. Our Agile and Lean consulting services draw on an diverse experience base
that spans the engineering, manufacturing, construction and financial services
industries. Additionally, Ennova is active in the development of software products
and therefore has first hand practical experience in the application of Agile and Lean
methods.
(http://www.ennova.com.au)
The Agile Academy is the next wave in Agile learning and collaboration. Designed for
IT professionals, the Agile Academy is a knowledge hub that promotes Agile related
learning, knowledge sharing and capability development across the IT industry. We
offer an integrated curriculum of leading edge courses across the entire solution
development life cycle, covering all roles at varying levels.
(http://www.agileacademy.com.au)