Managing Testing Efforts with Automated Test Cases and Lab Environments

Mitch Denny

Chief Technology Officer

mitch.denny@readify.net

http://notgartner.com

@MitchDenny

• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments

• Terminology
• Demos
– Creating Test Plans
– Understanding Test Settings
– Creating Test Cases
– Using Shared Steps
– Launching Test Cases
– Creating Bugs
– Reviewing Results
• Best Practices

• Test Plan; a container for test cases with a
set time span.
• Test Case; a sequence of steps which must
be tested.
• Test Run; a group of tests that are being
run locally or in the lab.
• Test Result; a result from a test case in a
test run.

• Test Plans – By Feature Area/By Iteration?
• Shared Steps – When to Use?
• Configurations – Common Attributes?
• Data Recorders – Considerations?

• Coded UI Test; some code that uses the
UI test automation framework that is
hosted inside MSTest.
• Coded UI Test Builder; a utility that allows
you to graphically construct UI tests.
• Action Log Recording; an XML file
previously recorded via the Test Runner
with the Action Log Recording data
collector.

• Terminology
• Demos
– Create from Action Log Recording
– Create with Coded UI Test Builder
– Create from Scratch
– Using Test Case Data Sources
• Best Practices

• Action Log Recordings - Good or Bad?
• Hand Code? The curse of the UIMap!
• Automation - When to automate?

Legend
New

Iteration 1 Iteration 2 Iteration 3 Iteration 4

Story Story
#1 #2

Legend
New Changed


Story Story Story Story Story
#1 #2 #1 #2 #3

Story Story
#4 #5

Legend
New Changed Stable


Story Story Story Story Story Story Story Story
#1 #2 #1 #2 #3 #1 #2 #3

Story Story Story Story Story
#4 #5 #4 #5 #6

Story
#7

Legend
New Changed Stable


Story Story Story Story Story Story Story Story Story Story Story
#1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3

#4 #5 #4 #5 #6 #4 #5 #6

Story Story Story Story
#7 #7 #8 #9

Legend
New Changed Stable


#1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3

#4 #5 #4 #5 #6 #4 #5 #6

#7 #7 #8 #9

Action Log Assisted Testing

Legend
New Changed Stable


#1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3

#4 #5 #4 #5 #6 #4 #5 #6

#7 #7 #8 #9


Coded UI Testing

Legend
New Changed Stable


#1 #2 #1 #2 #3 #1 #2 #3 #1 #2 #3

#4 #5 #4 #5 #6 #4 #5 #6

#7 #7 #8 #9


Coded UI Testing

Unit Testing

• Terminology
• Demos
– Running Automated Tests from MTLM
– Creating Environments
– Automating Deployments
– Nightly Regression Tests
• Best Practices

• Team Build; a component of TFS that
provides distributed build capability.
• Build Workflow; a XAML file containing
the instructions to produce a build via
Team Build.
• Lab Build; a special case build workflow
designed to automate lab management.

• Lab; the infrastructure you use to test out
the products you are developing.
• Environment; a specific subset of the lab
dedicated to a particular team project.
• Hyper-V; the virtualisation technology
created by Microsoft.
• SCVMM; a product from the System
Centre suite designed to manage multiple
Hyper-V hosts.

• Library; a storage location for saved VMs,
ISO images etc.
• Snapshot/Checkpoint; a point in time
version of a lab machine (memory + disk).

• Snapshotting – Pre/Post?
• Reporting - Track Quality, Track Activity
• Network Isolation – What is it? Why?
• Environment Configuration – How?

Remote
Active
Internet Access
Directory
Gateway

VPN (Encrypted)
RDP (Encrypted) Multi-
HTTP (Encrypted) Tenant TFS

Firewall Hyper-V
Farm
(VMM)
Customer Customer
Build Build
Server(s) Server(s)

Dedicated Dedicated
Dedicated Dedicated Other
Lab Lab Other
optional external Lab Lab Services
Machines Machines Services
exposure Machines Machines

• http://blogs.msdn.com/lab_management/
• http://vslabmgmt.codeplex.com
• http://channel9.msdn.com/tags/ALM/

• Visual Studio 2010 Workshop (1 day)
• Implementation Consulting
• Virtual Build Master (Managed Service)

Managing Testing Efforts with Automated Test Cases and Lab Environments

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (18)

Managing Testing Efforts with Automated Test Cases and Lab Environments