Testmanagement mit Visual Studio 2013 / CodedUI / Neues aus der Produktgruppe ...

© AIT GmbH & Co. KGIhre Software effizienter entwickelt
Testmanagement mit VS 2013
Nico Orschel, MVP ALM, AIT GmbH & Co. KG

 Aktuelle Herausforderungen
 Visual Studio Familie
 Testmanagement
 Manuelle Testausführung
Agenda

 Continous Delivery
 Parallele Releases
 Agile Prozesse
 Zusammenarbeit mit Kunden und Zulieferern
 Multi Plattform (Tablets, Smartphones, andere)
 Cloud
 Testumgebungen, Testautomatisierung
Herausforderungen

E X T E N S I B L E A P I s
Version
Control
Build
Automation
Customizable
Processes
Requirements
Management
Test Case
Management
Project
Management
End-to-End
Traceability
Lab ManagementAnalytics

Wie ordnet sich TCM in die TFS/VS Welt ein?
Microsoft Testmanager (MTM)
• Testmanagement
• Man. Testausführung (Formal+Agile)
• Testumgebungsmanagement
Visual Studio (Testautomatisierung)
• Code
• Autom. Testausführung
(DefaultLabTemplate.XAML)*
Lab Management (Testumgebungen)
• SCVMM
• Standard

© AIT GmbH & Co. KGIhre Software effizienter entwickelt 10
Die Qual der Wahl: MTM vs. Test Hub

TCM – Hierarchischer Aufbau
Team Projekt
Test Plan
Release 1
Test Plan Release 2 …
Test Suite 1
Test Suite
2
…
Test
Daten
Test
Steps
Shared
Steps
Test 1
Test
Daten
Test
Steps
Test 2
Konfiguratione
n

Testplanung
13

Testsuite Struktur
Testplan-Name
Automated Tests
UI
Backend
Services
Manual Tests
UI
Backend
Services

Planung Gesamt
MyEvent_1.0
UI
Test Case 1
Test Case 2
Test Case 3
Services
DB
Rest

Planung Sprint 1
MyEvent_1.0 UI Test Case 1

Planung Sprint 2
MyEvent_1.0 UI
Test Case 1
Test Case 3

Planung Sprint 3
MyEvent_1.0 UI
Test Case 2
Test Case 3

Planung Gesamt
MyEvent_1.0
UI
Test Case 1
Test Case 2
Test Case 3
Test Case 4
Services
DB
Rest

Planung Sprint 4
MyEvent_1.0 UI
Test Case 3
Test Case 4

TCM Sprintplanung
Sprint 1 Sprint 2 Sprint 3 Sprint 4
Repository v 1.0 CopyCopyCopy Copy

TCM Baselining bei mehren Releases
Repository v 1.0
Repository v 2.0
Clone

Demo WebAccess Testhub
Testmanagement

Demo WebAccess Testhub
Testdurchführung

Demo MTM
Testdurchführung

KONTAKT
Nico.Orschel@aitgmbh.de
+49 151 55052624
AIT GmbH & Co. KG
Leitzstr. 45, 70469 Stuttgart
www.aitgmbh.de
BERATUNG
Agile ALM und TFS
.NET und Architektur
ENTWICKLUNG
Dienstleister für individuelle
Lösungen mit .NET und Azure
© AIT GmbH & Co. KG – Alle genannten und gezeigten Marken oder Warenzeichen sind eingetragene Marken oder eingetragene Warenzeichen ihrer jeweiligen Eigentümer und
ggf. nicht gesondert gekennzeichnet. Aus dem Fehlen der Kennzeichnung kann nicht geschlossen werden, daß es sich bei einem Begriﬀ oder einem Bild nicht um eine
eingetragene Marke oder ein eingetragenes Warenzeichen handelt.
Wir unterstützen Sie

UI - Testautomatisierung
Der nächste Schritt
30

 CodedUI Einordnung und Basics
 Demos
 Der erste Test
 Win 8.1 Apps
 Optimierung
 Lokalisierung, Performance und Wartung
Agenda

Wie ordnet sich CodedUI
in die TFS/VS Welt ein?
Microsoft Testmanager (MTM)
• Testmanagement
• Man. Testausführung (Formal+Agile)
• Testumgebungsmanagement
Visual Studio (Testautomatisierung)
• Code
• Autom. Testausführung
(DefaultLabTemplate.XAML)*
Lab Management (Testumgebungen)
• SCVMM
• Standard

Technologie
Testautomatisierung
Wie ist CodedUI einzuordnen?
Welche Werkzeuge stehen mir zur
Verfügung?
Welche Technologien werden
unterstützt?
UI Testing
Framework
Wie werden die Technologien
eingebunden?

Unterstützte Plattformen
Technology Support Comment
IE 8-11 Yes Older IEs are not supported
anymore
WinForms 2.0, WPF 3 Yes 3rd party controls could be a
problem
Win 8.1 Store Apps Yes VS 2013
Chrome, Firefox Yes Latest version via Selenium
Adapter, (> VS 2012 Update 1,
VS 2013)
Silverlight No Unofficial support for
Silverlight v4/v5 (only VS 2012)
Flash, Java, Mobile No e.g. Ranorex, Squish
Windows Win32 / MFC Partially May work with known issues
SharePoint Yes > SP 2007, > VS 2012 Update
1, VS 2013
Vollständige Liste siehe
http://msdn.microsoft.com/en-
us/library/vstudio/dd380742.aspx

UITest Architektur
Web Plug-ins
(MSHTML/DOM)
Interpreter
Coded UI Test
Code
Generation
Test Runner
PlaybackRecorder
Rich Client Plug-ins
(UIA/MSAA)
Filter/
Aggregation
Rules
API
Property
Provider
3rd Party Plug-ins
Action
Invoker
My UI
Technology Abstraction Layer

Demo 1
Der erste CodedUI Test

Demo 2 – Win 8.1
Touch this …

1 2
3 4
Anwendungsoptimierung
UI Technology
Optimierung der
Anwendung für gute Test-
automatisierung
notwendig
MSAA
Winforms / MFC
AccessibleDescription
Accessible Name
UIA
WPF
AutomationProperties.Name
und AutomationId

Demo 3
Optimierung

Page object pattern
Within your web app's UI there are areas
that your tests interact with. A Page
Object simply models these as objects
within the test code. This reduces the
amount of duplicated code and means
that if the UI changes, the fix need only
be applied in one place.
 https://code.google.com/p/selenium/wiki/PageObjects

Dutch way of testing
Within your web app's UI there are areas
that your tests interact with. A Page
Object simply models these as objects
within the test code. This reduces the
amount of duplicated code and means
that if the UI changes, the fix need only
be applied in one place.
 https://code.google.com/p/selenium/wiki/PageObjects

Demo 4
Lokalisierung, Performance und Wartung

Weiterführende Informationen
Testing Workshops von AIT (Standard / Inhouse)
http://www.aitgmbh.de/aktuelles/aktuelle-meldungen/detail/article/workshops-testautomatisierung-mit-codedui-und-visual-studio-
lab-management.html
Internet
http://blog.aitgmbh.de/2011/01/07/codedui-diagnose-von-msaa-oder-uia-problemen-in-anwendungen-teil-1/
http://blog.aitgmbh.de/2011/01/20/codedui-wpf-anwendungen-fr-codedui-vorbereiten-teil-2/
http://blog.aitgmbh.de/2011/01/28/codedui-winforms-anwendungen-fr-uitest-vorbereiten-teil-3/
http://en.wikipedia.org/wiki/Microsoft_Active_Accessibility
http://en.wikipedia.org/wiki/Microsoft_UI_Automation
http://acccheck.codeplex.com/
http://blogs.msdn.com/b/mathew_aniyan/archive/2010/02/11/content-index-for-coded-ui-test.aspx
http://www.microsoft.com/en-us/download/details.aspx?id=8442
Twitter
http://www.twitter.com/nicoorschel

Neuigkeiten aus der Produktgruppe …
46

Releasezyklen
•
•
•

 On-Premise
 Code Lens
 Agile Testing
 Storyboarding
 Charting
 Cloud
 Load Testing
 Azure Dev/Test mit MSDN
 Roadmap
Agenda

Demo
Test (Load Testing in the cloud)

CodeLens

Incoming Changes Code Lens (VS 2013 Update 2)

Demo
Dev (CodeLens, Peek Definition und Scroll
Bar)

Storyboarding

Demo
Storyboarding, Exploratives Testen,
FeedbackClient

Visual Studio 2013 Preview in Azure Catalog

Demo
Test (AzureVM and WebApp)

Visual Studio 2013
Release Feature Ultimate with
MSDN
Premium with
MSDN
Test Professional
with MSDN
Professional with
MSDN
Professional
Update 1 Code Map ■
Update 2
Code Map Debugger
Integration
■
VS 2013 Memory Dump Analysis ■
VS 2013 CodeLens
■
Team
Foundation
Service
Load Testing using Team
Foundation Service ■
VS 2013
IntelliTrace Performance
Indicators
■
VS 2013 Peek Definition ■ ■ ■ ■
VS 2013
Profile Guided
Optimization for C++ apps
■ ■ ■ ■
Update 2 Unit Test Profiling ■ ■ ■ ■
VS 2013
Office 365 Cloud Business
Apps
■ ■ ■ ■

Visual Studio ALM Roadmap

 Enterprise ready VS Online
 Extensibility & Interop
 Agile planning
 Version control
 Build
 Team Explorer Everywhere
 Testing
 Release management
 Application Insights
Overview

Release management

DEV QAINT PRODTFS
Automates Deployments

DEV QAINT PRODTFS
Automate the pipeline workflow

DEV QAINT PRODTFS
Full Traceability

Stage Stack

Application Insights

A modern application – connected components
 Users
 Clients
 Browser
 Device
 Desktop
 Servers
 Databases
 Services

Experience starts and ends with the user
User experience is what
ultimately matters

Plenty of opportunities for things to go wrong
iPhone app crashed
Server request too slow
Database overloaded
Downstream service down
Feature too hard to use

1. Telemetry is collected at each
component: usage, performance,
exception, crash, event, synthetic
transactions, logs, developer-
supplied event data
2. Telemetry arrives to
Application Insights service
where it is processed
3. A 360 degree view of the
application – keep it available,
performing and improving.
Application
Insights
service
Application Insights

Telemetry sources
platform
infrastructure
app
1
3
4
5
6
Outside-in monitoring
Developer-emitted traces and events
Observed application behavior
Infrastructure performance
“Meta-telemetry”
URL pings and web tests from 16 global points
of presence.
Whatever the developer would like to send
to Application Insights.
No coding required – service dependencies,
queries, response time, exceptions, logs, etc.
System performance counters.
Source code, builds, deployments, configuration
changes.
2 Observed user behavior
How is the application being used?

Progressively “light up” the application
Start with any component of the
application and add more later.
Increase visibility at each
component.
Basic performance
Install agent on platform – no
change to application.
Non-invasive
Code change
Ping test/synthetic transactions
Configure URL ping or deploy
web tests – no application impact.
Application usage
Inject agent into application –
little or no developer effort.
Custom telemetry
Using SDK developer emits
custom events to the service.

Testmanagement mit Visual Studio 2013 / CodedUI / Neues aus der Produktgruppe ...

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (20)

Similar to Testmanagement mit Visual Studio 2013 / CodedUI / Neues aus der Produktgruppe ...

Similar to Testmanagement mit Visual Studio 2013 / CodedUI / Neues aus der Produktgruppe ... (20)

More from Nico Orschel

More from Nico Orschel (11)

Testmanagement mit Visual Studio 2013 / CodedUI / Neues aus der Produktgruppe ...