SlideShare a Scribd company logo
1 of 14
An Introduction to
Mobile-UI Automated
   Testing Tools
            Craig Wilson
   Software Quality Engineer, EMC2
             @DarkOxygen
UI Automation

• Automated testing from end-user’s
  perspective
• Validate appearance and functionality
• Rudimentary performance analysis
Automation Paradigms
Automation Paradigms
     Visual           Programmatic
 No interaction with Use application code to
  application code   interact with UI elements

       Verify
                      Verify presence and state
  appearance of UI
                            of UI elements
     elements
                     Beware of code changes
 Beware of intended
                    that don’t affect layout or
   visual changes
                           appearance.
Automation Paradigms
     Visual           Programmatic
 No interaction with Use application code to
  application code   interact with UI elements

       Verify
                      Verify presence and state
  appearance of UI
                            of UI elements
     elements
                     Beware of code changes
 Beware of intended
                    that don’t affect layout or
   visual changes
                           appearance.
Automation Paradigms
     Visual           Programmatic
 No interaction with Use application code to
  application code   interact with UI elements

       Verify
                      Verify presence and state
  appearance of UI
                            of UI elements
     elements
                     Beware of code changes
 Beware of intended
                    that don’t affect layout or
   visual changes
                           appearance.
Automation Paradigms
     Visual           Programmatic
 No interaction with Use application code to
  application code   interact with UI elements

       Verify
                      Verify presence and state
  appearance of UI
                            of UI elements
     elements
                     Beware of code changes
 Beware of intended
                    that don’t affect layout or
   visual changes
                           appearance.
The big question

How do I test on a physical
         device?
Not “can”, “how”
Not “can”, “how”

• Jailbreaking required
• Application code must be modified
• Functionality may be reduced
• As always, read the fine print
Device integration

• Multitouch gestures?
• Hardware controls?
 - Screen lock, volume, etc.
• Alert invocation?
 - New message, low battery, etc.
Other considerations
• Platform support
• Additional coding requirements
• Learning curve
• Compatibility with continuous integration
  processes
• Additional capabilities
Personal observations

• No clear “best-in-class” tool for all
  platforms
• Platform and device restrictions still
  prevalent
• iOS: Try Instruments first, then consider
  other tools
Questions?

More Related Content

What's hot

Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)
Sauce Labs
 
Appium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriverAppium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriver
Andrii Dzynia
 
Automation Proposal_V1.0
Automation Proposal_V1.0Automation Proposal_V1.0
Automation Proposal_V1.0
Dao Nhỏ
 

What's hot (20)

Automation With Appium
Automation With AppiumAutomation With Appium
Automation With Appium
 
Automated UI Testing Frameworks
Automated UI Testing FrameworksAutomated UI Testing Frameworks
Automated UI Testing Frameworks
 
Appium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | EdurekaAppium Interview Questions and Answers | Edureka
Appium Interview Questions and Answers | Edureka
 
Getting started with appium
Getting started with appiumGetting started with appium
Getting started with appium
 
Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)Using Selenium to Test Native Apps (Wait, you can do that?)
Using Selenium to Test Native Apps (Wait, you can do that?)
 
Appium ppt
Appium pptAppium ppt
Appium ppt
 
MonkeyTalk Automation Testing For Android Application
MonkeyTalk Automation Testing For Android ApplicationMonkeyTalk Automation Testing For Android Application
MonkeyTalk Automation Testing For Android Application
 
Appium workship, Mobile Web+Dev Conference
Appium workship,  Mobile Web+Dev ConferenceAppium workship,  Mobile Web+Dev Conference
Appium workship, Mobile Web+Dev Conference
 
Appium an introduction
Appium   an introductionAppium   an introduction
Appium an introduction
 
Appium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriverAppium Mobile Test Automation like WebDriver
Appium Mobile Test Automation like WebDriver
 
Appium overview session final
Appium overview session finalAppium overview session final
Appium overview session final
 
Appium basics
Appium basicsAppium basics
Appium basics
 
Android & iOS Automation Using Appium
Android & iOS Automation Using AppiumAndroid & iOS Automation Using Appium
Android & iOS Automation Using Appium
 
Android UI Testing with Appium
Android UI Testing with AppiumAndroid UI Testing with Appium
Android UI Testing with Appium
 
Appium testing api
Appium testing apiAppium testing api
Appium testing api
 
Appium overview
Appium overviewAppium overview
Appium overview
 
BCS Selenium Workshop
BCS Selenium WorkshopBCS Selenium Workshop
BCS Selenium Workshop
 
Automation Proposal_V1.0
Automation Proposal_V1.0Automation Proposal_V1.0
Automation Proposal_V1.0
 
Selenium training
Selenium trainingSelenium training
Selenium training
 
Mobile applications and automation testing
Mobile applications and automation testingMobile applications and automation testing
Mobile applications and automation testing
 

Viewers also liked

Vraa ieguld vidzeme
Vraa ieguld vidzemeVraa ieguld vidzeme
Vraa ieguld vidzeme
egilsdo
 
Pašv sad saldus_101111
Pašv sad saldus_101111Pašv sad saldus_101111
Pašv sad saldus_101111
egilsdo
 
Q3 2013 presentation final
Q3 2013 presentation finalQ3 2013 presentation final
Q3 2013 presentation final
primero_mining
 
A lap around mango
A lap around mangoA lap around mango
A lap around mango
Andy Chiang
 
Assignment 8 (2)
Assignment 8 (2)Assignment 8 (2)
Assignment 8 (2)
debbie14
 
Michael riley
Michael rileyMichael riley
Michael riley
uksov3
 
Assignment 6
Assignment 6Assignment 6
Assignment 6
debbie14
 
The antitrust treatment of loyalty discounts and rebates in the EU competitio...
The antitrust treatment of loyalty discounts and rebates in the EU competitio...The antitrust treatment of loyalty discounts and rebates in the EU competitio...
The antitrust treatment of loyalty discounts and rebates in the EU competitio...
Dr Danilo Samà
 
#4 horror group
#4 horror group#4 horror group
#4 horror group
debbie14
 
2011 TLMI Award Competition Winners
2011 TLMI Award Competition Winners2011 TLMI Award Competition Winners
2011 TLMI Award Competition Winners
TLMI
 
Smart goal presentation!
Smart goal presentation!Smart goal presentation!
Smart goal presentation!
Casey Ryan
 
New microsoft power point presentation
New microsoft power point presentationNew microsoft power point presentation
New microsoft power point presentation
Xinyan Yu
 

Viewers also liked (20)

Primero 2014-csr-web
Primero 2014-csr-webPrimero 2014-csr-web
Primero 2014-csr-web
 
Vraa ieguld vidzeme
Vraa ieguld vidzemeVraa ieguld vidzeme
Vraa ieguld vidzeme
 
Pašv sad saldus_101111
Pašv sad saldus_101111Pašv sad saldus_101111
Pašv sad saldus_101111
 
Project for developing the Date Sector in Jericho and the Jordan Valley
Project for developing the Date Sector in  Jericho and the Jordan ValleyProject for developing the Date Sector in  Jericho and the Jordan Valley
Project for developing the Date Sector in Jericho and the Jordan Valley
 
Q3 2013 presentation final
Q3 2013 presentation finalQ3 2013 presentation final
Q3 2013 presentation final
 
A lap around mango
A lap around mangoA lap around mango
A lap around mango
 
We didn't watch tv
We didn't watch tvWe didn't watch tv
We didn't watch tv
 
Status update 1
Status update 1Status update 1
Status update 1
 
Assignment 9
Assignment 9Assignment 9
Assignment 9
 
Assignment 8 (2)
Assignment 8 (2)Assignment 8 (2)
Assignment 8 (2)
 
Michael riley
Michael rileyMichael riley
Michael riley
 
Assignment 6
Assignment 6Assignment 6
Assignment 6
 
The antitrust treatment of loyalty discounts and rebates in the EU competitio...
The antitrust treatment of loyalty discounts and rebates in the EU competitio...The antitrust treatment of loyalty discounts and rebates in the EU competitio...
The antitrust treatment of loyalty discounts and rebates in the EU competitio...
 
Toxic waste (1)
Toxic waste (1)Toxic waste (1)
Toxic waste (1)
 
#4 horror group
#4 horror group#4 horror group
#4 horror group
 
Asteroiden
AsteroidenAsteroiden
Asteroiden
 
RBC Capital Markets 2015 Global Mining & Materials Conference
RBC Capital Markets 2015 Global Mining & Materials ConferenceRBC Capital Markets 2015 Global Mining & Materials Conference
RBC Capital Markets 2015 Global Mining & Materials Conference
 
2011 TLMI Award Competition Winners
2011 TLMI Award Competition Winners2011 TLMI Award Competition Winners
2011 TLMI Award Competition Winners
 
Smart goal presentation!
Smart goal presentation!Smart goal presentation!
Smart goal presentation!
 
New microsoft power point presentation
New microsoft power point presentationNew microsoft power point presentation
New microsoft power point presentation
 

Similar to Introduction to Mobile-UI Automated Testing Tools

Visual Testing: Quality and Speed -- by GIl Tayar, Applitools
Visual Testing: Quality and Speed -- by GIl Tayar, Applitools Visual Testing: Quality and Speed -- by GIl Tayar, Applitools
Visual Testing: Quality and Speed -- by GIl Tayar, Applitools
Applitools
 

Similar to Introduction to Mobile-UI Automated Testing Tools (20)

Visual Testing: Quality and Speed -- by GIl Tayar, Applitools
Visual Testing: Quality and Speed -- by GIl Tayar, Applitools Visual Testing: Quality and Speed -- by GIl Tayar, Applitools
Visual Testing: Quality and Speed -- by GIl Tayar, Applitools
 
A Test Automation Platform Designed for the Future
A Test Automation Platform Designed for the FutureA Test Automation Platform Designed for the Future
A Test Automation Platform Designed for the Future
 
Testing Android Application, Droidcon Torino
Testing Android Application, Droidcon TorinoTesting Android Application, Droidcon Torino
Testing Android Application, Droidcon Torino
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
 
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
Automated Generation, Evolution and Maintenance: a perspective for mobile GUI...
 
Wso2 italia Open Break session #7 - Test di API e microservizi nelle architet...
Wso2 italia Open Break session #7 - Test di API e microservizi nelle architet...Wso2 italia Open Break session #7 - Test di API e microservizi nelle architet...
Wso2 italia Open Break session #7 - Test di API e microservizi nelle architet...
 
UI Integrations Test
UI Integrations TestUI Integrations Test
UI Integrations Test
 
Tips for Testing Your Flutter App - Best Practices and Tools.pdf
Tips for Testing Your Flutter App - Best Practices and Tools.pdfTips for Testing Your Flutter App - Best Practices and Tools.pdf
Tips for Testing Your Flutter App - Best Practices and Tools.pdf
 
Automated Application Testing
Automated Application TestingAutomated Application Testing
Automated Application Testing
 
Automated Mobile UI Testing Fragility: An Exploratory Assessment Study on And...
Automated Mobile UI Testing Fragility: An Exploratory Assessment Study on And...Automated Mobile UI Testing Fragility: An Exploratory Assessment Study on And...
Automated Mobile UI Testing Fragility: An Exploratory Assessment Study on And...
 
testing services document.docx
testing services document.docxtesting services document.docx
testing services document.docx
 
GUI, Performance, Load and API testing with Test Studio
GUI, Performance, Load and API testing with Test StudioGUI, Performance, Load and API testing with Test Studio
GUI, Performance, Load and API testing with Test Studio
 
Lessons-Learned-SwiftUI.pptx
Lessons-Learned-SwiftUI.pptxLessons-Learned-SwiftUI.pptx
Lessons-Learned-SwiftUI.pptx
 
MVVM ( Model View ViewModel )
MVVM ( Model View ViewModel )MVVM ( Model View ViewModel )
MVVM ( Model View ViewModel )
 
Visual regression with applitools eyes
Visual regression with applitools eyesVisual regression with applitools eyes
Visual regression with applitools eyes
 
Surbhi Mahendru.docx
Surbhi Mahendru.docxSurbhi Mahendru.docx
Surbhi Mahendru.docx
 
Adaptation of Single-user Multi-touch Components to Support Synchronous Mobi...
Adaptation of Single-user Multi-touch Components to Support Synchronous Mobi...Adaptation of Single-user Multi-touch Components to Support Synchronous Mobi...
Adaptation of Single-user Multi-touch Components to Support Synchronous Mobi...
 
Automated Testing on iOS
Automated Testing on iOSAutomated Testing on iOS
Automated Testing on iOS
 
App Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareApp Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by Leaware
 
Top Automated UI Testing Tools 2023.pdf
Top Automated UI Testing Tools 2023.pdfTop Automated UI Testing Tools 2023.pdf
Top Automated UI Testing Tools 2023.pdf
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 

Introduction to Mobile-UI Automated Testing Tools

  • 1. An Introduction to Mobile-UI Automated Testing Tools Craig Wilson Software Quality Engineer, EMC2 @DarkOxygen
  • 2. UI Automation • Automated testing from end-user’s perspective • Validate appearance and functionality • Rudimentary performance analysis
  • 4. Automation Paradigms Visual Programmatic No interaction with Use application code to application code interact with UI elements Verify Verify presence and state appearance of UI of UI elements elements Beware of code changes Beware of intended that don’t affect layout or visual changes appearance.
  • 5. Automation Paradigms Visual Programmatic No interaction with Use application code to application code interact with UI elements Verify Verify presence and state appearance of UI of UI elements elements Beware of code changes Beware of intended that don’t affect layout or visual changes appearance.
  • 6. Automation Paradigms Visual Programmatic No interaction with Use application code to application code interact with UI elements Verify Verify presence and state appearance of UI of UI elements elements Beware of code changes Beware of intended that don’t affect layout or visual changes appearance.
  • 7. Automation Paradigms Visual Programmatic No interaction with Use application code to application code interact with UI elements Verify Verify presence and state appearance of UI of UI elements elements Beware of code changes Beware of intended that don’t affect layout or visual changes appearance.
  • 8. The big question How do I test on a physical device?
  • 10. Not “can”, “how” • Jailbreaking required • Application code must be modified • Functionality may be reduced • As always, read the fine print
  • 11. Device integration • Multitouch gestures? • Hardware controls? - Screen lock, volume, etc. • Alert invocation? - New message, low battery, etc.
  • 12. Other considerations • Platform support • Additional coding requirements • Learning curve • Compatibility with continuous integration processes • Additional capabilities
  • 13. Personal observations • No clear “best-in-class” tool for all platforms • Platform and device restrictions still prevalent • iOS: Try Instruments first, then consider other tools

Editor's Notes

  1. \n
  2. \n
  3. - Use folder name truncation bug (in EMC Mobile) as example of difference between the verification methods\n- Programmatic verification can also be selective: verify text, state, location, etc.\n- Last points refer to what will change more: the appearance of your UI, or how you code it?\n\n
  4. - Use folder name truncation bug (in EMC Mobile) as example of difference between the verification methods\n- Programmatic verification can also be selective: verify text, state, location, etc.\n- Last points refer to what will change more: the appearance of your UI, or how you code it?\n\n
  5. - Use folder name truncation bug (in EMC Mobile) as example of difference between the verification methods\n- Programmatic verification can also be selective: verify text, state, location, etc.\n- Last points refer to what will change more: the appearance of your UI, or how you code it?\n\n
  6. - Use folder name truncation bug (in EMC Mobile) as example of difference between the verification methods\n- Programmatic verification can also be selective: verify text, state, location, etc.\n- Last points refer to what will change more: the appearance of your UI, or how you code it?\n\n
  7. \n
  8. - TestPlant’s “eggPlant” is an example for the first point.\n- FrogLogic’s “Squish” is example of second point, leads to build complexity.\n- Also bring up cloud solutions like DeviceAnywhere where you remotely access devices from a shared pool.\n
  9. - Instruments can do a lot of these\n- Gestures are very important for mobile!\n
  10. - Easy example for second point: Instruments, with its requirement for accessibility labels.\n- Learning curve isn’t just the scripting language, but also how the application is written.\n- examples of additional capabilities: screenshots, multiple scripting language support, movie recording, etc.\n
  11. \n
  12. \n