1. ho here would travel in a plane
developed and tested by their
own team?”
“W

2. Mobile Web Testing - Explored
by
Raj Subramanian
@epsilon11

3. Agenda
• Introduction
• Testing Approaches
• Testing Responsive Websites
• Lessons Learned
• Future of Mobile Web

4. Introduction

5. My Bio
•
•
•
Tester at Progressive Insurance (STE)
7 years experience in testing
Actively involved in testing community
•
•
•
•
•
NOSQAA
NOTICE meetup
Newsletter
Testing articles
Blogging

6. Mobile Ecosystem

7. Mobile Ecosystem

8. Mobile Ecosystem

9. The Context
• Complete redesign of mobile website
• 3 releases
• Made the website responsive
• Testing team size - 2 testers

10. Device Selection
• Apple
• Android
• Windows
• Blackberry
• Firefox
• Ubuntu

11. Device Selection - Strategy
•
•
•
Step 1 - Usage Statistics
•
•
•
OS versions
Rendering engines
Browsers
Step 2 - Discuss findings and get feedback
Step 3 - Select devices to test

13. Testing Approaches

23. Prioritizing story cards
• Business priority
• Impact to the user
• Amount of testing effort needed

25. Paired Scripted Testing
• Two sets of eyes. Domain/technical
knowledge combination
• Both execute same high level test case and
discuss results

26. Defects

27. Defects

29. Paired Exploratory Testing
• 45 - 90 min session
• Charter/Goal
• Noted ideas and scenarios
• Paraphrased/Debriefed
• Discussed observations
• Posted defects

30. Defects

31. Defects

32. Defects

33. Defects

34. Defects

35. Defects

36. Defects

38. Mobile Testing - Device
• Wi-Fi / 4G
• Interrupt testing
• Sending text messages
• Calling phone
• Disabling javascript

39. Mobile Testing - Web
• Back buttoning
• Hard buttons
• Soft buttons

40. Mobile Testing - Web
•
Back buttoning
•
•
Hard buttons
Soft buttons

41. Mobile Testing - Web
•
Back buttoning
•
•
Hard buttons
Soft buttons

42. Mobile Testing - Web
• URL editing
• New pages
• Old pages
• System error pages

43. Mobile Testing - Web
• URL editing
• New pages
• Old pages
• System error pages

44. Mobile Testing - Web
• Private browsing (Incognito)

45. Mobile Testing - Web
• Checking function calls

46. RST Techniques
• Galumphing
• Doing number of clicks around a button,
page text etc.

47. RST Techniques
• Galumphing
• Doing number of clicks around a button,
page text etc.

48. RST Techniques
• Blink test
• Used to compare two very similar pages
and look for differences
• Testing to see visual patterns

50. Tools
• Browser tools
• Used Chrome/IE (F12) browser tools
• Inspect Javascript, HTML, CSS errors

51. Tools
• Browser tools
• Used Chrome/IE (F12) browser tools
• Inspect Javascript, HTML, CSS errors

52. Tools
• MITE
• Tool from Keynote
• Emulator - over 2200 mobile devices
• Useful for smoke testing

53. Tools
• MITE
• Tool from Keynote
• Emulator - over 2200 mobile devices
• Useful for smoke testing

54. Tools
• Fiddler
• Captures HTTP traffic
• “Login button” scenario

55. Tools
• Fiddler
• Captures HTTP traffic
• “Login button” scenario

56. Tools
• Fiddler
• Captures HTTP traffic
• “Login button” scenario

57. Testing Responsive
Websites

58. What is “Responsive”?

59. What is “Responsive”

60. Free Tools
•
•
•
•
•
screenfly - http://quirktools.com/screenfly/
•
Chrome plugin - Window Resizer
responsivepx - http://responsivepx.com/
resizeMyBrowser - http://resizemybrowser.com/
Responsinator - http://www.responsinator.com/
Matt Kersley’s tool - http://mattkersley.com/
responsive/

61. My Tools
• Break point test utility
• Media query test utility

62. Lessons Learned

63. From Testing
•
•
•
•
Proof of concepts
Pairing
Prior investigation
Continuous research

64. From Tools
•
•
•
•
•
•
•
Sikuli
Adobe Edge Inspect
Test Studio
SeeTest
Meux
DeviceAnywhere
perfecto mobile
For more info - www.rajsubra.com

65. Future of Mobile Web

66. Future of Mobile Web
• Testing tools still evolving
• New OS coming up - Firefox, Ubuntu
• Majority of the websites would be
“Responsive”
• Integration of mobile web with watch, cars
and other devices

67. Summary
• Introduction
• Testing Approaches
• Testing Responsive Websites
• Lessons Learned
• Future of Mobile Web

68. Contact Details
e-mail: raj@rajsubra.com
website: www.rajsubra.com
twitter: @epsilon11