Selenium is the most popular open-source tool for acceptance testing dynamic web applications. In Selenium 2.0, the Selenium project merged with the WebDriver project. This session will explain the benefits of Selenium 2.0's technology and go into detail on what is and is not changing. If you like browser test automation, you'll enjoy what's cooking in Selenium 2.0. Selenium was originally created by Jason Huggins and his team at ThoughtWorks in 2004 as a tool for cross-browser acceptance testing of dynamic web apps -- apps that use JavaScript heavily on the client. Over the years, the Selenium tool family has expanded to include a Firefox record and playback tool (Selenium IDE), a Remote Control server that allows API access from any major programming language, and a grid server that allows tests to run in parallel across many machines. Despite it's widespread industry adoption, the Selenium project is far from done. Selenium's goal is to drive any browser the same way an end user would (e.g. opening pages, clicking buttons, entering text, etc.) with any programming language on any OS platform. It's an ambitious goal, and with a steady stream of new browsers (Chrome), new platforms (Android, iPhone), and new HTML5 technologies (video, canvas, offline storage) to support, just keeping up is an arduous task. This session will also cover trends in testing and test automation, and how Selenium fits into the bigger project management picture. Specific guidance will be given on how to determine what should be tested with Selenium and how to deal with the problem of brittle, expensive-to-maintain Selenium tests. Oh, and robots. The talk will have robots.

1. Selenium 2
Jason Huggins
Co-creator, The Selenium Project
Co-founder, CTO, Sauce Labs Inc
twitter: @hugs
email: hugs@saucelabs.com

2. Heckle me on Twitter:
@hugs

3. Agenda
• Numbers
• Selenium 1
• Selenium 2
• How to avoid Selenium poisoning
• The Future of Testing - Part 1
• The Future of Testing - Part 2

4. How do you measure
market share?

5. 3300

7. 2969

9. #1!

10. 51%

11. Percent of Fortune 150 with
Selenium experience
Source:

12. Past the Tipping Point
Bran
d X
Sele
nium

13. What is Selenium?
= +

14. The Problem

15. Selenium IDE for Firefox

16. !"#$%"&'$(%)$*
16
+%%,-..///01*234)03$#.,+$%$5.23"6$(".789:;8<=:

17. Selenium Remote Control
Selenium RC Server
Python, Ruby,
Your Awesome
Java, C#, or Perl HTTP HTTP HTTP
Web App
Test Script

18. Example Selenium RC Test - Java

19. Example Selenium RC Test - C#

20. !"#$
Selenium Grid
%&&'())***+,-#./"+.01)'%0&02)$345)678

21. Servers
Time
Unit of Work

22. Servers
Time
Unit of Work

23. Sauce Labs

24. Selenium 2:
Why and What

25. Builder (new!)

26. The Pareto Principle

27. AKA (“The Pacman Problem”)
Selenium 1
Selenium 2

28. Solving the last 20%
• Native keyboard & mouse events
• Same Origin Policy / XSS / HTTP(S)
• Pop-ups, dialogs
– Basic Authentication
– Self-signed certi cates
– File upload/download

29. Mobile

30. Types of Mobile Testing
• Emulator
• Real device (tethered to workstation)
• Real device in a real location on a real
network

31. Native vs Web

32. Life before the Web
Total Application Market

33. Yesterday
JS+HTML
Total Application Market

34. Today
JS+HTML5
Total Application Market

35. Today
Selenium
lives here!
JS+HTML5
Total Application Market

37. Today
Selenium
lives here!
JS+HTML5
Total Application Market

38. Tomorrow
Selenium
lives here!
JS+HTML5
Total Application Market

39. But, wait!

40. Tomorrow
Selenium
lives here!
JS+HTML5
Selenium lives
here, too!
Total Application Market

41. code.google.com/p/nativedriver

43. “NativeDriver is an implementation of the
WebDriver API which drives of the UI of a
native application rather than a web
application.”

44. Native app testing!
• Android - Usable!
• iOS - Usable!
• Windows - Experimental!

45. Cleaner API
• WebDriver Object
• WebElement Objects

47. Other Bene ts
• Improved architecture
• Removing road-blocks, hacks, and workarounds
• Scales down (more developer friendly) experience

48. Selenium Remote Control
Selenium RC Server
Python, Ruby,
Your Awesome
Java, C#, or Perl HTTP HTTP HTTP
Web App
Test Script

49. Selenium 2
Selenium RC Server
Python, Ruby,
Your Awesome
Java, C#, or Perl HTTP HTTP HTTP
Web App
Test Script

50. Python, Ruby,
Your Awesome
Java, C#, or Perl HTTP HTTP
Web App
Test Script

51. Python, Ruby,
Your Awesome
Java, C#, or Perl C/C++ HTTP
Web App
Test Script

52. Running a server is now optional!
Selenium Grid
Python, Ruby,
Your Awesome
Java, C#, or Perl HTTP HTTP HTTP
Web App
Test Script

53. Demo!

54. How to Avoid
Selenium Poisoning

55. Intent Action

56. Action
• open 'www.example.com'
• clickAndWait 'link=Log in'
• type 'User Id', 'hugs@saucelabs.com'
• type 'password', '12345678'
• clickAndWait 'Log In'

57. Intent
• Log in
• Change password
• Modify profile
• Log out

58. 1. Write intent.
2. Map to actions.

59. Seek higher level
abstractions

60. Jenkins
Ant/NAnt
xUnit
Selenium

61. Jenkins
Ant/NAnt
xUnit
Business Specific Library
Selenium

62. Page Object Model

63. Search: “Selenium Page Objects”

65. Start small

66. It’ll get big anyway

67. Problems with
Testing
(UI)

68. Brittle!

69. Expensive!

70. How to Think about
Testing

72. Risk
Time

74. How to Think about
Testing (Part 2)

76. “The prime goal of the new
economy is to undo --
company by company,
industry by industry
-- the industrial economy.”

79. “ADD”

80. “ADD”
Analytics Driven Development

81. Science Fiction?

82. analytics.blogspot.com/2011/10/introducing-flow-visualization.html

83. Visitor Flow

84. Use production
analytics to measure
(or create!) your test
suite

85. One more thing...

86. Robots!

87. bitbeam.org

88. BitbeamBot
The Selenium-Powered Angry-Birds
Playing Functional Testing Robot

89. What?
• A computer-controlled (CNC) robot for
testing applications on mobile devices
• Open Source components:
- Electronics: Arduino
- Mechanics: Bitbeam
- Lego Technic compatible building toy
- Made from Basswood
- Designed with 3D tool OpenSCAD
- Lasercut at TechShop San Francisco
- Software: Python, Selenium

90. Why?
• Selenium is a software-based robot.
• Selenium’s mission is to mimic and
automate how users interact with an
application.
• For mobile, this means handling real
devices.
• BitbeamBot is an experiment to take
Selenium out of the screen and into the
real world.

91. No really, why?

92. The “Clicker”

93. Motorized Pin Art

94. pinthing.com

95. Links
For More Information:
✓http://saucelabs.com
✓http://seleniumhq.org
✓http://code.google.com/p/selenium
✓http://code.google.com/p/se-builder/
✓https://addons.mozilla.org/en-US/ refox/addon/se-builder
✓http://code.google.com/p/nativedriver
✓http://twitter.com/hugs
✓http://bitbeam.org
✓http://pinthing.com
✓http://analytics.blogspot.com/2011/10/introducing- ow-visualization.html
Demo:
✓Android: http://www.youtube.com/watch?v=IUUcEIfkOEY
✓Bitbeambot #1: http://www.youtube.com/watch?v=NoOdrf0kt9I
✓Bitbeambot #2: http://www.youtube.com/watch?v=x2e73HraePY
Android Demo Code:
✓http://gist.github.com/830011

96. Thanks!
Jason Huggins
Co-creator, The Selenium Project
Co-founder, CTO, Sauce Labs Inc
twitter: @hugs
email: hugs@saucelabs.com