Selenium Deep Dive

@BagmarAnand
Selenium Deep Dive
@BagmarAnand
Anand Bagmar
Software Quality Evangelist

@BagmarAnand
@BagmarAnand
About Me
https://www.linkedin.com/in/anandbagmar/

@BagmarAnand
Agenda
@BagmarAnand

@BagmarAnand
• Be on time
• Make this an interactive workshop
• Ask questions
• We will try to address unrelated / long discussions towards the end
Rules for the day
@BagmarAnand

@BagmarAnand
Module 1
Implement your first test!
@BagmarAnand

@BagmarAnand
Site: https://dev.confengine.com/
Scenario: As a non-logged-in user, I should be asked to login when adding
a session to my schedule
• From UPCOMING section, Select “Selenium Conf 2020”
• “View Schedule”
• Add the 1st session to My Schedule (that is NOT already added)
• Do not login to sync the schedule to other devices
• Verify count has increased in “My Schedule”
Exercise #1
@BagmarAnand

@BagmarAnand
• Understand how to get started
• Objective of Automation
Objective / Learning from Exercise #1
@BagmarAnand

@BagmarAnand
Module 2
WebDriver
Typical challenges
How does WebDriver work?
@BagmarAnand

@BagmarAnand
Test Automation In the world
of AI & ML
@BagmarAnand

@BagmarAnand
How do you setup your test
execution machine?
@BagmarAnand
Manual setup? Scripted setup

@BagmarAnand
Do your tests run in CI ?
@BagmarAnand
No Yes

@BagmarAnand
If tests run in CI, do they run
automatically?
@BagmarAnand
Manual trigger Auto triggers

@BagmarAnand
How long does it take to run
your functional tests?
@BagmarAnand
> 30 min < 30 min

@BagmarAnand
For multiple platforms, do
you implement separate
tests?
@BagmarAnand
Duplicated tests Single test

@BagmarAnand
What is the test passing
percentage?
@BagmarAnand
Various reasons
of failure
Failures related
to product issues

@BagmarAnand
Do you automatically “rerun”
the failing tests?
@BagmarAnand
Yes No

@BagmarAnand
How do you debug and get to
the root cause of failures?
@BagmarAnand
Rerun test
All info available
to debug

@BagmarAnand
• Browser types & versions
• No easy way to identify locators
• Changes in locators / data
• Flaky tests / intermittent test failures
• Test Data availability
• Test Configuration in code?
Typical challenges
@BagmarAnand

@BagmarAnand@BagmarAnand
The Way Forward!

@BagmarAnand
What is Selenium?
@BagmarAnand
Selenium
WebDriver IDE Grid
https://www.selenium.dev/documentation/en/getting_started/quick/

@BagmarAnand
How does WebDriver work?
@BagmarAnand
Selenium Browser
Drivers
Browsers
Wire Protocol
over HTTP
HTTP
over
HTTP
Server
Test Scripts use
Selenium Client
Libraries

@BagmarAnand
• Hardcoded / specific browser driver versions
• Locators specified as part of tests / duplicated
• Duplicate code for setup / teardown
Challenges from Exercise #1
@BagmarAnand

@BagmarAnand
Module 3
Overcoming common challenges
Drivers for different browsers
Test Runner & annotations
Waits & Locators
@BagmarAnand

@BagmarAnand
Scenario: Execute test from Exercise 1 in multiple browsers
• Run test on multiple browsers
• No driver instantiation / tear-down in the test implementation
Exercise #2
@BagmarAnand

@BagmarAnand
• WebDriverManager to manage browser drivers & versions
• Locators – types, how to identify and specify
• Use of TestRunner Annotations for setup & teardown
• Build tool for configuration / setup
• Maven
• Gradle
@BagmarAnand

@BagmarAnand
• Test intent not clear
• Duplication of implementation details
• Very granular / imperative implementation
Challenges from Exercise #2
@BagmarAnand

@BagmarAnand
Module 4
Design Patterns
Builder, Factory Method, Singleton
Page-Object, Business-Layer-Page-Object
@BagmarAnand

@BagmarAnand
• Page-Object
• Business Layer
• Composition
• Factory Method
• Singleton -> DO NOT USE UNLESS YOU ARE VERY SURE
Commonly used Design Patterns
@BagmarAnand

@BagmarAnand
• The page object will contain the representation of the page, and the services the
page provides via methods
• Single source for the services or operations offered by the page
• Clean separation between test code and page specific code
• Page objects themselves should never make verifications or assertions
• “Page Component Objects” that represent discrete chunks of the page and can be
included in page objects -> Composite Pattern
• https://www.selenium.dev/documentation/en/guidelines_and_recommendations/page_objec
t_models/
Page-Object Model
@BagmarAnand

@BagmarAnand
Scenario: As a non-logged-in user, I shouldn’t be able to add a session to
my schedule for a conference that has completed
• From PAST section, Select “Appium Conf 2019”
• “View Schedule”
• Add the 1st session to My Schedule (that is NOT already added)
• Verify adding session to Schedule does not increase the count in “My
Schedule” for a conference in the PAST
Exercise #3 – Use Page-Object Model
@BagmarAnand

@BagmarAnand
• Test intent gets polluted
• Duplication of Test intent & implementation
• Intent becomes Imperative
• Maintenance challenges
• Scaling challenges
Limitations of Page-Object Pattern
@BagmarAnand

@BagmarAnand
• Test speaks the “business” language
• Test orchestrates business operations
• Business operations orchestrate other business operations & page objects
• Assertions in business operations
• Declarative style of writing the test
• Clear intent
• Executable business requirements / documentation
• Great resource for onboarding new team members
Business-Layer Page-Object Pattern
@BagmarAnand

@BagmarAnand
• Introduction to Patterns
• Implementing Page-Object Pattern & Business-Layer Pattern
• Implement for parallel execution & scaling
• Examples of usage for other patterns in Functional Automation
• Clear Test Intent (Test does not care about the driver, nor
implementation details)
@BagmarAnand

@BagmarAnand
• Get information from the page
• Do actions on the page
• Page Objects cannot differentiate between right or wrong!
• No assertions in the Page Object
Page-Object Model
@BagmarAnand

@BagmarAnand
Module 5
Test Data Management
In Test
External to Test
@BagmarAnand

@BagmarAnand
Scenario: Run test with multiple datasets
• For the implemented tests, run the tests with multiple test datasets
• Select conference
• Run against multiple environment
Exercise #4
@BagmarAnand

@BagmarAnand
• Importance of test data management strategy
• Different ways to specify test data
@BagmarAnand

@BagmarAnand
Why do we need to think
differently about Test Data?
@BagmarAnand

@BagmarAnand
• Data is complex
• Needs to mimic ‘real’ data
• Needs to be unique
• Data can be nested
• Though specified as static, may need to be Dynamic
• Data can be shared and reused
Characteristics of Test Data
@BagmarAnand

@BagmarAnand
• In Test implementation
• In Test specification / intent
• In code … separate data structures / classes / etc.
• External files
Different ways to specify Test Data
@BagmarAnand

@BagmarAnand
• CSV
• Property
• XML
• YAML
• JSON
• Database
• Excel
Examples of Test Data in External Sources
@BagmarAnand

@BagmarAnand
• Usable
• Easy to specify
• Easy to read and consume (by test implementation)
• Ability to override specified data, easily
Criteria for selecting Test Data file format
@BagmarAnand

@BagmarAnand
• Consistent way to specify test data
• Read the data as Business Entities
• Override as appropriate
• Create DSL to giving meaning to data
• Implement Test Data Entity Utilities – ex: Build / Equals /
Copy / Find / etc.
Tips for implementing Test Data Strategy
@BagmarAnand

@BagmarAnand
Which is the best Test Data
pattern to use?
@BagmarAnand

@BagmarAnand
It depends on the “CONTEXT”
@BagmarAnand
https://theieltsgenius.com/wp-content/uploads/2018/10/depends.jpg

@BagmarAnand
Module 6
Assertions
Hard & Soft Asserts
Where should you add assertions?
@BagmarAnand

@BagmarAnand
• Not intuitive to read
• First assertion stops the test execution
Challenge of Assertions
@BagmarAnand

@BagmarAnand
• TestNG Assertions
• Junit Assertions
• AssertJ
• Hamcrest
• Truth
Assertion libraries
@BagmarAnand

@BagmarAnand
Scenario: Implement declarative matchers using AssertJ / Hamcrest
Exercise #5
@BagmarAnand

@BagmarAnand
• Advantages & disadvantages of Assertions
• Hard asserts Vs Soft asserts
• Use of Assertions
• Where to include them?
• How to use them?
• Clarity in intent of validation
• Assertions Vs throwing exceptions
@BagmarAnand

@BagmarAnand
Module 7
Responsive Web Design (RWD)
@BagmarAnand

@BagmarAnand
What is Responsive Web Design?
@BagmarAnand
https://www.w3schools.com/css/css_rwd_intro.asp

@BagmarAnand
• Using CSS & HTML to resize, hide, shrink, enlarge, or move
the content to make it look good on any screen
• In some cases, Javascript execution in the browser on page-
load also changes / optimises functionality
How does Responsive Web Design work?
@BagmarAnand

@BagmarAnand
• Strategy for RWD Automation
• Need for Cross-Browser Testing
• How is RWD implemented in the product-under-test / AUT?
• Select browsers to run your functional tests
• Manage different browser versions
• Viewport sizes for automation implementation / execution
Next Steps for RWD Automation
@BagmarAnand

@BagmarAnand
Module 8
Test Reporting
Default reports
Custom reporters
@BagmarAnand

@BagmarAnand
• Intent of executed test is seen clearly
• Includes logs / screenshots / video of test execution
• Showcases the functional coverage from the execution
• Identifies trends of execution results
• Includes functional performance benchmarking
Characteristics of a good report!
@BagmarAnand

@BagmarAnand
• TestNG reports
• Junit reports
• reportportal.io - https://reportportal.io/
• Cucumber-html-reporting -
https://www.npmjs.com/package/cucumber-html-reporter
• Allure - http://allure.qatools.ru/
• Extent - https://extentreports.com/
Test Reporting options
@BagmarAnand

@BagmarAnand
Module 9
Other Topics / Open Questions
CI
Parallel Execution
Flaky tests
Q&A
@BagmarAnand

@BagmarAnand
Unit (xUnit / JavaScript)
Manual / Exploratory
Web Service
UI / e2e
Business-facing
Tests
Technology-facing
Tests
@BagmarAnand
Test Pyramid
Slow
More integration
Expensive
Fast
More isolation
Cheap

@BagmarAnand
Web
Service
UI / e2e
Business-facing
Tests
Technology-facing
Tests
@BagmarAnand
Slow
More integration
Expensive
Fast
More isolation
Cheap
Workflow
API
Contract
Consumer
Provider
Test Pyramid

@BagmarAnand@BagmarAnand
Web Service
UI / e2e
Performance
Security
Accessibility
Analytics
Test Pyramid includes NFRs

@BagmarAnand
Product Quality
@BagmarAnand

@BagmarAnand
Architecture of e2e
Automation Framework
@BagmarAnand

@BagmarAnand
gradle / groovy
Manage Devices
Wifi Management
Optimize Device
Utilization
Appium Server
Management
Test Specifications
Business Rules (cucumber-jvm)
Business Flows
Implement Domain
functionality
(actions, verifications, rules)
Resources
Entities / Models
Pages /
Screens
Trigger e2e Tests in
Jenkins Server
- Jenkins File
- Node Management
Archive artefacts
- logs, screenshots, videos, logcat, Appium logs, etc
- Cucumber reports
‘x’ Jenkins Agents on ‘y’ Mac Minis
Helpers / Utilities
(Android / iOS) Driver utilities
Loggers
File
utilities
Custom
Reporter
Screenshot
utilities
ADB utilities Video capture
Analytics
GPU Profiling
Command
Executor
Log files from Devices
Enrich Test
Execution Report
Manage Failing Tests
Upload to TTA
@BagmarAnand

@BagmarAnand
Resources
@BagmarAnand
• https://www.selenium.dev/
• https://www.selenium.dev/documentation/en/guidelines_and_recommendations/
• https://www.selenium.dev/documentation/en/worst_practices/
• https://testng.org/doc/documentation-main.html
• https://github.com/cbeust/testng
• https://junit.org/junit4/
• https://junit.org/junit5/
• https://www.infoq.com/articles/test-automation-ai-ml/
• Sample Code
• https://github.com/anandbagmar/selenium-deep-dive
• https://github.com/anandbagmar/reactjs-reqres.in
• https://github.com/anandbagmar/WAAT
• https://github.com/anandbagmar/cuke-jvm-sample

@BagmarAnand
@BagmarAnand
Thank you
https://www.linkedin.com/in/anandbagmar/

Selenium Deep Dive

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Selenium Deep Dive

Similar to Selenium Deep Dive (20)

More from Anand Bagmar

More from Anand Bagmar (20)

Recently uploaded

Recently uploaded (20)

Selenium Deep Dive