Learning Objectives: The most used and heard about buzz words in the Software Industry today are … IoT and Big Data! With IoT, with a creative mindset looking for opportunities and ways to add value, the possibilities are infinite. With each such opportunity, there is a huge volume of data being generated - which if analyzed and used correctly, can feed into creating more opportunities and increased value propositions. There are 2 types of analysis that one needs to think about. 1. How is the end-user interacting with the product? This will give some level of understanding into how to re-position and focus on the true value add features for the product. 2. With the huge volume of data being generated by the end-user interactions, and the data being captured by all devices in the food-chain of the offering, it is important to identify patterns from what has happened, and find out new product / value opportunities based on usage patterns. Learn what is Web Analytics, why is it important, and see some techniques how you can test it manually and and also automate that validation.

1. THE WHAT, WHY & HOW
OF (WEB) ANALYTICS
TESTING
Anand Bagmar
Software Quality Evangelist

2. ABOUT ME
@BagmarAnand
about.me/anand.bagmar

4. Web Analytics

5. WHAT IS WEB ANALYTICS?

6. WHY DO WE NEED WEB ANALYTICS?

8. WEB ANALYTICS SOLUTIONS
Google Analytics
SiteCatalyst
AWStats
WebTrends
….

9. Testing Web Analytics

13. TESTING AT THE REPORT LEVEL
Pros
¨ Ensure report is setup correctly
Cons
¨Licensing
¨Reports not yet setup
¨Validate all requests are sent / captured

14. Biggest Problem
It is TOO LATE!

15. The Solution

19. Web Analytics Testing
Challenges

20. MANUAL

21. REPEATING OVER-AND-OVER AGAIN

23. The Automation
Solution

24. WAAT - Web Analytics
Automation Testing

25. WHAT DOES WAAT DO FOR ME?
q Plugs into existing Test Automation Framework
q With minimal changes
q Web Analytic tool independent
q UI Driver framework independent
q Browser independent

26. FLAVORS

27. WAAT-JAVA
q Original flavor
q Supports 2 plugins
q Omniture Debugger
q Proxy
q HttpSniffer
q JsSniffer
q Available on github
Will be eventually available as a Maven Dependency!

28. WAAT-RUBY
q Ruby gem implemented over WAAT-Java
q Uses RJB – Ruby-Java-Bridge
q Supports 2 plugins
q HttpSniffer
q JsSniffer
q Available on github and rubygems.org
Will be changing soon!

29. WAAT-JAVA
q Original flavor
q Supports 3 plugins
q Omniture Debugger
q HttpSniffer
q JsSniffer
q Available on github

30. WAAT-RUBY
q Ruby gem implemented over WAAT-Java
q Uses RJB – Ruby-Java-Bridge
q Supports 2 plugins
q HttpSniffer
q JsSniffer
q Available on github and rubygems.org

31. OMNITURE DEBUGGER

32. OMNITURE DEBUGGER
Pros
q OS independent
q Run using the regular test-user
Cons
q Browser dependent – need to implement ScriptRunner
for the UI-driver in use
q Web-Analytic solution dependent – Adobe Marketing
Cloud / Omniture SiteCatalyst

33. HTTPSNIFFER
Pros
q Web-analytic solution independent
q Browser independent
q UI-driver independent
Cons
q 3
rd
party libraries are OS Dependent
q HTTPs not supported out-of-the-box
q Run tests as ‘root’

34. JSSNIFFER
Pros
q Web-analytic solution independent
q Browser independent
q HTTPs supported out-of-the-box
q No dependency on any 3
rd
party library
Cons
q Need to write JavaScript to get the URL from the browser
q UI-driver dependent

35. @BagmarAnand #waat how can I contribute?

36. PROXY DEBUGGER
Pros
q Web-analytic solution independent
q Browser independent
q UI-driver dependent
q HTTPs supported out-of-the-box
q No dependency on any 3
rd
party library
Cons
q Making it work for Mobile needs manual setup

37. ARCHITECTURE

38. Is that all to
Web Analytics?

39. The new “kids” in town
IoT & Big Data

40. Some popular use cases
https://www.kaaproject.org/iot-use-cases/

41. IOT – INTERNET OF THINGS
Opportunity to
¨ Create new value propositions
¨ Be Innovative & Creative

42. IOT – HOW TO DELIVER VALUE?
¨ Automate the manual processes
¨ Integrate data capabilities
¨ Collect – integrate from various sources
¨ Repeat collection – automate the collection
¨ Analyze – manual & machine learning
¨ Optimize / Pivot
¨ Repeat

43. IOT – CHALLENGES
¨ Federated devices,
¨ Different types of networks
¨ Different communication channels
¨ Physical (hardware) & Virtual (software)

44. IOT – BIGGER CHALLENGES
¨ Too many devices
¨ Lots of data

45. BIG DATA …. IS GETTING BIGGER
¨ Volumes of data generated
¨ A jet engine generates 1TB of data per flight.
¨ A large refinery generates 1TB of raw data per day.
¨ As cars get smarter, the number of sensors is projected to reach as many as 200
per car.
¨ Sensors of all types will generate immense amounts of data. In fact, analysts
estimate that by 2020, 40 percent of all data will come from sensors.
¨ IoT leads to massive volumes of data
http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper

46. What does this mean
for Testing?

47. TESTING OPPORTUNITIES
¨ “Testing” of these new integrations & its value
propositions
¨ Performance
¨ Reliability
¨ Security
https://www.wired.com/2017/03/medical-devices-next-
security-nightmare/?mbid=social_twitter_onsiteshare

48. TESTING OPPORTUNITIES ...
¨ Build capabilities (and tools) to validate –
¨ Data collection is working well
¨ From all sources
¨ Analyzing data, capturing patterns and trends
¨ Optimize business value
¨ Create new opportunities and value propositions

49. @BagmarAnand
about.me/anand.bagmar
THANK YOU

50. RESOURCES
¨ https://github.com/anandbagmar/waat
¨ https://github.com/anandbagmar/waat-ruby
¨ http://essenceoftesting.blogspot.in/search/label/waat
¨ http://www.cisco.com/web/solutions/trends/iot/docs/io
t-data-analytics-white-paper
¨ http://www.dezyre.com/article/how-big-data-analysis-
helped-increase-walmart-s-sales-turnover/109