Here are slides from my talk on "What, Why and How of Analytics Testing" at Selenium Conference, Berlin 2017. This talk focusses on Analytics related to Browser & Mobile Native apps, with impact on / of IoT (Internet of Things) and Big Data. See my blog for more details - https://essenceoftesting.blogspot.com/2017/10/analytics-forgotten-child.html

1. THE WHAT, WHY & HOW OF
WEB ANALYTICS TESTING
Anand Bagmar
Software Quality Evangelist

2. ABOUT ME
@BagmarAnand
about.me/anand.bagmar

4. Analytics
Web / Mobile / ...

5. WHY DO WE NEED ANALYTICS?

6. WHAT IS ANALYTICS?

8. ANALYTICS SOLUTIONS
Google Analytics
SiteCatalyst
Amplitude
WebTrends
….

9. Is that all to Analytics?

10. The new “kids” in town
IoT & Big Data
teenagers

11. Some popular use cases
https://www.kaaproject.org/iot-use-cases/

12. IOT – INTERNET OF THINGS
Opportunity to
¨ Create new value propositions
¨ Be Innovative & Creative

13. IOT – HOW TO DELIVER VALUE?
¨ Automate the manual processes
¨ Integrate data capabilities
¨ Collect – integrate from various sources
¨ Repeat collection – automate the collection
¨ Analyze – manual & machine learning
¨ Optimize / Pivot
¨ Repeat

14. IOT – CHALLENGES
¨ Federated devices,
¨ Different types of networks
¨ Different communication channels
¨ Physical (hardware) & Virtual (software)

15. IOT – BIGGER CHALLENGES
¨ Too many devices
¨ Lots of data

16. BIG DATA …. IS GETTING BIGGER
¨ Volumes of data generated
¨ A jet engine generates 1TB of data per flight.
¨ A large refinery generates 1TB of raw data per day.
¨ As cars get smarter, the number of sensors is projected to reach as many as 200 per car.
¨ Sensors of all types will generate immense amounts of data. In fact, analysts estimate that by 2020, 40 percent of
all data will come from sensors.
¨ IoT leads to massive volumes of data
http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-white-paper

17. What does all this mean for
Testing?

18. TESTING OPPORTUNITIES ...
¨ Build capabilities (and tools) to validate –
¨ Data collection is working well
¨ From all sources
¨ Analyzing data, capturing patterns and trends
¨ Optimize business value
¨ Create new opportunities and value propositions

19. TESTING OPPORTUNITIES
¨ “Testing” of these new integrations & its value propositions
¨ Performance
¨ Reliability
¨ Security
¨ Scale

20. You don’t need to
think complex!!

21. VIU
¨ Unique installs (Android) - > 1.75M
¨ Unique # of devices (Android) - > 13K

24. Testing Analytics

29. TESTING AT THE REPORT LEVEL
Pros
¨ Ensure report is setup correctly
Cons
¨Licensing
¨Reports not yet setup
¨Validate all requests are sent / captured

30. Biggest Problem
It is TOO LATE!

31. The Solution

36. Analytics Testing
Challenges

37. MANUAL

38. REPEATING OVER-AND-OVER AGAIN

40. BATCHING

41. The Automation Solution

42. WAAT - Web Analytics Automation
Testing

43. WHAT DOES WAAT DO FOR ME?
q Plugs into existing Test Automation Framework
q With minimal changes
q Web Analytic tool independent
q UI Driver framework independent
q Browser independent
q Works for Native apps as well mobile-web (Android / iOS)

45. @BagmarAnand
about.me/anand.bagmar
THANK YOU

46. RESOURCES
¨ https://github.com/anandbagmar/waat
¨ https://github.com/anandbagmar/waat-ruby
¨ http://essenceoftesting.blogspot.in/search/label/waat
¨ http://www.cisco.com/web/solutions/trends/iot/docs/iot-data-analytics-
white-paper
¨ http://www.dezyre.com/article/how-big-data-analysis-helped-increase-
walmart-s-sales-turnover/109