Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Data Driven Product
Development
Ishan Agrawal
Founder, Customator
@ishanagr
About Me
• Founder, Customator
• Data Engineer @ Viki, a Rakuten Company
• Research Intern @ Paypal
• Teaching Assistant @...
Fun stuff I did
Products I built
• Tuition Agency for Indian education boards
• FML NUS
• CorruptionTrak
• Devops as a Ser...
Overview
• Early Products and Lessons
Learnt
• Data Driven Product
Development
• What?
• Why?
• How?
• Data @ Viki
• Why?
...
Data Driven Product
Development
• Lets say we are building ‘NUS TimeTable Builder’
• Problem?
• Solution?
• Is it working?
• Can we make it better?
Is it working?
• What should we measure?
Can we make it better?
• What should we measure?
Can we make it better?
• What do we do to make it better?
Data @ Viki
Data Products @ Viki
• Dashboard - easy reporting
• AB testing
• Personalisation
• Real time charting and alerting
• Data ...
Data Products @ Viki
AB Testing
AB Testing types
• Split url testing
• Landing page testing
• Multi page testing
• Multi variate testing
AB Testing pitfalls
• Dilution
• Statistical Significance
• AB tests don’t always win
• Novelty effect
• External factors
...
Subscription Service Info page
Homepage Personalisation
User engagement - Favorite button
Personalisation
Experimentation and
Personalisation made easy
• Cross Platform
• Experimentation in algorithms, not just UI
• Easy to use ...
Activity
• Lets pick a popular product of your choice
• Facebook? Quora?
• Brainstorm through the goals of the product
• What shoul...
Thanks
@ishanagr
agrawal.ish@gmail.com
Data Driven Product Development
Data Driven Product Development
Data Driven Product Development
Data Driven Product Development
Data Driven Product Development
Data Driven Product Development
Data Driven Product Development
Upcoming SlideShare
Loading in …5
×

Data Driven Product Development

860 views

Published on

Data and experimentation is becoming core of product development in todays world. In this talk I will talk about what I learned from building various products, why data and experimentation matter when building products used by millions of users. The talk will also touch on how we at Customator plan to make it easy for any one to follow a data driven product development approach.
Venue : NUS School of Computing Seminar

Published in: Engineering
  • Login to see the comments

Data Driven Product Development

  1. 1. Data Driven Product Development Ishan Agrawal Founder, Customator @ishanagr
  2. 2. About Me • Founder, Customator • Data Engineer @ Viki, a Rakuten Company • Research Intern @ Paypal • Teaching Assistant @ SoC • Software Engineer @ Rocketful Inc.
  3. 3. Fun stuff I did Products I built • Tuition Agency for Indian education boards • FML NUS • CorruptionTrak • Devops as a Service
  4. 4. Overview • Early Products and Lessons Learnt • Data Driven Product Development • What? • Why? • How? • Data @ Viki • Why? • How? • Impact? • Customator • Activity
  5. 5. Data Driven Product Development
  6. 6. • Lets say we are building ‘NUS TimeTable Builder’ • Problem? • Solution? • Is it working? • Can we make it better?
  7. 7. Is it working? • What should we measure?
  8. 8. Can we make it better? • What should we measure?
  9. 9. Can we make it better? • What do we do to make it better?
  10. 10. Data @ Viki
  11. 11. Data Products @ Viki • Dashboard - easy reporting • AB testing • Personalisation • Real time charting and alerting • Data Science
  12. 12. Data Products @ Viki
  13. 13. AB Testing
  14. 14. AB Testing types • Split url testing • Landing page testing • Multi page testing • Multi variate testing
  15. 15. AB Testing pitfalls • Dilution • Statistical Significance • AB tests don’t always win • Novelty effect • External factors • Choosing your goals wisely
  16. 16. Subscription Service Info page
  17. 17. Homepage Personalisation
  18. 18. User engagement - Favorite button
  19. 19. Personalisation
  20. 20. Experimentation and Personalisation made easy • Cross Platform • Experimentation in algorithms, not just UI • Easy to use for non-technical users • Auto personalisation • Data Driven experimentation
  21. 21. Activity
  22. 22. • Lets pick a popular product of your choice • Facebook? Quora? • Brainstorm through the goals of the product • What should we measure? • How can we improve the product?
  23. 23. Thanks @ishanagr agrawal.ish@gmail.com

×