SlideShare a Scribd company logo
1 of 30
Data Driven Product
Development
Ishan Agrawal
Founder, Customator
@ishanagr
About Me
• Founder, Customator
• Data Engineer @ Viki, a Rakuten Company
• Research Intern @ Paypal
• Teaching Assistant @ SoC
• Software Engineer @ Rocketful Inc.
Fun stuff I did
Products I built
• Tuition Agency for Indian education boards
• FML NUS
• CorruptionTrak
• Devops as a Service
Overview
• Early Products and Lessons
Learnt
• Data Driven Product
Development
• What?
• Why?
• How?
• Data @ Viki
• Why?
• How?
• Impact?
• Customator
• Activity
Data Driven Product
Development
• Lets say we are building ‘NUS TimeTable Builder’
• Problem?
• Solution?
• Is it working?
• Can we make it better?
Is it working?
• What should we measure?
Can we make it better?
• What should we measure?
Can we make it better?
• What do we do to make it better?
Data @ Viki
Data Products @ Viki
• Dashboard - easy reporting
• AB testing
• Personalisation
• Real time charting and alerting
• Data Science
Data Products @ Viki
AB Testing
AB Testing types
• Split url testing
• Landing page testing
• Multi page testing
• Multi variate testing
AB Testing pitfalls
• Dilution
• Statistical Significance
• AB tests don’t always win
• Novelty effect
• External factors
• Choosing your goals wisely
Subscription Service Info page
Homepage Personalisation
User engagement - Favorite button
Personalisation
Experimentation and
Personalisation made easy
• Cross Platform
• Experimentation in algorithms, not just UI
• Easy to use for non-technical users
• Auto personalisation
• Data Driven experimentation
Activity
• Lets pick a popular product of your choice
• Facebook? Quora?
• Brainstorm through the goals of the product
• What should we measure?
• How can we improve the product?
Thanks
@ishanagr
agrawal.ish@gmail.com

More Related Content

What's hot

What's hot (20)

Scala Data Pipelines @ Spotify
Scala Data Pipelines @ SpotifyScala Data Pipelines @ Spotify
Scala Data Pipelines @ Spotify
 
Uber Real Time Data Analytics
Uber Real Time Data AnalyticsUber Real Time Data Analytics
Uber Real Time Data Analytics
 
Magento Overview
Magento  OverviewMagento  Overview
Magento Overview
 
Introduction to Microsoft Fabric.pdf
Introduction to Microsoft Fabric.pdfIntroduction to Microsoft Fabric.pdf
Introduction to Microsoft Fabric.pdf
 
OBIEE ARCHITECTURE.ppt
OBIEE ARCHITECTURE.pptOBIEE ARCHITECTURE.ppt
OBIEE ARCHITECTURE.ppt
 
Metrics, Engagement & Personalization
Metrics, Engagement & Personalization Metrics, Engagement & Personalization
Metrics, Engagement & Personalization
 
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
What Is Power BI? | Introduction To Microsoft Power BI | Power BI Training | ...
 
iceberg introduction.pptx
iceberg introduction.pptxiceberg introduction.pptx
iceberg introduction.pptx
 
Tableau Customer Presentation
Tableau Customer PresentationTableau Customer Presentation
Tableau Customer Presentation
 
Netflix Keystone - How Netflix Handles Data Streams up to 11M Events/Sec
Netflix Keystone - How Netflix Handles Data Streams up to 11M Events/SecNetflix Keystone - How Netflix Handles Data Streams up to 11M Events/Sec
Netflix Keystone - How Netflix Handles Data Streams up to 11M Events/Sec
 
Zeus: Uber’s Highly Scalable and Distributed Shuffle as a Service
Zeus: Uber’s Highly Scalable and Distributed Shuffle as a ServiceZeus: Uber’s Highly Scalable and Distributed Shuffle as a Service
Zeus: Uber’s Highly Scalable and Distributed Shuffle as a Service
 
Machine learning for Netflix recommendations talk at SF Make School
Machine learning for Netflix recommendations talk at SF Make SchoolMachine learning for Netflix recommendations talk at SF Make School
Machine learning for Netflix recommendations talk at SF Make School
 
SharePoint as a Document Management System (DMS)
SharePoint as a Document Management System (DMS)SharePoint as a Document Management System (DMS)
SharePoint as a Document Management System (DMS)
 
Netflix Data Engineering @ Uber Engineering Meetup
Netflix Data Engineering @ Uber Engineering MeetupNetflix Data Engineering @ Uber Engineering Meetup
Netflix Data Engineering @ Uber Engineering Meetup
 
Data Lake: A simple introduction
Data Lake: A simple introductionData Lake: A simple introduction
Data Lake: A simple introduction
 
Observability at Spotify
Observability at SpotifyObservability at Spotify
Observability at Spotify
 
Interactive real time dashboards on data streams using Kafka, Druid, and Supe...
Interactive real time dashboards on data streams using Kafka, Druid, and Supe...Interactive real time dashboards on data streams using Kafka, Druid, and Supe...
Interactive real time dashboards on data streams using Kafka, Druid, and Supe...
 
Tableau vs PowerBI
Tableau vs PowerBITableau vs PowerBI
Tableau vs PowerBI
 
Data Discovery at Databricks with Amundsen
Data Discovery at Databricks with AmundsenData Discovery at Databricks with Amundsen
Data Discovery at Databricks with Amundsen
 
Real-Time Streaming: Intro to Amazon Kinesis
Real-Time Streaming: Intro to Amazon KinesisReal-Time Streaming: Intro to Amazon Kinesis
Real-Time Streaming: Intro to Amazon Kinesis
 

Similar to Data Driven Product Development

InfoVision_PM101_RPadaki
InfoVision_PM101_RPadakiInfoVision_PM101_RPadaki
InfoVision_PM101_RPadaki
Ravi Padaki
 
Oracle BI Applications: Delivering Value Through Rapid Implementations
Oracle BI Applications: Delivering Value Through Rapid ImplementationsOracle BI Applications: Delivering Value Through Rapid Implementations
Oracle BI Applications: Delivering Value Through Rapid Implementations
KPI Partners
 
The SAS Search Journey: Using AI to Move from Google to Lucidworks - Alex Fl...
The SAS Search Journey:  Using AI to Move from Google to Lucidworks - Alex Fl...The SAS Search Journey:  Using AI to Move from Google to Lucidworks - Alex Fl...
The SAS Search Journey: Using AI to Move from Google to Lucidworks - Alex Fl...
Lucidworks
 
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...
Lucidworks
 

Similar to Data Driven Product Development (20)

InfoVision_PM101_RPadaki
InfoVision_PM101_RPadakiInfoVision_PM101_RPadaki
InfoVision_PM101_RPadaki
 
Oracle BI Applications: Delivering Value Through Rapid Implementations
Oracle BI Applications: Delivering Value Through Rapid ImplementationsOracle BI Applications: Delivering Value Through Rapid Implementations
Oracle BI Applications: Delivering Value Through Rapid Implementations
 
Product Management 101 for Data and Analytics
Product Management 101 for Data and Analytics Product Management 101 for Data and Analytics
Product Management 101 for Data and Analytics
 
The SAS Search Journey: Using AI to Move from Google to Lucidworks - Alex Fl...
The SAS Search Journey:  Using AI to Move from Google to Lucidworks - Alex Fl...The SAS Search Journey:  Using AI to Move from Google to Lucidworks - Alex Fl...
The SAS Search Journey: Using AI to Move from Google to Lucidworks - Alex Fl...
 
The Importance of Culture: Building and Sustaining Effective Engineering Org...
The Importance of Culture:  Building and Sustaining Effective Engineering Org...The Importance of Culture:  Building and Sustaining Effective Engineering Org...
The Importance of Culture: Building and Sustaining Effective Engineering Org...
 
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...
Building a Fast and Powerful Search App with Lucidworks Site Search - Andrew ...
 
Working Smarter: Integrating lean startup practices into your company
Working Smarter: Integrating lean startup practices into your companyWorking Smarter: Integrating lean startup practices into your company
Working Smarter: Integrating lean startup practices into your company
 
SEO in the Age of Artificial Intelligence | How AI influences Search
SEO in the Age of Artificial Intelligence | How AI influences SearchSEO in the Age of Artificial Intelligence | How AI influences Search
SEO in the Age of Artificial Intelligence | How AI influences Search
 
Agile Data Warehousing
Agile Data WarehousingAgile Data Warehousing
Agile Data Warehousing
 
How we built Talentpioneer by Productsquads
How we built Talentpioneer by ProductsquadsHow we built Talentpioneer by Productsquads
How we built Talentpioneer by Productsquads
 
Spiking Your Way to Improved Agile Development - Anatoli Kazatchkov
Spiking Your Way to Improved Agile Development - Anatoli KazatchkovSpiking Your Way to Improved Agile Development - Anatoli Kazatchkov
Spiking Your Way to Improved Agile Development - Anatoli Kazatchkov
 
ExistBI Data Integration Consulting Case Study
ExistBI Data Integration Consulting Case StudyExistBI Data Integration Consulting Case Study
ExistBI Data Integration Consulting Case Study
 
Agile ux fullday-uxpa2016
Agile ux fullday-uxpa2016Agile ux fullday-uxpa2016
Agile ux fullday-uxpa2016
 
Creating a Winning Content Strategy
Creating a Winning Content StrategyCreating a Winning Content Strategy
Creating a Winning Content Strategy
 
Lean Business Analysis and UX Runway - Natalie Warnert
Lean Business Analysis and UX Runway - Natalie WarnertLean Business Analysis and UX Runway - Natalie Warnert
Lean Business Analysis and UX Runway - Natalie Warnert
 
Lean Business Analysis and UX Runway: Managing Value by Reducing Waste (Natal...
Lean Business Analysis and UX Runway: Managing Value by Reducing Waste (Natal...Lean Business Analysis and UX Runway: Managing Value by Reducing Waste (Natal...
Lean Business Analysis and UX Runway: Managing Value by Reducing Waste (Natal...
 
Lean Security
Lean SecurityLean Security
Lean Security
 
Minimum viable product
Minimum viable productMinimum viable product
Minimum viable product
 
#Techmeetupkz Askhat Murzabayev
#Techmeetupkz Askhat Murzabayev#Techmeetupkz Askhat Murzabayev
#Techmeetupkz Askhat Murzabayev
 
SharePoint Saturday Warsaw 2018 - Modern Collaboration in Teams & Projects wi...
SharePoint Saturday Warsaw 2018 - Modern Collaboration in Teams & Projects wi...SharePoint Saturday Warsaw 2018 - Modern Collaboration in Teams & Projects wi...
SharePoint Saturday Warsaw 2018 - Modern Collaboration in Teams & Projects wi...
 

Recently uploaded

AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
ankushspencer015
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college project
Tonystark477637
 

Recently uploaded (20)

(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
Roadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and RoutesRoadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and Routes
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Russian Call Girls in Nagpur Grishma Call 7001035870 Meet With Nagpur Escorts
Russian Call Girls in Nagpur Grishma Call 7001035870 Meet With Nagpur EscortsRussian Call Girls in Nagpur Grishma Call 7001035870 Meet With Nagpur Escorts
Russian Call Girls in Nagpur Grishma Call 7001035870 Meet With Nagpur Escorts
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college project
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
 
Online banking management system project.pdf
Online banking management system project.pdfOnline banking management system project.pdf
Online banking management system project.pdf
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptx
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptx
 
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writing
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 

Data Driven Product Development

Editor's Notes

  1. Its difficult to get money from Freshmen, specially when they are your friends. Create a buzz around the products you build. Helping people more difficult than making money. People love seeing other people (specially young people) drive change. Don’t work on something that doesn’t excite you enough to work on it full time. Choose your team mates / co-founders very carefully.
  2. I think my slides don’t strictly follow the outline, but its a general overview
  3. DDPD seems like a big term thrown around in the industry a lot. Lets try to figure it out together.
  4. Your very own time table builder, built by students from NUS. Lets up the stakes. Lets say we make it a product and sell it to all university students around the world. How do we make money? - And we make money by a subscription service.
  5. So we found the problem, we came to a solution. Now how do we know if its working? Visits Visitors Average time per session Demographics, location, time of day Every dimension of information gives you more insight
  6. Drop offs at different points in the application What are we optimising for? Heatmaps Funnels Retention rates
  7. Feature improvements / New feature development Measure how the changes are performing Experiment? Personalize? https://www.zopim.com/ example
  8. So what is AB testing?
  9. Bottom left was the clear winner Split url testing
  10. Drove the conversions up by 20%
  11. Learning which variations work best for what audience and then auto targeting.