Slideshare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our User Agreement and Privacy Policy.

Slideshare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our Privacy Policy and User Agreement for details.

Successfully reported this slideshow.

Like this presentation? Why not share!

- What to Upload to SlideShare by SlideShare 5390159 views
- Customer Code: Creating a Company C... by HubSpot 4037601 views
- Be A Great Product Leader (Amplify,... by Adam Nash 902286 views
- Trillion Dollar Coach Book (Bill Ca... by Eric Schmidt 1070098 views
- APIdays Paris 2019 - Innovation @ s... by apidays 1203793 views
- A few thoughts on work life-balance by Wim Vanderbauwhede 937888 views

4,436 views

Published on

Published in:
Data & Analytics

No Downloads

Total views

4,436

On SlideShare

0

From Embeds

0

Number of Embeds

2,589

Shares

0

Downloads

51

Comments

4

Likes

2

No notes for slide

- 1. How much data is needed to calculate LTV? Eric Benjamin Seufert GDC Data Science Meetup @ N3TWORK March 20, 2018
- 2. Who I am N3TWORK Mobile Dev Memo Freemium Economics
- 3. Who I am
- 4. Review: How do we build an LTV estimate? - Get clarity on model; - Get clarity on early stage signal
- 5. Review: How do we build an LTV estimate? - If we’re confident in the model, we can use early-stage monetization data to project out to some goal LTV metric (“Day X LTV”); - Eg. if we want to recoup our money in 90 days, we should project a Day 90 LTV; if we are confident in our model, perhaps we can estimate a Day 90 LTV with just 7 days of data.
- 6. Review: How do we build an LTV estimate? - 7 days isn’t a long time. But how much data do we need to even get a comfortable, robust estimate of 7-day LTV?
- 7. The Approach - Simulate the collection of monetization data to understand how many users it takes to get a good estimate on Day 7 LTV;
- 8. The Funnel - As we acquire users into our app, we accumulate data over time; - The amount of data we have at Day X is a function of the input new users + retention + days that new users have been acquired; - With 100% user retention, with 100 DNU running for 4 days, we have 400 data points for Day 1, 300 data points for Day 2, 200 data points for Day 3, and 100 data points for Day 4 (only one cohort has reached Day 4 in our app); - Adding in a typical retention curve makes this degradation in data size even more pronounced.
- 9. The Approach - Simulate the collection of monetization data to understand how many users it takes to get a good estimate on Day 7 LTV; - Build some reasonable assumptions of how our app / marketing performs:
- 10. The Approach - Generate a retention curve:
- 11. The Approach - Generate a retention curve:
- 12. The Approach - Simulate cohorts joining the app by using a pareto distribution to model monetization
- 13. The Approach - Stack up the monetization by Day to come up with LTVs
- 14. The Approach - Calculate confidence intervals for each Day X LTV
- 15. The Approach - Calculate confidence intervals for each Day X LTV - 5 Days of cohorts, 500 users per day - Day 4 LTV CI 95% is $0.38 -> $0.62 - $0.24 difference, nearly 50%! - And that’s just Day 4!
- 16. The Approach - What about 90 days of traffic buying? - Day 5 has a tight CI - But Day 90 spread is large
- 17. Thanks! @eric_seufert eric@mobiledevmemo.com

No public clipboards found for this slide

Login to see the comments