2. 2
• Retail shopping rewards app
• Led Growth Engineering team
• Grew from 1MM to 8MM users in
3 years
• Acquired for $200MM
• Visual discovery & bookmarking
app
• Eng manager for Engagement
• Over 100 million MAUs
• Engagement experiments have
added millions of WAUs
21. 1d7s
• Percentage of new signups that use the app 1 or more times in the week
following signup
• Quicker to run experiments with
• At Pinterest this is highly correlated with user’s long-term retention
21
25. One Key Engagement Metric
Medium: Total Time Spent Reading (TTR)
Twitter: MAUs with 7+ visits a month (7d28s)
Uber: Weekly Trips
Facebook: WAUs with 6+ visits a week (6L7s)
Pinterest: Weekly Active Repiners or Clickers (WARCs)
25
26. Finding Your Key Engagement Metric
1) What are the actions a user has to take to get value from your product?
2) What is the frequency someone need to use your product
26
27. User States
Core: Active multiple times a week
Casual: Active once or twice a week
Marginal: Active a couple times a month
New: Joined in the past 28 days
Dormant: Not active for 28 days
Resurrected: Was dormant, but became active
again in the past 28 days
27
31. Marketing
Pros:
• Coverage. Can reach the entire user base
Cons:
• Not personalized, lower open rates
• User’s have much lower tolerance
compared to emails
31
32. Transactional
Pros:
• More personal than marketing
notifications
Cons:
• Users need activity to generate
notifications
• Need mechanisms to rate limit
32
33. Recommendations
Pros:
• Coverage. Can reach most users
• Personalized to the user
Cons:
• Expensive and time consuming to build
out recommendation engine
• Quality may not be good if user has low
amount of activity
33
2:50 PM 100%2:50 PM 100%
34. Measuring Engagement for Emails/Push
• Positive measures of quality
- Must lift key engagement metric
- Minimum required CTR rates
• Negative measures of quality
- App deletions
- Spam reports
- Unsubscribes
34
39. Wrap Up
• Pre Product/Market Fit: Product comes first
• Initial Traction: Do things that don’t scale
• Growth Stage: Prioritize projects based on return on investment
• Use funnels for analyzing acquisition flows
• 1d7s to analyze on activation
• Use user states to understand how engaged users are
• Make sure emails/notifications for true engagement
• Use segmentation for experiments & metrics in general
39