SlideShare a Scribd company logo
1 of 152
Download to read offline
Startup Metrics, a love story.
Everything you need to know about
Startup Product Metrics.
#iCatapult Workshop - 2013-08-12
Slideshare Exclusive: The full Powerdeck. ;)
@andreasklinger
@andreasklinger
ā€œStartup Founderā€
ā€œProduct Guyā€
@andreasklinger
@andreasklinger
ā€œStartup Founderā€
ā€œProduct Guyā€
What we will cover
- Early Stage Metrics (Pre Product Market Fit).
- Create your dashboard & customer journey map.
- Wrong assumptions on Metrics
- Lean Analytics & Advanced Topics
@andreasklinger
#emminvest ā€“ @andreasklinger
The Biggest Risk of a Startup?
#emminvest ā€“ @andreasklinger
The Biggest Risk of a Startup?
Time/Money? No You will learn a lot + huge network gain.
#emminvest ā€“ @andreasklinger
Building ALMOST the right thing.
The Biggest Risk of a Startup?
Seeing the successful new competitor who does what you do,
but has one little detail different that you never focused on.
ā€œStartups donā€™t fail because they lack a product;
they fail because they lack customers and a
proļ¬table business modelā€ Steve Blank
And it might have been where you didnā€™t look.
@andreasklinger
Market
Your
Solution
Customer
Job/Problem
Willing to pay
To miss your opportunity. By focusing on the wrong thing.
@andreasklinger
Market
Customer
Job/Problem
Willing to pay
competitor
competitor
competitor
competitor
Your
Solution
Other
Market
Customer
Job/Problem
Willing to pay
Or by looking at the wrong customer.
@andreasklinger
Startup Founders.
@andreasklinger
Some startups have
ideas for a new product.
Looking for customers
to buy (or at least use) it.
Customers donā€™t buy.
ā€œearly stageā€
@andreasklinger
traction
time
Product/Market Fit
With early stage
I do not mean ā€œX Yearsā€
I mean before product/market ļ¬t.
@andreasklinger
Product/market ļ¬t
Being in a good market
with a product that can satisfy
that market.
~ Marc Andreessen
@andreasklinger
Product/market ļ¬t
Being in a good market
with a product that can satisfy
that market.
~ Marc Andreessen
= People want your stuff.
@andreasklinger
traction
time
Product/Market Fit
@andreasklinger
Discovery
traction
time
Validation Efļ¬ciency Scale
Product/Market Fit
Steve Blank - Customer Development
@andreasklinger
traction
time
Empathy Stickness Virality Revenue
Product/Market Fit
Ben Yoskovitz, Alistair Croll - Lean Analytics
Scale
@andreasklinger
traction
time
Product/Market Fit
Find a product
the market wants.
Empathy Stickness Virality Revenue Scale
@andreasklinger
traction
time
Product/Market Fit
Find a product
the market wants.
Optimise the product
for the market.
Empathy Stickness Virality Revenue Scale
@andreasklinger
traction
time
Product/Market Fit
Find a product
the market wants.
Optimise the product
for the market.
Most clones
start here.
People in search
for new product
start here.
Empathy Stickness Virality Revenue Scale
@andreasklinger
traction
time
Product/Market Fit
Product & Customer
Development
Scale Marketing
& Operations
Empathy Stickness Virality Revenue Scale
@andreasklinger
traction
time
Product/Market Fit
Startups have phases
but they overlap.
Empathy Stickness Virality Revenue Scale
@andreasklinger
traction
time
Product/Market Fit
83% of all startups are in here.
Empathy Stickness Virality Revenue Scale
@andreasklinger
traction
time
Product/Market Fit
83% of all startups are in here. Most stuff we learn about
web analytics is meant for this part
Empathy Stickness Virality Revenue Scale
@andreasklinger
Most of the techniques/pattern
we ļ¬nd when we look to learn about
metrics come out from Online Marketing
@andreasklinger
A/B Testing, Funnels, Referral Optimization, etc etc
They are about optimizing, not innovating
@andreasklinger
What are we testing here?
@andreasklinger
What are we testing here?
Value Proposition, Communication.
Maybe Channels, Target Group.
Not the product implementation.
@andreasklinger
We need product insights.
@andreasklinger
Good news: We donā€™t need many people
Itā€™s too early for optimizations.
Challenge #1: Get them to stay.
@andreasklinger
ā€œ...interesting...ā€
What does this mean for my product?
Are we even on the right track?
eg. What is a good Time on Site?
Maybe users spend time reading
your support pages just because
they are super confused.
Google Analytics is meant for
Referral Optimization.
Where does trafļ¬c come from?
Is this trafļ¬c of value?
What does it mean anyway?
@andreasklinger
What does it mean anyway?
ā€œWe have 50k registered users!ā€
Do they still use the service? Are they the right people?
ā€œWe have 5000 newsletter signups!ā€
Do they react? Are they potential customers?
ā€œWe have 500k app downloads!ā€
Do they still use the app?
@andreasklinger
Some graphs always go up.
Vanity. Use it for the Press.
Not for your product.
@andreasklinger
Itā€™s easy to improve conversions
(of the wrong people)
Source: http://www.codinghorror.com/blog/2009/07/how-not-to-advertise-on-the-internet.html
@andreasklinger
Itā€™s easy to improve conversions
(of the wrong people)
This is a real example.
Thank the Internet.
Source: http://www.codinghorror.com/blog/2009/07/how-not-to-advertise-on-the-internet.html
@andreasklinger
The same is true for funnels.
Itā€™s easy to optimize by pushing the wrong
people forward.
Disclaimer: this is not a real example. btw newrelic is awesome ;)
@andreasklinger
The same is true for funnels.
Itā€™s easy to optimize by pushing the wrong
people forward.
Disclaimer: this is not a real example. btw newrelic is awesome ;)
@andreasklinger
why early stage metrics suck.
small something
Most likely
ā€œSmall Dataā€
Early Stage Product Metrics suck:
- We have the wrong product
- With the wrong communication
- Attacting the wrong targetgroup
- Who provide us too few datapoints
@andreasklinger
Early stage product metrics get easily
affected by external trafļ¬c.
One of our main goals is to minimize that effect.
@andreasklinger
Values: 0, 0, 0, 100
Whatā€™s the average?
#1
@andreasklinger
Values: 0, 0, 0, 100
Whatā€™s the average? 25
Whatā€™s the median?
#1
@andreasklinger
#scb13 ā€“ @andreasklinger
Values: 0, 0, 0, 100
Whatā€™s the average? 25
Whatā€™s the median? 0
Eg. ā€œAverage Interactionsā€
can be Bollocks
#1
#scb13 ā€“ @andreasklinger
Values: 0, 0, 0, 100
Whatā€™s the average? 25
Whatā€™s the median? 0
Eg. ā€œAverage Interactionsā€
can be Bollocks
#1
Values: 0, 5, 10
Whatā€™s the average?
#2
@andreasklinger
#scb13 ā€“ @andreasklinger
Values: 0, 5, 10
Whatā€™s the average? 5
Whatā€™s the standard
deviation? 4,08
=> ā€œAverageā€ hides information.
#2
ā€œThis is not statistical
signiļ¬cant.ā€
I donā€™t care.
We are anyway playing dart in a
dark room.
Letā€™s try to get it as good as
possible and use our intuation
for the rest.
#3
@andreasklinger
#scb13 ā€“ @andreasklinger
Correlation / Causality
Source: Lean Analytics
Correlation / Causality
@andreasklingerSource: Lean Analytics
How can we use metrics?
@andreasklinger
How can we use metrics?
To Explore (Examples)
Investigate an
assumption.
Look for causalities.
Validate customer
feedback.
Validate internal opinions.
To Report (Examples)
Measure Progress.
(Accounting)
Measure Feature Impact.
See customer happiness/
health.
@andreasklinger
What do i measure?
TL;DR: In case of doubt, people.
Hits
Visits
Visitors
People
Views
Clicks
Page Views
Conversions
Engagement
@andreasklinger
#scb13 ā€“ @andreasklinger
Framework: AARRR
Linked to assumptions of your product (validation/falsify)
What are good KPIs?
#scb13 ā€“ @andreasklinger
Framework: AARRR
Rate or Ratio (0.X or %)
What are good KPIs?
#scb13 ā€“ @andreasklinger
Framework: AARRR
Comparable (To your history (or a/b). Forget the market)
What are good KPIs?
#scb13 ā€“ @andreasklinger
Framework: AARRR
Explainable (If you donā€™t get it it means nothing)
What are good KPIs?
#scb13 ā€“ @andreasklinger
Framework: AARRR
Explainable (If you donā€™t get it it means nothing)
What are good KPIs?
Linked to assumptions of your product (validation/falsify)
Rate or Ratio (0.X or %)
Comparable (To your history (or a/b). Forget the market)
#scb13 ā€“ @andreasklinger
Framework: AARRR
ā€œIndustry Standardsā€
Use industry averages as reality check.
Not as benchmark.
- Usually very hard to get.
- Everyone deļ¬nes stuff different.
- You might end up with another business
model anyway.
- Compare yourself vs your history data.
#scb13 ā€“ @andreasklinger
Letā€™s start.
Segment Users into Cohorts
Cohorts = Groups of people that share attributes.
@andreasklinger
Segment Users into Cohorts
Like it
People 23%
@andreasklinger
Segment Users into Cohorts
Like it
People 0-25 3%
People 26-50 4%
People 51-75 65%
@andreasklinger
Segment Users into Cohorts
Average Spending
Jan ā‚¬5
Feb ā‚¬4.5
Mar ā‚¬5
Apr ā‚¬4.25
May ā‚¬4.5
... ...
Averages can hide patterns.
@andreasklinger
Segment Users into Cohorts
1 2 3 4 5
Jan ā‚¬5 ā‚¬3 ā‚¬2 ā‚¬1 ā‚¬0.5
Feb ā‚¬6 ā‚¬4 ā‚¬2 ā‚¬1
Mar ā‚¬7 ā‚¬6 ā‚¬5
Apr ā‚¬8 ā‚¬7
May ā‚¬9
... ...
Registration Month
Month Lifecycle
Insight: Users spend less over time in average.
We still donā€™t know if they spend less, or if less people spend at all.
@andreasklinger
Apply a framework: AARRR
@andreasklinger
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
(c) Dave McClure
Example: Blossom.io
Kanban Project Mangement Tool
created a card
Activation
moved a card
Retention
invited team members
Referral
have upgraded
Revenue
(people who) registered an account
Acquisition
Example: Photoapp
created ļ¬rst photo
Activation
opened app twice in perioid
Retention
shared photo to fb
Referral
??? (exit?)
Revenue
(people who) registered an account
Acquisition
Example: Photoapp
ARRR
acquisition activation retention referral revenue
registration ļ¬rst photo twice a month share ā€¦
8750 65% 23% 9%
WK acquisition activation retention referral revenue
Photoapp registration ļ¬rst photo
twice a
month
share ā€¦
1 400 62,5% 25% 10%
2 575 65% 23% 9%
3 350 64% 26% 4%
ā€¦ ā€¦ ā€¦ ā€¦ ā€¦
Example: Photoapp
Cohorts based on registration week AARRR
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
(c) Dave McClure
Which Metrics to focus on?
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
Short Answer:
Focus on Retention
(c) Dave McClure
Because
Retention = f(user_happiness)
Because
Retention = f(user_happiness)
Not only ā€œvisited againā€.
But ā€œdid core activity X againā€
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
(c) Dave McClure
Long answer - It depends on two things:
Phase of company
Type of Product
Engine of Growth
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
Source: Lean Analytics Book - highly recommend
#1 Phase
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
#2 Engine of Growth
Paid
Make more money on a customer
than you spend, to buy new ones. Eg. Saas
Viral
A Users brings more than one new user.
Eg. typical interactive ad-campaigns
@andreasklinger
Sticky
Keep your userbase to improve your quality.
Eg. Communities
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
#2 Type of Company (linked to Engine of Growth)
Saas
Build a better product
Social Network/Community
ā€œ(subjective) Critical Massā€
Marketplace
Get the right sellers
and many more...
@andreasklinger
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
Short Answer:
Focus on Retention
(c) Dave McClure
Retention Matrix
Stickness over lifetime.
Source: www.usercycle.com
Acquisition
Visit / Signup / etc
Activation
Use of core feature
Retention
Come + use again
Referral
Invite + Signup
Revenue
$$$ Earned
Short Answer:
Focus on Retention
(c) Dave McClure
Eg. Did core-action X
times in period.
Dig deeper: Crashpadderā€™s Happiness Index
e.g. Weighted sum over core activities by hosts.
Cohorts by cities and time.
= Health/Happiness Dashboard
Marketplaces
/ 2-sided models
Marketplaces
/ 2-sided models
Marketplaces
/ 2-sided models
Amazon Approach:
1) Create loads of inventory
for longtail search
2) Create demand
3) Have shitloads of money.
4) Wait and win.
Boticca (aka Startup)
Approach:
1) Focus on one niche
Targetgroup
2) Create ā€œenoughā€
inventory with very few
sellers
3) Create demand
4) Create more demand
5) Add a few more sellers.
Repeat. Pray.
How to solve the
Chicken and Egg
Problem TL;DR:
You need very few
but very good and
happy chickens
to get a lot of eggs.
Btw: If the chickens
donā€™t come by
themselves, buy them.
Uber paid 30$/h to the
ļ¬rst drivers.
Ignore the ā€œminor
chickensā€, they come
anyway.
#scb13 ā€“ @andreasklinger
Framework: AARRR
Example Mobile App: Pusher2000
Trainer2peer pressure sport app (prelaunch ā€œbetaā€).
Rev channel: Trainers pay monthly fee.
Two sided => Segment AARRR for both sides (trainer/user)
Marketplace => Value = Transactions / Supplier
Social Software => DAU/MAU to see if activated users stay active
Chicken/Egg => You need a few very happy chickens for loads of eggs.
Activated User: More than two training sessions
Week/Week retention to see if public launch makes sense
Optimize retention: Interviews with Users that left
Measure Trainer Happiness Index
Pushups / User / Week to see if the core assumption (People will do
more pushups) is valid
#scb13 ā€“ @andreasklinger
Framework: AARRR
Groupwork
- What stage are you in?
Empathy Stickness Virality Revenue Scale
#scb13 ā€“ @andreasklinger
Framework: AARRR
Groupwork
- Deļ¬ne your AARRR Metrics!
Acquisition, Activation, Retention, Referral, Revenue
One KPI each. (e.g. User who xxxx)
#scb13 ā€“ @andreasklinger
Framework: AARRR
Groupwork
- Whatā€™s your current core metric.
Show & Tell.
@andreasklinger
The dirty side of metrics.
@andreasklinger
Metrics need to hurt
@andreasklinger
A Startup should always only focus on
one core metric to optimize.
Metrics need to hurt
Your dashboard should only show
metrics you are ashamed of.
@andreasklinger
Have two dashboards (example bufferApp):
A actionable board to work on your product
(eg. % people buffering tweets in week 2)
A vanity board one to show to investors and tell to the press
(eg. total amount of tweets buffered)
Metrics need to hurt
@andreasklinger
If you are not ashamed about the KPIs in
your product dashboard than something is
wrong.
Either you focus on the wrong KPIs.
OR you do not drill deep enough.
Metrics need to hurt
@andreasklinger
Example: Garmz/LOOKK
Great Numbers:
90% activation (activation = vote)
But they only voted for friends
instead of actually using the platform.
We drilled (not far) deeper:
Activation = Vote for 2 different designers. Boom. Pain.
Metrics need to hurt.
Metrics need to hurt
@andreasklinger
Letā€™s talk cash.
@andreasklinger
Letā€™s talk cash: Life Time Value (LTV)
Life Time = 1/Churn
Eg. 1 / 0.08 = 12.5 months
Average Revenue Per User (ARPU)
= Revenue / Amount of Users
Eg. 20.000ā‚¬ / 1500 = 13.33ā‚¬
LTV = ARPU * LifeTime
= 13.33ā‚¬ * 12.5 = 166.6666
@andreasklinger
Letā€™s talk cash: Customer Acquisition Costs
CAC = Total Acquisition Costs this month /
New Customers this month
Goal:
CAC < LTV even better: 2-3xCAC < LTV
@andreasklinger
MRR
Monthly Recurring
Revenue
Revenue Churn &
Qty Churn
Monitor Revenue
@andreasklinger
Source: www.usercycle.com
But how to make more money?
@andreasklinger
Big wins are often cheap.
source: thomas fuchs - www.metricsftw.com
Viral Distribution
@andreasklinger
Viral Distribution
3 kinds of virality
Product Inherent
A function of use. Eg. Dropbox sharing
Product Artiļ¬cial
Added to support behaviour. E.g.
Reward systems
Word of Mouth
Function of customer satisfaction.
Source: Lean Analytics
Viral Distribution
Invitation Rate = Invited people / inviters
eg. 1250 users invited 2000 people = 1.6
Acceptance Rate = Invited Signed-up / Invited total
eg. out of the 2000 people 580 signed up = 0.29
Viral Coefļ¬cient = Invitation Rate * Acceptance Rate
eg. 1.6 * 0.29 = 0.464
(every customer will bring half a customer additionally)
Viral Distribution
Important #1:
Unless your Growth Engine is Viral,
donā€™t focus early on Viral Factors.
Focus on retention/stickyness.
Important #2: Viral Cycle Time (time between recv
invite and sending invite) is extremely important.
eg. K = 2
Cycle Time: 2 days => 20 days = 20.470 users
Cycle Time: 1 day => 20 days = 20mio users
Source: http://www.forentrepreneurs.com/lessons-learnt-viral-marketing/
#scb13 ā€“ @andreasklinger
Churn is not what you think it is
@andreasklinger
#scb13 ā€“ @andreasklinger
Churn is not what you think it is
ā€œ5% Churnrate per monthā€
One of the highest churn reasons is expired
credit cards.
Sad Fact: People forget about you.
@andreasklinger
#scb13 ā€“ @andreasklinger
Churn is not what you think it is
People donā€™t
wake up and
suddenly want to
unsubscribe your
service...
ā€œOh.. itā€™s May 5th..
Better churn from that
random online startup i
found 2 months ago.ā€
@andreasklinger
#scb13 ā€“ @andreasklinger
Churn is not what you think it is
You loose them in the
ļ¬rst 3 weeks.
And then at some point just
remind them to unsubscribe.
Thatā€™s when we measure it (too
late).
Source: Intercom.io
#scb13 ā€“ @andreasklinger
Churn is not what you think it is
Source: Lean Analytics
#scb13 ā€“ @andreasklinger
Checkout Intercom.io
Segment + message customers = Awesome
User activation.
Some users are happy (power users)
Some come never again (churned users)
What differs them? Itā€™s their activities in their ļ¬rst 30 days.
@andreasklinger
Sub-funnels
ā€œWhat did the people do
that signed up,
before they signed up,
compare to those who didnā€™t?ā€
Source: Usercycle
#scb13 ā€“ @andreasklinger
How often did activated users
use twitter in the ļ¬rst month:
7 times
What did they do?
Follow 20 people, followed
back by 10
Churn:
If they donā€™t keep them 7 times
in the ļ¬rst 30 days.
They will lose them forever.
It doesnā€™t matter when a user
remembers to unsubscribe
Example Twitter
#scb13 ā€“ @andreasklinger
Example Twitter:
How did they get more people
to follow 30people within
7visits in the ļ¬rst 30 days?
Ran assumptions, created
features and ran experiments!
Watch: http://www.youtube.com/watch?v=L2snRPbhsF0
Example Twitter
Data is noisy.
@andreasklinger
source: thomas fuchs - www.metricsftw.com
Data is noisy.
source: thomas fuchs - www.metricsftw.com
Data is noisy.
source: thomas fuchs - www.metricsftw.com
Data is noisy.
source: thomas fuchs - www.metricsftw.com
Data is noisy.
source: thomas fuchs - www.metricsftw.com
Data is noisy.
Dataschmutz
A layer of dirt obfuscating
your useable data.
(~ sample noise we created ourselves)
Usually ā€œwrong intentā€.
Usually our fault.
@andreasklinger
Dataschmutz
A layer of dirt obfuscating
your useable data.
@andreasklinger
Dataschmutz
A layer of dirt obfuscating
your useable data.
e.g. Trafļ¬c Spikes of wrong
customer segment.
(wrong intent)
@andreasklinger
More ā€œwrongā€ people come.
Lower conversion rate on the
landing page.
How to minimize the impact of Dataschmutz
Base your KPIs on wavebreakers.
WK visitors acquisition activation retention referral revenue
Birchbox visit registration ļ¬rst photo
twice a
month
share ā€¦
1 6000 66% / 4000 62,5% 25% 10%
2 25000 35% / 8750 65% 23% 9%
3 5000 70%Ā / 3500 64% 26% 4%
Dataschmutz
MySugr
is praised as
ā€œbeautiful appā€
example.ā€¦
=> Downloads
=> Problem:
Not all are diabetic
They focus on people
who activated.
@andreasklinger
Competition Created
ā€œDataschmutzā€
* Users had huge extra incentive.
* Marketing can hurt your numbers.
* While we decided on how to
relaunch we had dirty numbers.
Dataschmutz
Competitions (before P/M Fit)
are nothing but Teļ¬‚on Marketing
People come. People leave.
They leave dirt in your database.
Competitions create artiļ¬cial incentive
ā€œWould you use my app and might
win 1.000.000 USD?ā€
@andreasklinger
Lean Analytics
@andreasklinger
Lean Analytics
@andreasklinger
Lean Analytics
Lean Analytics
Hypothesis: We believe that introducing a newsfeed
will increase interaction between users.
Track: Engagement between users (comments/likes)
Falsiļ¬able Hypothesis: People who visited the
newsfeed will give a 30% more comments and likes,
than people who didnā€™t.
Lean Analytics
Important #1:
Donā€™t forget to timebox experiments.
Important #2:
Worry less about statistical signiļ¬cance (while early stage).
Just use experiments to doublecheck your entrepreneurial
intuition.
AARRR misses something
@andreasklinger
Acquisition
Activation
Retention
Referral
Revenue
(c) Dave McClure
CUSTOMER INTENT
FULFILMENT OF CUSTOMER INTENT
Acquisition
Activation
Retention
Referral
Revenue
(c) Dave McClure
CUSTOMER INTENT (JOB)
FULFILMENT OF CUSTOMER INTENT
Customer
Interviews
Customer
Interviews
& Metrics
@andreasklinger
Thatā€™s you using metrics
ā€œLook ma, the light started blinkingā€
Metrics are horrible way to understand customer intent
Customer Intent = His ā€œJob to be doneā€
Watch: http://bit.ly/cc-jtbd
Products are bought because
they solve a ā€œjob to be doneā€.
Learn about Jobs to be done Framework
@andreasklinger
Metrics are horrible way to understand customer intent
Great Way: Customer Interviews
But: We bias our people,
when we ask them.
Even if we try not to.
Reason: we believe our
own bullshit.
Watch: www.hackertalks.io
Source: Lukas Fittl - http://speakerdeck.com/lļ¬ttl
#scb13 ā€“ @andreasklinger
Framework: AARRR
Groupwork.
- Draw your customer journey
- Pick a point where there is likely a problem
- Formulate assumption
- Formulate Success Criteria
Show & Tell.
@andreasklinger
@andreasklinger
Summary
Summary
- Use Metrics for Product and Customer Development.
- Use Cohorts.
- Use AARRR.
- Figure Customer Intent through non-biasing interviews.
- Understand your type of product and itā€™s core drivers
- Find KPIs that mean something to your speciļ¬c product.
- Avoid Telfonmarketing (eg Campaigns pre-product).
- Filter Dataschmutz
- Metrics need to hurt
- Focus on the ļ¬rst 30 days of customer activation.
- Connect Product Hypotheses to Metrics.
- Donā€™t hide behind numbers.
TL;DR: Use metrics to validate/doublecheck.
Use those insights when designing for/speaking to your customers.
Read on
Startup metrics for Pirates by Dave McClure
http://www.slideshare.net/dmc500hats/startup-metrics-for-pirates-long-version
Actionable Metrics by Ash Mauyra
http://www.ashmaurya.com/2010/07/3-rules-to-actionable-metrics/
Data Science Secrets by DJ Patil - LeWeb London 2012
http://www.youtube.com/watch?v=L2snRPbhsF0
Twitter sign up process
http://www.lukew.com/ff/entry.asp?1128
Lean startup metrics - @stueccles
http://www.slideshare.net/stueccles/lean-startup-metrics
Cohorts in Google Analytics - @serenestudios
http://danhilltech.tumblr.com/post/12509218078/startups-hacking-a-cohort-analysis-with-google
Rob Fitzpatrickā€™s Collection of best Custdev Videos - @robļ¬tz
http://www.hackertalks.io
Lean Analytics Book
http://leananalyticsbook.com/introducing-lean-analytics/
Actionable Metrics - @lļ¬ttl
http://www.slideshare.net/lļ¬ttl/actionable-metrics-lean-startup-meetup-berlin
App Engagement Matrix - Flurry
http://blog.ļ¬‚urry.com/bid/90743/App-Engagement-The-Matrix-Reloaded
My Blog
http://www.klinger.io
@andreasklinger
Thank you
@andreasklinger
Slides: http://slideshare.net/andreasklinger
All pictures: http://ļ¬‚ickr.com/commons
Liked it?
Tweet it.

More Related Content

What's hot

Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...
Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...
Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...MargoHowie
Ā 
Growth hacking secrets
Growth hacking secrets Growth hacking secrets
Growth hacking secrets alig12
Ā 
Google Sheets For SEO - Tom Pool - London SEO Meetup XL
Google Sheets For SEO - Tom Pool - London SEO Meetup XLGoogle Sheets For SEO - Tom Pool - London SEO Meetup XL
Google Sheets For SEO - Tom Pool - London SEO Meetup XLTom Pool
Ā 
brighton final.pptx
brighton final.pptxbrighton final.pptx
brighton final.pptxssuser152aeb
Ā 
SEO For Marketplaces: Overcoming Technical Challenges #WTSFest
SEO For Marketplaces: Overcoming Technical Challenges #WTSFestSEO For Marketplaces: Overcoming Technical Challenges #WTSFest
SEO For Marketplaces: Overcoming Technical Challenges #WTSFestAleyda SolĆ­s
Ā 
Creating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone UnderstandsCreating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone Understandsuxpin
Ā 
Product Development How To Develop A Product Line
Product Development How To Develop A Product LineProduct Development How To Develop A Product Line
Product Development How To Develop A Product LineRoland Frasier
Ā 
AI-powered Semantic SEO by Koray GUBUR
AI-powered Semantic SEO by Koray GUBURAI-powered Semantic SEO by Koray GUBUR
AI-powered Semantic SEO by Koray GUBURAnton Shulke
Ā 
Finding the one growth metric that matters
Finding the one growth metric that mattersFinding the one growth metric that matters
Finding the one growth metric that mattersSean Ellis
Ā 
How to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat Shah
How to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat ShahHow to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat Shah
How to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat ShahDaytodayebay
Ā 
DAX Digital Agency Expo Presentation Customer Experience
DAX Digital Agency Expo Presentation Customer ExperienceDAX Digital Agency Expo Presentation Customer Experience
DAX Digital Agency Expo Presentation Customer ExperienceRoland Frasier
Ā 
SEO, PPC and AI in 2023 and Beyond
SEO, PPC and AI in 2023 and BeyondSEO, PPC and AI in 2023 and Beyond
SEO, PPC and AI in 2023 and BeyondLily Ray
Ā 
Get inside your Buyers Head - Improve Funnel Conversion Rates
Get inside your Buyers Head - Improve Funnel Conversion RatesGet inside your Buyers Head - Improve Funnel Conversion Rates
Get inside your Buyers Head - Improve Funnel Conversion RatesDavid Skok
Ā 
A High Growth SaaS Playbook - 12 Metrics to Drive Success
A High Growth SaaS Playbook - 12 Metrics to Drive SuccessA High Growth SaaS Playbook - 12 Metrics to Drive Success
A High Growth SaaS Playbook - 12 Metrics to Drive SuccessSaaStock
Ā 
PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...
PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...
PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...LazarinaStoyanova
Ā 
How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...
How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...
How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...Kristina Azarenko
Ā 
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...Jason Evanish
Ā 
Growth Hacking / Marketing 101: It's about process
Growth Hacking / Marketing 101: It's about processGrowth Hacking / Marketing 101: It's about process
Growth Hacking / Marketing 101: It's about processRuben Hamilius
Ā 
How to categorise 100K search queries in 15 minutes - MeasureFest
How to categorise 100K search queries in 15 minutes - MeasureFestHow to categorise 100K search queries in 15 minutes - MeasureFest
How to categorise 100K search queries in 15 minutes - MeasureFestRichard Lawrence
Ā 
eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)
eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)
eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)Kristina Azarenko
Ā 

What's hot (20)

Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...
Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...
Commerce Platforms PDP Content Strategy: Amazon and Beyond - BrightonSEO Oct ...
Ā 
Growth hacking secrets
Growth hacking secrets Growth hacking secrets
Growth hacking secrets
Ā 
Google Sheets For SEO - Tom Pool - London SEO Meetup XL
Google Sheets For SEO - Tom Pool - London SEO Meetup XLGoogle Sheets For SEO - Tom Pool - London SEO Meetup XL
Google Sheets For SEO - Tom Pool - London SEO Meetup XL
Ā 
brighton final.pptx
brighton final.pptxbrighton final.pptx
brighton final.pptx
Ā 
SEO For Marketplaces: Overcoming Technical Challenges #WTSFest
SEO For Marketplaces: Overcoming Technical Challenges #WTSFestSEO For Marketplaces: Overcoming Technical Challenges #WTSFest
SEO For Marketplaces: Overcoming Technical Challenges #WTSFest
Ā 
Creating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone UnderstandsCreating Agile Product Roadmaps Everyone Understands
Creating Agile Product Roadmaps Everyone Understands
Ā 
Product Development How To Develop A Product Line
Product Development How To Develop A Product LineProduct Development How To Develop A Product Line
Product Development How To Develop A Product Line
Ā 
AI-powered Semantic SEO by Koray GUBUR
AI-powered Semantic SEO by Koray GUBURAI-powered Semantic SEO by Koray GUBUR
AI-powered Semantic SEO by Koray GUBUR
Ā 
Finding the one growth metric that matters
Finding the one growth metric that mattersFinding the one growth metric that matters
Finding the one growth metric that matters
Ā 
How to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat Shah
How to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat ShahHow to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat Shah
How to launch a NEW product successfully on Amazon | BrightonSEO | Prabhat Shah
Ā 
DAX Digital Agency Expo Presentation Customer Experience
DAX Digital Agency Expo Presentation Customer ExperienceDAX Digital Agency Expo Presentation Customer Experience
DAX Digital Agency Expo Presentation Customer Experience
Ā 
SEO, PPC and AI in 2023 and Beyond
SEO, PPC and AI in 2023 and BeyondSEO, PPC and AI in 2023 and Beyond
SEO, PPC and AI in 2023 and Beyond
Ā 
Get inside your Buyers Head - Improve Funnel Conversion Rates
Get inside your Buyers Head - Improve Funnel Conversion RatesGet inside your Buyers Head - Improve Funnel Conversion Rates
Get inside your Buyers Head - Improve Funnel Conversion Rates
Ā 
A High Growth SaaS Playbook - 12 Metrics to Drive Success
A High Growth SaaS Playbook - 12 Metrics to Drive SuccessA High Growth SaaS Playbook - 12 Metrics to Drive Success
A High Growth SaaS Playbook - 12 Metrics to Drive Success
Ā 
PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...
PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...
PubCon, Lazarina Stoy. - Machine Learning in Search: Google's ML APIs vs Open...
Ā 
How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...
How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...
How Online Stores Can Quickly Build Sub-categories Targeting Long-tail Keywor...
Ā 
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
Ā 
Growth Hacking / Marketing 101: It's about process
Growth Hacking / Marketing 101: It's about processGrowth Hacking / Marketing 101: It's about process
Growth Hacking / Marketing 101: It's about process
Ā 
How to categorise 100K search queries in 15 minutes - MeasureFest
How to categorise 100K search queries in 15 minutes - MeasureFestHow to categorise 100K search queries in 15 minutes - MeasureFest
How to categorise 100K search queries in 15 minutes - MeasureFest
Ā 
eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)
eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)
eCommerce Internal Linking - Into the Spider-Verse (BrightonSEO edition)
Ā 

Viewers also liked

Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)Geeks On A Plane
Ā 
Dropbox Startup Lessons Learned
Dropbox Startup Lessons LearnedDropbox Startup Lessons Learned
Dropbox Startup Lessons Learnedgueste94e4c
Ā 
Startup Metrics for Pirates
Startup Metrics for PiratesStartup Metrics for Pirates
Startup Metrics for PiratesDave McClure
Ā 
Actionable Metrics @ Lean Startup Meetup Berlin
Actionable Metrics @ Lean Startup Meetup BerlinActionable Metrics @ Lean Startup Meetup Berlin
Actionable Metrics @ Lean Startup Meetup BerlinLukas Fittl
Ā 
Dropbox startup lessons learned 2011
Dropbox   startup lessons learned 2011Dropbox   startup lessons learned 2011
Dropbox startup lessons learned 2011Eric Ries
Ā 
Growth Hacking Guide - Mindset, Framework and Tools
Growth Hacking Guide - Mindset, Framework and ToolsGrowth Hacking Guide - Mindset, Framework and Tools
Growth Hacking Guide - Mindset, Framework and ToolsDavid Arnoux . Growth
Ā 
Lean UX: Getting out of the deliverables business
Lean UX: Getting out of the deliverables businessLean UX: Getting out of the deliverables business
Lean UX: Getting out of the deliverables businessJeff Gothelf
Ā 
Lean Analytics Cycle
Lean Analytics CycleLean Analytics Cycle
Lean Analytics CycleHiten Shah
Ā 

Viewers also liked (9)

Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Ā 
Ultimate Guide to SaaS Pricing
Ultimate Guide to SaaS PricingUltimate Guide to SaaS Pricing
Ultimate Guide to SaaS Pricing
Ā 
Dropbox Startup Lessons Learned
Dropbox Startup Lessons LearnedDropbox Startup Lessons Learned
Dropbox Startup Lessons Learned
Ā 
Startup Metrics for Pirates
Startup Metrics for PiratesStartup Metrics for Pirates
Startup Metrics for Pirates
Ā 
Actionable Metrics @ Lean Startup Meetup Berlin
Actionable Metrics @ Lean Startup Meetup BerlinActionable Metrics @ Lean Startup Meetup Berlin
Actionable Metrics @ Lean Startup Meetup Berlin
Ā 
Dropbox startup lessons learned 2011
Dropbox   startup lessons learned 2011Dropbox   startup lessons learned 2011
Dropbox startup lessons learned 2011
Ā 
Growth Hacking Guide - Mindset, Framework and Tools
Growth Hacking Guide - Mindset, Framework and ToolsGrowth Hacking Guide - Mindset, Framework and Tools
Growth Hacking Guide - Mindset, Framework and Tools
Ā 
Lean UX: Getting out of the deliverables business
Lean UX: Getting out of the deliverables businessLean UX: Getting out of the deliverables business
Lean UX: Getting out of the deliverables business
Ā 
Lean Analytics Cycle
Lean Analytics CycleLean Analytics Cycle
Lean Analytics Cycle
Ā 

Similar to Startup Product Metrics Before Fit

Alistaire croll lean analytics - montreal lean startup circle - september 2018
Alistaire croll   lean analytics - montreal lean startup circle - september 2018Alistaire croll   lean analytics - montreal lean startup circle - september 2018
Alistaire croll lean analytics - montreal lean startup circle - september 2018Lean Startup Circle Montreal
Ā 
Analytics for Startups - Dublin Web Summit 2015
Analytics for Startups - Dublin Web Summit 2015Analytics for Startups - Dublin Web Summit 2015
Analytics for Startups - Dublin Web Summit 2015Andy Young
Ā 
Forget your feelings: How to actually quantify your buyer personas - SaaSFest...
Forget your feelings: How to actually quantify your buyer personas - SaaSFest...Forget your feelings: How to actually quantify your buyer personas - SaaSFest...
Forget your feelings: How to actually quantify your buyer personas - SaaSFest...Price Intelligently
Ā 
Design, the Importance of Research, and a Call to Arms
Design, the Importance of Research, and a Call to ArmsDesign, the Importance of Research, and a Call to Arms
Design, the Importance of Research, and a Call to ArmsDesignMap
Ā 
Growth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-YoungGrowth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-YoungMattan Griffel
Ā 
User Centered Analytics: Superweek 2015
User Centered Analytics: Superweek 2015User Centered Analytics: Superweek 2015
User Centered Analytics: Superweek 2015Tim Leighton-Boyce
Ā 
The Future of Technical Communication is Marketing
The Future of Technical Communication is MarketingThe Future of Technical Communication is Marketing
The Future of Technical Communication is MarketingScott Abel
Ā 
Lean Analytics & Analytics Dashboards
Lean Analytics & Analytics DashboardsLean Analytics & Analytics Dashboards
Lean Analytics & Analytics DashboardsYves Ferket
Ā 
How to become Data Driven for startups - keboola
How to become Data Driven for startups - keboolaHow to become Data Driven for startups - keboola
How to become Data Driven for startups - keboolaPavel Dolezal
Ā 
Actionable Customer Development
Actionable Customer DevelopmentActionable Customer Development
Actionable Customer DevelopmentAndreas Klinger
Ā 
20 top AB testing mistakes and how to avoid them
20 top AB testing mistakes and how to avoid them20 top AB testing mistakes and how to avoid them
20 top AB testing mistakes and how to avoid themCraig Sullivan
Ā 
Einstein Analytics Prediction Builder
Einstein Analytics Prediction BuilderEinstein Analytics Prediction Builder
Einstein Analytics Prediction Builderrikkehovgaard
Ā 
Intro To Lean Startup (8 Oct 2015)
Intro To Lean Startup (8 Oct 2015)Intro To Lean Startup (8 Oct 2015)
Intro To Lean Startup (8 Oct 2015)Mai Quay
Ā 
Intro Lean Startup
Intro Lean StartupIntro Lean Startup
Intro Lean StartupPouya Kondori
Ā 
Funnels Workshop Web Summit 2014 @geckoboard @GA
Funnels Workshop Web Summit 2014 @geckoboard @GAFunnels Workshop Web Summit 2014 @geckoboard @GA
Funnels Workshop Web Summit 2014 @geckoboard @GASofia Quintero
Ā 
Startup Next Seattle - Product Market Fit by Joanna Lord
Startup Next Seattle - Product Market Fit by Joanna LordStartup Next Seattle - Product Market Fit by Joanna Lord
Startup Next Seattle - Product Market Fit by Joanna LordStartup Next
Ā 
LTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdfLTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdfjeroen_tjepkema
Ā 
Mass Conversions | Product Mix | Conversion Optimization
Mass Conversions | Product Mix | Conversion OptimizationMass Conversions | Product Mix | Conversion Optimization
Mass Conversions | Product Mix | Conversion OptimizationRoland Frasier
Ā 

Similar to Startup Product Metrics Before Fit (20)

Alistaire croll lean analytics - montreal lean startup circle - september 2018
Alistaire croll   lean analytics - montreal lean startup circle - september 2018Alistaire croll   lean analytics - montreal lean startup circle - september 2018
Alistaire croll lean analytics - montreal lean startup circle - september 2018
Ā 
Analytics for Startups - Dublin Web Summit 2015
Analytics for Startups - Dublin Web Summit 2015Analytics for Startups - Dublin Web Summit 2015
Analytics for Startups - Dublin Web Summit 2015
Ā 
Forget your feelings: How to actually quantify your buyer personas - SaaSFest...
Forget your feelings: How to actually quantify your buyer personas - SaaSFest...Forget your feelings: How to actually quantify your buyer personas - SaaSFest...
Forget your feelings: How to actually quantify your buyer personas - SaaSFest...
Ā 
Design, the Importance of Research, and a Call to Arms
Design, the Importance of Research, and a Call to ArmsDesign, the Importance of Research, and a Call to Arms
Design, the Importance of Research, and a Call to Arms
Ā 
Beyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish
Beyond the Button: Tests that actually move the needle - Karen Hopper, RazorfishBeyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish
Beyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish
Ā 
Growth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-YoungGrowth Hacking with Cassie Lancellotti-Young
Growth Hacking with Cassie Lancellotti-Young
Ā 
User Centered Analytics: Superweek 2015
User Centered Analytics: Superweek 2015User Centered Analytics: Superweek 2015
User Centered Analytics: Superweek 2015
Ā 
The Future of Technical Communication is Marketing
The Future of Technical Communication is MarketingThe Future of Technical Communication is Marketing
The Future of Technical Communication is Marketing
Ā 
Lean ing
Lean   ingLean   ing
Lean ing
Ā 
Lean Analytics & Analytics Dashboards
Lean Analytics & Analytics DashboardsLean Analytics & Analytics Dashboards
Lean Analytics & Analytics Dashboards
Ā 
How to become Data Driven for startups - keboola
How to become Data Driven for startups - keboolaHow to become Data Driven for startups - keboola
How to become Data Driven for startups - keboola
Ā 
Actionable Customer Development
Actionable Customer DevelopmentActionable Customer Development
Actionable Customer Development
Ā 
20 top AB testing mistakes and how to avoid them
20 top AB testing mistakes and how to avoid them20 top AB testing mistakes and how to avoid them
20 top AB testing mistakes and how to avoid them
Ā 
Einstein Analytics Prediction Builder
Einstein Analytics Prediction BuilderEinstein Analytics Prediction Builder
Einstein Analytics Prediction Builder
Ā 
Intro To Lean Startup (8 Oct 2015)
Intro To Lean Startup (8 Oct 2015)Intro To Lean Startup (8 Oct 2015)
Intro To Lean Startup (8 Oct 2015)
Ā 
Intro Lean Startup
Intro Lean StartupIntro Lean Startup
Intro Lean Startup
Ā 
Funnels Workshop Web Summit 2014 @geckoboard @GA
Funnels Workshop Web Summit 2014 @geckoboard @GAFunnels Workshop Web Summit 2014 @geckoboard @GA
Funnels Workshop Web Summit 2014 @geckoboard @GA
Ā 
Startup Next Seattle - Product Market Fit by Joanna Lord
Startup Next Seattle - Product Market Fit by Joanna LordStartup Next Seattle - Product Market Fit by Joanna Lord
Startup Next Seattle - Product Market Fit by Joanna Lord
Ā 
LTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdfLTK - FC - Supply Chain - Startup Challenge v3.pdf
LTK - FC - Supply Chain - Startup Challenge v3.pdf
Ā 
Mass Conversions | Product Mix | Conversion Optimization
Mass Conversions | Product Mix | Conversion OptimizationMass Conversions | Product Mix | Conversion Optimization
Mass Conversions | Product Mix | Conversion Optimization
Ā 

More from Andreas Klinger

I started a VC fund - here is what happened
I started a VC fund - here is what happenedI started a VC fund - here is what happened
I started a VC fund - here is what happenedAndreas Klinger
Ā 
Engineering Management in Remote teams
Engineering Management in Remote teamsEngineering Management in Remote teams
Engineering Management in Remote teamsAndreas Klinger
Ā 
Engineering Management for Early Stage Startups
Engineering Management for Early Stage StartupsEngineering Management for Early Stage Startups
Engineering Management for Early Stage StartupsAndreas Klinger
Ā 
Metrics for early stage startups
Metrics for early stage startupsMetrics for early stage startups
Metrics for early stage startupsAndreas Klinger
Ā 
Lessons Learned: Pace, Focus, Niche and Investments - Startup Live Vienna
Lessons Learned: Pace, Focus, Niche and Investments - Startup Live ViennaLessons Learned: Pace, Focus, Niche and Investments - Startup Live Vienna
Lessons Learned: Pace, Focus, Niche and Investments - Startup Live ViennaAndreas Klinger
Ā 
Founders - why we do what we do - and why this sucks.
Founders - why we do what we do - and why this sucks.Founders - why we do what we do - and why this sucks.
Founders - why we do what we do - and why this sucks.Andreas Klinger
Ā 
Metrics in early stage startups - Leancamp Berlin
Metrics in early stage startups - Leancamp Berlin Metrics in early stage startups - Leancamp Berlin
Metrics in early stage startups - Leancamp Berlin Andreas Klinger
Ā 
Co-Founders - short lessons learned
Co-Founders - short lessons learnedCo-Founders - short lessons learned
Co-Founders - short lessons learnedAndreas Klinger
Ā 
Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...
Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...
Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...Andreas Klinger
Ā 
Sh*t I wish I'd known before - Startup Lessons Learned
Sh*t I wish I'd known before - Startup Lessons LearnedSh*t I wish I'd known before - Startup Lessons Learned
Sh*t I wish I'd known before - Startup Lessons LearnedAndreas Klinger
Ā 
A Nerded View On Fashion - Lean Startup for Fashion Labels
A Nerded View On Fashion - Lean Startup for Fashion LabelsA Nerded View On Fashion - Lean Startup for Fashion Labels
A Nerded View On Fashion - Lean Startup for Fashion LabelsAndreas Klinger
Ā 
StartUp Metrics Lesson Learned - LeanCamp Barcelona
StartUp Metrics Lesson Learned - LeanCamp BarcelonaStartUp Metrics Lesson Learned - LeanCamp Barcelona
StartUp Metrics Lesson Learned - LeanCamp BarcelonaAndreas Klinger
Ā 
Metrics - Lessons Learned - LeanCamp London 2012
Metrics - Lessons Learned - LeanCamp London 2012Metrics - Lessons Learned - LeanCamp London 2012
Metrics - Lessons Learned - LeanCamp London 2012Andreas Klinger
Ā 
Metrics: Lessons Learned - Killing your pre market product illusions
Metrics: Lessons Learned - Killing your pre market product illusionsMetrics: Lessons Learned - Killing your pre market product illusions
Metrics: Lessons Learned - Killing your pre market product illusionsAndreas Klinger
Ā 
Fashion & Internet - REVOLUTION!
Fashion & Internet - REVOLUTION!Fashion & Internet - REVOLUTION!
Fashion & Internet - REVOLUTION!Andreas Klinger
Ā 
Socialisten Summit09
Socialisten Summit09Socialisten Summit09
Socialisten Summit09Andreas Klinger
Ā 
The Future of Blog Formats
The Future of Blog FormatsThe Future of Blog Formats
The Future of Blog FormatsAndreas Klinger
Ā 
My TopFriend is Nike
My TopFriend is NikeMy TopFriend is Nike
My TopFriend is NikeAndreas Klinger
Ā 
Ideas to make mjam more delicious
Ideas to make mjam more deliciousIdeas to make mjam more delicious
Ideas to make mjam more deliciousAndreas Klinger
Ā 

More from Andreas Klinger (20)

I started a VC fund - here is what happened
I started a VC fund - here is what happenedI started a VC fund - here is what happened
I started a VC fund - here is what happened
Ā 
Engineering Management in Remote teams
Engineering Management in Remote teamsEngineering Management in Remote teams
Engineering Management in Remote teams
Ā 
Engineering Management for Early Stage Startups
Engineering Management for Early Stage StartupsEngineering Management for Early Stage Startups
Engineering Management for Early Stage Startups
Ā 
Metrics for early stage startups
Metrics for early stage startupsMetrics for early stage startups
Metrics for early stage startups
Ā 
Lessons Learned: Pace, Focus, Niche and Investments - Startup Live Vienna
Lessons Learned: Pace, Focus, Niche and Investments - Startup Live ViennaLessons Learned: Pace, Focus, Niche and Investments - Startup Live Vienna
Lessons Learned: Pace, Focus, Niche and Investments - Startup Live Vienna
Ā 
Founders - why we do what we do - and why this sucks.
Founders - why we do what we do - and why this sucks.Founders - why we do what we do - and why this sucks.
Founders - why we do what we do - and why this sucks.
Ā 
Metrics in early stage startups - Leancamp Berlin
Metrics in early stage startups - Leancamp Berlin Metrics in early stage startups - Leancamp Berlin
Metrics in early stage startups - Leancamp Berlin
Ā 
Co-Founders - short lessons learned
Co-Founders - short lessons learnedCo-Founders - short lessons learned
Co-Founders - short lessons learned
Ā 
Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...
Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...
Applying Lean to existing teams and other lessons learned @ Lean Startup Mach...
Ā 
Sh*t I wish I'd known before - Startup Lessons Learned
Sh*t I wish I'd known before - Startup Lessons LearnedSh*t I wish I'd known before - Startup Lessons Learned
Sh*t I wish I'd known before - Startup Lessons Learned
Ā 
A Nerded View On Fashion - Lean Startup for Fashion Labels
A Nerded View On Fashion - Lean Startup for Fashion LabelsA Nerded View On Fashion - Lean Startup for Fashion Labels
A Nerded View On Fashion - Lean Startup for Fashion Labels
Ā 
StartUp Metrics Lesson Learned - LeanCamp Barcelona
StartUp Metrics Lesson Learned - LeanCamp BarcelonaStartUp Metrics Lesson Learned - LeanCamp Barcelona
StartUp Metrics Lesson Learned - LeanCamp Barcelona
Ā 
Metrics - Lessons Learned - LeanCamp London 2012
Metrics - Lessons Learned - LeanCamp London 2012Metrics - Lessons Learned - LeanCamp London 2012
Metrics - Lessons Learned - LeanCamp London 2012
Ā 
Metrics: Lessons Learned - Killing your pre market product illusions
Metrics: Lessons Learned - Killing your pre market product illusionsMetrics: Lessons Learned - Killing your pre market product illusions
Metrics: Lessons Learned - Killing your pre market product illusions
Ā 
Lessons learned
Lessons learnedLessons learned
Lessons learned
Ā 
Fashion & Internet - REVOLUTION!
Fashion & Internet - REVOLUTION!Fashion & Internet - REVOLUTION!
Fashion & Internet - REVOLUTION!
Ā 
Socialisten Summit09
Socialisten Summit09Socialisten Summit09
Socialisten Summit09
Ā 
The Future of Blog Formats
The Future of Blog FormatsThe Future of Blog Formats
The Future of Blog Formats
Ā 
My TopFriend is Nike
My TopFriend is NikeMy TopFriend is Nike
My TopFriend is Nike
Ā 
Ideas to make mjam more delicious
Ideas to make mjam more deliciousIdeas to make mjam more delicious
Ideas to make mjam more delicious
Ā 

Recently uploaded

Grateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdfGrateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdfPaul Menig
Ā 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.Aaiza Hassan
Ā 
(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR
(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR
(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCRsoniya singh
Ā 
Call Girls Miyapur 7001305949 all area service COD available Any Time
Call Girls Miyapur 7001305949 all area service COD available Any TimeCall Girls Miyapur 7001305949 all area service COD available Any Time
Call Girls Miyapur 7001305949 all area service COD available Any Timedelhimodelshub1
Ā 
VIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130 Available With Room
VIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130  Available With RoomVIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130  Available With Room
VIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130 Available With Roomdivyansh0kumar0
Ā 
Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...lizamodels9
Ā 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Servicediscovermytutordmt
Ā 
Marketing Management Business Plan_My Sweet Creations
Marketing Management Business Plan_My Sweet CreationsMarketing Management Business Plan_My Sweet Creations
Marketing Management Business Plan_My Sweet Creationsnakalysalcedo61
Ā 
The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024christinemoorman
Ā 
Lean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ Abridged
Lean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ AbridgedLean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ Abridged
Lean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ AbridgedKaiNexus
Ā 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear RegressionRavindra Nath Shukla
Ā 
FULL ENJOY - 9953040155 Call Girls in Chhatarpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Chhatarpur | DelhiFULL ENJOY - 9953040155 Call Girls in Chhatarpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Chhatarpur | DelhiMalviyaNagarCallGirl
Ā 
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts ServiceVip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Serviceankitnayak356677
Ā 
BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,
BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,
BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,noida100girls
Ā 
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth MarketingShawn Pang
Ā 
RE Capital's Visionary Leadership under Newman Leech
RE Capital's Visionary Leadership under Newman LeechRE Capital's Visionary Leadership under Newman Leech
RE Capital's Visionary Leadership under Newman LeechNewman George Leech
Ā 
Catalogue ONG NUOC PPR DE NHAT .pdf
Catalogue ONG NUOC PPR DE NHAT      .pdfCatalogue ONG NUOC PPR DE NHAT      .pdf
Catalogue ONG NUOC PPR DE NHAT .pdfOrient Homes
Ā 
Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.Eni
Ā 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Dipal Arora
Ā 
Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...anilsa9823
Ā 

Recently uploaded (20)

Grateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdfGrateful 7 speech thanking everyone that has helped.pdf
Grateful 7 speech thanking everyone that has helped.pdf
Ā 
M.C Lodges -- Guest House in Jhang.
M.C Lodges --  Guest House in Jhang.M.C Lodges --  Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.
Ā 
(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR
(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR
(8264348440) šŸ” Call Girls In Mahipalpur šŸ” Delhi NCR
Ā 
Call Girls Miyapur 7001305949 all area service COD available Any Time
Call Girls Miyapur 7001305949 all area service COD available Any TimeCall Girls Miyapur 7001305949 all area service COD available Any Time
Call Girls Miyapur 7001305949 all area service COD available Any Time
Ā 
VIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130 Available With Room
VIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130  Available With RoomVIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130  Available With Room
VIP Kolkata Call Girl Howrah šŸ‘‰ 8250192130 Available With Room
Ā 
Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ā¤ļø8860477959_Russian 100% Genuine Escorts I...
Ā 
Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Service
Ā 
Marketing Management Business Plan_My Sweet Creations
Marketing Management Business Plan_My Sweet CreationsMarketing Management Business Plan_My Sweet Creations
Marketing Management Business Plan_My Sweet Creations
Ā 
The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024
Ā 
Lean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ Abridged
Lean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ AbridgedLean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ Abridged
Lean: From Theory to Practice ā€” One Cityā€™s (and Libraryā€™s) Lean Storyā€¦ Abridged
Ā 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear Regression
Ā 
FULL ENJOY - 9953040155 Call Girls in Chhatarpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Chhatarpur | DelhiFULL ENJOY - 9953040155 Call Girls in Chhatarpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Chhatarpur | Delhi
Ā 
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts ServiceVip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Vip Female Escorts Noida 9711199171 Greater Noida Escorts Service
Ā 
BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,
BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,
BEST Call Girls In Greater Noida āœØ 9773824855 āœØ Escorts Service In Delhi Ncr,
Ā 
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Ā 
RE Capital's Visionary Leadership under Newman Leech
RE Capital's Visionary Leadership under Newman LeechRE Capital's Visionary Leadership under Newman Leech
RE Capital's Visionary Leadership under Newman Leech
Ā 
Catalogue ONG NUOC PPR DE NHAT .pdf
Catalogue ONG NUOC PPR DE NHAT      .pdfCatalogue ONG NUOC PPR DE NHAT      .pdf
Catalogue ONG NUOC PPR DE NHAT .pdf
Ā 
Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.Eni 2024 1Q Results - 24.04.24 business.
Eni 2024 1Q Results - 24.04.24 business.
Ā 
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Navi Mumbai Just Call 9907093804 Top Class Call Girl Service Avail...
Ā 
Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Lucknow šŸ’‹ Escorts in Lucknow - 450+ Call Girl Cash Payment 8923113531 Neha Th...
Ā 

Startup Product Metrics Before Fit

  • 1. Startup Metrics, a love story. Everything you need to know about Startup Product Metrics. #iCatapult Workshop - 2013-08-12 Slideshare Exclusive: The full Powerdeck. ;) @andreasklinger
  • 3. @andreasklinger ā€œStartup Founderā€ ā€œProduct Guyā€ What we will cover - Early Stage Metrics (Pre Product Market Fit). - Create your dashboard & customer journey map. - Wrong assumptions on Metrics - Lean Analytics & Advanced Topics @andreasklinger
  • 4. #emminvest ā€“ @andreasklinger The Biggest Risk of a Startup?
  • 5. #emminvest ā€“ @andreasklinger The Biggest Risk of a Startup? Time/Money? No You will learn a lot + huge network gain.
  • 6. #emminvest ā€“ @andreasklinger Building ALMOST the right thing. The Biggest Risk of a Startup? Seeing the successful new competitor who does what you do, but has one little detail different that you never focused on.
  • 7. ā€œStartups donā€™t fail because they lack a product; they fail because they lack customers and a proļ¬table business modelā€ Steve Blank And it might have been where you didnā€™t look. @andreasklinger
  • 8. Market Your Solution Customer Job/Problem Willing to pay To miss your opportunity. By focusing on the wrong thing. @andreasklinger
  • 11. Some startups have ideas for a new product. Looking for customers to buy (or at least use) it. Customers donā€™t buy. ā€œearly stageā€ @andreasklinger
  • 12. traction time Product/Market Fit With early stage I do not mean ā€œX Yearsā€ I mean before product/market ļ¬t. @andreasklinger
  • 13. Product/market ļ¬t Being in a good market with a product that can satisfy that market. ~ Marc Andreessen @andreasklinger
  • 14. Product/market ļ¬t Being in a good market with a product that can satisfy that market. ~ Marc Andreessen = People want your stuff. @andreasklinger
  • 16. Discovery traction time Validation Efļ¬ciency Scale Product/Market Fit Steve Blank - Customer Development @andreasklinger
  • 17. traction time Empathy Stickness Virality Revenue Product/Market Fit Ben Yoskovitz, Alistair Croll - Lean Analytics Scale @andreasklinger
  • 18. traction time Product/Market Fit Find a product the market wants. Empathy Stickness Virality Revenue Scale @andreasklinger
  • 19. traction time Product/Market Fit Find a product the market wants. Optimise the product for the market. Empathy Stickness Virality Revenue Scale @andreasklinger
  • 20. traction time Product/Market Fit Find a product the market wants. Optimise the product for the market. Most clones start here. People in search for new product start here. Empathy Stickness Virality Revenue Scale @andreasklinger
  • 21. traction time Product/Market Fit Product & Customer Development Scale Marketing & Operations Empathy Stickness Virality Revenue Scale @andreasklinger
  • 22. traction time Product/Market Fit Startups have phases but they overlap. Empathy Stickness Virality Revenue Scale @andreasklinger
  • 23. traction time Product/Market Fit 83% of all startups are in here. Empathy Stickness Virality Revenue Scale @andreasklinger
  • 24. traction time Product/Market Fit 83% of all startups are in here. Most stuff we learn about web analytics is meant for this part Empathy Stickness Virality Revenue Scale @andreasklinger
  • 25. Most of the techniques/pattern we ļ¬nd when we look to learn about metrics come out from Online Marketing @andreasklinger
  • 26. A/B Testing, Funnels, Referral Optimization, etc etc They are about optimizing, not innovating @andreasklinger
  • 27. What are we testing here? @andreasklinger
  • 28. What are we testing here? Value Proposition, Communication. Maybe Channels, Target Group. Not the product implementation. @andreasklinger
  • 29. We need product insights. @andreasklinger
  • 30. Good news: We donā€™t need many people Itā€™s too early for optimizations. Challenge #1: Get them to stay. @andreasklinger
  • 31.
  • 33. What does this mean for my product? Are we even on the right track?
  • 34. eg. What is a good Time on Site? Maybe users spend time reading your support pages just because they are super confused.
  • 35. Google Analytics is meant for Referral Optimization. Where does trafļ¬c come from? Is this trafļ¬c of value?
  • 36. What does it mean anyway? @andreasklinger
  • 37. What does it mean anyway? ā€œWe have 50k registered users!ā€ Do they still use the service? Are they the right people? ā€œWe have 5000 newsletter signups!ā€ Do they react? Are they potential customers? ā€œWe have 500k app downloads!ā€ Do they still use the app? @andreasklinger
  • 38. Some graphs always go up. Vanity. Use it for the Press. Not for your product. @andreasklinger
  • 39. Itā€™s easy to improve conversions (of the wrong people) Source: http://www.codinghorror.com/blog/2009/07/how-not-to-advertise-on-the-internet.html @andreasklinger
  • 40. Itā€™s easy to improve conversions (of the wrong people) This is a real example. Thank the Internet. Source: http://www.codinghorror.com/blog/2009/07/how-not-to-advertise-on-the-internet.html @andreasklinger
  • 41. The same is true for funnels. Itā€™s easy to optimize by pushing the wrong people forward. Disclaimer: this is not a real example. btw newrelic is awesome ;) @andreasklinger
  • 42. The same is true for funnels. Itā€™s easy to optimize by pushing the wrong people forward. Disclaimer: this is not a real example. btw newrelic is awesome ;) @andreasklinger
  • 43. why early stage metrics suck. small something Most likely ā€œSmall Dataā€ Early Stage Product Metrics suck: - We have the wrong product - With the wrong communication - Attacting the wrong targetgroup - Who provide us too few datapoints @andreasklinger
  • 44. Early stage product metrics get easily affected by external trafļ¬c. One of our main goals is to minimize that effect. @andreasklinger
  • 45. Values: 0, 0, 0, 100 Whatā€™s the average? #1 @andreasklinger
  • 46. Values: 0, 0, 0, 100 Whatā€™s the average? 25 Whatā€™s the median? #1 @andreasklinger
  • 47. #scb13 ā€“ @andreasklinger Values: 0, 0, 0, 100 Whatā€™s the average? 25 Whatā€™s the median? 0 Eg. ā€œAverage Interactionsā€ can be Bollocks #1
  • 48. #scb13 ā€“ @andreasklinger Values: 0, 0, 0, 100 Whatā€™s the average? 25 Whatā€™s the median? 0 Eg. ā€œAverage Interactionsā€ can be Bollocks #1
  • 49. Values: 0, 5, 10 Whatā€™s the average? #2 @andreasklinger
  • 50. #scb13 ā€“ @andreasklinger Values: 0, 5, 10 Whatā€™s the average? 5 Whatā€™s the standard deviation? 4,08 => ā€œAverageā€ hides information. #2
  • 51. ā€œThis is not statistical signiļ¬cant.ā€ I donā€™t care. We are anyway playing dart in a dark room. Letā€™s try to get it as good as possible and use our intuation for the rest. #3 @andreasklinger
  • 52. #scb13 ā€“ @andreasklinger Correlation / Causality Source: Lean Analytics
  • 54. How can we use metrics? @andreasklinger
  • 55. How can we use metrics? To Explore (Examples) Investigate an assumption. Look for causalities. Validate customer feedback. Validate internal opinions. To Report (Examples) Measure Progress. (Accounting) Measure Feature Impact. See customer happiness/ health. @andreasklinger
  • 56. What do i measure? TL;DR: In case of doubt, people. Hits Visits Visitors People Views Clicks Page Views Conversions Engagement @andreasklinger
  • 57. #scb13 ā€“ @andreasklinger Framework: AARRR Linked to assumptions of your product (validation/falsify) What are good KPIs?
  • 58. #scb13 ā€“ @andreasklinger Framework: AARRR Rate or Ratio (0.X or %) What are good KPIs?
  • 59. #scb13 ā€“ @andreasklinger Framework: AARRR Comparable (To your history (or a/b). Forget the market) What are good KPIs?
  • 60. #scb13 ā€“ @andreasklinger Framework: AARRR Explainable (If you donā€™t get it it means nothing) What are good KPIs?
  • 61. #scb13 ā€“ @andreasklinger Framework: AARRR Explainable (If you donā€™t get it it means nothing) What are good KPIs? Linked to assumptions of your product (validation/falsify) Rate or Ratio (0.X or %) Comparable (To your history (or a/b). Forget the market)
  • 62. #scb13 ā€“ @andreasklinger Framework: AARRR ā€œIndustry Standardsā€ Use industry averages as reality check. Not as benchmark. - Usually very hard to get. - Everyone deļ¬nes stuff different. - You might end up with another business model anyway. - Compare yourself vs your history data.
  • 64. Segment Users into Cohorts Cohorts = Groups of people that share attributes. @andreasklinger
  • 65. Segment Users into Cohorts Like it People 23% @andreasklinger
  • 66. Segment Users into Cohorts Like it People 0-25 3% People 26-50 4% People 51-75 65% @andreasklinger
  • 67. Segment Users into Cohorts Average Spending Jan ā‚¬5 Feb ā‚¬4.5 Mar ā‚¬5 Apr ā‚¬4.25 May ā‚¬4.5 ... ... Averages can hide patterns. @andreasklinger
  • 68. Segment Users into Cohorts 1 2 3 4 5 Jan ā‚¬5 ā‚¬3 ā‚¬2 ā‚¬1 ā‚¬0.5 Feb ā‚¬6 ā‚¬4 ā‚¬2 ā‚¬1 Mar ā‚¬7 ā‚¬6 ā‚¬5 Apr ā‚¬8 ā‚¬7 May ā‚¬9 ... ... Registration Month Month Lifecycle Insight: Users spend less over time in average. We still donā€™t know if they spend less, or if less people spend at all. @andreasklinger
  • 69. Apply a framework: AARRR @andreasklinger
  • 70. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned (c) Dave McClure
  • 71. Example: Blossom.io Kanban Project Mangement Tool created a card Activation moved a card Retention invited team members Referral have upgraded Revenue (people who) registered an account Acquisition
  • 72. Example: Photoapp created ļ¬rst photo Activation opened app twice in perioid Retention shared photo to fb Referral ??? (exit?) Revenue (people who) registered an account Acquisition
  • 73. Example: Photoapp ARRR acquisition activation retention referral revenue registration ļ¬rst photo twice a month share ā€¦ 8750 65% 23% 9%
  • 74. WK acquisition activation retention referral revenue Photoapp registration ļ¬rst photo twice a month share ā€¦ 1 400 62,5% 25% 10% 2 575 65% 23% 9% 3 350 64% 26% 4% ā€¦ ā€¦ ā€¦ ā€¦ ā€¦ Example: Photoapp Cohorts based on registration week AARRR
  • 75. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned (c) Dave McClure Which Metrics to focus on?
  • 76. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned Short Answer: Focus on Retention (c) Dave McClure
  • 78. Because Retention = f(user_happiness) Not only ā€œvisited againā€. But ā€œdid core activity X againā€
  • 79. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned (c) Dave McClure Long answer - It depends on two things: Phase of company Type of Product Engine of Growth
  • 80. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned Source: Lean Analytics Book - highly recommend #1 Phase
  • 81. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned #2 Engine of Growth Paid Make more money on a customer than you spend, to buy new ones. Eg. Saas Viral A Users brings more than one new user. Eg. typical interactive ad-campaigns @andreasklinger Sticky Keep your userbase to improve your quality. Eg. Communities
  • 82. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned #2 Type of Company (linked to Engine of Growth) Saas Build a better product Social Network/Community ā€œ(subjective) Critical Massā€ Marketplace Get the right sellers and many more... @andreasklinger
  • 83. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned Short Answer: Focus on Retention (c) Dave McClure
  • 84. Retention Matrix Stickness over lifetime. Source: www.usercycle.com
  • 85. Acquisition Visit / Signup / etc Activation Use of core feature Retention Come + use again Referral Invite + Signup Revenue $$$ Earned Short Answer: Focus on Retention (c) Dave McClure Eg. Did core-action X times in period.
  • 86. Dig deeper: Crashpadderā€™s Happiness Index e.g. Weighted sum over core activities by hosts. Cohorts by cities and time. = Health/Happiness Dashboard
  • 89. Marketplaces / 2-sided models Amazon Approach: 1) Create loads of inventory for longtail search 2) Create demand 3) Have shitloads of money. 4) Wait and win. Boticca (aka Startup) Approach: 1) Focus on one niche Targetgroup 2) Create ā€œenoughā€ inventory with very few sellers 3) Create demand 4) Create more demand 5) Add a few more sellers. Repeat. Pray.
  • 90. How to solve the Chicken and Egg Problem TL;DR: You need very few but very good and happy chickens to get a lot of eggs. Btw: If the chickens donā€™t come by themselves, buy them. Uber paid 30$/h to the ļ¬rst drivers. Ignore the ā€œminor chickensā€, they come anyway.
  • 91. #scb13 ā€“ @andreasklinger Framework: AARRR Example Mobile App: Pusher2000 Trainer2peer pressure sport app (prelaunch ā€œbetaā€). Rev channel: Trainers pay monthly fee. Two sided => Segment AARRR for both sides (trainer/user) Marketplace => Value = Transactions / Supplier Social Software => DAU/MAU to see if activated users stay active Chicken/Egg => You need a few very happy chickens for loads of eggs. Activated User: More than two training sessions Week/Week retention to see if public launch makes sense Optimize retention: Interviews with Users that left Measure Trainer Happiness Index Pushups / User / Week to see if the core assumption (People will do more pushups) is valid
  • 92. #scb13 ā€“ @andreasklinger Framework: AARRR Groupwork - What stage are you in? Empathy Stickness Virality Revenue Scale
  • 93. #scb13 ā€“ @andreasklinger Framework: AARRR Groupwork - Deļ¬ne your AARRR Metrics! Acquisition, Activation, Retention, Referral, Revenue One KPI each. (e.g. User who xxxx)
  • 94. #scb13 ā€“ @andreasklinger Framework: AARRR Groupwork - Whatā€™s your current core metric.
  • 96. The dirty side of metrics. @andreasklinger
  • 97. Metrics need to hurt @andreasklinger
  • 98. A Startup should always only focus on one core metric to optimize. Metrics need to hurt Your dashboard should only show metrics you are ashamed of. @andreasklinger
  • 99. Have two dashboards (example bufferApp): A actionable board to work on your product (eg. % people buffering tweets in week 2) A vanity board one to show to investors and tell to the press (eg. total amount of tweets buffered) Metrics need to hurt @andreasklinger
  • 100. If you are not ashamed about the KPIs in your product dashboard than something is wrong. Either you focus on the wrong KPIs. OR you do not drill deep enough. Metrics need to hurt @andreasklinger
  • 101. Example: Garmz/LOOKK Great Numbers: 90% activation (activation = vote) But they only voted for friends instead of actually using the platform. We drilled (not far) deeper: Activation = Vote for 2 different designers. Boom. Pain. Metrics need to hurt. Metrics need to hurt @andreasklinger
  • 103. Letā€™s talk cash: Life Time Value (LTV) Life Time = 1/Churn Eg. 1 / 0.08 = 12.5 months Average Revenue Per User (ARPU) = Revenue / Amount of Users Eg. 20.000ā‚¬ / 1500 = 13.33ā‚¬ LTV = ARPU * LifeTime = 13.33ā‚¬ * 12.5 = 166.6666 @andreasklinger
  • 104. Letā€™s talk cash: Customer Acquisition Costs CAC = Total Acquisition Costs this month / New Customers this month Goal: CAC < LTV even better: 2-3xCAC < LTV @andreasklinger
  • 105. MRR Monthly Recurring Revenue Revenue Churn & Qty Churn Monitor Revenue @andreasklinger Source: www.usercycle.com
  • 106. But how to make more money? @andreasklinger
  • 107. Big wins are often cheap. source: thomas fuchs - www.metricsftw.com
  • 109. Viral Distribution 3 kinds of virality Product Inherent A function of use. Eg. Dropbox sharing Product Artiļ¬cial Added to support behaviour. E.g. Reward systems Word of Mouth Function of customer satisfaction. Source: Lean Analytics
  • 110. Viral Distribution Invitation Rate = Invited people / inviters eg. 1250 users invited 2000 people = 1.6 Acceptance Rate = Invited Signed-up / Invited total eg. out of the 2000 people 580 signed up = 0.29 Viral Coefļ¬cient = Invitation Rate * Acceptance Rate eg. 1.6 * 0.29 = 0.464 (every customer will bring half a customer additionally)
  • 111. Viral Distribution Important #1: Unless your Growth Engine is Viral, donā€™t focus early on Viral Factors. Focus on retention/stickyness. Important #2: Viral Cycle Time (time between recv invite and sending invite) is extremely important. eg. K = 2 Cycle Time: 2 days => 20 days = 20.470 users Cycle Time: 1 day => 20 days = 20mio users Source: http://www.forentrepreneurs.com/lessons-learnt-viral-marketing/
  • 112. #scb13 ā€“ @andreasklinger Churn is not what you think it is @andreasklinger
  • 113. #scb13 ā€“ @andreasklinger Churn is not what you think it is ā€œ5% Churnrate per monthā€ One of the highest churn reasons is expired credit cards. Sad Fact: People forget about you. @andreasklinger
  • 114. #scb13 ā€“ @andreasklinger Churn is not what you think it is People donā€™t wake up and suddenly want to unsubscribe your service... ā€œOh.. itā€™s May 5th.. Better churn from that random online startup i found 2 months ago.ā€ @andreasklinger
  • 115. #scb13 ā€“ @andreasklinger Churn is not what you think it is You loose them in the ļ¬rst 3 weeks. And then at some point just remind them to unsubscribe. Thatā€™s when we measure it (too late). Source: Intercom.io
  • 116. #scb13 ā€“ @andreasklinger Churn is not what you think it is Source: Lean Analytics
  • 117. #scb13 ā€“ @andreasklinger Checkout Intercom.io Segment + message customers = Awesome
  • 118. User activation. Some users are happy (power users) Some come never again (churned users) What differs them? Itā€™s their activities in their ļ¬rst 30 days. @andreasklinger
  • 119. Sub-funnels ā€œWhat did the people do that signed up, before they signed up, compare to those who didnā€™t?ā€ Source: Usercycle
  • 120. #scb13 ā€“ @andreasklinger How often did activated users use twitter in the ļ¬rst month: 7 times What did they do? Follow 20 people, followed back by 10 Churn: If they donā€™t keep them 7 times in the ļ¬rst 30 days. They will lose them forever. It doesnā€™t matter when a user remembers to unsubscribe Example Twitter
  • 121. #scb13 ā€“ @andreasklinger Example Twitter: How did they get more people to follow 30people within 7visits in the ļ¬rst 30 days? Ran assumptions, created features and ran experiments! Watch: http://www.youtube.com/watch?v=L2snRPbhsF0 Example Twitter
  • 123. source: thomas fuchs - www.metricsftw.com Data is noisy.
  • 124. source: thomas fuchs - www.metricsftw.com Data is noisy.
  • 125. source: thomas fuchs - www.metricsftw.com Data is noisy.
  • 126. source: thomas fuchs - www.metricsftw.com Data is noisy.
  • 127. source: thomas fuchs - www.metricsftw.com Data is noisy.
  • 128. Dataschmutz A layer of dirt obfuscating your useable data. (~ sample noise we created ourselves) Usually ā€œwrong intentā€. Usually our fault. @andreasklinger
  • 129. Dataschmutz A layer of dirt obfuscating your useable data. @andreasklinger
  • 130. Dataschmutz A layer of dirt obfuscating your useable data. e.g. Trafļ¬c Spikes of wrong customer segment. (wrong intent) @andreasklinger More ā€œwrongā€ people come. Lower conversion rate on the landing page.
  • 131. How to minimize the impact of Dataschmutz Base your KPIs on wavebreakers. WK visitors acquisition activation retention referral revenue Birchbox visit registration ļ¬rst photo twice a month share ā€¦ 1 6000 66% / 4000 62,5% 25% 10% 2 25000 35% / 8750 65% 23% 9% 3 5000 70%Ā / 3500 64% 26% 4%
  • 132. Dataschmutz MySugr is praised as ā€œbeautiful appā€ example.ā€¦ => Downloads => Problem: Not all are diabetic They focus on people who activated. @andreasklinger
  • 133. Competition Created ā€œDataschmutzā€ * Users had huge extra incentive. * Marketing can hurt your numbers. * While we decided on how to relaunch we had dirty numbers. Dataschmutz Competitions (before P/M Fit) are nothing but Teļ¬‚on Marketing People come. People leave. They leave dirt in your database. Competitions create artiļ¬cial incentive ā€œWould you use my app and might win 1.000.000 USD?ā€ @andreasklinger
  • 137. Lean Analytics Hypothesis: We believe that introducing a newsfeed will increase interaction between users. Track: Engagement between users (comments/likes) Falsiļ¬able Hypothesis: People who visited the newsfeed will give a 30% more comments and likes, than people who didnā€™t.
  • 138. Lean Analytics Important #1: Donā€™t forget to timebox experiments. Important #2: Worry less about statistical signiļ¬cance (while early stage). Just use experiments to doublecheck your entrepreneurial intuition.
  • 141. Acquisition Activation Retention Referral Revenue (c) Dave McClure CUSTOMER INTENT (JOB) FULFILMENT OF CUSTOMER INTENT Customer Interviews Customer Interviews & Metrics
  • 142. @andreasklinger Thatā€™s you using metrics ā€œLook ma, the light started blinkingā€
  • 143. Metrics are horrible way to understand customer intent Customer Intent = His ā€œJob to be doneā€ Watch: http://bit.ly/cc-jtbd Products are bought because they solve a ā€œjob to be doneā€. Learn about Jobs to be done Framework @andreasklinger
  • 144. Metrics are horrible way to understand customer intent Great Way: Customer Interviews But: We bias our people, when we ask them. Even if we try not to. Reason: we believe our own bullshit. Watch: www.hackertalks.io
  • 145.
  • 146. Source: Lukas Fittl - http://speakerdeck.com/lļ¬ttl
  • 147. #scb13 ā€“ @andreasklinger Framework: AARRR Groupwork. - Draw your customer journey - Pick a point where there is likely a problem - Formulate assumption - Formulate Success Criteria
  • 150. Summary - Use Metrics for Product and Customer Development. - Use Cohorts. - Use AARRR. - Figure Customer Intent through non-biasing interviews. - Understand your type of product and itā€™s core drivers - Find KPIs that mean something to your speciļ¬c product. - Avoid Telfonmarketing (eg Campaigns pre-product). - Filter Dataschmutz - Metrics need to hurt - Focus on the ļ¬rst 30 days of customer activation. - Connect Product Hypotheses to Metrics. - Donā€™t hide behind numbers. TL;DR: Use metrics to validate/doublecheck. Use those insights when designing for/speaking to your customers.
  • 151. Read on Startup metrics for Pirates by Dave McClure http://www.slideshare.net/dmc500hats/startup-metrics-for-pirates-long-version Actionable Metrics by Ash Mauyra http://www.ashmaurya.com/2010/07/3-rules-to-actionable-metrics/ Data Science Secrets by DJ Patil - LeWeb London 2012 http://www.youtube.com/watch?v=L2snRPbhsF0 Twitter sign up process http://www.lukew.com/ff/entry.asp?1128 Lean startup metrics - @stueccles http://www.slideshare.net/stueccles/lean-startup-metrics Cohorts in Google Analytics - @serenestudios http://danhilltech.tumblr.com/post/12509218078/startups-hacking-a-cohort-analysis-with-google Rob Fitzpatrickā€™s Collection of best Custdev Videos - @robļ¬tz http://www.hackertalks.io Lean Analytics Book http://leananalyticsbook.com/introducing-lean-analytics/ Actionable Metrics - @lļ¬ttl http://www.slideshare.net/lļ¬ttl/actionable-metrics-lean-startup-meetup-berlin App Engagement Matrix - Flurry http://blog.ļ¬‚urry.com/bid/90743/App-Engagement-The-Matrix-Reloaded My Blog http://www.klinger.io
  • 152. @andreasklinger Thank you @andreasklinger Slides: http://slideshare.net/andreasklinger All pictures: http://ļ¬‚ickr.com/commons Liked it? Tweet it.