SlideShare a Scribd company logo
1 of 78
Download to read offline
Paying To Win?,[object Object],Battlefield Heroes, virtual goods and selling gameplay advantages,[object Object],Ben Cousins, General Manager, Easy (EA),[object Object]
Who am I?,[object Object]
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Facts about Easy,[object Object],Battlefield heroes started in 2007 at DICE,[object Object],20 staff from Heroes team spun out into Easy in Nov 2008 ’act like a startup’,[object Object],Almost ten million registered users,[object Object],Profitable after 16 months,[object Object],FY12 revenue forecast at double FY11,[object Object]
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Hey Ben, … Do you feel like a big man now Ben? I bet you do. That's good. I hope you enjoy watching your playerbase crumble and all your customers turn against you. A lot of us really loved your game Ben, and the ideas that you started out with. When I saw the first Heroes trailer I was amazed. It sounded too good to be true. Then it turned out that it was…,[object Object],You went behind our backs and changed the basic things that made this game different and great. You ruined your game Ben. You and the higher-ups at EA ruined OUR game…I hope you're happy Ben, I hope you're really, really happy. Do you know how many children you ruined Christmas for Ben? Why don't you think about that too while you're at it.R.I.P Battlefield: Heroes. -A formerly loyal customer.“,[object Object]
How did we get here?,[object Object]
Paying To Win
Learnings from Korea,[object Object],Items that sell well,[object Object],Customization items,[object Object],Clothing, name colour,[object Object],Convienience items,[object Object],XP boost, currency boost, stats reset,[object Object],Advantage-giving items,[object Object],BE CAREFUL – the looser MUST NOT know they have lost because of the use of an item,[object Object]
Heroes Launch Catalogue,[object Object],Head,[object Object],Face,[object Object],Neck,[object Object],Chest,[object Object],Jacket,[object Object],Hands,[object Object],Legs,[object Object],Feet,[object Object],Back,[object Object],Waist,[object Object],XP Boost,[object Object],VP Boost,[object Object]
Paying To Win
Paying To Win
Paying To Win
Total gross revenue,[object Object],ARPU =,[object Object],Total number of users              ,[object Object],$3 million in funding,[object Object],= $1.50 ARPU,[object Object],2 million users,[object Object]
Total gross revenue,[object Object],ARPU =,[object Object],Total number of users              ,[object Object],$3 million in funding,[object Object],= $1.50 ARPU,[object Object],2 million users,[object Object],Our (conservative) target = $0.50 ARPU,[object Object],Our  launch month ARPU = $0.25 ,[object Object]
Working out what was going wrong,[object Object]
Paying To Win
Paying To Win
KPIs*,[object Object],Monthly ARPU (av. revenue per user),[object Object],MAU (Monthly Active Users),[object Object],Monthly Conversion rate (% of Actives spending),[object Object],Monthly ARPPU (av. revenue per PAYING user),[object Object],*Key Performance Indicators,[object Object]
July KPIs*,[object Object],ARPPU (av. revenue per PAYING user),[object Object],$20.25 ,[object Object],*Key Performance Indicators,[object Object]
July KPIs*,[object Object],ARPPU (av. revenue per PAYING user),[object Object],$20.25 ,[object Object],Conversion rate (% of Actives spending),[object Object],1.29% ,[object Object],*Key Performance Indicators,[object Object]
Fix Conv. Rate,[object Object],Good MAU and ARPPU,[object Object],Bad ARPU caused by poor Conversion Rate,[object Object],What were spenders buying?,[object Object]
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
“I think their plan to get the low hanging fruit is right, but it is going too slow…,[object Object],They need some heads and a little bit of $$$ to pick up speed and make some needed changes to the game. “,[object Object],Frank Gibeau,[object Object]
Paying To Win
Paying To Win
”This game is too free, we are giving away too much”,[object Object]
”This game is too free, we are giving away too much”,[object Object],”Too much VP in the system”,[object Object]
Action Points,[object Object],Increase VP-per hour cost of hiring ’demo’ weapons,[object Object],If you play a few hours a day, maintain a weapon for a single character,[object Object],Drop cash-prices of permanent weapons,[object Object],SMS payment methods for some EU countries,[object Object],Release more powerful versions of normal weapons,[object Object]
3 weapons slightly bigger magazines,[object Object],5 weapons slightly greater chance of critical hit,[object Object],2 weapons slightly more damage,[object Object],One recoil reduction,[object Object],Sub Machine Gun,[object Object],Rounds in magazine from 40 - 45,[object Object],Critical hit chance from 0.025 - 0.04,[object Object],Damage for a critical hit from 15 – 20,[object Object],Pistol,[object Object],Rounds in magazine from 12-15,[object Object],Critical hit chance from 0.04 - 0.13,[object Object],Machine Gun,[object Object],Critical hit chance from 0.03 -0.07,[object Object],Shotgun,[object Object],Rounds in magazine from 12 – 15,[object Object],Critical hit chance from 0.05 – 0.07,[object Object],Sniper Rifle,[object Object],Rounds in magazine from 5 – 7,[object Object],Better over short range,[object Object],Recoil slightly reduced,[object Object],Knife,[object Object],Damage from 28-30,[object Object],Hit radius from 2-3,[object Object],RPGs,[object Object],Critical hit chance from 0 to 0.3,[object Object],Critical hit damage set at 10,[object Object]
Paying To Win
Paying To Win
Paying To Win
What happened next?,[object Object]
Fix Conv. Rate,[object Object],Good MAU and ARPPU,[object Object],Bad ARPU caused by poor Conversion Rate,[object Object]
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Total gross revenue from forum posters,[object Object],Total number of forum posters,[object Object]
Total gross revenue from forum posters,[object Object],= $22 ARPFP,[object Object],Total number of forum posters,[object Object]
Total gross revenue from forum posters,[object Object],= $22 ARPFP,[object Object],Total number of forum posters,[object Object],Forum posters spend more than 10x the average user,[object Object]
Paying To Win
Hey Ben, … Do you feel like a big man now Ben? I bet you do. That's good. I hope you enjoy watching your playerbase crumble and all your customers turn against you. A lot of us really loved your game Ben, and the ideas that you started out with. When I saw the first Heroes trailer I was amazed. It sounded too good to be true. Then it turned out that it was…,[object Object],You went behind our backs and changed the basic things that made this game different and great. You ruined your game Ben. You and the higher-ups at EA ruined OUR game…I hope you're happy Ben, I hope you're really, really happy. Do you know how many children you ruined Christmas for Ben? Why don't you think about that too while you're at it.R.I.P Battlefield: Heroes. -A formerly loyal customer.“,[object Object]
Paying To Win
Paying To Win
Paying To Win
Paying To Win
Paying To Win
To recap…,[object Object],The original store catalogue was sub-optimal because we;,[object Object],Had insufficient info about western gamer’s appetite for virtual goods,[object Object],Were scared by the Bad Company 1’s ‘weapons for sale’ controversy,[object Object],We were being too conservative,[object Object],As a result our conversion rate was too low,[object Object],We quickly identified what we needed to do to increase conversion rate with a survey,[object Object],We were understaffed until Frank Gibeau allowed us enough to staff up,[object Object],We were still too conservative about changing game balance…,[object Object],…until we got very concerned about losing ours and our team’s jobs,[object Object],Which forced us to make radical changes…,[object Object],…which caused a huge uproar online…,[object Object],…but which didn’t actually correspond with a declining userbase,[object Object]
Paying To Win
Common assumptions about the types of virtual goods it is acceptable to sell are incorrect,[object Object]
Paying To Win
Paying To Win
Paying To Win
Paying To Win
What should virtual goods games be?,[object Object],What do consumers want virtual goods games to be?,[object Object]
Questions?,[object Object],bcousins@ea.com,[object Object],Twitter - benjamincousins,[object Object]

More Related Content

What's hot

LAFS SVI Level 3 - Game Design and Analysis
LAFS SVI Level 3 - Game Design and AnalysisLAFS SVI Level 3 - Game Design and Analysis
LAFS SVI Level 3 - Game Design and AnalysisDavid Mullich
 
GDC2011 - Motivating Players in Open Worlds
GDC2011 - Motivating Players in Open WorldsGDC2011 - Motivating Players in Open Worlds
GDC2011 - Motivating Players in Open WorldsJoel Burgess
 
Game Balance 3: Interesting Strategies
Game Balance 3: Interesting StrategiesGame Balance 3: Interesting Strategies
Game Balance 3: Interesting StrategiesMarc Miquel
 
쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)
쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)
쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)Kay Kim
 
Game concept presentation
Game concept presentationGame concept presentation
Game concept presentationErez Yerushalmi
 
Killer Game Loops in Social Games
Killer Game Loops in Social GamesKiller Game Loops in Social Games
Killer Game Loops in Social GamesWooga
 
Understanding casual games
Understanding casual gamesUnderstanding casual games
Understanding casual gamesDori Adar
 
게임 기획자의 생존 전략
게임 기획자의 생존 전략게임 기획자의 생존 전략
게임 기획자의 생존 전략태성 이
 
Lecture 15 Game Analytics in the Age of Big Data
Lecture 15 Game Analytics in the Age of Big DataLecture 15 Game Analytics in the Age of Big Data
Lecture 15 Game Analytics in the Age of Big DataTrieu Nguyen
 
Course Presentation: Games design
Course Presentation: Games designCourse Presentation: Games design
Course Presentation: Games designBrunel University
 
20130720 case study of candy crush saga
20130720 case study of candy crush saga20130720 case study of candy crush saga
20130720 case study of candy crush sagaChristina Hsu
 
게임업계에서 내가 하고 싶은 일 찾는 방법
게임업계에서 내가 하고 싶은 일 찾는 방법게임업계에서 내가 하고 싶은 일 찾는 방법
게임업계에서 내가 하고 싶은 일 찾는 방법Donghun Lee
 
[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정
[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정
[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정강 민우
 
KGC 2013 - 5일만에 레벨 디자인하기
KGC 2013 - 5일만에 레벨 디자인하기KGC 2013 - 5일만에 레벨 디자인하기
KGC 2013 - 5일만에 레벨 디자인하기용태 이
 
[NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래
[NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래 [NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래
[NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래 Hwang Sang Hun
 
02. 게임기획, 재미를 향한 끝없는 여정
02. 게임기획, 재미를 향한 끝없는 여정02. 게임기획, 재미를 향한 끝없는 여정
02. 게임기획, 재미를 향한 끝없는 여정태성 이
 
Roles in the gaming industry
Roles in the gaming industryRoles in the gaming industry
Roles in the gaming industrymissstevenson01
 
LAFS Game Design 1 - Foundational Elements
LAFS Game Design 1 - Foundational ElementsLAFS Game Design 1 - Foundational Elements
LAFS Game Design 1 - Foundational ElementsDavid Mullich
 

What's hot (20)

LAFS SVI Level 3 - Game Design and Analysis
LAFS SVI Level 3 - Game Design and AnalysisLAFS SVI Level 3 - Game Design and Analysis
LAFS SVI Level 3 - Game Design and Analysis
 
GDC2011 - Motivating Players in Open Worlds
GDC2011 - Motivating Players in Open WorldsGDC2011 - Motivating Players in Open Worlds
GDC2011 - Motivating Players in Open Worlds
 
Game Balance 3: Interesting Strategies
Game Balance 3: Interesting StrategiesGame Balance 3: Interesting Strategies
Game Balance 3: Interesting Strategies
 
쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)
쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)
쩌는 게임 기획서, 이렇게 쓴다(How to write great design documents) from GDC 2008 (Korean)
 
Game concept presentation
Game concept presentationGame concept presentation
Game concept presentation
 
Killer Game Loops in Social Games
Killer Game Loops in Social GamesKiller Game Loops in Social Games
Killer Game Loops in Social Games
 
Understanding casual games
Understanding casual gamesUnderstanding casual games
Understanding casual games
 
Gaming Industry
Gaming IndustryGaming Industry
Gaming Industry
 
게임 기획자의 생존 전략
게임 기획자의 생존 전략게임 기획자의 생존 전략
게임 기획자의 생존 전략
 
Lecture 15 Game Analytics in the Age of Big Data
Lecture 15 Game Analytics in the Age of Big DataLecture 15 Game Analytics in the Age of Big Data
Lecture 15 Game Analytics in the Age of Big Data
 
Course Presentation: Games design
Course Presentation: Games designCourse Presentation: Games design
Course Presentation: Games design
 
20130720 case study of candy crush saga
20130720 case study of candy crush saga20130720 case study of candy crush saga
20130720 case study of candy crush saga
 
게임업계에서 내가 하고 싶은 일 찾는 방법
게임업계에서 내가 하고 싶은 일 찾는 방법게임업계에서 내가 하고 싶은 일 찾는 방법
게임업계에서 내가 하고 싶은 일 찾는 방법
 
[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정
[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정
[IGC 2017] 넥슨코리아 심재근 - 시스템 기획자에 대한 기본 지식과 준비과정
 
KGC 2013 - 5일만에 레벨 디자인하기
KGC 2013 - 5일만에 레벨 디자인하기KGC 2013 - 5일만에 레벨 디자인하기
KGC 2013 - 5일만에 레벨 디자인하기
 
[NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래
[NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래 [NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래
[NDC 2014] 시나리오라이터의 과거와 현재, 그리고 미래
 
02. 게임기획, 재미를 향한 끝없는 여정
02. 게임기획, 재미를 향한 끝없는 여정02. 게임기획, 재미를 향한 끝없는 여정
02. 게임기획, 재미를 향한 끝없는 여정
 
Roles in the gaming industry
Roles in the gaming industryRoles in the gaming industry
Roles in the gaming industry
 
Phases of game development
Phases of game developmentPhases of game development
Phases of game development
 
LAFS Game Design 1 - Foundational Elements
LAFS Game Design 1 - Foundational ElementsLAFS Game Design 1 - Foundational Elements
LAFS Game Design 1 - Foundational Elements
 

Viewers also liked

Ben Cousins - A History
Ben Cousins - A HistoryBen Cousins - A History
Ben Cousins - A Historygueste78f0
 
Adding And Subtracting Whole Numbers
Adding And Subtracting Whole NumbersAdding And Subtracting Whole Numbers
Adding And Subtracting Whole Numbersgusma1am
 
Adding whole numbers kori (1)
Adding whole numbers kori (1)Adding whole numbers kori (1)
Adding whole numbers kori (1)Rusty Aquino
 
Counter anti feminist
Counter anti feministCounter anti feminist
Counter anti feministC
 
Rd An Innovative
Rd An InnovativeRd An Innovative
Rd An Innovativenayyer14
 
Cryptography
CryptographyCryptography
Cryptographygadgetic
 
07 Study Of The Law Love - Coveteousness
07 Study Of The Law Love - Coveteousness07 Study Of The Law Love - Coveteousness
07 Study Of The Law Love - CoveteousnessDon McClain
 
Managing It Solutions Architecture Presentation Main
Managing It Solutions Architecture Presentation MainManaging It Solutions Architecture Presentation Main
Managing It Solutions Architecture Presentation Mainguest8d3c01
 
Moto Telepizza
Moto TelepizzaMoto Telepizza
Moto Telepizzakirvesc
 
Social.media 201 - alumni senate 2010
Social.media 201  - alumni senate 2010Social.media 201  - alumni senate 2010
Social.media 201 - alumni senate 2010Josh Stowe
 
Social media 101 - alumni senate 2010
Social media 101  - alumni senate 2010Social media 101  - alumni senate 2010
Social media 101 - alumni senate 2010Josh Stowe
 
Varias listas ordenadas genis chiquillo 1b
Varias listas ordenadas genis chiquillo 1bVarias listas ordenadas genis chiquillo 1b
Varias listas ordenadas genis chiquillo 1bgenischiquillo
 
Tina's Slide Show
Tina's Slide ShowTina's Slide Show
Tina's Slide Showmamafeenix
 
Autism omnibus results_031010
Autism omnibus results_031010Autism omnibus results_031010
Autism omnibus results_031010Wayne Rohde
 

Viewers also liked (20)

Ben Cousins - A History
Ben Cousins - A HistoryBen Cousins - A History
Ben Cousins - A History
 
Story openings
Story openingsStory openings
Story openings
 
Adding And Subtracting Whole Numbers
Adding And Subtracting Whole NumbersAdding And Subtracting Whole Numbers
Adding And Subtracting Whole Numbers
 
Write a story
Write a story Write a story
Write a story
 
Adding whole numbers kori (1)
Adding whole numbers kori (1)Adding whole numbers kori (1)
Adding whole numbers kori (1)
 
Counter anti feminist
Counter anti feministCounter anti feminist
Counter anti feminist
 
Rd An Innovative
Rd An InnovativeRd An Innovative
Rd An Innovative
 
Cryptography
CryptographyCryptography
Cryptography
 
07 Study Of The Law Love - Coveteousness
07 Study Of The Law Love - Coveteousness07 Study Of The Law Love - Coveteousness
07 Study Of The Law Love - Coveteousness
 
Wiki
WikiWiki
Wiki
 
Ccna1v3 Mod02
Ccna1v3 Mod02Ccna1v3 Mod02
Ccna1v3 Mod02
 
Managing It Solutions Architecture Presentation Main
Managing It Solutions Architecture Presentation MainManaging It Solutions Architecture Presentation Main
Managing It Solutions Architecture Presentation Main
 
Moto Telepizza
Moto TelepizzaMoto Telepizza
Moto Telepizza
 
Social.media 201 - alumni senate 2010
Social.media 201  - alumni senate 2010Social.media 201  - alumni senate 2010
Social.media 201 - alumni senate 2010
 
Social media 101 - alumni senate 2010
Social media 101  - alumni senate 2010Social media 101  - alumni senate 2010
Social media 101 - alumni senate 2010
 
Varias listas ordenadas genis chiquillo 1b
Varias listas ordenadas genis chiquillo 1bVarias listas ordenadas genis chiquillo 1b
Varias listas ordenadas genis chiquillo 1b
 
Tina's Slide Show
Tina's Slide ShowTina's Slide Show
Tina's Slide Show
 
Historiaurrea
HistoriaurreaHistoriaurrea
Historiaurrea
 
Club
ClubClub
Club
 
Autism omnibus results_031010
Autism omnibus results_031010Autism omnibus results_031010
Autism omnibus results_031010
 

Similar to Paying To Win

Metrics for a Brave New Whirled
Metrics for a Brave New WhirledMetrics for a Brave New Whirled
Metrics for a Brave New Whirledcapncleaver
 
FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)
FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)
FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)mochimedia
 
Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...
Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...
Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...Kongregate
 
GDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P Games
GDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P GamesGDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P Games
GDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P GamesTamara (Tammy) Levy
 
Agency Innovation Camp '13: Yellow Group
Agency Innovation Camp '13: Yellow Group Agency Innovation Camp '13: Yellow Group
Agency Innovation Camp '13: Yellow Group Digiday
 
Core Games, Real Numbers: Asian & Western Games
Core Games, Real Numbers: Asian & Western GamesCore Games, Real Numbers: Asian & Western Games
Core Games, Real Numbers: Asian & Western Gamesemily_greer
 
Essay On Reforms In Indian Legal System. Online assignment writing service.
Essay On Reforms In Indian Legal System. Online assignment writing service.Essay On Reforms In Indian Legal System. Online assignment writing service.
Essay On Reforms In Indian Legal System. Online assignment writing service.Vanessa Perkins
 
Maximizing Monetization - Casual Connect SF 2013
Maximizing Monetization - Casual Connect SF 2013Maximizing Monetization - Casual Connect SF 2013
Maximizing Monetization - Casual Connect SF 2013emily_greer
 
What is this Sims 4?
What is this Sims 4?What is this Sims 4?
What is this Sims 4?Ruth Deller
 
DevDays Games UX Talk
DevDays Games UX TalkDevDays Games UX Talk
DevDays Games UX Talkguest7e5c7c1
 
F2P Design Crash Course (Casual Connect Kyiv 2013)
F2P Design Crash Course (Casual Connect Kyiv 2013)F2P Design Crash Course (Casual Connect Kyiv 2013)
F2P Design Crash Course (Casual Connect Kyiv 2013)Kongregate
 
Monetization Case Study - blood brothers 2
Monetization Case Study - blood brothers 2Monetization Case Study - blood brothers 2
Monetization Case Study - blood brothers 2Sun Cho
 
R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...
R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...
R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...David Piao Chiu
 
How Streaming is Changing the Way We Play
How Streaming is Changing the Way We PlayHow Streaming is Changing the Way We Play
How Streaming is Changing the Way We PlayTwitch Developers
 
FMP - 3. Research
FMP - 3. ResearchFMP - 3. Research
FMP - 3. ResearchDaniel Corr
 
Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...
Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...
Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...David Piao Chiu
 
Are You Making the Right Game?
Are You Making the Right Game?Are You Making the Right Game?
Are You Making the Right Game?Intel® Software
 
Monetization As Part Of Game Design
Monetization As Part Of Game DesignMonetization As Part Of Game Design
Monetization As Part Of Game DesignInMobi
 

Similar to Paying To Win (20)

Metrics for a Brave New Whirled
Metrics for a Brave New WhirledMetrics for a Brave New Whirled
Metrics for a Brave New Whirled
 
FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)
FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)
FGS 2011: Keeping Yourself Honest in Game Design (SteamBirds)
 
Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...
Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...
Tammy Levy at GDC 2019: Nature vs. Nurture: Unpacking Player Spending in F2P ...
 
GDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P Games
GDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P GamesGDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P Games
GDC Talk - Nature vs Nurture: Unpacking Player Spending in F2P Games
 
Agency Innovation Camp '13: Yellow Group
Agency Innovation Camp '13: Yellow Group Agency Innovation Camp '13: Yellow Group
Agency Innovation Camp '13: Yellow Group
 
Core Games, Real Numbers: Asian & Western Games
Core Games, Real Numbers: Asian & Western GamesCore Games, Real Numbers: Asian & Western Games
Core Games, Real Numbers: Asian & Western Games
 
Essay On Reforms In Indian Legal System. Online assignment writing service.
Essay On Reforms In Indian Legal System. Online assignment writing service.Essay On Reforms In Indian Legal System. Online assignment writing service.
Essay On Reforms In Indian Legal System. Online assignment writing service.
 
Maximizing Monetization - Casual Connect SF 2013
Maximizing Monetization - Casual Connect SF 2013Maximizing Monetization - Casual Connect SF 2013
Maximizing Monetization - Casual Connect SF 2013
 
About EA
About EAAbout EA
About EA
 
About EA
About EAAbout EA
About EA
 
What is this Sims 4?
What is this Sims 4?What is this Sims 4?
What is this Sims 4?
 
DevDays Games UX Talk
DevDays Games UX TalkDevDays Games UX Talk
DevDays Games UX Talk
 
F2P Design Crash Course (Casual Connect Kyiv 2013)
F2P Design Crash Course (Casual Connect Kyiv 2013)F2P Design Crash Course (Casual Connect Kyiv 2013)
F2P Design Crash Course (Casual Connect Kyiv 2013)
 
Monetization Case Study - blood brothers 2
Monetization Case Study - blood brothers 2Monetization Case Study - blood brothers 2
Monetization Case Study - blood brothers 2
 
R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...
R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...
R2Games: Maximizing F2P Monetization Presentation from the Montreal Internati...
 
How Streaming is Changing the Way We Play
How Streaming is Changing the Way We PlayHow Streaming is Changing the Way We Play
How Streaming is Changing the Way We Play
 
FMP - 3. Research
FMP - 3. ResearchFMP - 3. Research
FMP - 3. Research
 
Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...
Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...
Kongregate - Maximizing Player Retention and Monetization in Free-to-Play Gam...
 
Are You Making the Right Game?
Are You Making the Right Game?Are You Making the Right Game?
Are You Making the Right Game?
 
Monetization As Part Of Game Design
Monetization As Part Of Game DesignMonetization As Part Of Game Design
Monetization As Part Of Game Design
 

Recently uploaded

Young adult book quiz by SJU quizzers.ppt
Young adult book quiz by SJU quizzers.pptYoung adult book quiz by SJU quizzers.ppt
Young adult book quiz by SJU quizzers.pptSJU Quizzers
 
The Hardest Part About Picking A Show To Watch (Comics)
The Hardest Part About Picking A Show To Watch (Comics)The Hardest Part About Picking A Show To Watch (Comics)
The Hardest Part About Picking A Show To Watch (Comics)Salty Vixen Stories & More
 
Inside Look: Brooke Monk's Exclusive OnlyFans Content Production
Inside Look: Brooke Monk's Exclusive OnlyFans Content ProductionInside Look: Brooke Monk's Exclusive OnlyFans Content Production
Inside Look: Brooke Monk's Exclusive OnlyFans Content Productionget joys
 
5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life
5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life
5 Moments of Everyday Self-Loathing That Perfectly Describe Your LifeSalty Vixen Stories & More
 
How the fever night scores above your mundane nightlife occurrence
How the fever night scores above your mundane nightlife occurrenceHow the fever night scores above your mundane nightlife occurrence
How the fever night scores above your mundane nightlife occurrenceJFI Production
 
Taylor Swift quiz( with answers) by SJU quizzers
Taylor Swift quiz( with answers) by SJU quizzersTaylor Swift quiz( with answers) by SJU quizzers
Taylor Swift quiz( with answers) by SJU quizzersSJU Quizzers
 
"Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ...
"Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ..."Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ...
"Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ...RAGHURAMYC
 
Holi:: "The Festival of Colors in India"
Holi:: "The Festival of Colors in India"Holi:: "The Festival of Colors in India"
Holi:: "The Festival of Colors in India"IdolsArts
 

Recently uploaded (8)

Young adult book quiz by SJU quizzers.ppt
Young adult book quiz by SJU quizzers.pptYoung adult book quiz by SJU quizzers.ppt
Young adult book quiz by SJU quizzers.ppt
 
The Hardest Part About Picking A Show To Watch (Comics)
The Hardest Part About Picking A Show To Watch (Comics)The Hardest Part About Picking A Show To Watch (Comics)
The Hardest Part About Picking A Show To Watch (Comics)
 
Inside Look: Brooke Monk's Exclusive OnlyFans Content Production
Inside Look: Brooke Monk's Exclusive OnlyFans Content ProductionInside Look: Brooke Monk's Exclusive OnlyFans Content Production
Inside Look: Brooke Monk's Exclusive OnlyFans Content Production
 
5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life
5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life
5 Moments of Everyday Self-Loathing That Perfectly Describe Your Life
 
How the fever night scores above your mundane nightlife occurrence
How the fever night scores above your mundane nightlife occurrenceHow the fever night scores above your mundane nightlife occurrence
How the fever night scores above your mundane nightlife occurrence
 
Taylor Swift quiz( with answers) by SJU quizzers
Taylor Swift quiz( with answers) by SJU quizzersTaylor Swift quiz( with answers) by SJU quizzers
Taylor Swift quiz( with answers) by SJU quizzers
 
"Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ...
"Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ..."Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ...
"Quest for Knowledge: An Exciting Journey Through 40 Brain-Bending Questions ...
 
Holi:: "The Festival of Colors in India"
Holi:: "The Festival of Colors in India"Holi:: "The Festival of Colors in India"
Holi:: "The Festival of Colors in India"
 

Paying To Win

  • 1.
  • 2.
  • 8.
  • 14.
  • 15.
  • 17.
  • 18.
  • 22.
  • 23.
  • 24.
  • 27.
  • 28.
  • 29.
  • 30.
  • 40.
  • 43.
  • 44.
  • 45.
  • 46.
  • 50.
  • 51.
  • 60.
  • 61.
  • 62.
  • 64.
  • 70.
  • 72.
  • 77.
  • 78.

Editor's Notes

  1. General Manager Easy. First ever team in EA to have been ‘built’ for free to play business models
  2. four live titles, Battlefield Heroes – which is the subject of this talkFree to play cartoon shooter – open beta June 2009EA’s first free to play game outside of PogoThe landing page video does a good job of giving you a feel for the game
  3. Battlefield Play4Free
  4. Battleforge
  5. Lord of Ultima
  6. 80 staff divided between three teamsTeam in Stockholm who build shooters, Team called Phenomic in Ingelheim, Germany who build strategy gamesTeam in Stockholm who tie the titles together with web technology and websites. Set up as a fully integrated developer/publisher, with most of the key functions all housed in one location.
  7. ‘Battlefield Heroes Is Practically Ruined’ – with this headline on December 1st 2009, Kotaku announced something we’d been working on in my studio for the last several months. ‘As a regular player of the game, I've had some kind things to say about Battlefield Heroes. As an online game, however, things can change at the drop of a hat. And EA just dropped the hat.’
  8. Over at ArsTechnica they felt the same – ‘a recent price restructuring destroys the ability to play without spending real money’.
  9. Over at industry news site Inside Social Games they reported a little more soberly ‘EA’s Battlefield Heroes Has Virtual Economy Troubles’ ‘The phrase here is “freemium,” in quotes, because recent virtual goods changes to the game have shot the title in its digital foot, forcing players that want to compete to spend money.’Articles using our forums as sources this is a typical forum post
  10. ‘Now it's impossible for me to play the game for free. I can't even afford the long ranged pistol anymore, let alone bandages. Let me make this clear: now it takes 22 wins for us to earn enough VPs to rent a weapon for a day. If each match is 10 minutes long, that means I'll have to play for 3 hours and a half with a stellar team just to afford the weapon.’Post originally contained an incorrect calculationSaid 6 hours to maintain weapon for freeHe corrected itOnline news sites didn’t
  11. ‘EA Failed’ forum sig campaign 80% of forum users were using this sigGot 300+ emails that weekHere’s one
  12. According to forum posters, fans emailing me, consumer press and business blogs we’d fucked upKilled a popular free gameAlienated the audiencePushed commerce too farGame was obviously going to dieWhy am I standing here? Why is Easy still open? How come I still have a job? How come we are releasing a game with an identical business model this month?This talk will answer those questions
  13. Heroes after Korean modelNo significant virtual goods games in western world in 2007No shootersAnnounced the game in 2008 – many questioned if a free to play shooter would work in the westWe learnt from Neowiz, collaborated on Battlefield OnlineThey taught us about Korean item catalogues
  14. Heroes launch catalogue was simpleTech limitation meant we couldn’t do pets with AIClothing itemsEmotes – can be played at a key moment – when you’ve been killedWidgets – our convenience itemsAllow faster access to content but don’t directly sell content, especially not weapons.Didn’t sell weapons because of something else happening in EA
  15. March 2008 Bad Company 1 closed beta from sister studio DICEMistake ‘buy this weapon on Xbox Live Marketplace’Internet uproarWe decided to pull permanent weapon salesMade promises in interview, many on YouTube, came back to haunt me
  16. Launched on the 25th of June 2009A year late (that’s another presentation)July 2009 still our biggest month for usersLots of people playing the game a lotWe had a problemBy the end of the month I t was clear we were not making anywhere near as much money as forecasted
  17. Free to play games measure success by ARPU, among other metrics
  18. We calculate ARPU this wayPicked a conservative forecast arpu supported by Korean data
  19. We calculate ARPU this wayPicked a conservative forecast arpu supported by Korean data
  20. Didn’t feel goodWe were confident about $0.50 forecast from Korean benchmarksARPU was lower in the closed betaThought that was because it was closed betaSweden has mandatory month-long holidays in JulyMany spent the summer worrying
  21. I got back in augustOne of the only other people there was RommyGhaly, our analyst
  22. Rommy and I looked at the KPIs for July Already talked about ARPUMeasure player volume with Monthly Active Users or MAUOther metrics Rommy and I looked at% of active players who spend in a given monthAverage revenue per paying user in a month
  23. Our ARPPU was goodThe conversion rate was horrible for a game like this
  24. Our ARPPU was goodThe conversion rate was horrible for a game like this
  25. Good user volume, good amount of money from spendersConv rate was the issueThis clarity enabled us to concentrate
  26. Store metrics told us spenders were buying clothesPeacock – show off relative wealth with cool-looking heroOnly 1.29% of userbase were peacocksNeed to double that number. Find out what everyone else wanted to buyDecided to run survey
  27. Store metrics told us spenders were buying clothesPeacock – show off relative wealth with cool-looking heroOnly 1.29% of userbase were peacocksNeed to double that number. Find out what everyone else wanted to buyDecided to run survey
  28. Store metrics told us spenders were buying clothesPeacock – show off relative wealth with cool-looking heroOnly 1.29% of userbase were peacocksNeed to double that number. Find out what everyone else wanted to buyDecided to run survey
  29. I worked in Market Research for 2 yearsWe had previously set up a zoomerang accountCould pop up surveys when players hut down clientWanted to find out what items would convert people to spending
  30. Multiple choice - % add up to more than 100Vehicle cust considered too technically difficult and would just be more ARPPU from peacocks, not solving the problemMore payment instruments, bundles already planned
  31. Boost items wasn’t in our backlog, we’d decided not to do it
  32. When people got back from summerBuilt a plan to add updates according to surveyPut advantage items at bottom of list, thought it would kill userbaseWanted to try to stick to original plan – no buying advantages
  33. Team was too small to do this workHad to do work on dev framework before we could even do updatesAsked immediate bosses for more staffThey said ‘not until you make more money’A Catch 22 situation
  34. F2P was new to EAThey didn’t know if the business model would ever work, even with more staffRefused to make investmentWe slowly worked through planUptick in October, but not enoughMoving too slow on key monetization features
  35. Frank visitedOriginally gave Heroes greenlight and said ‘I would invest my own money in this’Looked at plans and metricsQuickly agreed that we needed more moneyWithin an hour, hiring blockages were cleared.
  36. By late Oct we had most of the features from the surveyPerm weapons, bundles, more clothes, more payment types, but were holding back on advantagesBut immediate bosses had lost patience. Game was still loosing moneyWe weren’t moving the needle enoughEA was going through an aggressive round of layoffsIn this climate we were in trouble – we started getting very paranoid that we would be laid off along with the teamFear of losing our jobs caused us to consider making some big changes
  37. Orange room for adhoc meetingsJohny – game still too free. Salt – VP is for ‘demo’ rentals, but so much of it that people can keep renting foreverWe had guys who had played for 100s of hours and never paid a penny
  38. Orange room for adhoc meetingsJohny – game still too free. Salt – VP is for ‘demo’ rentals, but so much of it that people can keep renting foreverWe had guys who had played for 100s of hours and never paid a penny
  39. Orange room for adhoc meetingsJohny – game still too free. Salt – VP is for ‘demo’ rentals, but so much of it that people can keep renting foreverWe had guys who had played for 100s of hours and never paid a penny
  40. Changes made us nervousThought it could have a big effect on userbase, driving revenues down even if more people were paying as a proportion of userbaseWe were going back on assurances we made nearly 2 years beforeUnder pressure to save our jobs and our staffs jobsDev team went to work
  41. At 11:57 am local time on the 30th of November 2009 we updated the gameChristmas calendar campaignFirst weapons that dropped were shotgunsEnd of the day had 64 page forum thread about shotgunsSo moderators made a dedicated thread on changesBy end of the day 50 pages, 1000 postsWithin a week 200 pages and 4000 postsForums in turmoil, moderators working to close abusive threads
  42. Press picked up on changesKotaku often lead the way with news stories and within days all the major news sites had picked up on our changes It was everywhere. In the eyes of the world we had fucked up. The community was in uproar, the press was openly critical of the changes. In any normal business we would have assumed we were fucked and packed our desks ready to leave. But we aren’t in any normal business. We are running a direct-to-consumer online business. We have one thing a lot of people don’t have. We have the data…
  43. So what happened to the consumer behavior?
  44. Recap of what was broken before?So what happened after the pricing change and the new weapons were introduced?
  45. As you can see here our revenue approximately doubled overnightBut what was causing this upswing? Was it more users, or higher revenue per user?
  46. Here’s the users.Note there was no change in users during this periodThe doubling of revenue wasn’t caused by a doubling of playersBut crucially there was no exodus in players at all contrary to what people were expectingSo, if the doubling of revenue wasn’t more users, was it that the existing spenders were simply spending more?
  47. Nope – as you can see, the spending per spender actually dropped during this periodSo if the douboling of revenue wasn’t more usersAnd it wasn’t the spenders spending moreIt must have been conversiton rate – more people were spending?
  48. It wasWe’d succeeded in our goal of increasing conversionWe’d created items that appealed to the competitive players, not just the peacocksAs you can see we’d tripled our spenders, while maintaining the userbase and only slightly decreasing the amount spenders were spending.Worth noting that its still a very small number of users (less than 5%) who buy stuff in a daySo what was happening on the forums? They seemed to be indicating the audience were deeply unhappy with these changes, and that the userbase should be crashing
  49. Shows the entire userbase, divided by different types of forum usage78% of users never touch the forums, never even visit them20% of the users visit the forums to read at least onceOnly 2% of users post on the forumsSo these complaints on the forums only represented 2% of the entire audience for the gameSo maybe the forum posters represented a small subset of players who were passionate but wernt the sort of people who would spend?We decided to look at the spending habits of forum posters
  50. Shows the entire userbase, divided by different types of forum usage78% of users never touch the forums, never even visit them20% of the users visit the forums to read at least onceOnly 2% of users post on the forumsSo these complaints on the forums only represented 2% of the entire audience for the gameSo maybe the forum posters represented a small subset of players who were passionate but wernt the sort of people who would spend?We decided to look at the spending habits of forum posters
  51. Shows the entire userbase, divided by different types of forum usage78% of users never touch the forums, never even visit them20% of the users visit the forums to read at least onceOnly 2% of users post on the forumsSo these complaints on the forums only represented 2% of the entire audience for the gameSo maybe the forum posters represented a small subset of players who were passionate but wernt the sort of people who would spend?We decided to look at the spending habits of forum posters
  52. Shows the entire userbase, divided by different types of forum usage78% of users never touch the forums, never even visit them20% of the users visit the forums to read at least onceOnly 2% of users post on the forumsSo these complaints on the forums only represented 2% of the entire audience for the gameSo maybe the forum posters represented a small subset of players who were passionate but wernt the sort of people who would spend?We decided to look at the spending habits of forum posters
  53. We calculated the average revenue per forum poster (ARPFP) Ar-Per-FupThis gave us an astonishing figure.Forum posters on average spend more than ten time the average userSo a couple of reasons why the sentiment of the forum posters was so contrary to user behaviorFirstly, numerically they are a very small sample of the entire userbase only 2%Secondly there seemed to be a disconnect between what they were saying ‘I will leave the game and never spend a penny’ and what they were doing (sticking around and spending lots of money)We now no-longer think of the forums as giving us a chance to take the temperature of the entire userbaseWe think of the forum posters as a small but passionately engaged subset of usersThey play more, they spend more, they talk more, they socialize more they care moreWhen they panic about say balance or cheating, we take notice and do an data-driven investigation, rather than thinking this is how all players feelSo what about some of the guys who were complaining earlier
  54. We calculated the average revenue per forum poster (ARPFP) Ar-Per-FupThis gave us an astonishing figure.Forum posters on average spend more than ten time the average userSo a couple of reasons why the sentiment of the forum posters was so contrary to user behaviorFirstly, numerically they are a very small sample of the entire userbase only 2%Secondly there seemed to be a disconnect between what they were saying ‘I will leave the game and never spend a penny’ and what they were doing (sticking around and spending lots of money)We now no-longer think of the forums as giving us a chance to take the temperature of the entire userbaseWe think of the forum posters as a small but passionately engaged subset of usersThey play more, they spend more, they talk more, they socialize more they care moreWhen they panic about say balance or cheating, we take notice and do an data-driven investigation, rather than thinking this is how all players feelSo what about some of the guys who were complaining earlier
  55. We calculated the average revenue per forum poster (ARPFP) Ar-Per-FupThis gave us an astonishing figure.Forum posters on average spend more than ten time the average userSo a couple of reasons why the sentiment of the forum posters was so contrary to user behaviorFirstly, numerically they are a very small sample of the entire userbase only 2%Secondly there seemed to be a disconnect between what they were saying ‘I will leave the game and never spend a penny’ and what they were doing (sticking around and spending lots of money)We now no-longer think of the forums as giving us a chance to take the temperature of the entire userbaseWe think of the forum posters as a small but passionately engaged subset of usersThey play more, they spend more, they talk more, they socialize more they care moreWhen they panic about say balance or cheating, we take notice and do an data-driven investigation, rather than thinking this is how all players feelSo what about some of the guys who were complaining earlier
  56. This guy who said he couldn’t play for free anymore and was quitting the gameHe was still an active player a year later
  57. And this guy who wanted to tell me how many children I’d ruined Christmas for?He quickly became a paying player.So lets finish by looking at the long-term performance of Heroes in the year or more since the ‘big change’ to what the big trends are
  58. Here’s the registration rate – how many new players we get.No major change since the pricing changesA big summer dip this yearGame is most popular in Europe, young people take long summer holidays over thereCan see that there’s no real long-term effect of the pricing change on regsitrations
  59. Here’s the churn rate – the % of players that leave the game each month – high is bad, low is good.We can see that the pricing changes had no long-term impact on the rate at which people registered for the game or left the game
  60. Gross revenue gone up a lotWe thought Dec 2009 was good after we made the changesThis Dec we took twice as much money from approx the same number of usersSo what's causing this upward trend?
  61. A small uptick in conversion rate following the big upswing in Dec 2009Caused mostly by the addition of more payment instruments like SMS
  62. Also we’ve had an increase in how much the spenders are spendingThis is mostly driven my releasing more and more items that appeal to either the peacocks or the competitive playersWith more choice of items to buy, people tend to spend more
  63. In conclusion then…Heroes is very profitableProjections for next year have a 50% profit margin
  64. Has enabled us to get approval to make a new game Battlefield Play4Free Takes the free-to play game to the next level with the same business model as Heroes, but with HD graphics and a more realistic settingWe aim to make this the western world’s biggest ever client-based free to play game
  65. What can we take away from this?
  66. The BF Heroes team acted as crash test dummiesIt took fear of losing our job to take a leap in the darkWe discovered people don’t mind playing a multiplayer game where some players have bought an advantageAre there analogies from the real world?
  67. Lots of sports where better equipment can given an advantageI race road bikes, always someone who has spent $10k on some really light wheelsSometimes hes a strong rider and we don’t mind him winningSometimes he’s an overweight banker and we like beating himThis is also the case in other sports like golf and motor racing. Buying a small advantage in equipment is accepted
  68. We accept inequality in other aspects of lifeDon’t hate the guy with the Porsche unless he’s an asshole about itDon’t begrudge people because they got an expensive engagement ring
  69. In Heroes, people don’t mind that much if they’ve been killed with a more expensive weaponSometimes the guys is a good player and he would have killed them anywaySometimes he’s not such a good player and the free players enjoy killing himThe difference between the haves and have-nots and the desire to better yourself that comes from this inequality is what drives all economies, whether we like it or not
  70. So let’s follow the user behavior and stop trying to define what a virtual goods game should be in an ideal world, Instead look at what the consumers want them to be. Our consumers told us that our virtual goods game is like a game of golf, a car race or a bicycle race where small purchased advantages are part of the accepted norm, rather than a perfectly balanced game of chess or Poker where no outside influences are allowed.The users accept this, in fact as our survey shows, they demand it.