SlideShare a Scribd company logo
1 of 28
Starting Experimentation &
Scaling to Personalization
Sarah Fruy
VP of Marketing
Linqia
Agenda
• Decision-making without experimentation
• Proving the need for experimentation
• Getting buy-in
• Leveling up to personalization
SARAH FRUY
VP of Marketing
Linqia
@sarahfruy
“In an increasingly digital world, if you don’t
do large-scale experimentation, in the long
term—and in many industries the short
term—you’re dead.”
- Mark Okerstrom, CEO
Your team can anchor on out-of-date or
misleading information
◆Working off of assumptions
◆High-risk
◆Lack of innovation
◆Inability to respond to rapidly
changing environments
Decision-Making
Without
Experimentatio
n
Properly managed experimentation programs
yield positive ROI for your business
◆Data-driven decision making
◆Faster iterations
◆Cross-functional collaboration
Proving the
Need for
Experimentatio
n
PANTHEON.IO
7
Growth Levers
Measurable Growth Levers
(e.g. page layout, UX,
color, CTA, etc )
North Star Metric
(e.g. site conversion)
[Regular experimentation] helped
Microsoft’s Bing unit make dozens of
monthly improvements, which collectively
have boosted revenue per search by
10% to 25% a year.
Getting Buy-In to Initiate Your
Experimentation Program
9
Ensure top-down, bottom up consensus
◆ Create enthusiasm for your program at
all levels of your organization
◆ Identify potential blockers
Getting Buy-In
to Initiate Your
Experimentatio
n Program
Build a business case for resources
◆ Budget
◆ Tools/software
◆ Staff: developers, user interface
designers, data analysts, copywriters, etc.
◆ Data pipelines
Establish a strong foundation with a single
northstar metric
◆ Centralized vs decentralized teams
◆ Program management guidelines
◆ Prioritization framework
◆ Ethical testing practices
“Our success at Amazon is a function of how
many experiments we do per year, per month,
per week, per day.”
- Jeff Bezos, CEO
Maximize the Impact of Your
Experimentation Program
14
➔ Eliminate the guesswork
◆ Data must trump opinions
➔ Create a culture of
experimentation
◆ Ensure a continuous cycle of iteration
◆ Create opportunities for learning
◆ Enable healthy debate among team
members
◆ Embrace failure and learn from it
Maximize the
Impact of Your
Experimentation
Program
Socialize and celebrate
wins/learnings
◆ Tie your experiments back to your
company goals
◆ Nurture an environment where all
employees can contribute
Insights-driven businesses are growing by
more than 30% annually and are on track to
earn $1.8 trillion by 2021.
Leveling Up to Personalization
18
Foster collaborative brainstorming
sessions
◆ Gather a diverse set of stakeholders
◆ Look at data and analytics: customer
surveys/interviews, funnel reporting, engagement
metrics, heat-mapping, and cohort analysis
Leveling Up to
Personalization
Stay focused on the needs of your
customers
◆ Form a hypothesis on where the line is between
helpful and creepy when it comes to
personalization
◆ Include both qualitative and quantitative data in
your research
➔ Ensure good data
◆ When personalization goes wrong, it can hurt
your business
➔ Incentivize employees to submit
ideas for experimentation
PANTHEON.IO
PANTHEON.IO
2323
Experimenting with Growth Levers
+53.5% improvement on Demo CTA +10.8% improvement on Free Trial CTA
24
V-0
V-1
V-2
PANTHEON.IO
+3.3% improvement on Demo CTA +1.5% improvement on Free Trial CTA
Key Takeaways
Embrace
experimentation
across your entire
company
Tie results back to
company goals
Keep your customer
at the center of your
experimentation
program
Thank You!
27
Any Questions???
28

More Related Content

Similar to Starting Experimentation & Scaling to Personalization.pptx

Leading Product: The Sparks, the Challenges, and the Victories
Leading Product: The Sparks, the Challenges, and the VictoriesLeading Product: The Sparks, the Challenges, and the Victories
Leading Product: The Sparks, the Challenges, and the VictoriesVMware Tanzu
 
Necessary Elements of Digital Marketing to Grow Your Business
Necessary Elements of Digital Marketing to Grow Your BusinessNecessary Elements of Digital Marketing to Grow Your Business
Necessary Elements of Digital Marketing to Grow Your BusinessDigital Vidya
 
Denver startup week outcome based roadmaps
Denver startup week   outcome based roadmapsDenver startup week   outcome based roadmaps
Denver startup week outcome based roadmapsAnderson H. Santiago
 
How to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PMHow to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PMProduct School
 
Start With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data CultureStart With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data CultureAggregage
 
Start With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data CultureStart With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data CultureBrittanyShear
 
Building a sales organization for scale 2019 07 18 (002)
Building a sales organization for scale 2019 07 18 (002)Building a sales organization for scale 2019 07 18 (002)
Building a sales organization for scale 2019 07 18 (002)Arlen Meyers, MD, MBA
 
8 Essentials for Building Robust Features by EA Sr Product Manager
8 Essentials for Building Robust Features  by EA Sr Product Manager8 Essentials for Building Robust Features  by EA Sr Product Manager
8 Essentials for Building Robust Features by EA Sr Product ManagerProduct School
 
Key Strategies to Help You Scale Growth with SAP
Key Strategies to Help You Scale Growth with SAPKey Strategies to Help You Scale Growth with SAP
Key Strategies to Help You Scale Growth with SAPsaastr
 
More Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed DesignMore Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed DesignCourtney Clark
 
Customer Success for Ad Tech
Customer Success for Ad TechCustomer Success for Ad Tech
Customer Success for Ad TechGainsight
 
Ultimate+Team+Building+Pack+2.pptx
Ultimate+Team+Building+Pack+2.pptxUltimate+Team+Building+Pack+2.pptx
Ultimate+Team+Building+Pack+2.pptxAshenafiGirma4
 
Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...
Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...
Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...Optimizely
 
Active Competitive Intelligence
Active Competitive IntelligenceActive Competitive Intelligence
Active Competitive IntelligenceJeremy Horn
 
Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...
Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...
Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...ReadyTalk
 
Achieving Business Excellence (a ChangeThis Manifesto by John Spence)
Achieving Business Excellence (a ChangeThis Manifesto by John Spence)Achieving Business Excellence (a ChangeThis Manifesto by John Spence)
Achieving Business Excellence (a ChangeThis Manifesto by John Spence)Samuli Pahkala
 
Architect, Interior Design, Digital Marketing, Web Design, Graphics Design
Architect, Interior Design, Digital Marketing, Web Design, Graphics DesignArchitect, Interior Design, Digital Marketing, Web Design, Graphics Design
Architect, Interior Design, Digital Marketing, Web Design, Graphics DesignFree Lance
 
Creating Actionable Product Strategy by Turo Director of Product
Creating Actionable Product Strategy by Turo Director of ProductCreating Actionable Product Strategy by Turo Director of Product
Creating Actionable Product Strategy by Turo Director of ProductProduct School
 
Advancing Research: Double Your Mileage
Advancing Research: Double Your MileageAdvancing Research: Double Your Mileage
Advancing Research: Double Your MileageNathan Shedroff
 

Similar to Starting Experimentation & Scaling to Personalization.pptx (20)

Leading Product: The Sparks, the Challenges, and the Victories
Leading Product: The Sparks, the Challenges, and the VictoriesLeading Product: The Sparks, the Challenges, and the Victories
Leading Product: The Sparks, the Challenges, and the Victories
 
Necessary Elements of Digital Marketing to Grow Your Business
Necessary Elements of Digital Marketing to Grow Your BusinessNecessary Elements of Digital Marketing to Grow Your Business
Necessary Elements of Digital Marketing to Grow Your Business
 
Denver startup week outcome based roadmaps
Denver startup week   outcome based roadmapsDenver startup week   outcome based roadmaps
Denver startup week outcome based roadmaps
 
How to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PMHow to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PM
 
Start With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data CultureStart With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data Culture
 
Start With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data CultureStart With Why: Build Product Progress with a Strong Data Culture
Start With Why: Build Product Progress with a Strong Data Culture
 
Gravity v0.2
Gravity v0.2Gravity v0.2
Gravity v0.2
 
Building a sales organization for scale 2019 07 18 (002)
Building a sales organization for scale 2019 07 18 (002)Building a sales organization for scale 2019 07 18 (002)
Building a sales organization for scale 2019 07 18 (002)
 
8 Essentials for Building Robust Features by EA Sr Product Manager
8 Essentials for Building Robust Features  by EA Sr Product Manager8 Essentials for Building Robust Features  by EA Sr Product Manager
8 Essentials for Building Robust Features by EA Sr Product Manager
 
Key Strategies to Help You Scale Growth with SAP
Key Strategies to Help You Scale Growth with SAPKey Strategies to Help You Scale Growth with SAP
Key Strategies to Help You Scale Growth with SAP
 
More Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed DesignMore Than a Feeling: Data-Informed Design
More Than a Feeling: Data-Informed Design
 
Customer Success for Ad Tech
Customer Success for Ad TechCustomer Success for Ad Tech
Customer Success for Ad Tech
 
Ultimate+Team+Building+Pack+2.pptx
Ultimate+Team+Building+Pack+2.pptxUltimate+Team+Building+Pack+2.pptx
Ultimate+Team+Building+Pack+2.pptx
 
Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...
Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...
Webinar: Crate and Barrel Accelerates Their Personalization Program with Opti...
 
Active Competitive Intelligence
Active Competitive IntelligenceActive Competitive Intelligence
Active Competitive Intelligence
 
Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...
Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...
Nurture vs. Nature - The Rules of Real Relationship Building for Prospects & ...
 
Achieving Business Excellence (a ChangeThis Manifesto by John Spence)
Achieving Business Excellence (a ChangeThis Manifesto by John Spence)Achieving Business Excellence (a ChangeThis Manifesto by John Spence)
Achieving Business Excellence (a ChangeThis Manifesto by John Spence)
 
Architect, Interior Design, Digital Marketing, Web Design, Graphics Design
Architect, Interior Design, Digital Marketing, Web Design, Graphics DesignArchitect, Interior Design, Digital Marketing, Web Design, Graphics Design
Architect, Interior Design, Digital Marketing, Web Design, Graphics Design
 
Creating Actionable Product Strategy by Turo Director of Product
Creating Actionable Product Strategy by Turo Director of ProductCreating Actionable Product Strategy by Turo Director of Product
Creating Actionable Product Strategy by Turo Director of Product
 
Advancing Research: Double Your Mileage
Advancing Research: Double Your MileageAdvancing Research: Double Your Mileage
Advancing Research: Double Your Mileage
 

More from VWO

Uncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsUncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsVWO
 
Fueling A_B experiments with behavioral insights (1).pdf
Fueling A_B experiments with behavioral insights (1).pdfFueling A_B experiments with behavioral insights (1).pdf
Fueling A_B experiments with behavioral insights (1).pdfVWO
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
 
Life between variants by Tomas Voves.pdf
Life between variants by Tomas Voves.pdfLife between variants by Tomas Voves.pdf
Life between variants by Tomas Voves.pdfVWO
 
Message-Market Fit VWO Workshop by Daphne tideman
Message-Market Fit VWO Workshop by Daphne tidemanMessage-Market Fit VWO Workshop by Daphne tideman
Message-Market Fit VWO Workshop by Daphne tidemanVWO
 
A_B Testing Personalized Meditation Recommendations.pdf
A_B Testing Personalized Meditation Recommendations.pdfA_B Testing Personalized Meditation Recommendations.pdf
A_B Testing Personalized Meditation Recommendations.pdfVWO
 
Converting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROConverting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROVWO
 
Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfVWO
 
Run more experiments with fewer resources
Run more experiments with fewer resourcesRun more experiments with fewer resources
Run more experiments with fewer resourcesVWO
 
Crafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesCrafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesVWO
 
Diseñando según la regulación actual de cookies para lograr más conversión
Diseñando según la regulación actual de cookies para lograr más conversiónDiseñando según la regulación actual de cookies para lograr más conversión
Diseñando según la regulación actual de cookies para lograr más conversiónVWO
 
VWO - Mark de Winter - Run more experiments with fewer resources.pdf
VWO - Mark de Winter - Run more experiments with fewer resources.pdfVWO - Mark de Winter - Run more experiments with fewer resources.pdf
VWO - Mark de Winter - Run more experiments with fewer resources.pdfVWO
 
Turn Website Visits into Conversions (2).pdf
Turn Website Visits into Conversions (2).pdfTurn Website Visits into Conversions (2).pdf
Turn Website Visits into Conversions (2).pdfVWO
 
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...VWO
 
Understand user struggles. Optimize mobile app UX.
Understand user struggles. Optimize mobile app UX.Understand user struggles. Optimize mobile app UX.
Understand user struggles. Optimize mobile app UX.VWO
 
Turn Website Visits into Conversions (1).pdf
Turn Website Visits into Conversions (1).pdfTurn Website Visits into Conversions (1).pdf
Turn Website Visits into Conversions (1).pdfVWO
 
Converting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROConverting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROVWO
 
Optimizing Mobile App UX for better engagement & conversions.pptx
Optimizing Mobile App UX for better engagement & conversions.pptxOptimizing Mobile App UX for better engagement & conversions.pptx
Optimizing Mobile App UX for better engagement & conversions.pptxVWO
 
Optimizing Mobile App UX for better engagement & conversions.pdf
Optimizing Mobile App UX for better engagement & conversions.pdfOptimizing Mobile App UX for better engagement & conversions.pdf
Optimizing Mobile App UX for better engagement & conversions.pdfVWO
 
7 puntos clave y prácticos en todo proyecto de CRO
7 puntos clave y prácticos en todo proyecto de CRO7 puntos clave y prácticos en todo proyecto de CRO
7 puntos clave y prácticos en todo proyecto de CROVWO
 

More from VWO (20)

Uncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 ReportsUncover Insightful User Journey Secrets Using GA4 Reports
Uncover Insightful User Journey Secrets Using GA4 Reports
 
Fueling A_B experiments with behavioral insights (1).pdf
Fueling A_B experiments with behavioral insights (1).pdfFueling A_B experiments with behavioral insights (1).pdf
Fueling A_B experiments with behavioral insights (1).pdf
 
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfResearch and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdf
 
Life between variants by Tomas Voves.pdf
Life between variants by Tomas Voves.pdfLife between variants by Tomas Voves.pdf
Life between variants by Tomas Voves.pdf
 
Message-Market Fit VWO Workshop by Daphne tideman
Message-Market Fit VWO Workshop by Daphne tidemanMessage-Market Fit VWO Workshop by Daphne tideman
Message-Market Fit VWO Workshop by Daphne tideman
 
A_B Testing Personalized Meditation Recommendations.pdf
A_B Testing Personalized Meditation Recommendations.pdfA_B Testing Personalized Meditation Recommendations.pdf
A_B Testing Personalized Meditation Recommendations.pdf
 
Converting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROConverting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CRO
 
Unifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdfUnifying feature management with experiments - Server Side Webinar (1).pdf
Unifying feature management with experiments - Server Side Webinar (1).pdf
 
Run more experiments with fewer resources
Run more experiments with fewer resourcesRun more experiments with fewer resources
Run more experiments with fewer resources
 
Crafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesCrafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing Pages
 
Diseñando según la regulación actual de cookies para lograr más conversión
Diseñando según la regulación actual de cookies para lograr más conversiónDiseñando según la regulación actual de cookies para lograr más conversión
Diseñando según la regulación actual de cookies para lograr más conversión
 
VWO - Mark de Winter - Run more experiments with fewer resources.pdf
VWO - Mark de Winter - Run more experiments with fewer resources.pdfVWO - Mark de Winter - Run more experiments with fewer resources.pdf
VWO - Mark de Winter - Run more experiments with fewer resources.pdf
 
Turn Website Visits into Conversions (2).pdf
Turn Website Visits into Conversions (2).pdfTurn Website Visits into Conversions (2).pdf
Turn Website Visits into Conversions (2).pdf
 
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
Principales obstáculos de la experimentación y cómo abordarlos en StartUps...
 
Understand user struggles. Optimize mobile app UX.
Understand user struggles. Optimize mobile app UX.Understand user struggles. Optimize mobile app UX.
Understand user struggles. Optimize mobile app UX.
 
Turn Website Visits into Conversions (1).pdf
Turn Website Visits into Conversions (1).pdfTurn Website Visits into Conversions (1).pdf
Turn Website Visits into Conversions (1).pdf
 
Converting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CROConverting with Comedy: Research Parallels for CRO
Converting with Comedy: Research Parallels for CRO
 
Optimizing Mobile App UX for better engagement & conversions.pptx
Optimizing Mobile App UX for better engagement & conversions.pptxOptimizing Mobile App UX for better engagement & conversions.pptx
Optimizing Mobile App UX for better engagement & conversions.pptx
 
Optimizing Mobile App UX for better engagement & conversions.pdf
Optimizing Mobile App UX for better engagement & conversions.pdfOptimizing Mobile App UX for better engagement & conversions.pdf
Optimizing Mobile App UX for better engagement & conversions.pdf
 
7 puntos clave y prácticos en todo proyecto de CRO
7 puntos clave y prácticos en todo proyecto de CRO7 puntos clave y prácticos en todo proyecto de CRO
7 puntos clave y prácticos en todo proyecto de CRO
 

Recently uploaded

The Skin Games 2024 25 - Sponsorship Deck
The Skin Games 2024 25 - Sponsorship DeckThe Skin Games 2024 25 - Sponsorship Deck
The Skin Games 2024 25 - Sponsorship DeckToluwanimi Balogun
 
BrightonSEO - Addressing SEO & CX - CMDL - Apr 24 .pptx
BrightonSEO -  Addressing SEO & CX - CMDL - Apr 24 .pptxBrightonSEO -  Addressing SEO & CX - CMDL - Apr 24 .pptx
BrightonSEO - Addressing SEO & CX - CMDL - Apr 24 .pptxcollette15
 
SORA AI: Will It Be the Future of Video Creation?
SORA AI: Will It Be the Future of Video Creation?SORA AI: Will It Be the Future of Video Creation?
SORA AI: Will It Be the Future of Video Creation?Searchable Design
 
Snapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdfSnapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdfEastern Online-iSURVEY
 
Mastering SEO in the Evolving AI-driven World
Mastering SEO in the Evolving AI-driven WorldMastering SEO in the Evolving AI-driven World
Mastering SEO in the Evolving AI-driven WorldScalenut
 
Forecast of Content Marketing through AI
Forecast of Content Marketing through AIForecast of Content Marketing through AI
Forecast of Content Marketing through AIRinky
 
Word Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample GenresWord Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample GenresLisa M. Masiello
 
Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...
Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...
Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...robertpresz7
 
Omnichannel Marketing: Defining Omnichannel Marketing
Omnichannel Marketing: Defining Omnichannel MarketingOmnichannel Marketing: Defining Omnichannel Marketing
Omnichannel Marketing: Defining Omnichannel MarketingDove Soft Ltd
 
The Impact of Digital Technologies
The Impact of Digital Technologies The Impact of Digital Technologies
The Impact of Digital Technologies bruguardarib
 
Best Persuasive selling skills presentation.pptx
Best Persuasive selling skills  presentation.pptxBest Persuasive selling skills  presentation.pptx
Best Persuasive selling skills presentation.pptxMasterPhil1
 
Red bull marketing presentation pptxxxxx
Red bull marketing presentation pptxxxxxRed bull marketing presentation pptxxxxx
Red bull marketing presentation pptxxxxx216310017
 
DIGITAL MARKETING COURSE IN BTM -Influencer Marketing Strategy
DIGITAL MARKETING COURSE IN BTM -Influencer Marketing StrategyDIGITAL MARKETING COURSE IN BTM -Influencer Marketing Strategy
DIGITAL MARKETING COURSE IN BTM -Influencer Marketing StrategySouvikRay24
 
2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)Jomer Gregorio
 
ASO Process: What is App Store Optimization
ASO Process: What is App Store OptimizationASO Process: What is App Store Optimization
ASO Process: What is App Store OptimizationAli Raza
 
Call Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCR
Call Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCRCall Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCR
Call Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCRlizamodels9
 
Jai Institute for Parenting Program Guide
Jai Institute for Parenting Program GuideJai Institute for Parenting Program Guide
Jai Institute for Parenting Program Guidekiva6
 
Local SEO Domination: Put your business at the forefront of local searches!
Local SEO Domination:  Put your business at the forefront of local searches!Local SEO Domination:  Put your business at the forefront of local searches!
Local SEO Domination: Put your business at the forefront of local searches!dstvtechnician
 
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfDIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfmayanksharma0441
 
How To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot SetupHow To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot Setupssuser4571da
 

Recently uploaded (20)

The Skin Games 2024 25 - Sponsorship Deck
The Skin Games 2024 25 - Sponsorship DeckThe Skin Games 2024 25 - Sponsorship Deck
The Skin Games 2024 25 - Sponsorship Deck
 
BrightonSEO - Addressing SEO & CX - CMDL - Apr 24 .pptx
BrightonSEO -  Addressing SEO & CX - CMDL - Apr 24 .pptxBrightonSEO -  Addressing SEO & CX - CMDL - Apr 24 .pptx
BrightonSEO - Addressing SEO & CX - CMDL - Apr 24 .pptx
 
SORA AI: Will It Be the Future of Video Creation?
SORA AI: Will It Be the Future of Video Creation?SORA AI: Will It Be the Future of Video Creation?
SORA AI: Will It Be the Future of Video Creation?
 
Snapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdfSnapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of March 2024-EOLiSurvey (EN).pdf
 
Mastering SEO in the Evolving AI-driven World
Mastering SEO in the Evolving AI-driven WorldMastering SEO in the Evolving AI-driven World
Mastering SEO in the Evolving AI-driven World
 
Forecast of Content Marketing through AI
Forecast of Content Marketing through AIForecast of Content Marketing through AI
Forecast of Content Marketing through AI
 
Word Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample GenresWord Count for Writers: Examples of Word Counts for Sample Genres
Word Count for Writers: Examples of Word Counts for Sample Genres
 
Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...
Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...
Content Marketing For A Travel Website On The Examples Of: Booking.com; TripA...
 
Omnichannel Marketing: Defining Omnichannel Marketing
Omnichannel Marketing: Defining Omnichannel MarketingOmnichannel Marketing: Defining Omnichannel Marketing
Omnichannel Marketing: Defining Omnichannel Marketing
 
The Impact of Digital Technologies
The Impact of Digital Technologies The Impact of Digital Technologies
The Impact of Digital Technologies
 
Best Persuasive selling skills presentation.pptx
Best Persuasive selling skills  presentation.pptxBest Persuasive selling skills  presentation.pptx
Best Persuasive selling skills presentation.pptx
 
Red bull marketing presentation pptxxxxx
Red bull marketing presentation pptxxxxxRed bull marketing presentation pptxxxxx
Red bull marketing presentation pptxxxxx
 
DIGITAL MARKETING COURSE IN BTM -Influencer Marketing Strategy
DIGITAL MARKETING COURSE IN BTM -Influencer Marketing StrategyDIGITAL MARKETING COURSE IN BTM -Influencer Marketing Strategy
DIGITAL MARKETING COURSE IN BTM -Influencer Marketing Strategy
 
2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)2024 SEO Trends for Business Success (WSA)
2024 SEO Trends for Business Success (WSA)
 
ASO Process: What is App Store Optimization
ASO Process: What is App Store OptimizationASO Process: What is App Store Optimization
ASO Process: What is App Store Optimization
 
Call Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCR
Call Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCRCall Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCR
Call Girls In Aerocity Delhi ❤️8860477959 Good Looking Escorts In 24/7 Delhi NCR
 
Jai Institute for Parenting Program Guide
Jai Institute for Parenting Program GuideJai Institute for Parenting Program Guide
Jai Institute for Parenting Program Guide
 
Local SEO Domination: Put your business at the forefront of local searches!
Local SEO Domination:  Put your business at the forefront of local searches!Local SEO Domination:  Put your business at the forefront of local searches!
Local SEO Domination: Put your business at the forefront of local searches!
 
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdfDIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
DIGITAL MARKETING STRATEGY_INFOGRAPHIC IMAGE.pdf
 
How To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot SetupHow To Utilize Calculated Properties in your HubSpot Setup
How To Utilize Calculated Properties in your HubSpot Setup
 

Starting Experimentation & Scaling to Personalization.pptx

  • 1. Starting Experimentation & Scaling to Personalization Sarah Fruy VP of Marketing Linqia
  • 2. Agenda • Decision-making without experimentation • Proving the need for experimentation • Getting buy-in • Leveling up to personalization
  • 3. SARAH FRUY VP of Marketing Linqia @sarahfruy
  • 4. “In an increasingly digital world, if you don’t do large-scale experimentation, in the long term—and in many industries the short term—you’re dead.” - Mark Okerstrom, CEO
  • 5. Your team can anchor on out-of-date or misleading information ◆Working off of assumptions ◆High-risk ◆Lack of innovation ◆Inability to respond to rapidly changing environments Decision-Making Without Experimentatio n
  • 6. Properly managed experimentation programs yield positive ROI for your business ◆Data-driven decision making ◆Faster iterations ◆Cross-functional collaboration Proving the Need for Experimentatio n
  • 7. PANTHEON.IO 7 Growth Levers Measurable Growth Levers (e.g. page layout, UX, color, CTA, etc ) North Star Metric (e.g. site conversion)
  • 8. [Regular experimentation] helped Microsoft’s Bing unit make dozens of monthly improvements, which collectively have boosted revenue per search by 10% to 25% a year.
  • 9. Getting Buy-In to Initiate Your Experimentation Program 9
  • 10. Ensure top-down, bottom up consensus ◆ Create enthusiasm for your program at all levels of your organization ◆ Identify potential blockers Getting Buy-In to Initiate Your Experimentatio n Program
  • 11. Build a business case for resources ◆ Budget ◆ Tools/software ◆ Staff: developers, user interface designers, data analysts, copywriters, etc. ◆ Data pipelines
  • 12. Establish a strong foundation with a single northstar metric ◆ Centralized vs decentralized teams ◆ Program management guidelines ◆ Prioritization framework ◆ Ethical testing practices
  • 13. “Our success at Amazon is a function of how many experiments we do per year, per month, per week, per day.” - Jeff Bezos, CEO
  • 14. Maximize the Impact of Your Experimentation Program 14
  • 15. ➔ Eliminate the guesswork ◆ Data must trump opinions ➔ Create a culture of experimentation ◆ Ensure a continuous cycle of iteration ◆ Create opportunities for learning ◆ Enable healthy debate among team members ◆ Embrace failure and learn from it Maximize the Impact of Your Experimentation Program
  • 16. Socialize and celebrate wins/learnings ◆ Tie your experiments back to your company goals ◆ Nurture an environment where all employees can contribute
  • 17. Insights-driven businesses are growing by more than 30% annually and are on track to earn $1.8 trillion by 2021.
  • 18. Leveling Up to Personalization 18
  • 19. Foster collaborative brainstorming sessions ◆ Gather a diverse set of stakeholders ◆ Look at data and analytics: customer surveys/interviews, funnel reporting, engagement metrics, heat-mapping, and cohort analysis Leveling Up to Personalization
  • 20. Stay focused on the needs of your customers ◆ Form a hypothesis on where the line is between helpful and creepy when it comes to personalization ◆ Include both qualitative and quantitative data in your research
  • 21. ➔ Ensure good data ◆ When personalization goes wrong, it can hurt your business ➔ Incentivize employees to submit ideas for experimentation
  • 23. PANTHEON.IO 2323 Experimenting with Growth Levers +53.5% improvement on Demo CTA +10.8% improvement on Free Trial CTA
  • 25. PANTHEON.IO +3.3% improvement on Demo CTA +1.5% improvement on Free Trial CTA
  • 26. Key Takeaways Embrace experimentation across your entire company Tie results back to company goals Keep your customer at the center of your experimentation program