70% (the red combined) of ideas brought to the consumer group have zero (or negative) impact to the business.
While this is taken from consumer, the process we’re using is the same, it’s subjective, decisions are made without visibility.
A data driven framework for analysis & development (that is objective in nature) will force the correct code to be written – yielding code that positively impacts business.
Create a framework that standardizes a methodology for opportunities.
Foundation for testing opportunities.
Decide where to test. Seeing that if customers cannot find the product page, don’t test there. Remove adhawk decision making.
Define the testing strategy, introducing analysis of where and how strategy should be implemented.
Testing to for discovery, to understand customer behavior at a high altitude.
Result of AB testing call to action above the fold.
Tried and true framework used with success.
Always test for a conversion rate, NOT total numbers. Always test for a %, test for engagement, time on site, any kind of metric that you can be normalized. Normalized goal metrics.
You may not have enough customers to test for conversion rates, and your goal may not be conversion rate. Enterprise goal should be return engagement….Their conversion rate is for lead generation. Goes back to business objectives. If Business objectives are to support sales channels, then metrics that ladder up to engagement is what’s being tested.
20% increase
.5 to 1 = 100% increase in conversion rate
10% to 30% = is a 20% increase in conversion rate.
It’s a tactic that supports the strategic roadmap.
With problem statement, we need to understand the framework for how and why it is deployed. We need to first understand business objective, then tactics to implement strategy.
Testing is an integral part to deploying a strategy.
***KD note: I changed employed to deployed. Is this right?
Top 5 "Actionable“ Items to Drive CSAT
Usability: Ease of Use, Learnability, and Delightful
NPS (Net Promoter Score)
Minimal Touch
Simplicity
Empowerment
Take the framework previously define and apply to any channel.
KD note: Below the graph I think Stickyness should be with an “i” to be Stickiness….
Test your messaging strategy against cohorts and segments
2 years of data round messaging strategy and compared sales to engagement – comparing promotional pricing versus value messaging. Helped drive strategy with regression analysis.
Take a more sustainable approach with product value messaging. Shows the value of the product over promotional pricing. Key is the measurement.
Appropriate measurement will help influence the proper strategy.
For Pizza Hut we were able to regress engagement with respect to sales and prove that a product messaging strategy was superior to coupons
(types of tests: AB testing, segmentation analysis, surveys, user profiling, user demographic profiling, regression testing)
AB testing is only 1 part of a comprehensive test based design methodology
Virtuous loop versus a loop that degrades overtime, virtuous cycle
Graph has components of actual tactics.
Learn Test Implement are the tactics:
This is how you develop, refine, and test strategy
Short cycles allow for implementation of learning. Use to make process more efficient, ultimately you build a better product, the success or failure of the product is determined by previous release.
Virtuous cycle helps create a balanced business model, through over time, reducing CAC to less than $1. SO the the LTV just above a dollar.
Example of adjusting UX of game, ensure people spent enough time on the site, to get the site viral.
Increasing return engagement, consequently people spend money and invite friends.
Getting 2nd, 3rd, 7th, and 14th day engagement numbers up
KD notes: Made some minor changes to the copy. Please see if it still says what you want it to.
Use good ux flow
See placement of content between pages 4 and 5
Use good ux flow
See placement of content between pages 4 and 5