5. Then compare two web pages by showing the two
variants (let's call them A and B) to similar visitors at
the same time.
Konrad Synoradzki Allegro Group 2013
9. What can you test?
Headlines
Sub headlines
Paragraph Text
Testimonials
Call to Action text
Call to Action Button
Links
Images
Content above or below
the fold
• Social proof
•
•
•
•
•
•
•
•
•
Konrad Synoradzki Allegro Group 2013
•
•
•
•
•
•
Media mentions
Awards and badges
Banners efficiency
Rotation speed
New version of page
Removing ads
11. A/B testing
Best used to measure the
impact of a two to four
variables on interactions with
the page.
Examples:
• new layout
• Labels on button
Konrad Synoradzki Allegro Group 2013
12. Multivariate Testing
• compares a higher
number of variables,
• reveals more information
about how these
variables interact with
one another.
• traffic to a page is split
between different
versions of the design.
Examples
• Test headline, button
color, button text and
image on landing page
Konrad Synoradzki Allegro Group 2013
13. Multi-Page Testing
• A/B test on multi-page
Example:
• Colors on primary
action in process
• Badges on promo items
Konrad Synoradzki Allegro Group 2013
25. Each Project Has Its Own
Project Code (Snippet)
or asynchronous version
Konrad Synoradzki Allegro Group 2013
26. Optimizely Snippet Contents
•
•
•
•
•
Active Experiments
Draft Experiments
Project Goals
Optimizely execution and tracking logic
Optimizely jQuery Settings (optional – version 1.6.4 included by
default)
Konrad Synoradzki Allegro Group 2013
28. Optimizely translates every change made in the visual editor
into a line of jQuery code, which we call Variation Code:
Konrad Synoradzki Allegro Group 2013
33. Optimizely Architecture Overview
• Google App Engine is used to store and manage your account and
experiment configuration settings, including your account login
and password information. Passwords are hashed and stored
securely using 160 bit cryptographic hashes.
• Amazon Elastic Compute Cloud and Simple Storage Service is
used to store your conversion/traffic logging data, which
Optimizely uses to compute experiment results.
• Akamai is used to store and serve your Optimizely snippet
JavaScript file(s). This file is publicly accessible by necessity.
Konrad Synoradzki Allegro Group 2013
34. Collecting data
The visitor’s browser makes an asynchronous request to
https://log.optimizely.com, which logs the following information:
•
•
•
•
•
•
•
The Optimizelyassigned unique user ID
IDs of the experiments and variations this visitor has seen
Your Optimizely account number
Visitor’s browser/OS version
Visitor’s IP address, with last octet removed
A string identifying this conversion goal, such as the page URL
Date and time
Konrad Synoradzki Allegro Group 2013