Lisa Seaman, User Experience Manager at Autodesk, shares how she tests and optimizes Autodesk’s websites with UserTesting. She’ll discuss how her team uses UserTesting and why it has become such a crucial tool for their agile approach.
4. Across All Platforms, At All Stages Of Development
Watch customers interact with:
DESKTOP SMARTPHONE TABLET
WEBSITES APPS &
PROGRAMS
PROTOTYPES &
WIREFRAMES
SURVEYS PHYSICAL
PRODUCTS
Anywhere people interact with your brand:
AT HOME AT A STORE ON THE GO
On any pla6orm or device:
#UTwebinar
5. 8
Lisa Seaman
User Experience Manager, Autodesk
Lisa Seaman, User Experience Manager at Autodesk, is a customer advocate at heart.
She uses A/B testing, usability studies, web analytics, and customer comments to
evaluate websites and find opportunities to make them work better. She has worked
in the user experience and web analytics space for over 12 years and her past
stomping grounds include WhichTestWon, Sun Microsystems, and Outward Bound.
@BoulderLisaS
#UTwebinar
10. 1. We meant well
2. Sometimes you want to convince
3. Comparison studies
4. A/B testing pairs well with UserTesting
5. + 4 tips!
Case Studies
@BoulderLisaS #UTwebinar
21. What
should I
test?
Tip #2: Read customer
comments or talk to tech
support. Run tests on tasks
that customers tell you
about or that you are
concerned about.
@BoulderLisaS
26. Quotes – What is this a picture of?
“canal”
Image A
“channel”
“sea port”
“dam concept”
“a series of water locks”
Image B
“water reservoir”
“a park”
“urban design, lighting poles,
streets, houses, empty plots, a
reservoir”
27. Quotes – Which image do you like better?
“Image A lends more
focus to the concept.”
“It is better to infer from
Image A what is
represented by it.”
“Looks much more
realistic.”
“It’s more complex,
has more details.”
Image A Image B
28. Which image did people prefer?
23%
77%
Like A better Like B better
Users who saw A first, then B
§ Image B was easier to understand after seeing image A
50% 50%
Like A better Like B better
Users who saw B first, then A
31. For a comparison study
where half the people see
A then B, and the other
half see B then A, can I do
that in one test?
Tip #3: Use two
separate tests to do a
comparison study.
@BoulderLisaS
32. If you do a/b testing, add a
UserTesting study
@BoulderLisaS
38. Case Studies
1. Evaluate usability (We meant well…)
2. Make a convincing case for change
3. Comparison study
4. A/B testing pairs well with UserTesting
Summary
@BoulderLisaS
Tips
1. In a hurry? Use more ratings, written, and multiple choice questions.
2. Looking for test ideas? Read customer comments or talk to tech support.
3. For a comparison study, swap the order of tasks and use two separate tests.
4. Want more older participants? Use two groups to get an even split of ages (or
browsers or genders) within one test.