Complete presentation of UX Webinar hosted by UXness on 'Remote Usability Testing: Plan & Setup' using Maze tool. Remote usability testing, pros-cons, best practices, types, planning, setup.
This Webinar was focussed on explaining the value of Remote Usability Testing and also the walkthrough of Maze tool given with live demo of setting up Usability Testing.
Author - Abhishek Jain (Design Lead UX Researcher)
To download the presentation - Please write to UXness (team@uxness.in) and we will share a copy with you.
Date: 11 Apr 2020
Location - Online
Website - www.uxness.in
Email - team@uxness.in
2. UXness
UXness is an online platform with 22K+ designers
where UX related knowledge gets shared by expert
UX authors. Along with information about UX tools,
design Events, UX books, UX Courses, UI Templates
etc.
UXness (World of UX Design)
www.uxness.in
Connections
22K+
Mobile app
downloads
10K+ UX Articles
UX Tools
UX Courses
UX Templates
UX Events
UX Books
Across the
globe
readers
Education Partner
Key offerings
5. Pros & Cons of Remote Usability Testing
Pros Cons
Time savings Controlling the environment
Recruit participants Difficulty in moderation
Natural environment Difficulty in observing non-verbal cues
True Behavior Building rapport with participants
More tests per day Session duration
Cross geographical mix Network connectivity
Drastic cost savings Software or infrastructure setup readiness
6. COVID 19 situation
• Work From Home (WFH)
• Business faces economical impact
• Travel restrictions across the globe
• Social distancing is the ‘Mantra’
• Reducing the cost on processes is must
• Innovative ways are needed for sustainability
8. Types of Remote Usability Testing
Moderated RUT
In moderated remote testing, users and
facilitators are in the same “virtual”
space at the same time — the facilitator
is watching the usability test remotely
as it happens, and communicating
directly with the participant via the
telephone, email, chat, or a
combination of methods.
Unmoderated RUT
In an unmoderated remote session, the
participant completes the study on his
or her own schedule, recording the
session for later review by the usability
expert.
Unmoderated testing works well in tight
time frames or when budget is
tight; you do not have the expense of
having to pay a facilitator. Unmoderated
testing is best used when testing a few
specific elements of an experience, like
a particular widget or a minor change.
9. Remote Usability & Collaboration Tools
- List Remote Usabiity Testing tools
- List online services like User Testing, UserCrowd etc.
- List the tools which can help in moderation
Usability testing tools Collaboration tools
11. Planning Remote Usability Testing
Key components of planning
- Research goals
- Metrics
- Mode of testing
- Tools to be used
- Test participants and selection criteria
- Tasks & Scenarios
- Pre and post UT questionnaires
- Timeframe, schedule & budget
Sample Usability Testing plan
12. Best practices
- Mix and expand the diversity in recruiting users
- Consider informing and notifying the users for session in advance and frequently
- Provide list of checklist for remote research etiquette like silent and disturbance free environment, video and audio call, research tool
preparation in advance (if required)
- Tasks length is critical, break the complex task in to smaller tasks
- Limit the session duration
- Most imp. aspect is NDA, Consent forms, get them signed before the schedule
- Incentives, share the incentive as soon as the session completes. Get the payment details and things setup in advance
- Screener is really important, do not directly post on social media for testing links
- Localization of content and design for specific geography
- Expect delays in communication while moderation
- Use Laptop hugging ( a cheap method) for mobile prototypes
- Have backup plan and alternate ways ready
- Test before you go for actual test, don’t just test the setup but also the data for insights
13. Setup (Sample project - NeedHunt)
NeedHunt is a concept of a platform
to search for daily household and
nearby service providers.
Prototype link
https://invis.io/A3WSCE4VC69
Testing tool
Maze
S.No. Task Scenario Expected interaction
1 Search service
provider
You recently moved from Delhi to
Mumbai and started living in Andheri. In
your new home you wanted to start
Newspaper delivery. You got to know
about NeedHunt app and wanted to look
for Newspaper Delivery service in that.
How would you do that?
- NeedHunt home > Use search
service provider for location
Mumbai, Andheri & service
Newspaper Delivery. > Search
- NeedHunt Home > Use search
service provider for location
Mumbai, Andheri > Most searched
services > Newspaper delivery
2 Book service You wanted to check for best Newspaper
delivery service and book for daily
delivery.
Search results > Select any service
provider > Look for details > Book
service button
3 Refer service provider You are very happy with your nearby
Laundry service and wanted to refer that
to more people. You got to know that in
NeedHunt you can help him by referring.
NeedHunt home > Refer Service
Provider > Enter Service Provider
details > Provide ratings > Refer
Service Provider
4 Become service
provider
You own a Music class in Pune, Wakad
and got to know that more people are
searching for Music classes on NeedHunt
application. You wanted to create your
presence at NeedHunt so that people
can search you.
NeedHunt home > Register as Service
Provider > Enter Service Provider
details > Create account
5 Update service details You recently started a new batch of
Music class Guitar and wanted to update
details in your NeedHunt account.
NeedHunt home > Login > Account
details > Edit > Update details