SlideShare a Scribd company logo
1 of 35
Download to read offline
Crafting a UX Challenge
UX Candidates
for Evaluating
Chelsea 

Soprano

Experience Architect
projekt202
Josh 

Christoper
Experience Director
projekt202
Like many internal processes, the way companies interview
candidates is often not created with intention.
Start with some:
“This is just how we’ve
always done it.”
+ +
Interviewing
Throw in a bit of:
“HR says we need to
be doing this.”
Sprinkle on some:
“Let’s try something
new and trendy.”
Craft the Experience
It’s worth the effort to
Organizations that invest in a strong candidate
experience improve their quality of hires by 70%.
2017 Statistical Reference Guide for Recruiters
Looking Deeper Into
Interview Process
Our Previous
PHONE INTERVIEW
Candidate
Recruiter
Interviewers
1
Candidate applies
1 1
Receives
application
and does initial
vetting
Practitioner
portfolio
review
APPLICATION
2
INITIAL SCREENING
Portfolio is
posted
internally for
review
3
Candidate is
contacted to
schedule
phone
interview
42
Phone interview
In-person
interview is
scheduled
IN-PERSON INTERVIEW
60 min.

Office tour,
introductions, interview
questions, 2-3 people
review portfolio
53 4 6 5 2
THE OFFER
7 6
Offer extended
Hired
Frustrations
• Recruiters
unsure about
what to look for
in a portfolio
• Recruiters frustrated by how
‘picky’ practitioners are
about candidates
• First contact to candidate
and it could have been a
lengthly wait.
• Overlap in questions
the candidate
originally was asked.
• No consistency in
questioning
• Time feels too short
• Poor tracking of info
• Portfolio is rehearsed
and unclear often of
involvement of
candidate
• Portfolio is thin but
see potential in
candidate
• Candidate has
accepted another offer
(time, money, level)
• Trouble remembering
specifics about the
candidate
PHONE INTERVIEW
Candidate
Recruiter
Interviewers
1
Candidate applies
1 1
Receives
application
and does initial
vetting
Practitioner
portfolio
review
APPLICATION
2
INITIAL SCREENING
Portfolio is
posted
internally for
review
3
Candidate is
contacted to
schedule
phone
interview
42
Phone interview
In-person
interview is
scheduled
IN-PERSON INTERVIEW
60 min.

Office tour,
introductions, interview
questions, 2-3 people
review portfolio
53 4 6 5 2
THE OFFER
7 6
Offer extended
Hired
Frustrations
• Recruiters
unsure about
what to look for
in a portfolio
• Recruiters frustrated by how
‘picky’ practitioners are
about candidates
• First contact to candidate
and it could have been a
lengthly wait.
• Overlap in questions
the candidate
originally was asked.
• No consistency in
questioning
• Time feels too short
• Poor tracking of info
• Portfolio is rehearsed
and unclear often of
involvement of
candidate
• Portfolio is thin but
see potential in
candidate
• Candidate has
accepted another offer
(time, money, level)
• Trouble remembering
specifics about the
candidate
Designers should be
able to speak to what’s
in their portfolio in
detail. In fact, it should
be a body of work that
they have been
critiqued by others
multiple times.
They’re
rehearsed
Candidate’s
role in the work
Constraints 

happen
UI kits are
prevalent
Portfolio Reviews
Issues with just having
Projects in portfolios
could have many
different designers
involved, what did the
candidate do? Was it a
team effort, could they
replicate the work at a
similar pace?
Did they find an a free
asset or utilize a robust
system tool like Google
Material to assemble
their design? It’s fine if
so, but can they
articulate good UI
decisions or were they
inherited?
We really couldn’t know
all the constraints that
person had to work
within. We often struggle
to find designers that
consistently have the
opportunity to get user
involvement in their
process.
1. Can they articulate rationale for business decisions made along the way?
2. Where was there tension, and how did they compromise?
3. What was the extent of their involvement over the length of the project?
4. What did they do to empathize and understand the needs of the end user?
5. Did it get made, and what was that process like?
Portfolio reviews will always play a
Huge Role
PHONE INTERVIEW
Candidate
Recruiter
Interviewers
1
Candidate applies
1 1
Receives
application
and does initial
vetting
Practitioner
portfolio
review
APPLICATION
2
INITIAL SCREENING
Portfolio is
posted
internally for
review
3
Candidate is
contacted to
schedule
phone
interview
42
Phone interview
In-person
interview is
scheduled
IN-PERSON INTERVIEW
60 min.

Office tour,
introductions, interview
questions, 2-3 people
review portfolio
53 4 6 5 2
THE OFFER
7 6
Offer extended
Hired
Frustrations
• Recruiters
unsure about
what to look for
in a portfolio
• Recruiters frustrated by how
‘picky’ practitioners are
about candidates
• First contact to candidate
and it could have been a
lengthly wait.
• Overlap in questions
the candidate
originally was asked.
• No consistency in
questioning
• Time feels too short
• Poor tracking of info
• Portfolio is rehearsed
and unclear often of
involvement of
candidate
• Portfolio is thin but
see potential in
candidate
• Candidate has
accepted another offer
(time, money, level)
• Trouble remembering
specifics about the
candidate
Based on the context gathered. There were a handful of other
factors that we needed to accommodate for.
We didn’t want to make
the process significantly
longer by adding more
rounds of interviews.
We have to staff up
rapidly, somewhat
unpredictably, and
sometimes significantly.
Whatever we do, HR
says it MUST BE
consistent for everyone
applying to that role.
Considerations
Run it like a
Project
2
Create a
protocol/
prototype
Gather 

data/context
1
Test it
3
Iterate
4
Launch
5
Are they an excellent
communicator?
Do they have a good understanding of
the UX process? Do they value working
on a team that places an emphasis on
user research?
What do we want to get
From the Interview?
Can they present and
defend their work?
“UX Hire”
“We” are looking for a
0
25
50
75
100
Qual. Researcher IA 'Rock Star' Design Front-End Dev Business Acumen Experience
Some ways to
UX candidates
Scare Away
Bean Bag Chairs
Unicorn Scrappy Rock Star
My client, a Fortune X Company…
Artistic / Artsy
Flexible
Generate Assets
Great Environment
Fast-pacedJedi-Mastery
Guru
Ninja
Some Avoidable
Keywords Self-starter
After all, this is the candidate’s experience.
What do we want the
candidate to get out of
the interview?
Do they align with the
way we do things? Do
they like it?
Are they getting what
they need?
Oh Shoot!
What about them?
Critique & Feedback
Giving good/safe
Ultimate List of Hiring Stats
94% of interviewees want to receive interview
feedback, but only 41% have received interview
feedback before.
Critique & Feedback
Giving good/safe
Ultimate List of Hiring Stats
Candidates are 4x more likely to consider your
company for a future opportunity when you offer them
constructive feedback.
And so... we decided to make a
Design Challenge
… I presented both my portfolio and the exercise
to a panel of designers/researchers for an hour
and then met with each of them in 1:1 interviews
for the rest of the day, breaking briefly for lunch at
the cafeteria. During lunch, a designer gave me a
brief tour of the campus. Each 1:1 interview
included a design exercise and a set list of
questions (to prevent overlap)…
Homework is extremely
vague on time
expectations. Asking a
candidate to solve real
work without a time
constraint is spec. work.
Not Homework
or Client Related
Not 1-Sided Not Pass/FailNot A Surprise
Our Challenge
We cautiously crafted
We want people to learn
just as much about us as
we learn about them
during our challenge/
interview. It is a dialogue
not a test. In our case we
gave them mock
research to inform their
solution.
We want to make sure
people know we will be
doing a challenge during
the interview ahead of
time. Interviewing is
stressful enough without
intentionally adding to
that stress.
It is meant to be an
opportunity to speak
deeper with candidates
about their process and
how they work. Often it
helps us rule in
candidates that have a
thinner portfolio.
& Consistency
Thoughts about training
Google explains why "Hiring is the Most Important Thing You Do"
“…we have found from our research that it isn't that some people are better
interviewers than other people. It's really the structure and the process that
makes you a good or a bad interviewer. So if you're somebody who can follow
that structure — you can follow instructions and ask good questions and engage
with candidates — then you can be a great interviewer.”
Improve efficiency
when anyone can give
the interview.
Create a more consistent
experience between
candidates.
Reduce bias with
documentation.
Consistency, consistency, with a
Protocol
1 2 3
Upfront
Let candidates know
All the Details
Give the candidate
To Choose From
Give them some options
Research
Give them the
Kelly Moran

P202 Principal Experience Researcher
We conducted
contextual
research with 24
users (pairing
managers with
tellers at a 50/50
split)…
“
“”
What to
Expect
Crafting an Interview Challenge for Evaluating UX Candidates
Crafting an Interview Challenge for Evaluating UX Candidates
Crafting an Interview Challenge for Evaluating UX Candidates
Crafting an Interview Challenge for Evaluating UX Candidates
In Summary
Design your candidate
experience with intention.
Keep in mind the purpose of
the interview, for both your
team and the candidate.
Do a whiteboard challenge if
it meets your needs. And do it
ethically.
Be more consistent, it’s better
for everyone. A protocol can
help you out.
Go out an make your companies better!
Thanks &
Questions?

More Related Content

Recently uploaded

Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before ConstructionResDraft
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfsaidbilgen
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxSamKuruvilla5
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsBlock Party
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxHasan S
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillCre8iveskill
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxb2kshani34
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024Alan Dix
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Ed Orozco
 
How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTThink 360 Studio
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Ted Drake
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfHctorFranciscoSnchez1
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Amil baba
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazineRivanEleraki
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...khushisharma298853
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024mikailaoh
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comjakyjhon00
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLkenzukiri
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtTeeFusion
 

Recently uploaded (19)

Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before Construction
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptx
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teams
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkill
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptx
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
 
How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPT
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdf
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazine
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...
 
UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.com
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy Shirt
 

Featured

ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming LanguageSimplilearn
 
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...Palo Alto Software
 
9 Tips for a Work-free Vacation
9 Tips for a Work-free Vacation9 Tips for a Work-free Vacation
9 Tips for a Work-free VacationWeekdone.com
 
I Rock Therefore I Am. 20 Legendary Quotes from Prince
I Rock Therefore I Am. 20 Legendary Quotes from PrinceI Rock Therefore I Am. 20 Legendary Quotes from Prince
I Rock Therefore I Am. 20 Legendary Quotes from PrinceEmpowered Presentations
 
How to Map Your Future
How to Map Your FutureHow to Map Your Future
How to Map Your FutureSlideShop.com
 

Featured (20)

ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
 
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
 
9 Tips for a Work-free Vacation
9 Tips for a Work-free Vacation9 Tips for a Work-free Vacation
9 Tips for a Work-free Vacation
 
I Rock Therefore I Am. 20 Legendary Quotes from Prince
I Rock Therefore I Am. 20 Legendary Quotes from PrinceI Rock Therefore I Am. 20 Legendary Quotes from Prince
I Rock Therefore I Am. 20 Legendary Quotes from Prince
 
How to Map Your Future
How to Map Your FutureHow to Map Your Future
How to Map Your Future
 

Crafting an Interview Challenge for Evaluating UX Candidates

  • 1. Crafting a UX Challenge UX Candidates for Evaluating
  • 2. Chelsea 
 Soprano
 Experience Architect projekt202 Josh 
 Christoper Experience Director projekt202
  • 3. Like many internal processes, the way companies interview candidates is often not created with intention. Start with some: “This is just how we’ve always done it.” + + Interviewing Throw in a bit of: “HR says we need to be doing this.” Sprinkle on some: “Let’s try something new and trendy.”
  • 4. Craft the Experience It’s worth the effort to Organizations that invest in a strong candidate experience improve their quality of hires by 70%. 2017 Statistical Reference Guide for Recruiters
  • 5. Looking Deeper Into Interview Process Our Previous
  • 6. PHONE INTERVIEW Candidate Recruiter Interviewers 1 Candidate applies 1 1 Receives application and does initial vetting Practitioner portfolio review APPLICATION 2 INITIAL SCREENING Portfolio is posted internally for review 3 Candidate is contacted to schedule phone interview 42 Phone interview In-person interview is scheduled IN-PERSON INTERVIEW 60 min.
 Office tour, introductions, interview questions, 2-3 people review portfolio 53 4 6 5 2 THE OFFER 7 6 Offer extended Hired Frustrations • Recruiters unsure about what to look for in a portfolio • Recruiters frustrated by how ‘picky’ practitioners are about candidates • First contact to candidate and it could have been a lengthly wait. • Overlap in questions the candidate originally was asked. • No consistency in questioning • Time feels too short • Poor tracking of info • Portfolio is rehearsed and unclear often of involvement of candidate • Portfolio is thin but see potential in candidate • Candidate has accepted another offer (time, money, level) • Trouble remembering specifics about the candidate
  • 7. PHONE INTERVIEW Candidate Recruiter Interviewers 1 Candidate applies 1 1 Receives application and does initial vetting Practitioner portfolio review APPLICATION 2 INITIAL SCREENING Portfolio is posted internally for review 3 Candidate is contacted to schedule phone interview 42 Phone interview In-person interview is scheduled IN-PERSON INTERVIEW 60 min.
 Office tour, introductions, interview questions, 2-3 people review portfolio 53 4 6 5 2 THE OFFER 7 6 Offer extended Hired Frustrations • Recruiters unsure about what to look for in a portfolio • Recruiters frustrated by how ‘picky’ practitioners are about candidates • First contact to candidate and it could have been a lengthly wait. • Overlap in questions the candidate originally was asked. • No consistency in questioning • Time feels too short • Poor tracking of info • Portfolio is rehearsed and unclear often of involvement of candidate • Portfolio is thin but see potential in candidate • Candidate has accepted another offer (time, money, level) • Trouble remembering specifics about the candidate
  • 8. Designers should be able to speak to what’s in their portfolio in detail. In fact, it should be a body of work that they have been critiqued by others multiple times. They’re rehearsed Candidate’s role in the work Constraints 
 happen UI kits are prevalent Portfolio Reviews Issues with just having Projects in portfolios could have many different designers involved, what did the candidate do? Was it a team effort, could they replicate the work at a similar pace? Did they find an a free asset or utilize a robust system tool like Google Material to assemble their design? It’s fine if so, but can they articulate good UI decisions or were they inherited? We really couldn’t know all the constraints that person had to work within. We often struggle to find designers that consistently have the opportunity to get user involvement in their process.
  • 9. 1. Can they articulate rationale for business decisions made along the way? 2. Where was there tension, and how did they compromise? 3. What was the extent of their involvement over the length of the project? 4. What did they do to empathize and understand the needs of the end user? 5. Did it get made, and what was that process like? Portfolio reviews will always play a Huge Role
  • 10. PHONE INTERVIEW Candidate Recruiter Interviewers 1 Candidate applies 1 1 Receives application and does initial vetting Practitioner portfolio review APPLICATION 2 INITIAL SCREENING Portfolio is posted internally for review 3 Candidate is contacted to schedule phone interview 42 Phone interview In-person interview is scheduled IN-PERSON INTERVIEW 60 min.
 Office tour, introductions, interview questions, 2-3 people review portfolio 53 4 6 5 2 THE OFFER 7 6 Offer extended Hired Frustrations • Recruiters unsure about what to look for in a portfolio • Recruiters frustrated by how ‘picky’ practitioners are about candidates • First contact to candidate and it could have been a lengthly wait. • Overlap in questions the candidate originally was asked. • No consistency in questioning • Time feels too short • Poor tracking of info • Portfolio is rehearsed and unclear often of involvement of candidate • Portfolio is thin but see potential in candidate • Candidate has accepted another offer (time, money, level) • Trouble remembering specifics about the candidate
  • 11. Based on the context gathered. There were a handful of other factors that we needed to accommodate for. We didn’t want to make the process significantly longer by adding more rounds of interviews. We have to staff up rapidly, somewhat unpredictably, and sometimes significantly. Whatever we do, HR says it MUST BE consistent for everyone applying to that role. Considerations
  • 12. Run it like a Project 2 Create a protocol/ prototype Gather 
 data/context 1 Test it 3 Iterate 4 Launch 5
  • 13. Are they an excellent communicator? Do they have a good understanding of the UX process? Do they value working on a team that places an emphasis on user research? What do we want to get From the Interview? Can they present and defend their work?
  • 14. “UX Hire” “We” are looking for a 0 25 50 75 100 Qual. Researcher IA 'Rock Star' Design Front-End Dev Business Acumen Experience
  • 15. Some ways to UX candidates Scare Away
  • 16. Bean Bag Chairs Unicorn Scrappy Rock Star My client, a Fortune X Company… Artistic / Artsy Flexible Generate Assets Great Environment Fast-pacedJedi-Mastery Guru Ninja Some Avoidable Keywords Self-starter
  • 17. After all, this is the candidate’s experience. What do we want the candidate to get out of the interview? Do they align with the way we do things? Do they like it? Are they getting what they need? Oh Shoot! What about them?
  • 18. Critique & Feedback Giving good/safe Ultimate List of Hiring Stats 94% of interviewees want to receive interview feedback, but only 41% have received interview feedback before.
  • 19. Critique & Feedback Giving good/safe Ultimate List of Hiring Stats Candidates are 4x more likely to consider your company for a future opportunity when you offer them constructive feedback.
  • 20. And so... we decided to make a Design Challenge
  • 21. … I presented both my portfolio and the exercise to a panel of designers/researchers for an hour and then met with each of them in 1:1 interviews for the rest of the day, breaking briefly for lunch at the cafeteria. During lunch, a designer gave me a brief tour of the campus. Each 1:1 interview included a design exercise and a set list of questions (to prevent overlap)…
  • 22. Homework is extremely vague on time expectations. Asking a candidate to solve real work without a time constraint is spec. work. Not Homework or Client Related Not 1-Sided Not Pass/FailNot A Surprise Our Challenge We cautiously crafted We want people to learn just as much about us as we learn about them during our challenge/ interview. It is a dialogue not a test. In our case we gave them mock research to inform their solution. We want to make sure people know we will be doing a challenge during the interview ahead of time. Interviewing is stressful enough without intentionally adding to that stress. It is meant to be an opportunity to speak deeper with candidates about their process and how they work. Often it helps us rule in candidates that have a thinner portfolio.
  • 23. & Consistency Thoughts about training Google explains why "Hiring is the Most Important Thing You Do" “…we have found from our research that it isn't that some people are better interviewers than other people. It's really the structure and the process that makes you a good or a bad interviewer. So if you're somebody who can follow that structure — you can follow instructions and ask good questions and engage with candidates — then you can be a great interviewer.”
  • 24. Improve efficiency when anyone can give the interview. Create a more consistent experience between candidates. Reduce bias with documentation. Consistency, consistency, with a Protocol 1 2 3
  • 26. All the Details Give the candidate
  • 27. To Choose From Give them some options
  • 28. Research Give them the Kelly Moran
 P202 Principal Experience Researcher We conducted contextual research with 24 users (pairing managers with tellers at a 50/50 split)… “ “”
  • 34. In Summary Design your candidate experience with intention. Keep in mind the purpose of the interview, for both your team and the candidate. Do a whiteboard challenge if it meets your needs. And do it ethically. Be more consistent, it’s better for everyone. A protocol can help you out.
  • 35. Go out an make your companies better! Thanks & Questions?