Check(mate) Your Bias: A game-driven approach to educating your team about bias

1
© 2018 Express Scripts. All Rights Reserved.
Let’s play a game!
• Play alone or form a team.
• Go to:
quizizz.com/join/game-
code
• Enter code: 021619
021619

2
Thanks for playing!
We’ll take a look at the results
later…

Check(mate) Your
Bias
A games-driven approach
Joe Johnson and Caron Garstka
UXPA 2019

4
JOE JOHNSON
LEAD UX ENGINEER
CARON GARSTKA
SR. UX RESEARCHER
WHO?

5
Agenda
1 / WHY
2 / WORK
3 / GAMES
4 / PLAY
5 / NEXT

6
6
WHY

7
WE ARE ALL
HUMAN. (IF NOT, THIS
TALK ISN’T FOR YOU.)
WHY

8
COGNITIVE BIAS
EFFECTS HUMANS.WHY

9
What is
cognitive bias?
Systematic error in
thinking that affects
the decisions and
judgments
A cognitive tool
Part of decision making
Can be beneficial and
useful
Can distort our
interpretation of the
world

10

11
1. WE ARE
HUMAN…
2. HUMANS HAVE
BIAS…
3. BIAS COLORS
OUR WORLD…
BECAUSE

12
12
WORK

13
WE NEED TO RECOGNIZE
OUR BIAS TO EFFECTIVELY
DO OUR JOBS.

14
WHEN YOU KNOW BETTER,
YOU DO BETTER.

15
BIAS IS HARD TO TALK
ABOUT.

16
HOW DO WE MAKE IT
APPROACHABLE?

17
GAMES!

18
Games…
• An engaging learning
tool
• Non-threatening
• Experiential
• Emotional investment

19
GAMES HELP US BETTER
RECOGNIZE BIAS IN
ACTION.
AWARENESS IS THE FIRST
STEP TOWARD CHANGE.

20
20
TIME FOR A GAME:
THREE NUMBERS

21
I’M GOING TO SHOW YOU
THREE NUMBERS.

22
I’M GOING TO SHOW YOU
THREE NUMBERS.
THESE NUMBERS FOLLOW A
RULE I HAVE IN MY HEAD.

23
YOUR ULTIMATE GOAL IS
TO GUESS MY RULE.

24
TO GET INFO ABOUT MY
RULE, YOU’LL GIVE ME
THREE NUMBERS YOU THINK
FIT THE RULE.

25
I’LL TELL YOU IF YOUR
THREE NUMBERS FIT THE
RULE.

26
READY?

27
THE NUMBERS ARE:
2, 4, 8
THINK ABOUT THE RULE…
(DON’T SAY IT!)

28
THE NUMBERS ARE:
2, 4, 8
GIVE THREE NUMBERS YOU
THINK FIT THE RULE.
(I’LL TELL IF THEY FIT THE
RULE.)

29
LET’S DISCUSS…

30
Anchoring Bias
The tendency to rely
too heavily on an
initial piece of
information.

31
Complexity Bias
The tendency to
believe that complex
solutions are better
than simple ones.

32
Confirmation
Bias
The tendency to find
or use evidence in a
way that confirms
preexisting beliefs.

33
• Takeaway 2: K.I.S.S. (Keep it
simple, silly)
• Takeaway 3: Point and counter
point

34
34
TIME FOR ANOTHER GAME:
GROUP ‘EM UP

35
LET’S SAY YOU HAVE A
CROWD OF PEOPLE.

36
EACH PERSON IS WEARING
A BADGE.

37
BADGES CAN VARY BY
SHAPE, COLOR, AND SIZE.

38

39
YOUR TASK IS TO FORM
GROUPS.

40
NOW FORM NEW GROUPS.

41
ONE FINAL ROUND OF GROUPS

42
THIS TIME, INCLUDE
YOURSELF.

43
LET’S DISCUSS…

44
Framing Effect
When people make
different choices
based on how a
decision is presented
or interpreted.

45
Availability
Heuristic
The tendency to rely on
immediate examples that
come to mind when
evaluating a decision.

46
Affinity Bias
The unconscious
tendency to get along
with others who are
like us.

47
• Takeaway 1: Lift the veil, see
beyond
• Takeaway 2: What am I m_ss_ing?
• Takeaway 3: Birds of a feather,
dissent together

48
48
LAST GAME:
LEG’GO OF MY LEGO

49
LET’S SEE HOW THE LEGO
SET IS SHAPING UP…

50
NOW I NEED A SECOND
VOLUNTEER.

51
HERE ARE THE RULES…

52
YOU’LL NAME THE HIGHEST
PRICE YOU’RE WILLING TO
PAY FOR THE LEGO SETS.

53
I’VE PICKED A PRICE
THAT REPRESENTS THE
VALUE OF EACH SET.
(I’LL REVEAL IT LATER.)

54
IF YOUR PRICE IS EQUAL
TO OR ABOVE MY PRICE,
YOU’LL GET A PRIZE.

55
IF YOUR PRICE IS BELOW
MY PRICE, YOU’LL WALK
AWAY WITH NOTHING.

56
YOU’LL EACH GIVE A
PRICE FOR YOUR LEGO SET
AND YOUR PARTNER’S.

57
READY?

58
WRITE DOWN THE HIGHEST
PAY FOR YOUR LEGO
CREATION.

59
WRITE DOWN THE HIGHEST
PAY FOR YOUR PARTNER’S
LEGO CREATION.

60
WHAT DID YOU BID?

61
NOW TIME FOR THE BIG
REVEAL…

62
$10.79!

63
LET’S DISCUSS…

64
IKEA Effect
The tendency to place
a disproportionately
high value on the
things you have helped
create.

65
Sunk Cost
Fallacy
Tendency to make
future decisions based
on how much effort or
resources have been
put in previously.

66
• Takeaway 1: If you build it…
• Takeaway 2: Let it go

67
67
BIAS CHECKER
QUIZ REVIEW

68
LET’S REVISIT THE QUIZ

69
Revisit the Quiz
What we Learn
Answer (1) or (3)
could indicate the
Sunk Cost Fallacy at
work.
Depends on your
reasons for keeping it!

70
Revisit the Quiz
What we Learn
“Yes” indicates a
Confirmation Bias or
Affinity Bias.

71
Revisit the Quiz
What we Learn
(1) may indicate
Affinity Bias.
(3) may be the best
answer, where a
diversity of views
contributes to a rich
creative process.

72
Revisit the Quiz
What we Learn
“Yes” indicates the
Sunk Cost Fallacy.

73
Revisit the Quiz
What we Learn
(3) “Both” would be
the balanced
approach to avoid
Confirmation Bias.

74
Revisit the Quiz
What we Learn
“Yes” may indicate an
Availability Heuristic
or an Anchoring
Bias.
Also the first idea
might not be simple -
think of Complexity
Bias and the 2-4-8
game.

75
HOW MANY OF YOU WANT TO
CHANGE YOUR ANSWERS?

76
76
CONCLUSION

77
GAME PLAY TO SHAPE
EMPATHIC + DATA-DRIVEN
CULTURE.

78
THIS IS WHAT IT COULD
LOOK LIKE IN THE REAL
WORLD…

79
NEXT
• Rinse and repeat
• Be open
• Be kind
• Game on!

80
QUESTIONS?

81
Contact Us:
Joe Johnson
Joe_johnson@express-scripts.com
Caron Garstka
cegarstka@express-scripts.com

82
APPENDIX

83
Cited resources
These resources were directly incorporated in the presentation.
• H. Arkes & C. Blumer. “The psychology of sunk costs.” Organizational Behavior and Human Decision Processes. (1985) 35, 124-
140.
• B. Benson. “Cognitive bias cheat sheet.” (2016): https://betterhumans.coach.me/cognitive-bias-cheat-sheet-55a472476b18
• J. Beshears, S. Frederick, and F. Gino “Test Yourself: Are You Being Tricked by Intuition?” Harvard Business Review. (2015):
https://hbr.org/2015/04/test-yourself-are-you-being-tricked-by-intuition
• T. Bradberry. “13 Cognitive Biases That Really Screw Things Up For You.” (2018): https://www.linkedin.com/pulse/13-cognitive-
biases-really-screw-things-up-you-dr-travis-bradberry/
• S. Fowler. “Intercultural Simulation Games: A Review (of the United States and Beyond).” International Simulation and Gaming
Association. (2010): https://doi.org/10.1177/1046878109352204
• M. Funchess. “Implicit Bias -- how it effects us and how we push through.” TEDxFlourCity. (2014):
https://www.youtube.com/watch?v=Fr8G7MtRNlk
• E. Hall. “The 9 Rules of Design Research.” (2018): https://medium.com/mule-design/the-9-rules-of-design-research-1a273fdd1d3b
• D. Kahneman. Thinking, Fast and Slow. (2011)
• T. Keereepart. “3 design principles to help us overcome everyday bias.” TEDxPortland. (2016):
https://www.youtube.com/watch?v=K6dstCUWsFY
• R. F. Mackay. “Playing to learn: Panelists at Stanford discussion say using games as an educational tool provides opportunities for
deeper learning.” (2013): https://news.stanford.edu/2013/03/01/games-education-tool-030113/
0

84
Cited resources
These resources were directly incorporated in the presentation.
• F. Menzies. “ ‘A-Ha’ Activities for Unconscious Bias Training.” (2018): https://cultureplusconsulting.com/2018/08/16/a-ha-activities-
for-unconscious-bias-training/
• M. I. Norton. “The Ikea Effect: When Labor Leads to Love.” (2012): http://nrs.harvard.edu/urn-3:HUL.InstRepos:12136084
• K. Pressner. ”Are you biased? I am.” TEDxBasel. (2016): https://www.youtube.com/watch?v=Bq_xYSOZrgU
• J.B. Soll, K.L. Milkman, and J.W. Payne. “Outsmart your own biases.” Harvard Business Review. (2015):
https://hbr.org/2015/05/outsmart-your-own-biases
• D. Stirling. “Games As Educational Tools: Teaching Skills, Transforming Thoughts.” Infospace. (2013):
https://ischool.syr.edu/infospace/2013/06/27/games-as-educational-tools-teaching-skills-transforming-thoughts/
• O.Svenson. “Are we all less risky and more skillful than our fellow drivers?” Acta Psychologica. (1981):
https://www.sciencedirect.com/science/article/pii/0001691881900056?via%3Dihub
• H. Turnball. “The Affinity Bias Conundrum: The Illusion of Inclusion Part III.” Diversity Journal. (2014):
http://www.diversityjournal.com/13763-affinity-bias-conundrum-illusion-inclusion-part-iii/
• “Can You Solve This?.” Veritasium – YouTube.com. (2014): https://www.youtube.com/watch?v=vKA4w2O61Xo
0

85
These resources were not quoted or directly used for our presentation, but present ideas and examples that influenced our thinking
and offer valuable, interesting insights.
• M. Hartmann. “Unpacking the biases that shape our beliefs.” TEDxStJohns. (2015):
https://www.youtube.com/watch?v=dU7Mhne4CzU
• N.A. Heflick. “We Are Blind to Our Own Biases.” Psychology Today. (2011): https://www.psychologytoday.com/blog/the-big-
questions/201102/we-are-blind-our-own-biases
• C. Jager. “24 Cognitive Biases You Need To Stop Making [Infographic]” Lifehacker. (2018):
https://www.lifehacker.com.au/2018/03/find-out-which-cognitive-biases-alter-your-perspective/
• T. Laurinavicius. “Cognitive Biases You Need to Master to Design Better Websites.” (2018):
https://webdesign.tutsplus.com/articles/cognitive-biases-you-need-to-master-to-design-better-websites--cms-30742
• C. Ratcliff. “12 ways to fight bias in your team” Synopsys of #uxchat on Twitter, hosted by K. Bachmann. (2018):
http://whatusersdo.com/blog/how-to-fight-bias-in-your-organisation-or-team/
• Mind Tools. “Avoiding Psychological Bias in Decision Making: How to Make Objective Decisions.” (2018):
https://www.mindtools.com/pages/article/avoiding-psychological-bias.htm
• M. Simmons. “Studies Show That People Who Have High ‘Integrative Complexity’ Are More Likely To Be Successful.” (2018):
https://medium.com/the-mission/studies-show-that-people-who-have-high-integrative-complexity-are-more-likely-to-be-
successful-443480e8930c
Additional resources
0

86
ADDITIONAL QUIZ REVIEW

87
Revisit the Quiz
What we Learn
Statistically (2) is most
likely.
(3) Indicates a
Conjunction Bias. The
combination of two
conditions being
considered more likely
than one condition.

88
Revisit the Quiz
What we Learn
“Yes” may indicate the
Pollyanna Principle.
Framing Bias may show
up in the viewpoint “look at
the bright side...”

89
Revisit the Quiz
What we Learn
Bandwagon Effect or
simply Wishful Thinking.

90
Revisit the Quiz
What we Learn
Halo Effect or a
Clustering Illusion.

91
Revisit the Quiz
What we Learn
“Yes” indicates the Sunk
Cost Fallacy.

92
Revisit the Quiz
What we Learn
An answer of “Yes”
indicates a Clustering
Illusion or the Gambler’s
Fallacy.

93
Revisit the Quiz
What we Learn
If “good chance” means
more than 50-50, then
“Yes” indicates a
Clustering Illusion or the
Gambler’s Fallacy.
Assumes 50%
independent probability of
red vs green!

94
Revisit the Quiz
What we Learn
If more people answered
(1) than (2) it indicates
Illusory Superiority.
93% of drivers claim to be
better than average!
(Svenson)

Check(mate) Your Bias: A game-driven approach to educating your team about bias

Recommended

Recommended

More Related Content

Similar to Check(mate) Your Bias: A game-driven approach to educating your team about bias

Similar to Check(mate) Your Bias: A game-driven approach to educating your team about bias (20)

More from UXPA International

More from UXPA International (20)

Recently uploaded

Recently uploaded (18)

Check(mate) Your Bias: A game-driven approach to educating your team about bias

Editor's Notes