SlideShare a Scribd company logo
1 of 30
@karenbachmann Know Thyself: Managing Bias #UXPA2018 1
Know thyself and to thine users be true:
Understanding and managing biases that can
influence UX work
Karen Bachmann
karen@designforcontext.com
@karenbachmann
UXPA 2018
Puerto Rico
#UXPA18
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— How to have non-threatening and productive discussions
โ— Tools for identifying our biases
โ— Tools to manage biases
โ— Bringing our new awareness into our design practice
What we will discuss
2
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Awareness, ourselves and our colleagues
Exposure to other perspectives
Connection with our own humanity
What do we need most
@karenbachmann Know Thyself: Managing Bias #UXPA2018 4
โ€œWhen you know better,
you do better.โ€
- Betty Easterly
@karenbachmann Know Thyself: Managing Bias #UXPA2018 5
An approachable definition of bias
โ— How should we talk about biases to ensure a non-
threatening and productive discussion?
A LITTLE BACKGROUND
@karenbachmann Know Thyself: Managing Bias #UXPA2018 6
No longer a mystery โ€œwhyโ€ it matters
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Bias: A Mental Shortcut
7
โ— Part of being
human
โ— Kahnemanโ€™s
System 1
โ— Not inherently
bad, may be
misapplied
โ— Implicit = invisible
โ— Not necessarily in
sync with our
conscious beliefs
โ— Can be managed
and changed
@karenbachmann Know Thyself: Managing Bias #UXPA2018
SO MANY BIASES!
8
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Do you see what I see?
9
How do you describe this
โ€ฆ without any presuppositions?
Objectivity is more elusive than we
want โ€“ or like โ€“ to admit to ourselves.
Image: https://www.flickr.com/photos/horiavarlan/4273846588/
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Addressing bias is not uniquely a UX challenge
10
Healthcare
Business Government
Law enforcement
Safety
Data science
Technology
Journalism
Entertainment
UX Research & Design
Science
@karenbachmann Know Thyself: Managing Bias #UXPA2018 11
Building awareness and knowing ourselves
โ— How can we best identify the biases within ourselves and our
teams?
โ— What tools and processes to control for bias we can
introduce into our processes?
โ— Where do biases emerge in our work?
KNOWING OURSELVES
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Start with understanding your own bias
Donโ€™t fall into the illusion of complete
objectivity
Donโ€™t be afraid to acknowledge bias
Know thyself
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— Provide the tools for mindfulness and self-awareness as well as
building team awareness
โ— Acknowledge your own biases and be open to learning more
โ— Establish clear goals to understand biases and why it matters to the
team and to your work
โ— Establish communication ground rules
โ— Use the ability to see the biases of others with empathy and
compassion
Discussions with the team
13
@karenbachmann Know Thyself: Managing Bias #UXPA2018
12 steps from #uxchat
โ—Encourage diversity
โ—Step back from your ego
โ—Always be talking to others
โ—Self-examination
โ—Beware of โ€œgroupthinkโ€
โ—Uncover biases as early as
possible
โ—Bring in a moderator
โ—Be transparent
โ—Be inclusive
โ—Focus on the data
โ—Encourage safe spaces and secure
channels
โ—Have empathy, always
14
http://whatusersdo.com/blog/how-to-fight-bias-in-your-organisation-or-team/ (now part of UserZoom)
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Detection Tools
โ—Changing decision making
approach
โ— Pre-mortems
โ— Worst case scenario
โ— Multiple estimations -> designs
โ— Seek outside view
โ—Implicit Association Test
โ—Flip it to test it
โ—Invite examination and input from
people who are not like โ€œusโ€
โ—Appoint a Devilโ€™s Diversity
Advocate
โ—Slow down and reflect
15
@karenbachmann Know Thyself: Managing Bias #UXPA2018 16
MY IAT results on disability
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— What's your default mode for judgments and decisions? To find out,
take this (very short) cognitive-reflection test, which was created by
Shane Frederick at Yale and originally appeared in The Journal of
Economic Perspectives. At the end, youโ€™ll receive feedback on your
answers and gain insight into how you arrived at them.
โ— A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball.
How much does the ball cost?
โ— If it takes five machines five minutes to make five widgets, how many
minutes would it take 100 machines to make 100 widgets?
โ— In a lake, there is a patch of lily pads. Every day, the patch doubles in size.
If it takes 48 days for the patch to cover the entire lake, how many days
would it take for the patch to cover half the lake?
Are you being tricked by intuition?
17
@karenbachmann Know Thyself: Managing Bias #UXPA2018
WHICH BIASES SHOULD WE LOOK FOR FIRST?
18
Confirmation bias
Anchoring
Implicit bias
Ingroup/Outgroup
Pro-Innovation
Recency effect
Overconfidence
Backfire effect
@karenbachmann Know Thyself: Managing Bias #UXPA2018 19
Biases can emerge anywhere
Research
โ— Recruiting
โ— Questions we ask
โ— Specific data we collect
โ— Conclusions and priority
Design
โ— Target markets
โ— Types of interactions
โ— Visual design selections
โ— Technology selection
@karenbachmann Know Thyself: Managing Bias #UXPA2018 20
Controlling our biases in our work
โ— How do we monitor for regressing thinking and new biases
throughout the design process?
MINDFULNESS & MANAGEMENT
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Mindfulness is a journey,
not a destination
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— Make the detection tools part of the design process โ€“ not once and
done
โ— Define goals and checks around identified biases
โ— Set objectives, check objectives
โ— Trip wires
โ— Watch for emergent โ€œexcusesโ€ for regressing to System 1 thinking
Integrating the tools for awareness
22
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— Establish a culture of questioning
โ— Listen for discord and regression
โ— Bias buddies
โ— Use technological aids where possible
โ— Communicate shared understanding continuously
โ— Be kind to each other
Enabling communication
23
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Awareness, ourselves and our colleagues
Exposure to other perspectives
Connection with our own humanity
What do we need most
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Cited resources
These resources were directly incorporated in the presentation.
โ— B. Benson. โ€œCognitive bias cheat sheet.โ€ (2016): https://betterhumans.coach.me/cognitive-bias-cheat-sheet-55a472476b18
โ— J. Beshears, S. Frederick, and F. Gino โ€œTest Yourself: Are You Being Tricked by Intuition?โ€ Harvard Business Review. (2015):
https://hbr.org/2015/04/test-yourself-are-you-being-tricked-by-intuition
โ— T. Bradberry. โ€œ13 Cognitive Biases That Really Screw Things Up For You.โ€ (2018): https://www.linkedin.com/pulse/13-cognitive-biases-
really-screw-things-up-you-dr-travis-bradberry/
โ— M. Funchess. โ€œImplicit Bias -- how it effects us and how we push through.โ€ TEDxFlourCity. (2014):
https://www.youtube.com/watch?v=Fr8G7MtRNlk
โ— E. Hall. โ€œThe 9 Rules of Design Research.โ€ (2018): https://medium.com/mule-design/the-9-rules-of-design-research-1a273fdd1d3b
โ— H.G. Halvorson. โ€œHow To Recognize (And Overcome) Your Unconscious Biases In Hiring.โ€ Fast Company. (2015):
https://www.fastcompany.com/3043074/how-to-thwart-your-unconscious-biases-when-hiring-a-diverse-team
โ— S. Judd. โ€œSuperfan.โ€ (2018): http://www.sachajudd.com/superfan
โ— D. Kahneman. Thinking, Fast and Slow. (2011)
โ— T. Keereepart. โ€œ3 design principles to help us overcome everyday bias.โ€ TEDxPortland. (2016):
https://www.youtube.com/watch?v=K6dstCUWsFY
โ— S. Lawrence-Lightfoot and J. Hoffmann Davis. The Art and Science of Portraiture. (1997):
http://www.saralawrencelightfoot.com/portraiture1.html
โ— A.C. Madrigal. โ€œDisposable America.โ€ The Atlantic. (2018): https://www.theatlantic.com/technology/archive/2018/06/disposable-
america/563204/
25
@karenbachmann Know Thyself: Managing Bias #UXPA2018
Cited resources (contโ€™d)
โ— P. McIntosh. "White Privilege: Unpacking the Invisible Knapsack" Peace and Freedom Magazine. (1989):
https://nationalseedproject.org/white-privilege-unpacking-the-invisible-knapsack
โ— K. Pressner. โ€Are you biased? I am.โ€ TEDxBasel. (2016): https://www.youtube.com/watch?v=Bq_xYSOZrgU
โ— Project Implicit. (2011): https://implicit.harvard.edu/implicit/index.jsp
โ— C. Ratcliff. โ€œ12 ways to fight bias in your teamโ€ Synopsys of #uxchat on Twitter, hosted by K. Bachmann. (2018):
http://whatusersdo.com/blog/how-to-fight-bias-in-your-organisation-or-team/
โ— S.E. Smith. โ€œWhy philosophy is so important in science education.โ€ Quartz. (2017): https://qz.com/1132948/why-philosophy-is-so-
important-in-science-education/ (Inspiration for the โ€œDo you seeโ€ exercise on Slide 9)
โ— J.B. Soll, K.L. Milkman, and J.W. Payne. โ€œOutsmart your own biases.โ€ Harvard Business Review. (2015):
https://hbr.org/2015/05/outsmart-your-own-biases
โ— S. Watcher-Boettcher. Technically Wrong: Sexist Apps, Biased Algorithms, and Other Threats of Toxic Tech. (2017):
http://www.sarawb.com/technically-wrong/
26
@karenbachmann Know Thyself: Managing Bias #UXPA2018
These resources were not quoted or directly use for my presentation, but present ideas and examples that influenced my thinking and
offer valuable, interesting insights.
โ— American Alliance of Museums. โ€œUnconscious Bias and Personal Work.โ€ (2018): https://www.aam-us.org/programs/diversity-equity-
accessibility-and-inclusion/facing-change-unconscious-bias-and-personal-work/
โ— @BienSur_JeTaime. โ€œOne of the reasons for more ethnic diversity in tech. Devices can't be biased, but if the creators don't account for
their own biases it shows up in things like Asian women being indistinguishable to iPhones and black hands not triggering sensors in
soap machines.โ€ (2017): https://twitter.com/BienSur_JeTaime/status/941866665746235397
โ— S. Bradley. โ€œAll the creepy, crazy and amazing things that happened in AI in 2017.โ€ Wired. (2017):
http://www.wired.co.uk/article/what-happened-in-ai-in-2017
โ— G.L. Ciampaglia and F. Menczer. โ€œMisinformation and biases infect social media, both intentionally and accidentally.โ€ The
Conversation. (2018): http://theconversation.com/misinformation-and-biases-infect-social-media-both-intentionally-and-accidentally-
97148
โ— J. Clark. โ€œDesign in the Era of the Algorithm.โ€ Presentation at Mind the Product, synopsis by J. Gadsby Peet. (2017):
https://www.mindtheproduct.com/2017/11/product-design-era-algorithm-josh-clark/
โ— D. Chopra. โ€œDoes the Human Mind Need a Fresh Start?โ€ (2017): https://www.choprafoundation.org/science-consciousness/does-the-
human-mind-need-a-fresh-start/
โ— R. Courtland. โ€œBias detectives: the researchers striving to make algorithms fair.โ€ Nature. (2018):
https://www.nature.com/articles/d41586-018-05469-3
โ— D. Gray. Liminal Thinking: Create the change you want by changing the way you think. (2016): http://liminalthinking.com/
Additional resources
27
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— M. Hartmann. โ€œUnpacking the biases that shape our beliefs.โ€ TEDxStJohns. (2015):
https://www.youtube.com/watch?v=dU7Mhne4CzU
โ— N.A. Heflick. โ€œWe Are Blind to Our Own Biases.โ€ Psychology Today. (2011): https://www.psychologytoday.com/blog/the-big-
questions/201102/we-are-blind-our-own-biases
โ— D. Hernandez. โ€œUnpacking and Transforming Your Biases For A Better Community.โ€ TEDxSanAntonio. (2016):
https://www.youtube.com/watch?v=FU4CDFFy77g
โ— D. Hockett. โ€œWe all have implicit biases. So what can we do about it?โ€ TEDxMidAtlanticSalon. (2017):
https://www.youtube.com/watch?v=kKHSJHkPeLY
โ— C. Jager. โ€œ24 Cognitive Biases You Need To Stop Making [Infographic]โ€ Lifehacker. (2018):
https://www.lifehacker.com.au/2018/03/find-out-which-cognitive-biases-alter-your-perspective/
โ— T. Laurinavicius. โ€œCognitive Biases You Need to Master to Design Better Websites.โ€ (2018):
https://webdesign.tutsplus.com/articles/cognitive-biases-you-need-to-master-to-design-better-websites--cms-30742
โ— J. Lindzon. โ€œThis Brain Hack Will Help Reframe Your Interpretation Of Reality.โ€ Fast Company. (2017):
https://www.fastcompany.com/40500514/this-brain-hack-will-help-reframe-your-interpretation-of-reality
โ— E. Livni. โ€œThe philosophy that could have stopped Silicon Valleyโ€™s crisis of conscience before it started.โ€ Quartz. (2017):
https://qz.com/1161704/silicon-valley-elite-from-companies-like-facebook-and-google-are-soothing-their-consciences-at-californias-
esalen-institute/
โ— Microsoft. โ€œKeeping an Eye on AI with Dr. Kate Crawford.โ€ Microsoft Research Podcast. (2018): https://www.microsoft.com/en-
us/research/blog/keeping-an-eye-on-ai-with-dr-kate-crawford/?OCID=msr_podcast_kcrawford_tw
Additional resources (contโ€™d)
28
@karenbachmann Know Thyself: Managing Bias #UXPA2018
โ— Mind Tools. โ€œAvoiding Psychological Bias in Decision Making: How to Make Objective Decisions.โ€ (2018):
https://www.mindtools.com/pages/article/avoiding-psychological-bias.htm
โ— Partnership on AI. (2016-1018): https://www.partnershiponai.org/
โ— J. Powell. โ€œIt's About Time We Challenge Our Unconscious Biases.โ€ TEDxStLouisWomen. (2016):
https://www.youtube.com/watch?v=thkmVv54e6M
โ— J. Powles. โ€œNew York Cityโ€™s Bold, Flawed Attempt to Make Algorithms Accountable.โ€ The New Yorker. (2017):
https://www.newyorker.com/tech/elements/new-york-citys-bold-flawed-attempt-to-make-algorithms-accountable
โ— M.J. Socolow. โ€œHow to Prevent Smart People From Spreading Dumb Ideas.โ€ The New York Times. (2018):
https://www.nytimes.com/2018/03/22/opinion/facebook-spreading-ideas.html
โ— J. Temperton. โ€œDeepMind's new AI ethics unit is the company's next big move.โ€ Wired UK. (2017):
http://www.wired.co.uk/article/deepmind-ethics-and-society-artificial-intelligence
โ— A. Thompson. โ€œGoogleโ€™s Sentiment Analyzer Thinks Being Gay Is Bad.โ€ Motherboard. (2017):
https://motherboard.vice.com/en_us/article/j5jmj8/google-artificial-intelligence-bias
โ— @sara_ann_marie. โ€œthe line from "look at our cool new facial-recognition app" to "wow this thing only works for white people" is a
fucking millimeter long and clearly marked. why can't a single tech co seem to be able to see it?โ€ (2018):
https://twitter.com/sara_ann_marie/status/953783812315602944
โ— M. Simmons. โ€œStudies Show That People Who Have High โ€˜Integrative Complexityโ€™ Are More Likely To Be Successful.โ€ (2018):
https://medium.com/the-mission/studies-show-that-people-who-have-high-integrative-complexity-are-more-likely-to-be-successful-
443480e8930c
Additional resources (contโ€™d)
29
@karenbachmann Know Thyself: Managing Bias #UXPA2018 30
Know thyself and to thine users be true
Understanding and managing biases that can
influence UX work
UXPA โ€ข June 2018 slides will be posted at: www.designforcontext.com/insights
Karen Bachmann
karen@designforcontext.com
@karenbachmann
UXPA 2018
Puerto Rico
#UXPA18

More Related Content

Similar to Know thyself and to thine users be true: Understanding and managing biases that can influence UX work

Can Social Media Analysis Improve Collective Awareness of Climate Change?
Can Social Media Analysis Improve Collective Awareness of Climate Change?Can Social Media Analysis Improve Collective Awareness of Climate Change?
Can Social Media Analysis Improve Collective Awareness of Climate Change?
Diana Maynard
ย 
Working Examples, ETC Student Project
Working Examples, ETC Student ProjectWorking Examples, ETC Student Project
Working Examples, ETC Student Project
Anna Roberts
ย 

Similar to Know thyself and to thine users be true: Understanding and managing biases that can influence UX work (20)

WOC 2016: "Can You Hear Me Out There?" The Power of Public Speaking
WOC 2016: "Can You Hear Me Out There?" The Power of Public SpeakingWOC 2016: "Can You Hear Me Out There?" The Power of Public Speaking
WOC 2016: "Can You Hear Me Out There?" The Power of Public Speaking
ย 
Buyer personas & Customer journey
Buyer personas & Customer journeyBuyer personas & Customer journey
Buyer personas & Customer journey
ย 
How to Achieve a Better Product Culture by Pinn VP of Platform
How to Achieve a Better Product Culture by Pinn VP of PlatformHow to Achieve a Better Product Culture by Pinn VP of Platform
How to Achieve a Better Product Culture by Pinn VP of Platform
ย 
How to Lead Your Product Team by Barnes & Noble Product Manager
How to Lead Your Product Team by Barnes & Noble Product ManagerHow to Lead Your Product Team by Barnes & Noble Product Manager
How to Lead Your Product Team by Barnes & Noble Product Manager
ย 
Nasdaq Pro/Design Masterclass at the Entrepreneurial Center
Nasdaq Pro/Design Masterclass at the Entrepreneurial CenterNasdaq Pro/Design Masterclass at the Entrepreneurial Center
Nasdaq Pro/Design Masterclass at the Entrepreneurial Center
ย 
7 Basic Steps to Successful Event Management
7 Basic Steps to Successful Event Management7 Basic Steps to Successful Event Management
7 Basic Steps to Successful Event Management
ย 
Building a foundation for strong content: Defining your audiences and their j...
Building a foundation for strong content: Defining your audiences and their j...Building a foundation for strong content: Defining your audiences and their j...
Building a foundation for strong content: Defining your audiences and their j...
ย 
Staff Resource Planning
Staff Resource PlanningStaff Resource Planning
Staff Resource Planning
ย 
The power and necessity of author care in today's publishing climate
The power and necessity of author care in today's publishing climateThe power and necessity of author care in today's publishing climate
The power and necessity of author care in today's publishing climate
ย 
Social media tips, tricks, and myths
Social media tips, tricks, and mythsSocial media tips, tricks, and myths
Social media tips, tricks, and myths
ย 
Can Social Media Analysis Improve Collective Awareness of Climate Change?
Can Social Media Analysis Improve Collective Awareness of Climate Change?Can Social Media Analysis Improve Collective Awareness of Climate Change?
Can Social Media Analysis Improve Collective Awareness of Climate Change?
ย 
The user group you never knew you had ux camp 2015
The user group you never knew you had   ux camp 2015The user group you never knew you had   ux camp 2015
The user group you never knew you had ux camp 2015
ย 
Pragmatic Marketer Winter 2015
Pragmatic Marketer Winter 2015Pragmatic Marketer Winter 2015
Pragmatic Marketer Winter 2015
ย 
Tara Hunt - Your Social Media Strategy Wont Save You
Tara Hunt - Your Social Media Strategy Wont Save YouTara Hunt - Your Social Media Strategy Wont Save You
Tara Hunt - Your Social Media Strategy Wont Save You
ย 
What Companies Look for When Hiring PMs by Spotify Product Lead
What Companies Look for When Hiring PMs by Spotify Product LeadWhat Companies Look for When Hiring PMs by Spotify Product Lead
What Companies Look for When Hiring PMs by Spotify Product Lead
ย 
0 to 1: Lessons Learned from a New PM Launching a New Product
0 to 1: Lessons Learned from a New PM Launching a New Product0 to 1: Lessons Learned from a New PM Launching a New Product
0 to 1: Lessons Learned from a New PM Launching a New Product
ย 
Working Examples, ETC Student Project
Working Examples, ETC Student ProjectWorking Examples, ETC Student Project
Working Examples, ETC Student Project
ย 
152 - Confident Communication
152 - Confident Communication 152 - Confident Communication
152 - Confident Communication
ย 
A few bad apples project form
A few bad apples project formA few bad apples project form
A few bad apples project form
ย 
UXPA 2023: F@#$ User Personas
UXPA 2023: F@#$ User PersonasUXPA 2023: F@#$ User Personas
UXPA 2023: F@#$ User Personas
ย 

More from Karen Bachmann

More from Karen Bachmann (9)

Designing more ethical and unbiased experiences
Designing more ethical and unbiased experiencesDesigning more ethical and unbiased experiences
Designing more ethical and unbiased experiences
ย 
Ethics: A human-centered design goal
Ethics: A human-centered design goalEthics: A human-centered design goal
Ethics: A human-centered design goal
ย 
Listen up and tune in!
Listen up and tune in!Listen up and tune in!
Listen up and tune in!
ย 
Listen up! Improving listening skills and awareness
Listen up! Improving listening skills and awarenessListen up! Improving listening skills and awareness
Listen up! Improving listening skills and awareness
ย 
Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...
Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...
Building a Solid Foundation: Usability & Information Architecture WIAD Tampa ...
ย 
A remedial course in empathy
A remedial course in empathyA remedial course in empathy
A remedial course in empathy
ย 
Getting to know you: User research fundamentals anyone can use
Getting to know you: User research fundamentals anyone can useGetting to know you: User research fundamentals anyone can use
Getting to know you: User research fundamentals anyone can use
ย 
Collaborative techniques for developing usability requirements
Collaborative techniques for developing usability requirementsCollaborative techniques for developing usability requirements
Collaborative techniques for developing usability requirements
ย 
Effectively communicating user interface and interaction design
Effectively communicating user interface and interaction designEffectively communicating user interface and interaction design
Effectively communicating user interface and interaction design
ย 

Recently uploaded

Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
kumaririma588
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐ŸงตCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
anilsa9823
ย 
SD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptxSD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptx
janettecruzeiro1
ย 
infant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxinfant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptx
suhanimunjal27
ย 
Design Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptxDesign Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptx
TusharBahuguna2
ย 
DragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxDragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptx
mirandajeremy200221
ย 
B. Smith. (Architectural Portfolio.).pdf
B. Smith. (Architectural Portfolio.).pdfB. Smith. (Architectural Portfolio.).pdf
B. Smith. (Architectural Portfolio.).pdf
University of Wisconsin-Milwaukee
ย 
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
amitlee9823
ย 
RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...
amitlee9823
ย 
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
amitlee9823
ย 
Stark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxStark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptx
jeswinjees
ย 
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธCall Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
soniya singh
ย 

Recently uploaded (20)

Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, Pune
ย 
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi๐Ÿ’˜ 9352852248 Good Looking standard Profil...
ย 
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfChapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐ŸงตCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service  ๐Ÿงต
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kalyanpur Lucknow best Female service ๐Ÿงต
ย 
SD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptxSD_The MATATAG Curriculum Training Design.pptx
SD_The MATATAG Curriculum Training Design.pptx
ย 
infant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptxinfant assessment fdbbdbdddinal ppt.pptx
infant assessment fdbbdbdddinal ppt.pptx
ย 
Tapestry Clothing Brands: Collapsing the Funnel
Tapestry Clothing Brands: Collapsing the FunnelTapestry Clothing Brands: Collapsing the Funnel
Tapestry Clothing Brands: Collapsing the Funnel
ย 
Design Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptxDesign Inspiration for College by Slidesgo.pptx
Design Inspiration for College by Slidesgo.pptx
ย 
DragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptxDragonBall PowerPoint Template for demo.pptx
DragonBall PowerPoint Template for demo.pptx
ย 
B. Smith. (Architectural Portfolio.).pdf
B. Smith. (Architectural Portfolio.).pdfB. Smith. (Architectural Portfolio.).pdf
B. Smith. (Architectural Portfolio.).pdf
ย 
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
ย 
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
Brookefield Call Girls: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangalore...
ย 
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
VVIP Pune Call Girls Hadapsar (7001035870) Pune Escorts Nearby with Complete ...
ย 
RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bang...
ย 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
ย 
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
Jigani Call Girls Service: ๐Ÿ“ 7737669865 ๐Ÿ“ High Profile Model Escorts | Bangal...
ย 
Stark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxStark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptx
ย 
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธCall Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
Call Girls in Kalkaji Delhi 8264348440 call girls โค๏ธ
ย 
Best VIP Call Girls Noida Sector 47 Call Me: 8448380779
Best VIP Call Girls Noida Sector 47 Call Me: 8448380779Best VIP Call Girls Noida Sector 47 Call Me: 8448380779
Best VIP Call Girls Noida Sector 47 Call Me: 8448380779
ย 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
ย 

Know thyself and to thine users be true: Understanding and managing biases that can influence UX work

  • 1. @karenbachmann Know Thyself: Managing Bias #UXPA2018 1 Know thyself and to thine users be true: Understanding and managing biases that can influence UX work Karen Bachmann karen@designforcontext.com @karenbachmann UXPA 2018 Puerto Rico #UXPA18
  • 2. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— How to have non-threatening and productive discussions โ— Tools for identifying our biases โ— Tools to manage biases โ— Bringing our new awareness into our design practice What we will discuss 2
  • 3. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Awareness, ourselves and our colleagues Exposure to other perspectives Connection with our own humanity What do we need most
  • 4. @karenbachmann Know Thyself: Managing Bias #UXPA2018 4 โ€œWhen you know better, you do better.โ€ - Betty Easterly
  • 5. @karenbachmann Know Thyself: Managing Bias #UXPA2018 5 An approachable definition of bias โ— How should we talk about biases to ensure a non- threatening and productive discussion? A LITTLE BACKGROUND
  • 6. @karenbachmann Know Thyself: Managing Bias #UXPA2018 6 No longer a mystery โ€œwhyโ€ it matters
  • 7. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Bias: A Mental Shortcut 7 โ— Part of being human โ— Kahnemanโ€™s System 1 โ— Not inherently bad, may be misapplied โ— Implicit = invisible โ— Not necessarily in sync with our conscious beliefs โ— Can be managed and changed
  • 8. @karenbachmann Know Thyself: Managing Bias #UXPA2018 SO MANY BIASES! 8
  • 9. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Do you see what I see? 9 How do you describe this โ€ฆ without any presuppositions? Objectivity is more elusive than we want โ€“ or like โ€“ to admit to ourselves. Image: https://www.flickr.com/photos/horiavarlan/4273846588/
  • 10. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Addressing bias is not uniquely a UX challenge 10 Healthcare Business Government Law enforcement Safety Data science Technology Journalism Entertainment UX Research & Design Science
  • 11. @karenbachmann Know Thyself: Managing Bias #UXPA2018 11 Building awareness and knowing ourselves โ— How can we best identify the biases within ourselves and our teams? โ— What tools and processes to control for bias we can introduce into our processes? โ— Where do biases emerge in our work? KNOWING OURSELVES
  • 12. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Start with understanding your own bias Donโ€™t fall into the illusion of complete objectivity Donโ€™t be afraid to acknowledge bias Know thyself
  • 13. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— Provide the tools for mindfulness and self-awareness as well as building team awareness โ— Acknowledge your own biases and be open to learning more โ— Establish clear goals to understand biases and why it matters to the team and to your work โ— Establish communication ground rules โ— Use the ability to see the biases of others with empathy and compassion Discussions with the team 13
  • 14. @karenbachmann Know Thyself: Managing Bias #UXPA2018 12 steps from #uxchat โ—Encourage diversity โ—Step back from your ego โ—Always be talking to others โ—Self-examination โ—Beware of โ€œgroupthinkโ€ โ—Uncover biases as early as possible โ—Bring in a moderator โ—Be transparent โ—Be inclusive โ—Focus on the data โ—Encourage safe spaces and secure channels โ—Have empathy, always 14 http://whatusersdo.com/blog/how-to-fight-bias-in-your-organisation-or-team/ (now part of UserZoom)
  • 15. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Detection Tools โ—Changing decision making approach โ— Pre-mortems โ— Worst case scenario โ— Multiple estimations -> designs โ— Seek outside view โ—Implicit Association Test โ—Flip it to test it โ—Invite examination and input from people who are not like โ€œusโ€ โ—Appoint a Devilโ€™s Diversity Advocate โ—Slow down and reflect 15
  • 16. @karenbachmann Know Thyself: Managing Bias #UXPA2018 16 MY IAT results on disability
  • 17. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— What's your default mode for judgments and decisions? To find out, take this (very short) cognitive-reflection test, which was created by Shane Frederick at Yale and originally appeared in The Journal of Economic Perspectives. At the end, youโ€™ll receive feedback on your answers and gain insight into how you arrived at them. โ— A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost? โ— If it takes five machines five minutes to make five widgets, how many minutes would it take 100 machines to make 100 widgets? โ— In a lake, there is a patch of lily pads. Every day, the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how many days would it take for the patch to cover half the lake? Are you being tricked by intuition? 17
  • 18. @karenbachmann Know Thyself: Managing Bias #UXPA2018 WHICH BIASES SHOULD WE LOOK FOR FIRST? 18 Confirmation bias Anchoring Implicit bias Ingroup/Outgroup Pro-Innovation Recency effect Overconfidence Backfire effect
  • 19. @karenbachmann Know Thyself: Managing Bias #UXPA2018 19 Biases can emerge anywhere Research โ— Recruiting โ— Questions we ask โ— Specific data we collect โ— Conclusions and priority Design โ— Target markets โ— Types of interactions โ— Visual design selections โ— Technology selection
  • 20. @karenbachmann Know Thyself: Managing Bias #UXPA2018 20 Controlling our biases in our work โ— How do we monitor for regressing thinking and new biases throughout the design process? MINDFULNESS & MANAGEMENT
  • 21. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Mindfulness is a journey, not a destination
  • 22. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— Make the detection tools part of the design process โ€“ not once and done โ— Define goals and checks around identified biases โ— Set objectives, check objectives โ— Trip wires โ— Watch for emergent โ€œexcusesโ€ for regressing to System 1 thinking Integrating the tools for awareness 22
  • 23. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— Establish a culture of questioning โ— Listen for discord and regression โ— Bias buddies โ— Use technological aids where possible โ— Communicate shared understanding continuously โ— Be kind to each other Enabling communication 23
  • 24. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Awareness, ourselves and our colleagues Exposure to other perspectives Connection with our own humanity What do we need most
  • 25. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Cited resources These resources were directly incorporated in the presentation. โ— B. Benson. โ€œCognitive bias cheat sheet.โ€ (2016): https://betterhumans.coach.me/cognitive-bias-cheat-sheet-55a472476b18 โ— J. Beshears, S. Frederick, and F. Gino โ€œTest Yourself: Are You Being Tricked by Intuition?โ€ Harvard Business Review. (2015): https://hbr.org/2015/04/test-yourself-are-you-being-tricked-by-intuition โ— T. Bradberry. โ€œ13 Cognitive Biases That Really Screw Things Up For You.โ€ (2018): https://www.linkedin.com/pulse/13-cognitive-biases- really-screw-things-up-you-dr-travis-bradberry/ โ— M. Funchess. โ€œImplicit Bias -- how it effects us and how we push through.โ€ TEDxFlourCity. (2014): https://www.youtube.com/watch?v=Fr8G7MtRNlk โ— E. Hall. โ€œThe 9 Rules of Design Research.โ€ (2018): https://medium.com/mule-design/the-9-rules-of-design-research-1a273fdd1d3b โ— H.G. Halvorson. โ€œHow To Recognize (And Overcome) Your Unconscious Biases In Hiring.โ€ Fast Company. (2015): https://www.fastcompany.com/3043074/how-to-thwart-your-unconscious-biases-when-hiring-a-diverse-team โ— S. Judd. โ€œSuperfan.โ€ (2018): http://www.sachajudd.com/superfan โ— D. Kahneman. Thinking, Fast and Slow. (2011) โ— T. Keereepart. โ€œ3 design principles to help us overcome everyday bias.โ€ TEDxPortland. (2016): https://www.youtube.com/watch?v=K6dstCUWsFY โ— S. Lawrence-Lightfoot and J. Hoffmann Davis. The Art and Science of Portraiture. (1997): http://www.saralawrencelightfoot.com/portraiture1.html โ— A.C. Madrigal. โ€œDisposable America.โ€ The Atlantic. (2018): https://www.theatlantic.com/technology/archive/2018/06/disposable- america/563204/ 25
  • 26. @karenbachmann Know Thyself: Managing Bias #UXPA2018 Cited resources (contโ€™d) โ— P. McIntosh. "White Privilege: Unpacking the Invisible Knapsack" Peace and Freedom Magazine. (1989): https://nationalseedproject.org/white-privilege-unpacking-the-invisible-knapsack โ— K. Pressner. โ€Are you biased? I am.โ€ TEDxBasel. (2016): https://www.youtube.com/watch?v=Bq_xYSOZrgU โ— Project Implicit. (2011): https://implicit.harvard.edu/implicit/index.jsp โ— C. Ratcliff. โ€œ12 ways to fight bias in your teamโ€ Synopsys of #uxchat on Twitter, hosted by K. Bachmann. (2018): http://whatusersdo.com/blog/how-to-fight-bias-in-your-organisation-or-team/ โ— S.E. Smith. โ€œWhy philosophy is so important in science education.โ€ Quartz. (2017): https://qz.com/1132948/why-philosophy-is-so- important-in-science-education/ (Inspiration for the โ€œDo you seeโ€ exercise on Slide 9) โ— J.B. Soll, K.L. Milkman, and J.W. Payne. โ€œOutsmart your own biases.โ€ Harvard Business Review. (2015): https://hbr.org/2015/05/outsmart-your-own-biases โ— S. Watcher-Boettcher. Technically Wrong: Sexist Apps, Biased Algorithms, and Other Threats of Toxic Tech. (2017): http://www.sarawb.com/technically-wrong/ 26
  • 27. @karenbachmann Know Thyself: Managing Bias #UXPA2018 These resources were not quoted or directly use for my presentation, but present ideas and examples that influenced my thinking and offer valuable, interesting insights. โ— American Alliance of Museums. โ€œUnconscious Bias and Personal Work.โ€ (2018): https://www.aam-us.org/programs/diversity-equity- accessibility-and-inclusion/facing-change-unconscious-bias-and-personal-work/ โ— @BienSur_JeTaime. โ€œOne of the reasons for more ethnic diversity in tech. Devices can't be biased, but if the creators don't account for their own biases it shows up in things like Asian women being indistinguishable to iPhones and black hands not triggering sensors in soap machines.โ€ (2017): https://twitter.com/BienSur_JeTaime/status/941866665746235397 โ— S. Bradley. โ€œAll the creepy, crazy and amazing things that happened in AI in 2017.โ€ Wired. (2017): http://www.wired.co.uk/article/what-happened-in-ai-in-2017 โ— G.L. Ciampaglia and F. Menczer. โ€œMisinformation and biases infect social media, both intentionally and accidentally.โ€ The Conversation. (2018): http://theconversation.com/misinformation-and-biases-infect-social-media-both-intentionally-and-accidentally- 97148 โ— J. Clark. โ€œDesign in the Era of the Algorithm.โ€ Presentation at Mind the Product, synopsis by J. Gadsby Peet. (2017): https://www.mindtheproduct.com/2017/11/product-design-era-algorithm-josh-clark/ โ— D. Chopra. โ€œDoes the Human Mind Need a Fresh Start?โ€ (2017): https://www.choprafoundation.org/science-consciousness/does-the- human-mind-need-a-fresh-start/ โ— R. Courtland. โ€œBias detectives: the researchers striving to make algorithms fair.โ€ Nature. (2018): https://www.nature.com/articles/d41586-018-05469-3 โ— D. Gray. Liminal Thinking: Create the change you want by changing the way you think. (2016): http://liminalthinking.com/ Additional resources 27
  • 28. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— M. Hartmann. โ€œUnpacking the biases that shape our beliefs.โ€ TEDxStJohns. (2015): https://www.youtube.com/watch?v=dU7Mhne4CzU โ— N.A. Heflick. โ€œWe Are Blind to Our Own Biases.โ€ Psychology Today. (2011): https://www.psychologytoday.com/blog/the-big- questions/201102/we-are-blind-our-own-biases โ— D. Hernandez. โ€œUnpacking and Transforming Your Biases For A Better Community.โ€ TEDxSanAntonio. (2016): https://www.youtube.com/watch?v=FU4CDFFy77g โ— D. Hockett. โ€œWe all have implicit biases. So what can we do about it?โ€ TEDxMidAtlanticSalon. (2017): https://www.youtube.com/watch?v=kKHSJHkPeLY โ— C. Jager. โ€œ24 Cognitive Biases You Need To Stop Making [Infographic]โ€ Lifehacker. (2018): https://www.lifehacker.com.au/2018/03/find-out-which-cognitive-biases-alter-your-perspective/ โ— T. Laurinavicius. โ€œCognitive Biases You Need to Master to Design Better Websites.โ€ (2018): https://webdesign.tutsplus.com/articles/cognitive-biases-you-need-to-master-to-design-better-websites--cms-30742 โ— J. Lindzon. โ€œThis Brain Hack Will Help Reframe Your Interpretation Of Reality.โ€ Fast Company. (2017): https://www.fastcompany.com/40500514/this-brain-hack-will-help-reframe-your-interpretation-of-reality โ— E. Livni. โ€œThe philosophy that could have stopped Silicon Valleyโ€™s crisis of conscience before it started.โ€ Quartz. (2017): https://qz.com/1161704/silicon-valley-elite-from-companies-like-facebook-and-google-are-soothing-their-consciences-at-californias- esalen-institute/ โ— Microsoft. โ€œKeeping an Eye on AI with Dr. Kate Crawford.โ€ Microsoft Research Podcast. (2018): https://www.microsoft.com/en- us/research/blog/keeping-an-eye-on-ai-with-dr-kate-crawford/?OCID=msr_podcast_kcrawford_tw Additional resources (contโ€™d) 28
  • 29. @karenbachmann Know Thyself: Managing Bias #UXPA2018 โ— Mind Tools. โ€œAvoiding Psychological Bias in Decision Making: How to Make Objective Decisions.โ€ (2018): https://www.mindtools.com/pages/article/avoiding-psychological-bias.htm โ— Partnership on AI. (2016-1018): https://www.partnershiponai.org/ โ— J. Powell. โ€œIt's About Time We Challenge Our Unconscious Biases.โ€ TEDxStLouisWomen. (2016): https://www.youtube.com/watch?v=thkmVv54e6M โ— J. Powles. โ€œNew York Cityโ€™s Bold, Flawed Attempt to Make Algorithms Accountable.โ€ The New Yorker. (2017): https://www.newyorker.com/tech/elements/new-york-citys-bold-flawed-attempt-to-make-algorithms-accountable โ— M.J. Socolow. โ€œHow to Prevent Smart People From Spreading Dumb Ideas.โ€ The New York Times. (2018): https://www.nytimes.com/2018/03/22/opinion/facebook-spreading-ideas.html โ— J. Temperton. โ€œDeepMind's new AI ethics unit is the company's next big move.โ€ Wired UK. (2017): http://www.wired.co.uk/article/deepmind-ethics-and-society-artificial-intelligence โ— A. Thompson. โ€œGoogleโ€™s Sentiment Analyzer Thinks Being Gay Is Bad.โ€ Motherboard. (2017): https://motherboard.vice.com/en_us/article/j5jmj8/google-artificial-intelligence-bias โ— @sara_ann_marie. โ€œthe line from "look at our cool new facial-recognition app" to "wow this thing only works for white people" is a fucking millimeter long and clearly marked. why can't a single tech co seem to be able to see it?โ€ (2018): https://twitter.com/sara_ann_marie/status/953783812315602944 โ— M. Simmons. โ€œStudies Show That People Who Have High โ€˜Integrative Complexityโ€™ Are More Likely To Be Successful.โ€ (2018): https://medium.com/the-mission/studies-show-that-people-who-have-high-integrative-complexity-are-more-likely-to-be-successful- 443480e8930c Additional resources (contโ€™d) 29
  • 30. @karenbachmann Know Thyself: Managing Bias #UXPA2018 30 Know thyself and to thine users be true Understanding and managing biases that can influence UX work UXPA โ€ข June 2018 slides will be posted at: www.designforcontext.com/insights Karen Bachmann karen@designforcontext.com @karenbachmann UXPA 2018 Puerto Rico #UXPA18

Editor's Notes

  1. Listening talk: filters and barriers NASA project โ€“ beliefs as a key element of project success, morphed into biases โ€œIt is useless to attempt to reason a man out of a thing he was never reasoned into.โ€ โ€• Jonathan Swift โ€œIt's not at all hard to understand a person; it's only hard to listen without bias.โ€ โ€• Criss Jami, Killosophy โ€œThe eye sees only what the mind is prepared to comprehend.โ€ โ€• Robertson Davies, Tempest-Tost โ€œI have yet to see a piece of writing, political or non-political, that does not have a slant. All writing slants the way a writer leans, and no man is born perpendicular.โ€ โ€• E.B. White
  2. How should we talk about biases to ensure a non-threatening and productive discussion? How can we best identify the biases within our teams, including ourselves? What tools and processes to control for bias we can introduce into our processes? Where do biases emerge in our work? How can we best incorporate our understanding within our design and research process? How do we monitor for regressing thinking and new biases throughout the design process?
  3. Humanity: โ€œUmbutu - I am who I am because of who we all are, and we are who we are because of who I am. I see you, I see myself.โ€ ~Melanie Funchess, TEDx on Implicit Bias https://www.linkedin.com/pulse/13-cognitive-biases-really-screw-things-up-you-dr-travis-bradberry/ Awareness is the best way to beat these biases, so pay careful attention to how they influence you. Technically Wrong Watcher-Boettcher [walk-ter Bet-cher] โ€œโ€ฆexposure to difference changes perspective, and increases tolerance.โ€ ~Sara Watcher-Boettcher Implicit Bias -- how it effects us and how we push through | Melanie Funchess | TEDxFlourCity Implicit biases can make us incapable of seeing the truth before our eyes "We all have them. Even people who have avowed commitments to impartiality. Like judges." "What has been done can be undoneโ€ฆ. Our brains have tremendous capacity for growth and change." Call yourself on your actions. Takes being extremely self-aware. "Transformational activism" - do your work Connect with people who don't look like you When you have privilege, use it to create equity Intentionally and deliberately engage in non-biasing activities - join groups not like you and learn and then teach others ย 
  4. Former diversity trainer at DOJ
  5. Tact is the art of making a point without making an enemy -- Isaac Newton
  6. Algorithms and training data Data collection Data use Limited perspectives informing the choices we make Echo chambers and social bubbles https://www.theatlantic.com/technology/archive/2017/07/the-internet-is-one-big-personality-test/531861/ When algorithms can be trained to accurately infer your personality based on anything you do, the internet is a personality quizโ€”or, at least, it can be, so long as each page visit, web search, and โ€œlikeโ€ can be gathered and correlated. Online, before you even click on a quiz, youโ€™re already filling something out. โ€œWeโ€™re being trained by algorithms that theyโ€™re always right,โ€ Kosinski says. โ€ฆ If peopleโ€™s faith in algorithms continues to grow, it might not be long before I trust a computer to tell me about my personality more than I trust friends or familyโ€”or more than I trust myself. http://www.wired.co.uk/article/mustafa-suleyman-deepmind-ai-morals-ethics [AI technologies] could shine a light on damaging human biases and help society address them, or entrench patterns of discrimination and perpetuate them. We need to do the hard, practical and messy work of finding out what ethical AI really means. https://www.buzzfeed.com/tedchiang/the-real-danger-to-civilization-isnt-ai-its-runaway Silicon Valley has unconsciously created a devil in their own image, a boogeyman whose excesses are precisely their own. [AI isnโ€™t the problem. Itโ€™s exposing the underlying problem.] https://www.mindtheproduct.com/2017/11/product-design-era-algorithm-josh-clark/ We must be cognisant of the fact that we could easily code our historical biases into the machines of the future. People who have been persecuted in the past are not outliers, they must be integrated into the fabric of our societies and we can help make that happen with technology. https://meanjin.com.au/essays/the-last-days-of-reality/ Over the last two years, that capacity to manage mood has been monetised through the sharing of fake news and political feeds atuned to reader preference: you can also make people happy by confirming theirย biases. We all like to believe weโ€™re in the right, and when we get some sign from the universe at large that we are correct, we feel better about ourselves. Thatโ€™s how the curated newsfeed became wedded to the world of profitable propaganda. ย  ย 
  7. http://www.sachajudd.com/superfan Biases are not inherently good or bad, but โ€œactually a cognitive tool. ย Itโ€™s all the tiny assumptions that we make as we navigate the world because weโ€™re bombarded with too much information and our brains sort it quicker than even we can recognise.โ€ https://www.fastcompany.com/3043074/how-to-thwart-your-unconscious-biases-when-hiring-a-diverse-team If you have a brain, youโ€™re automatically biased. End of story. https://medium.com/the-mission/studies-show-that-people-who-have-high-integrative-complexity-are-more-likely-to-be-successful-443480e8930c Many were instrumental to our survival in an ancient world, but can lead to irrational decisions in the modern world. https://medium.com/mule-design/the-9-rules-of-design-research-1a273fdd1d3b This has nothing to do with how smart or how well-informed you are. Once you accept this, and as long as you work in a team that evinces psychological safety and mutual respect, it can be a fun game to identify biases and call them out. Melanie Funchess "What has been done can be undoneโ€ฆ. Our brains have tremendous capacity for growth and change." Call yourself on your actions. Takes being extremely self-aware. 3 design principles to help us overcome everyday bias | Thaniya Keereepart | TEDxPortland "The biases baked into us aren't going away overnight." Already changing behavior, but we need to keep at it and do things a tiny step at a time โ€œIt is useless to attempt to reason a man out of a thing he was never reasoned into.โ€ โ€• Jonathan Swift โ€œIt's not at all hard to understand a person; it's only hard to listen without bias.โ€ โ€• Criss Jami, Killosophy โ€œThe eye sees only what the mind is prepared to comprehend.โ€ โ€• Robertson Davies, Tempest-Tost โ€œI have yet to see a piece of writing, political or non-political, that does not have a slant. All writing slants the way a writer leans, and no man is born perpendicular.โ€ โ€• E.B. White
  8. Laura: Itโ€™s a wonder we get anything done. KB addendum: Itโ€™s a wonder we get any of the right things done. What should we remember? Unreliability of memory Generalizing instinctively or selective facts Context of memory Need to act fast Overconfidence Immediacy > measured, long-term Inertia Risk aversion Oversimplification Too much information Reliance on familiar Incorrectly boosting significance Focus on change (anchoring!) Confirmation based on existing mindset (confirmation bias) Blind spots to our own biases Not enough meaning Invent meaning Fill gaps from past patterns Oversimplification Overconfidence Projecting our thoughts and assumptions https://betterhumans.coach.me/cognitive-bias-cheat-sheet-55a472476b18 Buster Benson is writing a book on cognitive biases and arguments (Patreon). Keeps a book of his beliefs that he updates regularly. https://aeon.co/videos/models-are-always-imperfect-and-the-ones-we-choose-greatly-shape-our-experience
  9. https://qz.com/1132948/why-philosophy-is-so-important-in-science-education/ To approach it, I invite students to look at something nearby without any presuppositions. I then ask them to tell me what they see. They pauseโ€ฆ and then recognize that they canโ€™t interpret their experiences without drawing on prior ideas. Once they notice this, the idea that it can be appropriate to ask questions about objectivity in science ceases to be so strange. Amusement for children Useful tool for anyone Scourge on the environment Metaphor for disposable culture Unreliable and faulty Essential tool for people with motor skill challenges and other disabilities https://www.theatlantic.com/technology/archive/2018/06/disposable-america/563204/ Liminal Thinking Principle: โ€œAssume [Know] you are not objective. If youโ€™re part of the system, youโ€™re part of the problem.โ€ Horia Varlan. https://www.flickr.com/photos/horiavarlan/4273846588/
  10. https://www.aam-us.org/programs/diversity-equity-accessibility-and-inclusion/facing-change-unconscious-bias-and-personal-work/ Many industries and professions are having a similar discussion and trying to solve the problem https://qz.com/1161704/silicon-valley-elite-from-companies-like-facebook-and-google-are-soothing-their-consciences-at-californias-esalen-institute/ โ€œBetter late than never, at Esalen, techies are now studying compassion and connection with the help of specialists.โ€ ย  https://motherboard.vice.com/en_us/article/j5jmj8/google-artificial-intelligence-bias "It's easy to get around [the bias] for each individual problem," Ernest Davis, a professor of computer science at New York University told me over the phone, "But getting around it systematically is very difficult." https://qz.com/1132948/why-philosophy-is-so-important-in-science-education/ I propose an explicit division of labour. Our scientist colleagues should continue to teach the fundamentals of science, but they can help by making clear to their students that science brims with important conceptual, interpretative, methodological, and ethical issues that philosophers are uniquely situated to address, and that far from being irrelevant to science, philosophical matters lie at its heart. http://www.wired.co.uk/article/deepmind-ethics-and-society-artificial-intelligence Suleyman is bullish about his companyโ€™s efforts to not just break new frontiers in artificial intelligence technology, but also keep a grip on the ethical implications. โ€ฆ "putting sensitive issues, proactively, up-front, on the table, for public discussion." https://www.nytimes.com/2018/01/17/technology/apple-addiction-iphone.html โ€œI do think this is their time to step up,โ€ said Tristan Harris, a former design ethicist at Google who now runs Time Well Spent, an organization working to improve technologyโ€™s impact on society. https://finance.yahoo.com/news/mec-challenges-industry-brave-bias-130000133.html: Brave your bias challenge
  11. The Art and Science of Portraiture lessons Sara Lawrence-Lightfoot and Jessica Hoffmann Davis Dan Klyn at WIAD Tampa 2018 Dan Klyn advocates "Please Yourself" in design rather than trying to neutralize ourselves as designer, despite the idea that this would be a hard sell Embracing, not suppressing, our humanity in the design process increasingly seems like a good idea. https://qz.com/1132948/why-philosophy-is-so-important-in-science-education/ โ€œBut all of us are โ€˜biasedโ€™ and our biases fuel the creative work of science. This issue can be difficult to address, because a naive conception of objectivity is so ingrained in the popular image of what science is. โ€œ https://associationsnow.com/2017/12/tech-conference-2017-curiosity-based-decision-making/ But thereโ€™s a role for introspection as well. Leaders need to get to know themselves better and learn to love their vulnerabilities, Steltzer said. Often, the biggest inhibitor to curiosity is not someone else, but your own fears. https://www.microsoft.com/en-us/research/blog/keeping-an-eye-on-ai-with-dr-kate-crawford/?OCID=msr_podcast_kcrawford_tw There is no quick technical fix to bias. Itโ€™s really tempting to want to think that thereโ€™s going to be some type of silver-bullet solution that we can just tweak our algorithms or, you know, use different sorts of training data sets, or try to boost signal in particular ways. The problem of this is that it really doesnโ€™t look to the deep social and historical issues that human data is made from. Well letโ€™s go back to FATE, because thatโ€™s kind of a big interest of yours right now. Fairness, accountability, transparency and ethics. Also WEIRD https://complexityandmanagement.wordpress.com/2012/11/23/trust-in-organisations/
  12. http://whatusersdo.com/blog/how-to-fight-bias-in-your-organisation-or-team/ Talking: If we strive for a culture where weโ€™re having open and honest conversations, then weโ€™ll always be mindful of everyoneโ€™s point-of-view and recognise when our own biases are surfacing. Self-exam: Do we need to add a specific time in the diary for regular self-reflection? If it doesnโ€™t come naturally, then maybe we do. Groupthink: As Psychologists for Social Responsibility states, โ€œA group is especially vulnerable to groupthink when its members are similar in background.โ€ Transparency: Portraiture lessons Inclusive: Make sure a diverse team is effective by making sure all voices have a chance to speak and be heard https://www.fastcompany.com/3043074/how-to-thwart-your-unconscious-biases-when-hiring-a-diverse-team Taken together with results from hundreds of other studies, itโ€™s clear that where raising awareness alone can fail, simple strategiesโ€“like taking a moment to focus on similarities and common identities, or slowing down to weigh all the evidenceโ€“can go a long way to increasing not only the diversity of hires in organizations, but also to creating the kind of inclusive environment that will make those hires feel like itโ€™s worth sticking around. Data: Data doesnโ€™t have bias. Researchers have bias. Challenge the questions, provide the context and background, provide raw data even
  13. https://hbr.org/2015/05/outsmart-your-own-biases Are you biased? I am | Kristen Pressner | TEDxBasel Aug 30, 2016 Two conversations and her reactions juxtaposed to expose a bias Mentally, "flip it to test it." Reverse a description or perception to the opposite (man/woman, Caucasian/Indian - If it is weird, you might have a problem Otherwise, You may be missing an opportunity to see the world differently.
  14. https://hbr.org/2015/04/test-yourself-are-you-being-tricked-by-intuition
  15. https://webdesign.tutsplus.com/articles/cognitive-biases-you-need-to-master-to-design-better-websites--cms-30742 Confirmation bias: tendency to search for, interpret, favor, and recall information in a way that confirms one's preexisting beliefs or hypotheses Anchoring: the tendency for an individual to rely too heavily on an initial piece of information offered (known as the "anchor") when making decisions. Pro-Innovation: Belief that an innovation should be adopted by whole society without the need of its alteration Recency effect: Our tendency to generalize memory means we give priority to things we most recently learned Overconfidence: a person's subjective confidence in his or her judgements is reliably greater than the objective accuracy of those judgements, Backfire: given evidence against their beliefs, people can reject the evidence and believe even more strongly Implicit bias: the unconscious attribution of particular qualities to a member of a certain social group Ingroup/Outgroup: a pattern of favoring members of one's in-group over out-group members. http://behavioralscientist.org/behavioral-immune-system-influences-attitudes-toward-immigration/: behavioral immune system https://www.mindtools.com/pages/article/avoiding-psychological-bias.htm Psychological bias is the opposite of common sense and clear, measured judgment. It can lead to missed opportunities and poor decision making. Confirmation bias Look for ways to challenge what you think you see. Seek out information from a range of sources, and use an approach such as the Six Thinking Hats technique to consider situations from multiple perspectives. Alternatively, discuss your thoughts with others. Surround yourself with a diverse group of people, and don't be afraid to listen to dissenting views. Anchoring - "first impression" bias reflect on your decision-making history, and think about whether you've rushed to judgment in the past. make time to make decisions slowly Overconfidence If you suspect that you might be depending on potentially unreliable information, think about what you can do to gather comprehensive, objective data. Gambler's Fallacy make sure that you look at trends from a number of angles look for trends in your environment Fundamental Attribution Error It's essential to look at situations, and the people involved in them, non-judgmentally. Use empathy and (if appropriate) cultural intelligence, to understand why people behave in the ways that they do. Also, build emotional intelligence, so that you can reflect accurately on your own behavior.
  16. For too long weโ€™ve focused on managing user bias. Can we manage our own?
  17. https://www.theatlantic.com/technology/archive/2017/07/the-internet-is-one-big-personality-test/531861/ People tend to have a sense of their own character, but this sense is never complete. We know ourselves, but we donโ€™t. Emergent excuses Time Budget Overconfidence Ambient understanding from AEL collaboration approach
  18. https://medium.com/mule-design/the-9-rules-of-design-research-1a273fdd1d3b Erika Hall 9. Find your biasย buddies: โ€ฆWhen it comes to interpreting the results of research, collaboration becomes particularly critical. Everyone with a human brain is burdened by human biases. And there is no way to sense oneโ€™s own. We all see what best fits our existing beliefs. So, we have to refer to an external standard (including the pre-established goals and questions) and work together to check each other Tech tools: sentiment analysis on team communication, present consolidated findings Ambient understanding from AEL collaboration approach
  19. How to have non-threatening and productive discussions Tools for identifying our biases Tools to manage biases Bringing our new awareness into our design practice Are you biased? I am | Kristen Pressner | TEDxBasel Aug 30, 2016 Worth the journey: โ€œOtherwise, You may be missing an opportunity to see the world differently.โ€ ย