SlideShare a Scribd company logo
1 of 30
#ethicalAlgorithms@abeGong
1 0
Ethics for
Powerful
Algorithms
@abeGong
Aspire Health
Wrangle, SF
July 2016
#ethicalAlgorithms@abeGong
1. Algorithms are de facto
gatekeepers to opportunity.
2. Good statistics are
necessary but not sufficient
for good ethics.
3. You should conduct an ethics review
…and tell someone.
#ethicalAlgorithms@abeGong
Hi! I’d like a Great!
Let me check your
Credit score
#ethicalAlgorithms@abeGong
Hi! I’d like an Sure!
Let me check your
SAT/ACT
#ethicalAlgorithms@abeGong
Hi! I’d like to start a
Of course!
Let me check your
Criminal
history
#ethicalAlgorithms@abeGong
Hi! I need access to Of course!
Let me check your
Rates
#ethicalAlgorithms@abeGong
Hi! I’d like a Great!
Let me check your
#ethicalAlgorithms@abeGong
?
Algorithms are de facto
gatekeepers to opportunity.
#ethicalAlgorithms@abeGong From TIME : Out of work in America (2010)
#ethicalAlgorithms@abeGong
You know the way that
advertising turned out to be
the native business model for
the Internet?
I think that insurance is
going to be the native
business model for the
Internet of Things.
- Tim O'Reilly
#ethicalAlgorithms@abeGong
Hi! I’d like to
not be in
prison
anymore
Sure thing!
Let me check your
COMPAS
score
#ethicalAlgorithms@abeGong
COMPAS
• Proprietary algorithm
• Predicts recidivism
• 137 questions
• Not used in conviction or sentencing (usually)
• Often used to inform parole
#ethicalAlgorithms@abeGong
#ethicalAlgorithms@abeGong
#ethicalAlgorithms@abeGong
#ethicalAlgorithms@abeGong
COMPAS isn’t (statistically) biased…
#ethicalAlgorithms@abeGong
…but could still be deeply unfair.
1. Biased ground truth
#ethicalAlgorithms@abeGong
…but could still be deeply unfair.
1. Biased ground truth
2. Resources to cheat
A hungry person has a right to steal.
When people get in trouble with the
law it’s because they have no
chance to get a decent job.
When people do minor offenses or
use drugs they don’t hurt anyone
except themselves.
If someone insults my friends, family
or group they are asking for trouble.
The law doesn’t help average
people.
#ethicalAlgorithms@abeGong
…but could still be deeply unfair.
1. Biased ground truth
2. Resources to cheat
3. Circumstances outside
personal control
If you lived with both parents and
they later separated, how old
were you at the time?
Was your father (or father figure
who principally raised you) ever
arrested, that you know of?
How many of your
friends/acquaintances are taking
illegal drugs regularly?
In your neighborhood, have
some of your friends or family
been crime victims?
#ethicalAlgorithms@abeGong
#ethicalAlgorithms@abeGong
Good
useful
wrong
Models
#ethicalAlgorithms@abeGong
Conduct an ethics review
No thanks, I’d rather
be an amoral jerk.
#ethicalAlgorithms@abeGong
1. Find a friend.
2. Ask 4 questions.
3. Share something you
learned.
1 0
#ethicalAlgorithms@abeGong
1 0
1. Are the statistics solid?
2. Who wins? Who loses?
3. Are those changes in power
structures healthy?
4. How can we mitigate harms?
#ethicalAlgorithms@abeGong
Share on twitter, etc.
No thanks, I don’t care
about building community.
#ethicalAlgorithms@abeGong
I did an ethics review for my new
workout classification algorithm
#ethicalalgorithms
Great insights from @clarecorthell during our
ethics review for hospitalization risk scores.
#ethicalalgorithms
Foreground detection can rule out accidental
bystanders from facial recognition apps.
#ethicalalgorithms
Just finished an ethics review for my latest
data project. Feeling really good about it.
#ethicalalgorithms
#ethicalAlgorithms@abeGong
Hi! I’d like…
Great!
Let me check the
Algorithms are de facto
gatekeepers to opportunity.
#ethicalAlgorithms@abeGong
Good
useful
wrong
Models
#ethicalAlgorithms@abeGong
Conduct an ethics review
1. Are the statistics valid?
2. Who gains? Who loses?
3. Are changes in power
structures healthy?
4. Can we mitigate harms?
And share on twitter, etc.
#ethicalalgorithms
#ethicalAlgorithms@abeGong
1 0
Ethics for
Powerful
Algorithms
@abeGong
Aspire Health
Wrangle, SF
July 2016

More Related Content

Viewers also liked

Viewers also liked (8)

From Science to Product (Company)
From Science to Product (Company)From Science to Product (Company)
From Science to Product (Company)
 
The Unreasonable Effectiveness of Product Sense
The Unreasonable Effectiveness of Product SenseThe Unreasonable Effectiveness of Product Sense
The Unreasonable Effectiveness of Product Sense
 
Data Science in Drug Discovery
Data Science in Drug DiscoveryData Science in Drug Discovery
Data Science in Drug Discovery
 
Wrangle 2016: (Lightning Talk) FizzBuzz in TensorFlow
Wrangle 2016: (Lightning Talk) FizzBuzz in TensorFlowWrangle 2016: (Lightning Talk) FizzBuzz in TensorFlow
Wrangle 2016: (Lightning Talk) FizzBuzz in TensorFlow
 
Wrangle 2016: Seeing Behaviors as Humans Do: Uncovering Hidden Patterns in Ti...
Wrangle 2016: Seeing Behaviors as Humans Do: Uncovering Hidden Patterns in Ti...Wrangle 2016: Seeing Behaviors as Humans Do: Uncovering Hidden Patterns in Ti...
Wrangle 2016: Seeing Behaviors as Humans Do: Uncovering Hidden Patterns in Ti...
 
Visualizing Your Data Through Dashboards
Visualizing Your Data Through Dashboards Visualizing Your Data Through Dashboards
Visualizing Your Data Through Dashboards
 
A/B Testing at Pinterest: Building a Culture of Experimentation
A/B Testing at Pinterest: Building a Culture of Experimentation A/B Testing at Pinterest: Building a Culture of Experimentation
A/B Testing at Pinterest: Building a Culture of Experimentation
 
Stephanie deWet, Software Engineer, Pinterest at MLconf SF 2016
Stephanie deWet, Software Engineer, Pinterest at MLconf SF 2016Stephanie deWet, Software Engineer, Pinterest at MLconf SF 2016
Stephanie deWet, Software Engineer, Pinterest at MLconf SF 2016
 

Similar to Wrangle 2016: Staying Hippocratic with High Stakes Data

Morality – an introduction powerpoint
Morality – an introduction powerpointMorality – an introduction powerpoint
Morality – an introduction powerpoint
christinadoyle89
 

Similar to Wrangle 2016: Staying Hippocratic with High Stakes Data (20)

Data Science unit 2 By: Professor Lili Saghafi
Data Science unit 2 By: Professor Lili SaghafiData Science unit 2 By: Professor Lili Saghafi
Data Science unit 2 By: Professor Lili Saghafi
 
Ethic notes
Ethic notesEthic notes
Ethic notes
 
SEO - Human Emotion Through Algorithmic Eyes
SEO - Human Emotion Through Algorithmic EyesSEO - Human Emotion Through Algorithmic Eyes
SEO - Human Emotion Through Algorithmic Eyes
 
Accepting the Truth at Work: 3 Practical Tools
Accepting the Truth at Work: 3 Practical Tools Accepting the Truth at Work: 3 Practical Tools
Accepting the Truth at Work: 3 Practical Tools
 
Introduction to AI Ethics
Introduction to AI EthicsIntroduction to AI Ethics
Introduction to AI Ethics
 
The Ethics of Everyday Things
The Ethics of Everyday ThingsThe Ethics of Everyday Things
The Ethics of Everyday Things
 
Effective internet-presence
Effective internet-presenceEffective internet-presence
Effective internet-presence
 
BA and Beyond 20 - Liz Calder - We can, but should we? Modern ethics and the BA.
BA and Beyond 20 - Liz Calder - We can, but should we? Modern ethics and the BA.BA and Beyond 20 - Liz Calder - We can, but should we? Modern ethics and the BA.
BA and Beyond 20 - Liz Calder - We can, but should we? Modern ethics and the BA.
 
The Real History of #LAMG #LAMG2018
The Real History of #LAMG #LAMG2018The Real History of #LAMG #LAMG2018
The Real History of #LAMG #LAMG2018
 
SMCKC January 2016 Breakfast Keeping It Legal on Social
SMCKC January 2016 Breakfast Keeping It Legal on SocialSMCKC January 2016 Breakfast Keeping It Legal on Social
SMCKC January 2016 Breakfast Keeping It Legal on Social
 
Search Incrementality: How Paid and Organic Overdeliver Together - Jon Kagan,...
Search Incrementality: How Paid and Organic Overdeliver Together - Jon Kagan,...Search Incrementality: How Paid and Organic Overdeliver Together - Jon Kagan,...
Search Incrementality: How Paid and Organic Overdeliver Together - Jon Kagan,...
 
003 6Th Grade Argumentative Essay Topi. Online assignment writing service.
003 6Th Grade Argumentative Essay Topi. Online assignment writing service.003 6Th Grade Argumentative Essay Topi. Online assignment writing service.
003 6Th Grade Argumentative Essay Topi. Online assignment writing service.
 
The Untold Benefits of Ethical Design - Coldfront 2018, Copenhagen
The Untold Benefits of Ethical Design - Coldfront 2018, CopenhagenThe Untold Benefits of Ethical Design - Coldfront 2018, Copenhagen
The Untold Benefits of Ethical Design - Coldfront 2018, Copenhagen
 
ETHICAL LEADERSHIP.pptx
ETHICAL LEADERSHIP.pptxETHICAL LEADERSHIP.pptx
ETHICAL LEADERSHIP.pptx
 
Week 3 Business Ethics and Social Responsibility.pdf
Week 3 Business Ethics and Social Responsibility.pdfWeek 3 Business Ethics and Social Responsibility.pdf
Week 3 Business Ethics and Social Responsibility.pdf
 
8 Wrong Questions Agencies Are Asking About Social Media
8 Wrong Questions Agencies Are Asking About Social Media8 Wrong Questions Agencies Are Asking About Social Media
8 Wrong Questions Agencies Are Asking About Social Media
 
Beyond Screen Time
Beyond Screen Time Beyond Screen Time
Beyond Screen Time
 
Ethics - Questionnaire 01
Ethics - Questionnaire 01Ethics - Questionnaire 01
Ethics - Questionnaire 01
 
Morality – an introduction powerpoint
Morality – an introduction powerpointMorality – an introduction powerpoint
Morality – an introduction powerpoint
 
Gender free tech momentum to mitigate biases in ai
Gender free tech   momentum to mitigate biases in aiGender free tech   momentum to mitigate biases in ai
Gender free tech momentum to mitigate biases in ai
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Recently uploaded (20)

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 

Wrangle 2016: Staying Hippocratic with High Stakes Data