SlideShare a Scribd company logo
1 of 34
Download to read offline
Superintelligence
How afraid should we be?
Principal, Delta WisdomChair, London Futurists
David Wood
@dw2
#CIUUK14
@dw2
Page 2
Powerful technology,
incompletely
understood
Operated by people
outside their level of
competence
Human lives knocked
catastrophically off
trajectory, unintentionally
http://www.bbc.co.uk/news/world-europe-28357880
Self-improving AGI Beyond human control Humanity knocked
catastrophically off
trajectory, unintentionallyhttp://mashable.com/2014/07/17/malaysia-airlines-ukraine-russia-rebel/
@dw2
Page 3
@dw2
Page 4
Likely date of advent of HL-AGI
Population 10% 50% 90%
Conference: Philosophy
& Theory of AI
Conference: Artificial
General Intelligence
Greek Association for
Artificial Intelligence
Top 100 cited academic
authors in AI
Combined (from above)
Nick Bostrom: Superintelligence
@dw2
Page 5
Likely date of advent of HL-AGI
Population 10% 50% 90%
Conference: Philosophy
& Theory of AI
2048
Conference: Artificial
General Intelligence
2040
Greek Association for
Artificial Intelligence
2050
Top 100 cited academic
authors in AI
2050
Combined (from above) 2040
Nick Bostrom: Superintelligence
@dw2
Page 6
Likely date of advent of HL-AGI
Population 10% 50% 90%
Conference: Philosophy
& Theory of AI
2048 2080
Conference: Artificial
General Intelligence
2040 2065
Greek Association for
Artificial Intelligence
2050 2093
Top 100 cited academic
authors in AI
2050 2070
Combined (from above) 2040 2075
Nick Bostrom: Superintelligence
@dw2
Page 7
Likely date of advent of HL-AGI
Population 10% 50% 90%
Conference: Philosophy
& Theory of AI
2023 2048 2080
Conference: Artificial
General Intelligence
2022 2040 2065
Greek Association for
Artificial Intelligence
2020 2050 2093
Top 100 cited academic
authors in AI
2024 2050 2070
Combined (from above) 2022 2040 2075
Nick Bostrom: Superintelligence
@dw2
Page 8
Reaching HL AGI: 5 driving forces
1. Hardware with higher performance: Continuation of Moore’s Law?
– “18 different candidates” in Intel labs to add extra life to that trend
– Possible breakthroughs with Quantum Computing?
2. Software algorithm improvements?
– Can speed things up faster than hardware gains – e.g. chess computers
– Compare: Andrew Wiles, unexpected proof of Fermat’s Last Theorem (1993)
3. Learnings from studying the human brain?
– Improved scanning techniques -> “neuromorphic computing” etc
– Philosophical insight into consciousness/creativity?!
4. More people studying these fields than ever before
– Stanford University online course on AI: 160,000 students (23,000 finished it)
– More components / databases / tools /methods ready for re-combination
– Unexpected triggers for improvement (malware wars, games AI, financial AI…)
5. Transformation in society’s motivation?
http://intelligence.org/2013/05/15/when-will-ai-be-created/
(Smarter people?!)
“Sputnik moment!?”
@dw2
Page 9
Superintelligence – model 1
Village idiot Einstein
http://intelligence.org/files/mindisall-tv07.ppt
Eliezer Yudkowsky
@dw2
Page 10
Superintelligence – model 2
http://intelligence.org/files/mindisall-tv07.ppt
Village idiotMouse
Chimp Einstein
AI
50-100 years 50-100 weeks? / days? / hours?
Vernor Vinge: The best answer to the question,
“Will computers ever be as smart as humans?”
is probably “Yes, but only briefly.”
“The final invention”
Eliezer Yudkowsky
@dw2
Page 11
Recursive improvement
Design,
Manufacturing
Computers
@dw2
Page 12
Recursive improvement
Software tools
(debuggers,
compilers…)
Software
@dw2
Page 13
Recursive improvement
AI tools
AI
Intelligence
explosion
++Rapid reading &
comprehension of
all written material
++Rapid expansion
onto improved
hardware
++Funded by financial winnings from smart stock trading
++Supported by humans easily psychologically manipulated
Who here wanted to merge again?
Jaan Tallinn: http://prezi.com/xku9q-v-fg_j/intelligence-stairway/
@dw2
Page 15
Exponential growth?
Technology
Time
2050
?
Technology
Time
2050
AGI=HL
ASI>>HL
Ray Kurzweil Eliezer Yudkowsky
@dw2
Page 16
Going nuclear: hard to calculate
• First hydrogen bomb test, 1st March 1954, Bikini Atoll
– Explosive yield was expected to be from 4 to 6 Megatons
– Was 15 Megatons, two and a half times
the expected maximum
– Physics error by the designers at Los
Alamos National Lab
– Wrongly considered the lithium-7 isotope
to be inert in bomb
– The crew in a nearby Japanese fishing boat
became ill in the wake of direct contact
with the fallout. One of the crew died
http://en.wikipedia.org/wiki/Castle_Bravo
@dw2
Page 17
Superintelligence – model 2
http://intelligence.org/files/mindisall-tv07.ppt
Village idiot
Chimp Einstein
Mouse
AI
Linear model of intelligence?
Eliezer Yudkowsky
@dw2
Page 18
Gloopy ASIs
Posthuman mindspace
Bipping ASIs
Freepy ASIs
Eliezer Yudkowsky
http://intelligence.org/
files/mindisall-tv07.ppt
Model 3
Transhuman mindspace
Human minds
Minds-in-general
@dw2
Page 19
Dimensions of mind
The ability to achieve
goals in a wide range
of environments
Being conscious?
Having compassion for
sentient beings with
lesser intelligence?
@dw2
Page 20
AI systems we should fear
Killer drones with
autonomous
decision-making
powers (Robocop)
Malware that can
hack infrastructure-
control systems
(e.g. Stuxnet)
Financial trading
systems software
(high speed)
Software that is
expert in
manipulating
humans
http://www.williamhertling.com/
Software that is expert in manipulating humans
@dw2
Page 22
AI systems we should fear
Killer drones with
autonomous
decision-making
powers (Robocop)
Malware that can
hack infrastructure-
control systems
(e.g. Stuxnet)
Financial trading
systems software
(high speed)
Software that is
expert in
manipulating
humans
Software
that pursues
a single
optimisation
goal to the
exclusion of
all others
The more power such an AI has, the more we should fear it
@dw2
Page 23
The pursuit of happiness?
Software
that pursues
a single
optimisation
goal to the
exclusion of
all others
Software will do what we say, rather than what we meant to say
Wire-heading?!
Just make us happy!?
@dw2
Page 24
The pursuit of morality?
Just be moral!?
http://www.clipartbest.com/clipart-nTXa54XTB
Whose morality?
The problem of computer morality is
at least as hard as the problem of
computer vision (!)
http://tvtropes.org/pmwiki/pmwiki.php/Creator/IsaacAsimov
Isaac Asimov’s
Three Laws of Robotics?!
@dw2
Page 25
The two fundamental problems
of superintelligence
Specification problem: How do we
define the goals of the AGI software?
Control problem: How do retain the
ability to shut down the software?
Creation problem: How do we create
AGI software in the first place?
@dw2
Page 26
The fundamental meta-problem
of superintelligence
Specification problem: How do we
define the goals of the AGI software?
Control problem: How do retain the
ability to shut down the software?
Creation problem: How do we create
AGI software in the first place?
~No
research
~No
research
Some
research
Accidental
research
“Friendly
AI” (FAI)
“AI
in a box”
@dw2
Page 27
AI in a box?
Tripwires? “Adam and Eve” ethernet port?!
Software will be a tool, answering questions, not an agent?
The “answers” which the software
gives us will have effects in the world
(e.g. software it writes for us)
Systems which rely on humans to verify and
carry out their actions will be uncompetitive
compared to those with greater autonomy
AGI may become very
smart in surreptitiously
evading tripwires
Simple?
@dw2
Page 28
“The orthogonality thesis”
Intelligence and final goals are orthogonal
More or less
any intelligence
…could in principle
be combined with…
more or less
any final goal
@dw2
Page 29
“The instrumental convergence thesis”
(“AI Drives”)
Some intermediate (instrumental) goals are
likely in all cases for a superintelligence:
• Resource acquisition
• Cognitive enhancement
• Greater creativity
• Self preservation (preservation of goal)…
Steve Omohundro: “For a sufficiently intelligent system, avoiding vulnerabilities
is as powerful a motivator as explicitly constructed goals and subgoals”
@dw2
Page 30
Indirect specification of goals?
Specification problem: How do we
define the goals of the AGI software?
“Achieve the goals which the creators of the AGI would have wished
it to achieve, if they had thought about the matter long and hard”
This software will do what we meant to say,
rather than what we actually said (?)
AGI helps us to figure out the answer to the spec problem!
@dw2
Page 31
CEV: Coherent Extrapolated Volition
AGI should be tasked to carry out:
Our wish if we knew more,
thought faster,
were more the people we wished we were,
had grown up farther together;
where the extrapolation converges rather than diverges,
where our wishes cohere rather than interfere;
extrapolated as we wish that extrapolated,
interpreted as we wish that interpreted
Eliezer Yudkowsky
@dw2
Page 32
Unanswered questions (selection)
1. Can we turn ‘poetic’ ideas like CEV into bug-free working software?
– Should we humans concentrate harder on working out our “blended volition”?
2. How can we stop a superintelligence from changing its own core goals?
– Like humans can choose to set aside their biologically inherited goals
– Could AGIs that start off ‘Friendly’ become “born again” with new priorities?!
3. Can we prevent AGIs from developing dangerous instrumental drives?
– By programming (bug-free) in tamper-proof limitations?
4. Can AGIs help us to figure out a solution to the Control problem?
– Can we use a hierarchy of lower-level AGIs to control higher-level ones?
5. Can we prevent the rapid nuclear-style take-off of self-improving AGI?
6. Are some approaches to creating AGIs safer than others?
– Whole Brain Emulation / AGI de novo / evolution in virtual environment…
– Open (everything published) vs. Closed (some parts secret)?
7. How does the AGI existential risk compare to other x-risks in priority?
– Nanotech grey goo, deadly new bio-hazard, nuclear holocaust, climate chaos…
@dw2
Page 33
Answered questions (selection)
a) Should we be afraid?
– Yes. (End-of-the-world afraid)
b) Can we slow down all research into AGI, until we’re confident we
have good answers to the control and/or specification problems?
– Unlikely – there’s too much financial investment happening worldwide
– Too many separate countries / militaries / finance houses… are involved
c) How do we promote wider study of the Superintelligence topic?
– Need to lose the “weird” and “embarrassment” angles
– “Less Wrong” strikes some observers as cultish
– “Terminator” and “Transcendence” have done more harm than good
– First class books / articles / movies needed, addressing thoughtful audiences
– Good intermediate results useful too (not just appeals for more funding)
Practical philosophy!
Preparing humanity to survive the
forthcoming transition to superintelligence
Principal, Delta WisdomChair, London Futurists
Urgent!
(Roles too for mathematicians, theologians…)
David Wood
@dw2
Philosophy with an expiry date! Making a real difference!

More Related Content

What's hot

9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use Today9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use TodayIQVIS
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligenceSai Nath
 
Philosophy of Artificial Intelligence
Philosophy of Artificial IntelligencePhilosophy of Artificial Intelligence
Philosophy of Artificial IntelligenceJuho Vaiste
 
AI in Finance: Moving forward!
AI in Finance: Moving forward!AI in Finance: Moving forward!
AI in Finance: Moving forward!Adrian Hornsby
 
Solve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscapeSolve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscapeEd Fernandez
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial IntelligenceGirish Naik
 
Using Generative AI
Using Generative AIUsing Generative AI
Using Generative AIMark DeLoura
 
AI in Manufacturing - John.pdf
AI in Manufacturing - John.pdfAI in Manufacturing - John.pdf
AI in Manufacturing - John.pdfJohn Chang
 
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...DataScienceConferenc1
 
Prompt Engineering - an Art, a Science, or your next Job Title?
Prompt Engineering - an Art, a Science, or your next Job Title?Prompt Engineering - an Art, a Science, or your next Job Title?
Prompt Engineering - an Art, a Science, or your next Job Title?Maxim Salnikov
 
An Introduction to Generative AI - May 18, 2023
An Introduction  to Generative AI - May 18, 2023An Introduction  to Generative AI - May 18, 2023
An Introduction to Generative AI - May 18, 2023CoriFaklaris1
 
ChatGPT, Foundation Models and Web3.pptx
ChatGPT, Foundation Models and Web3.pptxChatGPT, Foundation Models and Web3.pptx
ChatGPT, Foundation Models and Web3.pptxJesus Rodriguez
 
Introduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation SlidesIntroduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation SlidesSlideTeam
 
The Future is in Responsible Generative AI
The Future is in Responsible Generative AIThe Future is in Responsible Generative AI
The Future is in Responsible Generative AISaeed Al Dhaheri
 
Conversational AI and Chatbot Integrations
Conversational AI and Chatbot IntegrationsConversational AI and Chatbot Integrations
Conversational AI and Chatbot IntegrationsCristina Vidu
 
Generative AI, WiDS 2023.pptx
Generative AI, WiDS 2023.pptxGenerative AI, WiDS 2023.pptx
Generative AI, WiDS 2023.pptxColleen Farrelly
 
Landscape of AI/ML in 2023
Landscape of AI/ML in 2023Landscape of AI/ML in 2023
Landscape of AI/ML in 2023HyunJoon Jung
 
Ethics in the use of Data & AI
Ethics in the use of Data & AI Ethics in the use of Data & AI
Ethics in the use of Data & AI Kalilur Rahman
 

What's hot (20)

9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use Today9 Examples of Artificial Intelligence in Use Today
9 Examples of Artificial Intelligence in Use Today
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Philosophy of Artificial Intelligence
Philosophy of Artificial IntelligencePhilosophy of Artificial Intelligence
Philosophy of Artificial Intelligence
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
AI in Finance: Moving forward!
AI in Finance: Moving forward!AI in Finance: Moving forward!
AI in Finance: Moving forward!
 
Solve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscapeSolve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscape
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Using Generative AI
Using Generative AIUsing Generative AI
Using Generative AI
 
AI in Manufacturing - John.pdf
AI in Manufacturing - John.pdfAI in Manufacturing - John.pdf
AI in Manufacturing - John.pdf
 
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
[DSC DACH 23] ChatGPT and Beyond: How generative AI is Changing the way peopl...
 
Prompt Engineering - an Art, a Science, or your next Job Title?
Prompt Engineering - an Art, a Science, or your next Job Title?Prompt Engineering - an Art, a Science, or your next Job Title?
Prompt Engineering - an Art, a Science, or your next Job Title?
 
An Introduction to Generative AI - May 18, 2023
An Introduction  to Generative AI - May 18, 2023An Introduction  to Generative AI - May 18, 2023
An Introduction to Generative AI - May 18, 2023
 
ChatGPT, Foundation Models and Web3.pptx
ChatGPT, Foundation Models and Web3.pptxChatGPT, Foundation Models and Web3.pptx
ChatGPT, Foundation Models and Web3.pptx
 
Introduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation SlidesIntroduction To Artificial Intelligence PowerPoint Presentation Slides
Introduction To Artificial Intelligence PowerPoint Presentation Slides
 
The Future is in Responsible Generative AI
The Future is in Responsible Generative AIThe Future is in Responsible Generative AI
The Future is in Responsible Generative AI
 
Conversational AI and Chatbot Integrations
Conversational AI and Chatbot IntegrationsConversational AI and Chatbot Integrations
Conversational AI and Chatbot Integrations
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Generative AI, WiDS 2023.pptx
Generative AI, WiDS 2023.pptxGenerative AI, WiDS 2023.pptx
Generative AI, WiDS 2023.pptx
 
Landscape of AI/ML in 2023
Landscape of AI/ML in 2023Landscape of AI/ML in 2023
Landscape of AI/ML in 2023
 
Ethics in the use of Data & AI
Ethics in the use of Data & AI Ethics in the use of Data & AI
Ethics in the use of Data & AI
 

Viewers also liked

Superintelligence and Me
Superintelligence and MeSuperintelligence and Me
Superintelligence and MeJeff Kaminsky
 
Ben Franklin Creative Citizen
Ben Franklin Creative CitizenBen Franklin Creative Citizen
Ben Franklin Creative CitizenTom Tresser
 
Nick Bostrom, Oxford’s Future of Humanity Institute
Nick Bostrom, Oxford’s Future of Humanity InstituteNick Bostrom, Oxford’s Future of Humanity Institute
Nick Bostrom, Oxford’s Future of Humanity InstituteActivate Summit
 
SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...
SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...
SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...Namira Jasmine
 
SearchLove San Diego 2017 | Michael King | Machine Doing
SearchLove San Diego 2017 | Michael King | Machine DoingSearchLove San Diego 2017 | Michael King | Machine Doing
SearchLove San Diego 2017 | Michael King | Machine DoingDistilled
 
Kecerdasan buatan
Kecerdasan buatanKecerdasan buatan
Kecerdasan buatanzhu ma
 
2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝
2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝
2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝JungGeun Lee
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentationlpaviglianiti
 
Deep Learning - Convolutional Neural Networks
Deep Learning - Convolutional Neural NetworksDeep Learning - Convolutional Neural Networks
Deep Learning - Convolutional Neural NetworksChristian Perone
 
How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheLeslie Samuel
 

Viewers also liked (13)

Cloud Superintelligence
Cloud SuperintelligenceCloud Superintelligence
Cloud Superintelligence
 
Superintelligence and Me
Superintelligence and MeSuperintelligence and Me
Superintelligence and Me
 
Ben Franklin Creative Citizen
Ben Franklin Creative CitizenBen Franklin Creative Citizen
Ben Franklin Creative Citizen
 
Nick Bostrom, Oxford’s Future of Humanity Institute
Nick Bostrom, Oxford’s Future of Humanity InstituteNick Bostrom, Oxford’s Future of Humanity Institute
Nick Bostrom, Oxford’s Future of Humanity Institute
 
SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...
SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...
SIM, Namira Nur Jasmine, Hapzi Ali, Sistem Kecerdasan Buatan, Universitas Mer...
 
SearchLove San Diego 2017 | Michael King | Machine Doing
SearchLove San Diego 2017 | Michael King | Machine DoingSearchLove San Diego 2017 | Michael King | Machine Doing
SearchLove San Diego 2017 | Michael King | Machine Doing
 
Kecerdasan buatan
Kecerdasan buatanKecerdasan buatan
Kecerdasan buatan
 
2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝
2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝
2016 kcd 세미나 발표자료. 구글포토로 바라본 인공지능과 머신러닝
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
 
Artificial inteligence
Artificial inteligenceArtificial inteligence
Artificial inteligence
 
Deep Learning - Convolutional Neural Networks
Deep Learning - Convolutional Neural NetworksDeep Learning - Convolutional Neural Networks
Deep Learning - Convolutional Neural Networks
 
How to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your NicheHow to Become a Thought Leader in Your Niche
How to Become a Thought Leader in Your Niche
 

Similar to Superintelligence: how afraid should we be?

AI – Risks, Opportunities and Ethical Issues April 2023.pdf
AI – Risks, Opportunities and Ethical Issues April 2023.pdfAI – Risks, Opportunities and Ethical Issues April 2023.pdf
AI – Risks, Opportunities and Ethical Issues April 2023.pdfAdam Ford
 
Ethics for the machines altitude software
Ethics for the machines   altitude softwareEthics for the machines   altitude software
Ethics for the machines altitude softwareAltitude Software
 
Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01
Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01
Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01Adam Ford
 
AI – Risks, Opportunities and Ethical Issues.pdf
AI – Risks, Opportunities and Ethical Issues.pdfAI – Risks, Opportunities and Ethical Issues.pdf
AI – Risks, Opportunities and Ethical Issues.pdfAdam Ford
 
Chapter Three, four, five and six.ppt ITEtx
Chapter Three, four, five and six.ppt ITEtxChapter Three, four, five and six.ppt ITEtx
Chapter Three, four, five and six.ppt ITEtxgadisaAdamu
 
APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...
APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...
APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...apidays
 
What really is Artificial Intelligence about?
What really is Artificial Intelligence about? What really is Artificial Intelligence about?
What really is Artificial Intelligence about? Harmony Kwawu
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligenceBiniam Behailu
 
Technologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial IntelligenceTechnologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial IntelligencePioneers.io
 
Jdb code biology and ai final
Jdb code biology and ai finalJdb code biology and ai final
Jdb code biology and ai finalJoachim De Beule
 
Artificial Intelligence And Artificial Technology
Artificial Intelligence And Artificial TechnologyArtificial Intelligence And Artificial Technology
Artificial Intelligence And Artificial TechnologyMichele Johnson
 
Pros And Cons Of Fear Of Super Intelligence
Pros And Cons Of Fear Of Super IntelligencePros And Cons Of Fear Of Super Intelligence
Pros And Cons Of Fear Of Super IntelligenceYolanda Jenkins
 
AI and the Future of Work [TUG-CO, 11/15/23]
AI and the Future of Work [TUG-CO, 11/15/23]AI and the Future of Work [TUG-CO, 11/15/23]
AI and the Future of Work [TUG-CO, 11/15/23]Matt Small
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligencesaloni sharma
 
What will the world be like 50 years 20 (1)
What will the world be like 50 years 20 (1)What will the world be like 50 years 20 (1)
What will the world be like 50 years 20 (1)nitut1
 
Importance Of Artificial Intelligence
Importance Of Artificial IntelligenceImportance Of Artificial Intelligence
Importance Of Artificial IntelligenceGinger Martin
 
Singularity - fiction or future?
Singularity - fiction or future?Singularity - fiction or future?
Singularity - fiction or future?Jia Chai Low
 

Similar to Superintelligence: how afraid should we be? (20)

Mieczysław Muraszkiewicz, Warsaw University of Technology: Artificial Intelli...
Mieczysław Muraszkiewicz, Warsaw University of Technology: Artificial Intelli...Mieczysław Muraszkiewicz, Warsaw University of Technology: Artificial Intelli...
Mieczysław Muraszkiewicz, Warsaw University of Technology: Artificial Intelli...
 
AI – Risks, Opportunities and Ethical Issues April 2023.pdf
AI – Risks, Opportunities and Ethical Issues April 2023.pdfAI – Risks, Opportunities and Ethical Issues April 2023.pdf
AI – Risks, Opportunities and Ethical Issues April 2023.pdf
 
Ethics for the machines altitude software
Ethics for the machines   altitude softwareEthics for the machines   altitude software
Ethics for the machines altitude software
 
Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01
Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01
Will Super-Intellligent AI Transform Our Future? - Adam Ford - 2022-01
 
AI – Risks, Opportunities and Ethical Issues.pdf
AI – Risks, Opportunities and Ethical Issues.pdfAI – Risks, Opportunities and Ethical Issues.pdf
AI – Risks, Opportunities and Ethical Issues.pdf
 
Chapter Three, four, five and six.ppt ITEtx
Chapter Three, four, five and six.ppt ITEtxChapter Three, four, five and six.ppt ITEtx
Chapter Three, four, five and six.ppt ITEtx
 
APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...
APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...
APIdays Paris 2018 - Bots on the 'Net: The Good, the Bad, and the Future, Mik...
 
What really is Artificial Intelligence about?
What really is Artificial Intelligence about? What really is Artificial Intelligence about?
What really is Artificial Intelligence about?
 
AI: A Begining
AI: A BeginingAI: A Begining
AI: A Begining
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
Technologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial IntelligenceTechnologies Demystified: Artificial Intelligence
Technologies Demystified: Artificial Intelligence
 
Jdb code biology and ai final
Jdb code biology and ai finalJdb code biology and ai final
Jdb code biology and ai final
 
Artificial Intelligence And Artificial Technology
Artificial Intelligence And Artificial TechnologyArtificial Intelligence And Artificial Technology
Artificial Intelligence And Artificial Technology
 
Pros And Cons Of Fear Of Super Intelligence
Pros And Cons Of Fear Of Super IntelligencePros And Cons Of Fear Of Super Intelligence
Pros And Cons Of Fear Of Super Intelligence
 
AI and the Future of Work [TUG-CO, 11/15/23]
AI and the Future of Work [TUG-CO, 11/15/23]AI and the Future of Work [TUG-CO, 11/15/23]
AI and the Future of Work [TUG-CO, 11/15/23]
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
What will the world be like 50 years 20 (1)
What will the world be like 50 years 20 (1)What will the world be like 50 years 20 (1)
What will the world be like 50 years 20 (1)
 
Importance Of Artificial Intelligence
Importance Of Artificial IntelligenceImportance Of Artificial Intelligence
Importance Of Artificial Intelligence
 
Singularity - fiction or future?
Singularity - fiction or future?Singularity - fiction or future?
Singularity - fiction or future?
 
Sins2016
Sins2016Sins2016
Sins2016
 

More from David Wood

Assessing the risks of AI catastrophe - presentation given by David Wood on 1...
Assessing the risks of AI catastrophe - presentation given by David Wood on 1...Assessing the risks of AI catastrophe - presentation given by David Wood on 1...
Assessing the risks of AI catastrophe - presentation given by David Wood on 1...David Wood
 
AI - summary of focus groups.pdf
AI - summary of focus groups.pdfAI - summary of focus groups.pdf
AI - summary of focus groups.pdfDavid Wood
 
From the Eclipse Foundation to the Symbian Foundation
From the Eclipse Foundation to the Symbian FoundationFrom the Eclipse Foundation to the Symbian Foundation
From the Eclipse Foundation to the Symbian FoundationDavid Wood
 
The Future of AI: Scenarios, Ethics, and Regulations
The Future of AI: Scenarios, Ethics, and RegulationsThe Future of AI: Scenarios, Ethics, and Regulations
The Future of AI: Scenarios, Ethics, and RegulationsDavid Wood
 
The Singularity Principles for WTEF
The Singularity Principles for WTEFThe Singularity Principles for WTEF
The Singularity Principles for WTEFDavid Wood
 
Vital Syllabus project update 220410.pdf
Vital Syllabus project update 220410.pdfVital Syllabus project update 220410.pdf
Vital Syllabus project update 220410.pdfDavid Wood
 
The Abolition of Aging - An update for 2022.pdf
The Abolition of Aging - An update for 2022.pdfThe Abolition of Aging - An update for 2022.pdf
The Abolition of Aging - An update for 2022.pdfDavid Wood
 
Vital Syllabus project update 220315
Vital Syllabus project update 220315Vital Syllabus project update 220315
Vital Syllabus project update 220315David Wood
 
UK node MPPC 2021 v1
UK node MPPC 2021 v1UK node MPPC 2021 v1
UK node MPPC 2021 v1David Wood
 
Transhumanism 2024: A new future for politics?
Transhumanism 2024: A new future for politics?Transhumanism 2024: A new future for politics?
Transhumanism 2024: A new future for politics?David Wood
 
DW Augmented Humanity - Opportunity or Threat
DW Augmented Humanity - Opportunity or ThreatDW Augmented Humanity - Opportunity or Threat
DW Augmented Humanity - Opportunity or ThreatDavid Wood
 
DW New Kind of Thinking
DW New Kind of ThinkingDW New Kind of Thinking
DW New Kind of ThinkingDavid Wood
 
AI in 5-10 years time: 12 ways it could be very different from today
AI in 5-10 years time: 12 ways it could be very different from todayAI in 5-10 years time: 12 ways it could be very different from today
AI in 5-10 years time: 12 ways it could be very different from todayDavid Wood
 
DW H+Summit 2020
DW H+Summit 2020DW H+Summit 2020
DW H+Summit 2020David Wood
 
Uk node mpcc 2020 v2
Uk node mpcc 2020 v2Uk node mpcc 2020 v2
Uk node mpcc 2020 v2David Wood
 
Roadmapping the UK's future, 2019-2025-2035
Roadmapping the UK's future, 2019-2025-2035Roadmapping the UK's future, 2019-2025-2035
Roadmapping the UK's future, 2019-2025-2035David Wood
 
The roadmap to abolish aging by 2040
The roadmap to abolish aging by 2040The roadmap to abolish aging by 2040
The roadmap to abolish aging by 2040David Wood
 
Progressive ethics in the digital age
Progressive ethics in the digital ageProgressive ethics in the digital age
Progressive ethics in the digital ageDavid Wood
 
Lessons from 10 years of public meetups addressing existential risk
Lessons from 10 years of public meetups addressing existential riskLessons from 10 years of public meetups addressing existential risk
Lessons from 10 years of public meetups addressing existential riskDavid Wood
 
DW Establishing Futuristic Rights
DW Establishing Futuristic RightsDW Establishing Futuristic Rights
DW Establishing Futuristic RightsDavid Wood
 

More from David Wood (20)

Assessing the risks of AI catastrophe - presentation given by David Wood on 1...
Assessing the risks of AI catastrophe - presentation given by David Wood on 1...Assessing the risks of AI catastrophe - presentation given by David Wood on 1...
Assessing the risks of AI catastrophe - presentation given by David Wood on 1...
 
AI - summary of focus groups.pdf
AI - summary of focus groups.pdfAI - summary of focus groups.pdf
AI - summary of focus groups.pdf
 
From the Eclipse Foundation to the Symbian Foundation
From the Eclipse Foundation to the Symbian FoundationFrom the Eclipse Foundation to the Symbian Foundation
From the Eclipse Foundation to the Symbian Foundation
 
The Future of AI: Scenarios, Ethics, and Regulations
The Future of AI: Scenarios, Ethics, and RegulationsThe Future of AI: Scenarios, Ethics, and Regulations
The Future of AI: Scenarios, Ethics, and Regulations
 
The Singularity Principles for WTEF
The Singularity Principles for WTEFThe Singularity Principles for WTEF
The Singularity Principles for WTEF
 
Vital Syllabus project update 220410.pdf
Vital Syllabus project update 220410.pdfVital Syllabus project update 220410.pdf
Vital Syllabus project update 220410.pdf
 
The Abolition of Aging - An update for 2022.pdf
The Abolition of Aging - An update for 2022.pdfThe Abolition of Aging - An update for 2022.pdf
The Abolition of Aging - An update for 2022.pdf
 
Vital Syllabus project update 220315
Vital Syllabus project update 220315Vital Syllabus project update 220315
Vital Syllabus project update 220315
 
UK node MPPC 2021 v1
UK node MPPC 2021 v1UK node MPPC 2021 v1
UK node MPPC 2021 v1
 
Transhumanism 2024: A new future for politics?
Transhumanism 2024: A new future for politics?Transhumanism 2024: A new future for politics?
Transhumanism 2024: A new future for politics?
 
DW Augmented Humanity - Opportunity or Threat
DW Augmented Humanity - Opportunity or ThreatDW Augmented Humanity - Opportunity or Threat
DW Augmented Humanity - Opportunity or Threat
 
DW New Kind of Thinking
DW New Kind of ThinkingDW New Kind of Thinking
DW New Kind of Thinking
 
AI in 5-10 years time: 12 ways it could be very different from today
AI in 5-10 years time: 12 ways it could be very different from todayAI in 5-10 years time: 12 ways it could be very different from today
AI in 5-10 years time: 12 ways it could be very different from today
 
DW H+Summit 2020
DW H+Summit 2020DW H+Summit 2020
DW H+Summit 2020
 
Uk node mpcc 2020 v2
Uk node mpcc 2020 v2Uk node mpcc 2020 v2
Uk node mpcc 2020 v2
 
Roadmapping the UK's future, 2019-2025-2035
Roadmapping the UK's future, 2019-2025-2035Roadmapping the UK's future, 2019-2025-2035
Roadmapping the UK's future, 2019-2025-2035
 
The roadmap to abolish aging by 2040
The roadmap to abolish aging by 2040The roadmap to abolish aging by 2040
The roadmap to abolish aging by 2040
 
Progressive ethics in the digital age
Progressive ethics in the digital ageProgressive ethics in the digital age
Progressive ethics in the digital age
 
Lessons from 10 years of public meetups addressing existential risk
Lessons from 10 years of public meetups addressing existential riskLessons from 10 years of public meetups addressing existential risk
Lessons from 10 years of public meetups addressing existential risk
 
DW Establishing Futuristic Rights
DW Establishing Futuristic RightsDW Establishing Futuristic Rights
DW Establishing Futuristic Rights
 

Recently uploaded

Scenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenariosScenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenariosErol GIRAUDY
 
IT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingIT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingMAGNIntelligence
 
My key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAIMy key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAIVijayananda Mohire
 
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptxGraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptxNeo4j
 
Keep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES LiveKeep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES LiveIES VE
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsDianaGray10
 
The New Cloud World Order Is FinOps (Slideshow)
The New Cloud World Order Is FinOps (Slideshow)The New Cloud World Order Is FinOps (Slideshow)
The New Cloud World Order Is FinOps (Slideshow)codyslingerland1
 
Oracle Database 23c Security New Features.pptx
Oracle Database 23c Security New Features.pptxOracle Database 23c Security New Features.pptx
Oracle Database 23c Security New Features.pptxSatishbabu Gunukula
 
Outage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedIn
Outage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedInOutage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedIn
Outage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedInThousandEyes
 
Patch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updatePatch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updateadam112203
 
Top 10 Squarespace Development Companies
Top 10 Squarespace Development CompaniesTop 10 Squarespace Development Companies
Top 10 Squarespace Development CompaniesTopCSSGallery
 
20140402 - Smart house demo kit
20140402 - Smart house demo kit20140402 - Smart house demo kit
20140402 - Smart house demo kitJamie (Taka) Wang
 
LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0DanBrown980551
 
TrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie WorldTrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie WorldTrustArc
 
Technical SEO for Improved Accessibility WTS FEST
Technical SEO for Improved Accessibility  WTS FESTTechnical SEO for Improved Accessibility  WTS FEST
Technical SEO for Improved Accessibility WTS FESTBillieHyde
 
How to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptxHow to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptxKaustubhBhavsar6
 
UiPath Studio Web workshop series - Day 1
UiPath Studio Web workshop series  - Day 1UiPath Studio Web workshop series  - Day 1
UiPath Studio Web workshop series - Day 1DianaGray10
 
UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2DianaGray10
 
EMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarEMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarThousandEyes
 

Recently uploaded (20)

Scenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenariosScenario Library et REX Discover industry- and role- based scenarios
Scenario Library et REX Discover industry- and role- based scenarios
 
IT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingIT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced Computing
 
My key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAIMy key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAI
 
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptxGraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
GraphSummit Copenhagen 2024 - Neo4j Vision and Roadmap.pptx
 
Keep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES LiveKeep Your Finger on the Pulse of Your Building's Performance with IES Live
Keep Your Finger on the Pulse of Your Building's Performance with IES Live
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projects
 
The New Cloud World Order Is FinOps (Slideshow)
The New Cloud World Order Is FinOps (Slideshow)The New Cloud World Order Is FinOps (Slideshow)
The New Cloud World Order Is FinOps (Slideshow)
 
Oracle Database 23c Security New Features.pptx
Oracle Database 23c Security New Features.pptxOracle Database 23c Security New Features.pptx
Oracle Database 23c Security New Features.pptx
 
Outage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedIn
Outage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedInOutage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedIn
Outage Analysis: March 5th/6th 2024 Meta, Comcast, and LinkedIn
 
Patch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 updatePatch notes explaining DISARM Version 1.4 update
Patch notes explaining DISARM Version 1.4 update
 
Top 10 Squarespace Development Companies
Top 10 Squarespace Development CompaniesTop 10 Squarespace Development Companies
Top 10 Squarespace Development Companies
 
20140402 - Smart house demo kit
20140402 - Smart house demo kit20140402 - Smart house demo kit
20140402 - Smart house demo kit
 
LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0LF Energy Webinar - Unveiling OpenEEMeter 4.0
LF Energy Webinar - Unveiling OpenEEMeter 4.0
 
TrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie WorldTrustArc Webinar - How to Live in a Post Third-Party Cookie World
TrustArc Webinar - How to Live in a Post Third-Party Cookie World
 
SheDev 2024
SheDev 2024SheDev 2024
SheDev 2024
 
Technical SEO for Improved Accessibility WTS FEST
Technical SEO for Improved Accessibility  WTS FESTTechnical SEO for Improved Accessibility  WTS FEST
Technical SEO for Improved Accessibility WTS FEST
 
How to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptxHow to become a GDSC Lead GDSC MI AOE.pptx
How to become a GDSC Lead GDSC MI AOE.pptx
 
UiPath Studio Web workshop series - Day 1
UiPath Studio Web workshop series  - Day 1UiPath Studio Web workshop series  - Day 1
UiPath Studio Web workshop series - Day 1
 
UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2UiPath Studio Web workshop series - Day 2
UiPath Studio Web workshop series - Day 2
 
EMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarEMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? Webinar
 

Superintelligence: how afraid should we be?

  • 1. Superintelligence How afraid should we be? Principal, Delta WisdomChair, London Futurists David Wood @dw2 #CIUUK14
  • 2. @dw2 Page 2 Powerful technology, incompletely understood Operated by people outside their level of competence Human lives knocked catastrophically off trajectory, unintentionally http://www.bbc.co.uk/news/world-europe-28357880 Self-improving AGI Beyond human control Humanity knocked catastrophically off trajectory, unintentionallyhttp://mashable.com/2014/07/17/malaysia-airlines-ukraine-russia-rebel/
  • 4. @dw2 Page 4 Likely date of advent of HL-AGI Population 10% 50% 90% Conference: Philosophy & Theory of AI Conference: Artificial General Intelligence Greek Association for Artificial Intelligence Top 100 cited academic authors in AI Combined (from above) Nick Bostrom: Superintelligence
  • 5. @dw2 Page 5 Likely date of advent of HL-AGI Population 10% 50% 90% Conference: Philosophy & Theory of AI 2048 Conference: Artificial General Intelligence 2040 Greek Association for Artificial Intelligence 2050 Top 100 cited academic authors in AI 2050 Combined (from above) 2040 Nick Bostrom: Superintelligence
  • 6. @dw2 Page 6 Likely date of advent of HL-AGI Population 10% 50% 90% Conference: Philosophy & Theory of AI 2048 2080 Conference: Artificial General Intelligence 2040 2065 Greek Association for Artificial Intelligence 2050 2093 Top 100 cited academic authors in AI 2050 2070 Combined (from above) 2040 2075 Nick Bostrom: Superintelligence
  • 7. @dw2 Page 7 Likely date of advent of HL-AGI Population 10% 50% 90% Conference: Philosophy & Theory of AI 2023 2048 2080 Conference: Artificial General Intelligence 2022 2040 2065 Greek Association for Artificial Intelligence 2020 2050 2093 Top 100 cited academic authors in AI 2024 2050 2070 Combined (from above) 2022 2040 2075 Nick Bostrom: Superintelligence
  • 8. @dw2 Page 8 Reaching HL AGI: 5 driving forces 1. Hardware with higher performance: Continuation of Moore’s Law? – “18 different candidates” in Intel labs to add extra life to that trend – Possible breakthroughs with Quantum Computing? 2. Software algorithm improvements? – Can speed things up faster than hardware gains – e.g. chess computers – Compare: Andrew Wiles, unexpected proof of Fermat’s Last Theorem (1993) 3. Learnings from studying the human brain? – Improved scanning techniques -> “neuromorphic computing” etc – Philosophical insight into consciousness/creativity?! 4. More people studying these fields than ever before – Stanford University online course on AI: 160,000 students (23,000 finished it) – More components / databases / tools /methods ready for re-combination – Unexpected triggers for improvement (malware wars, games AI, financial AI…) 5. Transformation in society’s motivation? http://intelligence.org/2013/05/15/when-will-ai-be-created/ (Smarter people?!) “Sputnik moment!?”
  • 9. @dw2 Page 9 Superintelligence – model 1 Village idiot Einstein http://intelligence.org/files/mindisall-tv07.ppt Eliezer Yudkowsky
  • 10. @dw2 Page 10 Superintelligence – model 2 http://intelligence.org/files/mindisall-tv07.ppt Village idiotMouse Chimp Einstein AI 50-100 years 50-100 weeks? / days? / hours? Vernor Vinge: The best answer to the question, “Will computers ever be as smart as humans?” is probably “Yes, but only briefly.” “The final invention” Eliezer Yudkowsky
  • 12. @dw2 Page 12 Recursive improvement Software tools (debuggers, compilers…) Software
  • 13. @dw2 Page 13 Recursive improvement AI tools AI Intelligence explosion ++Rapid reading & comprehension of all written material ++Rapid expansion onto improved hardware ++Funded by financial winnings from smart stock trading ++Supported by humans easily psychologically manipulated
  • 14. Who here wanted to merge again? Jaan Tallinn: http://prezi.com/xku9q-v-fg_j/intelligence-stairway/
  • 16. @dw2 Page 16 Going nuclear: hard to calculate • First hydrogen bomb test, 1st March 1954, Bikini Atoll – Explosive yield was expected to be from 4 to 6 Megatons – Was 15 Megatons, two and a half times the expected maximum – Physics error by the designers at Los Alamos National Lab – Wrongly considered the lithium-7 isotope to be inert in bomb – The crew in a nearby Japanese fishing boat became ill in the wake of direct contact with the fallout. One of the crew died http://en.wikipedia.org/wiki/Castle_Bravo
  • 17. @dw2 Page 17 Superintelligence – model 2 http://intelligence.org/files/mindisall-tv07.ppt Village idiot Chimp Einstein Mouse AI Linear model of intelligence? Eliezer Yudkowsky
  • 18. @dw2 Page 18 Gloopy ASIs Posthuman mindspace Bipping ASIs Freepy ASIs Eliezer Yudkowsky http://intelligence.org/ files/mindisall-tv07.ppt Model 3 Transhuman mindspace Human minds Minds-in-general
  • 19. @dw2 Page 19 Dimensions of mind The ability to achieve goals in a wide range of environments Being conscious? Having compassion for sentient beings with lesser intelligence?
  • 20. @dw2 Page 20 AI systems we should fear Killer drones with autonomous decision-making powers (Robocop) Malware that can hack infrastructure- control systems (e.g. Stuxnet) Financial trading systems software (high speed) Software that is expert in manipulating humans
  • 21. http://www.williamhertling.com/ Software that is expert in manipulating humans
  • 22. @dw2 Page 22 AI systems we should fear Killer drones with autonomous decision-making powers (Robocop) Malware that can hack infrastructure- control systems (e.g. Stuxnet) Financial trading systems software (high speed) Software that is expert in manipulating humans Software that pursues a single optimisation goal to the exclusion of all others The more power such an AI has, the more we should fear it
  • 23. @dw2 Page 23 The pursuit of happiness? Software that pursues a single optimisation goal to the exclusion of all others Software will do what we say, rather than what we meant to say Wire-heading?! Just make us happy!?
  • 24. @dw2 Page 24 The pursuit of morality? Just be moral!? http://www.clipartbest.com/clipart-nTXa54XTB Whose morality? The problem of computer morality is at least as hard as the problem of computer vision (!) http://tvtropes.org/pmwiki/pmwiki.php/Creator/IsaacAsimov Isaac Asimov’s Three Laws of Robotics?!
  • 25. @dw2 Page 25 The two fundamental problems of superintelligence Specification problem: How do we define the goals of the AGI software? Control problem: How do retain the ability to shut down the software? Creation problem: How do we create AGI software in the first place?
  • 26. @dw2 Page 26 The fundamental meta-problem of superintelligence Specification problem: How do we define the goals of the AGI software? Control problem: How do retain the ability to shut down the software? Creation problem: How do we create AGI software in the first place? ~No research ~No research Some research Accidental research “Friendly AI” (FAI) “AI in a box”
  • 27. @dw2 Page 27 AI in a box? Tripwires? “Adam and Eve” ethernet port?! Software will be a tool, answering questions, not an agent? The “answers” which the software gives us will have effects in the world (e.g. software it writes for us) Systems which rely on humans to verify and carry out their actions will be uncompetitive compared to those with greater autonomy AGI may become very smart in surreptitiously evading tripwires Simple?
  • 28. @dw2 Page 28 “The orthogonality thesis” Intelligence and final goals are orthogonal More or less any intelligence …could in principle be combined with… more or less any final goal
  • 29. @dw2 Page 29 “The instrumental convergence thesis” (“AI Drives”) Some intermediate (instrumental) goals are likely in all cases for a superintelligence: • Resource acquisition • Cognitive enhancement • Greater creativity • Self preservation (preservation of goal)… Steve Omohundro: “For a sufficiently intelligent system, avoiding vulnerabilities is as powerful a motivator as explicitly constructed goals and subgoals”
  • 30. @dw2 Page 30 Indirect specification of goals? Specification problem: How do we define the goals of the AGI software? “Achieve the goals which the creators of the AGI would have wished it to achieve, if they had thought about the matter long and hard” This software will do what we meant to say, rather than what we actually said (?) AGI helps us to figure out the answer to the spec problem!
  • 31. @dw2 Page 31 CEV: Coherent Extrapolated Volition AGI should be tasked to carry out: Our wish if we knew more, thought faster, were more the people we wished we were, had grown up farther together; where the extrapolation converges rather than diverges, where our wishes cohere rather than interfere; extrapolated as we wish that extrapolated, interpreted as we wish that interpreted Eliezer Yudkowsky
  • 32. @dw2 Page 32 Unanswered questions (selection) 1. Can we turn ‘poetic’ ideas like CEV into bug-free working software? – Should we humans concentrate harder on working out our “blended volition”? 2. How can we stop a superintelligence from changing its own core goals? – Like humans can choose to set aside their biologically inherited goals – Could AGIs that start off ‘Friendly’ become “born again” with new priorities?! 3. Can we prevent AGIs from developing dangerous instrumental drives? – By programming (bug-free) in tamper-proof limitations? 4. Can AGIs help us to figure out a solution to the Control problem? – Can we use a hierarchy of lower-level AGIs to control higher-level ones? 5. Can we prevent the rapid nuclear-style take-off of self-improving AGI? 6. Are some approaches to creating AGIs safer than others? – Whole Brain Emulation / AGI de novo / evolution in virtual environment… – Open (everything published) vs. Closed (some parts secret)? 7. How does the AGI existential risk compare to other x-risks in priority? – Nanotech grey goo, deadly new bio-hazard, nuclear holocaust, climate chaos…
  • 33. @dw2 Page 33 Answered questions (selection) a) Should we be afraid? – Yes. (End-of-the-world afraid) b) Can we slow down all research into AGI, until we’re confident we have good answers to the control and/or specification problems? – Unlikely – there’s too much financial investment happening worldwide – Too many separate countries / militaries / finance houses… are involved c) How do we promote wider study of the Superintelligence topic? – Need to lose the “weird” and “embarrassment” angles – “Less Wrong” strikes some observers as cultish – “Terminator” and “Transcendence” have done more harm than good – First class books / articles / movies needed, addressing thoughtful audiences – Good intermediate results useful too (not just appeals for more funding)
  • 34. Practical philosophy! Preparing humanity to survive the forthcoming transition to superintelligence Principal, Delta WisdomChair, London Futurists Urgent! (Roles too for mathematicians, theologians…) David Wood @dw2 Philosophy with an expiry date! Making a real difference!