The document discusses the history and development of deep learning including key figures like Geoffrey Hinton, Yann LeCun, Frank Rosenblatt and the development of neural networks, perceptrons, convolutional neural networks, unsupervised learning, and applications like computer vision, machine translation, and self-driving cars. It also mentions initiatives like the US BRAIN Initiative to advance neuroscience and artificial intelligence technologies.

1. The Deep Learning Revolution
Terrence Sejnowski, The Salk Institute, UCSD, HHMI

2. Stanley the Self-driving Car
Sebastian Thrun

3. Marvin Minsky

5. Why Vision is a Hard Problem

6. Neurons As Processors

7. Neurons As Processors
Synapses are
plastic

8. Frank Rosenblatt

9. Perceptron

10. Perceptron

11. Limitations of Perceptrons
Minsky and Papert, Perceptrons, 1969

13. 1854

14. De Novo
NETtalk
Sejnowski and Rosenberg, 1986

15. Carterette and Jones

16. Saddle Points in High Dimensions
Error
Weights

17. Visual Cortex
Hubel and Wiesel, 1969

18. Hubel and Wiesel, 1962
Simple Cell

19. Complex Cell

20. Deep Learning

21. Geoffrey Hinton and Yann Le Cun

23. Picture Captioning

24. Translation

25. January 5, 2017:
“After humanity spent
thousands of years
improving our tactics,
computers tell us that
humans are
completely wrong.”
Ke Jie of China

27. Unsupervised Learning:
Generative Adversary Networks

28. Interfaces Use Case
1980 – Windows
1990 – Browsers
2000 – Apps
2010 – Personal Assistants
2020 – Theory of Mind

29. BRAIN Initiative
Brain Research through Advancing
Innovative Neurotechnologies
April 2, 2013
April 2, 2013

31. Geoffrey Hinton
Patricia Churchland
John Hopfield
David Rumelhart
Yann LeCun
Richard Sutton
George Boole
Frank Rosenblatt