Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

3

Share

Download to read offline

JupyterHub for Interactive Data Science Collaboration

Download to read offline

CineGrid presentation December 10, 2015

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all

JupyterHub for Interactive Data Science Collaboration

  1. 1. For Interactive Data Science Collaboration CineGrid December 10, 2015
  2. 2. HELLO
  3. 3. CAROL WILLING ➤ Python Software Foundation, Director ➤ Project Jupyter, Contributor ➤ Fab Lab San Diego, Geek in Residence
  4. 4. WRITER
  5. 5. MANAGER AND ANALYST
  6. 6. ENGINEER
  7. 7. ARTIST
  8. 8. TEACHER
  9. 9. WONDER AND CURIOSITY
  10. 10. PROJECT JUPYTER Just the Facts
  11. 11. JUPYTER NOTEBOOK
  12. 12. The Notebook: “Literate Computing” Computational Narratives ❖ Computers deal with code and data. ❖ Humans deal with narratives that communicate. Literate Computing (not Literate Programming) narratives anchored in a live computation, that communicate a story based on data and results. Cf: Mathematica, Maple, MuPad, Sage…
  13. 13. “Project Jupyter serves not only the academic and scientific communities but also a much broader constituency of data scientists in research, education, industry and journalism… - Fernando Pérez UC Berkeley
  14. 14. “…we see uses of our tools that range from high school education in programming to the nation’s supercomputing facilities and the leaders of the tech industry. - Fernando Pérez UC Berkeley
  15. 15. “More than a million people are currently using Jupyter for everything from… -Prof. Brian Granger Cal Poly
  16. 16. “…analyzing massive gene sequencing datasets to processing images from the Hubble Space Telescope and developing models of financial markets. -Prof. Brian Granger Cal Poly
  17. 17. “We are excited by the potential of Project Jupyter to reach even wider audiences and to contribute to increased cross-disciplinary collaboration in the sciences. -Betsy Fader Helmsley Charitable Trust
  18. 18. “Jupyter Notebook… will enable data exploration, visualization, and analysis in a way that encourages sound science and speeds progress. -Chris Mentzel The Gordon and Betty Moore Foundation
  19. 19. DATA CHALLENGES Constraints or Opportunities?
  20. 20. SCALE
  21. 21. SPEED
  22. 22. CHOICES
  23. 23. CONNECTIONS
  24. 24. OPPORTUNITIES Use our strengths
  25. 25. –Hamming'62 “The purpose of computing is insight, not numbers”
  26. 26. The Lifecycle of a Scientific Idea (schematically) 1. Individual exploratory work 2. Collaborative development 3. Parallel production runs (HPC, cloud, ...) 4. Publication & communication (reproducibly!) 5. Education 6. Goto 1.
  27. 27. JUPYTERHUB and Project Jupyter ecosystem
  28. 28. EDUCATION
  29. 29. nbviewer: seamless notebook sharing ❖ Zero-install reading of notebooks ❖ Just share a URL ❖ nbviewer.ipython.org
  30. 30. Executable books ❖ Springer hardcover book ❖ Chapters: IPython Notebooks ❖ Posted as a blog entry ❖ All available as a Github repo Python for Signal Processing, by José Unpingco
  31. 31. University Courses These are just some we are aware of!
  32. 32. A collaborative MOOC on OpenEdX http://lorenabarba.com/news/announcing-practical-numerical-methods-with-python-mooc ❖ Lorena Barba at George Washington University, USA. ❖ Ian Hawke at Southampton, UK ❖ Carlos Jerez at Pontifical Catholic University of Chile. ❖ All materials on Gihtub.
  33. 33. Changing the scientific culture http://www.nature.com/news/interactive-notebooks-sharing-the-code-1.16261
  34. 34. Executable papers: the future? http://www.nature.com/news/ipython-interactive-demo-7.21492?article=1.16261
  35. 35. Notebook Workflows: The Big Picture Image credit: Joshua Barratt
  36. 36. Lots more! The IPython Gallery https://github.com/ipython/ipython/wiki/A-gallery-of-interesting-IPython-Notebooks
  37. 37. GOVERNMENT
  38. 38. Shreyas Cholia & ! Oliver Ruebel! NERSC Data & Analytics Services Group! Jupyterhub Day, July 17 2015 Jupyterhub at NERSC and OpenMSI
  39. 39. NERSC is the Production HPC & Data Facility for DOE Office of Science Research Bio$Energy,$$Environment$ Compu2ng$ Materials,$Chemistry,$$ Geophysics$ Par2cle$Physics,$ Astrophysics$ Largest$funder$of$physical$ science$research$in$U.S.$$ Nuclear$Physics$ Fusion$Energy,$ Plasma$Physics$ D$2$D$
  40. 40. ART
  41. 41. BUSINESS
  42. 42. Quantopian: algorithmic trading Karen Rubin Dir. Product Management at Quantopian Quantopian Research Post Fortune.com
  43. 43. Microsoft: Python Tools for Visual Studio Shahrokh Mortazavi, Dino Viehland, Wenming Ye, Dennis Gannon.
  44. 44. Microsoft Azure: Notebooks in the Cloud
  45. 45. Google CoLaboratory Kayur Patel, Kester Tong, Mark Sanders, Corinna Cortes @ Google Matt Turk @ NCSA/UIUC
  46. 46. IBM Watson
  47. 47. SCIENCE
  48. 48. JupyterHub: multiuser support ❖ Out of the box ❖ Unix accounts ❖ Local single-user notebooks ❖ Customizable ❖ Authentication: OAuth, LDAP, etc. ❖ Subprocess control: Docker, VMs, etc.
  49. 49. JupyterHub in Education @ Berkeley https://developer.rackspace.com/blog/deploying-jupyterhub-for-education ❖ Computationally intensive course, ~220 students ❖ Fully hosted environment, zero-install ❖ Homework management and grading (w B. Granger) Jess Hamrick @ Cal K. Kelley Rackspace M. Ragan-Kelley Cal B. Granger Cal Poly
  50. 50. COLLABORATION Why?
  51. 51. A ten year journey. Optimism and hope for the future.
  52. 52. IMAGINE THE POSSIBILITIES
  53. 53. TRY.JUPYTER.ORG
  54. 54. WE’RE OPEN FOR YOU.
  55. 55. THANK YOU try.jupyter.org www.jupyter.org numfocus.org ipython.org
  56. 56. CREDITS AND ATTRIBUTION ➤ Sources ➤ Jupyter website www.jupyter.org [11, 31, 65, 66, 69] ➤ Fernando Pérez [12, 28, 29, 33-40, 48-52, 53-55] http://fperez.org/ BIDS http://bids.berkeley.edu/ ➤ Cal Poly and UC Berkeley Press Releases http://calpolynews.calpoly.edu/news_releases/2015/July/jupyter.html, http://bids.berkeley.edu/news/ project-jupyter-gets-6m-expand-collaborative-data-science-software [14-19] ➤ Jupyterhub at NERSC and OpenMSI, S. Cholla and O. Ruebel, Jupyterhub Day presentation, July 17, 2015 [42, 43] ➤ music21 website http://web.mit.edu/music21/ [45] ➤ Jeremy Freeman http://jeremyfreeman.net/ PyData Talk NYC Winter 2015 https://github.com/freeman-lab/talk-nyc-winter-2015 [56, 57, 58] ➤ CodeNeuro website http://codeneuro.org/ [59-60] ➤ Binder website http://mybinder.org/ [61] ➤ Images ➤ [2, 10, 21, 27, 30, 62, 64] Galaxy ➤ [23] Hummingbird https://flic.kr/p/mo5pa1 ➤ [25] Netflix Prize Christopher Hefele https://flic.kr/p/6LWT6K ➤ [3-7, 8 (artwork FabLab interns), 9, 20, 22, 24, 26, 42, 43, 46, 57, 63] Carol Willing. This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. ➤ For additional information ➤ Jupyter www.jupyter.org ➤ Python Software Foundation www.python.org ➤ Carol Willing, willingc@willingconsulting.com, @willingcarol, GitHub: willingc
  • NathanShammah

    Oct. 31, 2017
  • _THO_

    Jul. 16, 2017
  • RavirajAdrangi

    Jan. 14, 2017

CineGrid presentation December 10, 2015

Views

Total views

2,188

On Slideshare

0

From embeds

0

Number of embeds

6

Actions

Downloads

47

Shares

0

Comments

0

Likes

3

×