SlideShare a Scribd company logo
1 of 12
Download to read offline
From physics to data science
Andrew LoweAndrew Lowe
14 June 201714 June 2017
Early historyEarly history
(1993–1997)(1993–1997)
●
1993–1996: BSc in physics, Royal Holloway, University of1993–1996: BSc in physics, Royal Holloway, University of
LondonLondon
●
1997: TV & VCR retuning engineer, Channel 5 TV1997: TV & VCR retuning engineer, Channel 5 TV
●
Was the 5th national terrestrial analogue TV channel in theWas the 5th national terrestrial analogue TV channel in the
UKUK
●
Problem: TV broadcast frequencies had been allocated toProblem: TV broadcast frequencies had been allocated to
RF outputs from domestic video cassette recorders (VCRs)RF outputs from domestic video cassette recorders (VCRs)
●
To achieve national coverage, large numbers of VCRs hadTo achieve national coverage, large numbers of VCRs had
to be retuned at Channel 5's expense before broadcaststo be retuned at Channel 5's expense before broadcasts
could startcould start
●
Pre-launch, huge campaign to adapt public's VCRs to makePre-launch, huge campaign to adapt public's VCRs to make
them immune to RF interferencethem immune to RF interference
Pre-launch test transmissionPre-launch test transmission
Video playback withVideo playback with
RF interference from Channel 5RF interference from Channel 5
Reflections on being aReflections on being a
Channel 5 retunerChannel 5 retuner
●
My first customer-facing roleMy first customer-facing role
●
Visited several hundred homesVisited several hundred homes
●
Had to gain the trust of the homeowner to grant me accessHad to gain the trust of the homeowner to grant me access
to their home and their VCRto their home and their VCR
●
Job provided me with many interesting glimpses of theJob provided me with many interesting glimpses of the
inside of people's homes and how their owners liveinside of people's homes and how their owners live
●
Many surprises behind doors only 5 minutes away fromMany surprises behind doors only 5 minutes away from
where I lived at the time!where I lived at the time!
Time metrologistTime metrologist
(1998–2000)(1998–2000)
●
Assistant research scientist at the National PhysicalAssistant research scientist at the National Physical
Laboratory (NPL)Laboratory (NPL)
●
NPL: the UK's national measurement standards laboratoryNPL: the UK's national measurement standards laboratory
●
Provided technical and administrative support to a range ofProvided technical and administrative support to a range of
key activities relating to the maintenance andkey activities relating to the maintenance and
dissemination of the UK’s national time scaledissemination of the UK’s national time scale
●
An interesting place to work during the countdown to theAn interesting place to work during the countdown to the
start of the new millenniumstart of the new millennium
●
Much public concern about the “y2k bug” and the meltdownMuch public concern about the “y2k bug” and the meltdown
of civilisation that was forecast to result!of civilisation that was forecast to result!
Things I did at NPLThings I did at NPL
●
Maintained atomic clocksMaintained atomic clocks
●
Programmed the start andProgrammed the start and
end of daylight savings timeend of daylight savings time
●
Collected and analysed GPSCollected and analysed GPS
timing datatiming data
●
Operated a satellite earthOperated a satellite earth
stationstation
●
Published monthly bulletinsPublished monthly bulletins
●
Manned an enquiry serviceManned an enquiry service
that received hundreds ofthat received hundreds of
phone calls, letters andphone calls, letters and
emails from the publicemails from the public
Return to universityReturn to university
(2000–2008)(2000–2008)
●
MSc and PhD in particle physics, Royal Holloway,MSc and PhD in particle physics, Royal Holloway,
University of LondonUniversity of London
●
MSc thesis:MSc thesis:
●
Data mining analysis of the search potential for the HiggsData mining analysis of the search potential for the Higgs
boson in a notoriously difficult decay channelboson in a notoriously difficult decay channel
●
PhD thesis:PhD thesis:
●
Multiple key contributions to a real-time multi-stage cascadeMultiple key contributions to a real-time multi-stage cascade
classifier that reduces data rate from 60 TB/s to aclassifier that reduces data rate from 60 TB/s to a
manageable 300 MB/s that can be written to permanentmanageable 300 MB/s that can be written to permanent
storagestorage
●
Measured how performance of the data collection system isMeasured how performance of the data collection system is
degraded when electronic components in the detector diedegraded when electronic components in the detector die
I studied how much data is lostI studied how much data is lost
when electronic components diewhen electronic components die
Electronic boards in crates mounted on-detector
Life as an academicLife as an academic
(2008–2017)(2008–2017)
●
Particle physicist (2008–2017)Particle physicist (2008–2017)
●
Indiana University, USAIndiana University, USA
●
California State University,California State University,
Fresno, USAFresno, USA
●
Wigner Research Centre forWigner Research Centre for
Physics, HungaryPhysics, Hungary
●
I spent several years based atI spent several years based at
the European Organization forthe European Organization for
Nuclear Research (CERN) inNuclear Research (CERN) in
Geneva and was a member ofGeneva and was a member of
the team that discovered thethe team that discovered the
Higgs boson, the observation ofHiggs boson, the observation of
which led to the award of thewhich led to the award of the
2013 Nobel Prize in Physics2013 Nobel Prize in Physics
●
Moved to Hungary in 2013Moved to Hungary in 2013
Things I did as a particle physicistThings I did as a particle physicist
●
Developed algorithms for real-time particle identification in streamingDeveloped algorithms for real-time particle identification in streaming
data at an input rate of 1 GB/s (total data processed to date: 70data at an input rate of 1 GB/s (total data processed to date: 70  PB)PB)
●
Performed statistical data analysis for an experiment at CERN whichPerformed statistical data analysis for an experiment at CERN which
recreates conditions that are believed to have existed a fraction of arecreates conditions that are believed to have existed a fraction of a
second after the Big Bangsecond after the Big Bang
●
Used machine learning to develop predictive classification algorithmsUsed machine learning to develop predictive classification algorithms
for recognising subatomic particles based on their decay propertiesfor recognising subatomic particles based on their decay properties
Data scientistData scientist
(2017—present)(2017—present)
●
Now I'm at a major milestone againNow I'm at a major milestone again
●
Recently started a new role as a data scientist forRecently started a new role as a data scientist for EPAMEPAM
●
Opportunity to work with different types of data in differentOpportunity to work with different types of data in different
problem domains and have an impact on real-world problemsproblem domains and have an impact on real-world problems
●
As a physicist, I learned how to:As a physicist, I learned how to:
●
Work with data, including really big dataWork with data, including really big data
●
Understand and dissect complex problems and find creativeUnderstand and dissect complex problems and find creative
solutionssolutions
●
Work in large cross-functional teamsWork in large cross-functional teams
●
Visualise and interpret resultsVisualise and interpret results
●
Easy to make the switch to data science, just needed to learnEasy to make the switch to data science, just needed to learn
the language and toolsthe language and tools

More Related Content

Similar to From physics to data science

CarbonNet storage site characterisation and selection process
CarbonNet storage site characterisation and selection processCarbonNet storage site characterisation and selection process
CarbonNet storage site characterisation and selection process
Global CCS Institute
 
Introduction to Nanotechnology: Part 1
Introduction to Nanotechnology: Part 1Introduction to Nanotechnology: Part 1
Introduction to Nanotechnology: Part 1
glennfish
 

Similar to From physics to data science (20)

Miguel Foronda T3chfest
Miguel Foronda T3chfestMiguel Foronda T3chfest
Miguel Foronda T3chfest
 
Promoting a Joint EU-BR Digital Future - High Performance Computing
Promoting a Joint EU-BR Digital Future - High Performance ComputingPromoting a Joint EU-BR Digital Future - High Performance Computing
Promoting a Joint EU-BR Digital Future - High Performance Computing
 
CarbonNet storage site characterisation and selection process
CarbonNet storage site characterisation and selection processCarbonNet storage site characterisation and selection process
CarbonNet storage site characterisation and selection process
 
Detecting solar farms with deep learning
Detecting solar farms with deep learningDetecting solar farms with deep learning
Detecting solar farms with deep learning
 
ApacheCon NA 2013 VFASTR
ApacheCon NA 2013 VFASTRApacheCon NA 2013 VFASTR
ApacheCon NA 2013 VFASTR
 
Preservation And Reuse In High Energy Physics Salvatore Mele
Preservation And Reuse In High Energy Physics Salvatore MelePreservation And Reuse In High Energy Physics Salvatore Mele
Preservation And Reuse In High Energy Physics Salvatore Mele
 
Jon Batchelder c.v.
Jon Batchelder c.v.Jon Batchelder c.v.
Jon Batchelder c.v.
 
ECCB 2010 Next-gen sequencing Tutorial
ECCB 2010 Next-gen sequencing TutorialECCB 2010 Next-gen sequencing Tutorial
ECCB 2010 Next-gen sequencing Tutorial
 
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystemTraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
 
2014 11-13-sbsm032-reproducible research
2014 11-13-sbsm032-reproducible research2014 11-13-sbsm032-reproducible research
2014 11-13-sbsm032-reproducible research
 
Creating a Thriving Workplace: A conversation about the successes and challen...
Creating a Thriving Workplace: A conversation about the successes and challen...Creating a Thriving Workplace: A conversation about the successes and challen...
Creating a Thriving Workplace: A conversation about the successes and challen...
 
Qubbat el hawa_project
Qubbat el hawa_projectQubbat el hawa_project
Qubbat el hawa_project
 
Enabling Real Time Analysis & Decision Making - A Paradigm Shift for Experime...
Enabling Real Time Analysis & Decision Making - A Paradigm Shift for Experime...Enabling Real Time Analysis & Decision Making - A Paradigm Shift for Experime...
Enabling Real Time Analysis & Decision Making - A Paradigm Shift for Experime...
 
Axion Dark Matter Research With IBS CAPP
Axion Dark Matter Research With IBS CAPPAxion Dark Matter Research With IBS CAPP
Axion Dark Matter Research With IBS CAPP
 
Burst data retrieval after 50k GPU Cloud run
Burst data retrieval after 50k GPU Cloud runBurst data retrieval after 50k GPU Cloud run
Burst data retrieval after 50k GPU Cloud run
 
Roadshow2014 - presentazione Helmut Schober (4 giugno 2014)
Roadshow2014 - presentazione Helmut Schober (4 giugno 2014)Roadshow2014 - presentazione Helmut Schober (4 giugno 2014)
Roadshow2014 - presentazione Helmut Schober (4 giugno 2014)
 
Cern general information
Cern general informationCern general information
Cern general information
 
2018 HM PIXE PARTICLE -INDUCED X-RAY EMISSION AN ANALYTICAL TECHNIQUE
2018 HM PIXE PARTICLE -INDUCED X-RAY EMISSION AN ANALYTICAL TECHNIQUE2018 HM PIXE PARTICLE -INDUCED X-RAY EMISSION AN ANALYTICAL TECHNIQUE
2018 HM PIXE PARTICLE -INDUCED X-RAY EMISSION AN ANALYTICAL TECHNIQUE
 
Guidelines for the Use of Geophysics in Archaeology: should they be prescript...
Guidelines for the Use of Geophysics in Archaeology: should they be prescript...Guidelines for the Use of Geophysics in Archaeology: should they be prescript...
Guidelines for the Use of Geophysics in Archaeology: should they be prescript...
 
Introduction to Nanotechnology: Part 1
Introduction to Nanotechnology: Part 1Introduction to Nanotechnology: Part 1
Introduction to Nanotechnology: Part 1
 

Recently uploaded

No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
Sheetaleventcompany
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
Kayode Fayemi
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
Kayode Fayemi
 

Recently uploaded (20)

My Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle BaileyMy Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle Bailey
 
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
 
Introduction to Prompt Engineering (Focusing on ChatGPT)
Introduction to Prompt Engineering (Focusing on ChatGPT)Introduction to Prompt Engineering (Focusing on ChatGPT)
Introduction to Prompt Engineering (Focusing on ChatGPT)
 
ANCHORING SCRIPT FOR A CULTURAL EVENT.docx
ANCHORING SCRIPT FOR A CULTURAL EVENT.docxANCHORING SCRIPT FOR A CULTURAL EVENT.docx
ANCHORING SCRIPT FOR A CULTURAL EVENT.docx
 
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdfAWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
 
Dreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio IIIDreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio III
 
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
 
Air breathing and respiratory adaptations in diver animals
Air breathing and respiratory adaptations in diver animalsAir breathing and respiratory adaptations in diver animals
Air breathing and respiratory adaptations in diver animals
 
VVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara Services
VVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara ServicesVVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara Services
VVIP Call Girls Nalasopara : 9892124323, Call Girls in Nalasopara Services
 
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
No Advance 8868886958 Chandigarh Call Girls , Indian Call Girls For Full Nigh...
 
BDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 93 Noida Escorts >༒8448380779 Escort Service
 
ICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdfICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdf
 
Causes of poverty in France presentation.pptx
Causes of poverty in France presentation.pptxCauses of poverty in France presentation.pptx
Causes of poverty in France presentation.pptx
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
 
Report Writing Webinar Training
Report Writing Webinar TrainingReport Writing Webinar Training
Report Writing Webinar Training
 
SaaStr Workshop Wednesday w/ Lucas Price, Yardstick
SaaStr Workshop Wednesday w/ Lucas Price, YardstickSaaStr Workshop Wednesday w/ Lucas Price, Yardstick
SaaStr Workshop Wednesday w/ Lucas Price, Yardstick
 
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
 
Presentation on Engagement in Book Clubs
Presentation on Engagement in Book ClubsPresentation on Engagement in Book Clubs
Presentation on Engagement in Book Clubs
 
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdfThe workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
 

From physics to data science

  • 1. From physics to data science Andrew LoweAndrew Lowe 14 June 201714 June 2017
  • 2. Early historyEarly history (1993–1997)(1993–1997) ● 1993–1996: BSc in physics, Royal Holloway, University of1993–1996: BSc in physics, Royal Holloway, University of LondonLondon ● 1997: TV & VCR retuning engineer, Channel 5 TV1997: TV & VCR retuning engineer, Channel 5 TV ● Was the 5th national terrestrial analogue TV channel in theWas the 5th national terrestrial analogue TV channel in the UKUK ● Problem: TV broadcast frequencies had been allocated toProblem: TV broadcast frequencies had been allocated to RF outputs from domestic video cassette recorders (VCRs)RF outputs from domestic video cassette recorders (VCRs) ● To achieve national coverage, large numbers of VCRs hadTo achieve national coverage, large numbers of VCRs had to be retuned at Channel 5's expense before broadcaststo be retuned at Channel 5's expense before broadcasts could startcould start ● Pre-launch, huge campaign to adapt public's VCRs to makePre-launch, huge campaign to adapt public's VCRs to make them immune to RF interferencethem immune to RF interference
  • 4. Video playback withVideo playback with RF interference from Channel 5RF interference from Channel 5
  • 5. Reflections on being aReflections on being a Channel 5 retunerChannel 5 retuner ● My first customer-facing roleMy first customer-facing role ● Visited several hundred homesVisited several hundred homes ● Had to gain the trust of the homeowner to grant me accessHad to gain the trust of the homeowner to grant me access to their home and their VCRto their home and their VCR ● Job provided me with many interesting glimpses of theJob provided me with many interesting glimpses of the inside of people's homes and how their owners liveinside of people's homes and how their owners live ● Many surprises behind doors only 5 minutes away fromMany surprises behind doors only 5 minutes away from where I lived at the time!where I lived at the time!
  • 6. Time metrologistTime metrologist (1998–2000)(1998–2000) ● Assistant research scientist at the National PhysicalAssistant research scientist at the National Physical Laboratory (NPL)Laboratory (NPL) ● NPL: the UK's national measurement standards laboratoryNPL: the UK's national measurement standards laboratory ● Provided technical and administrative support to a range ofProvided technical and administrative support to a range of key activities relating to the maintenance andkey activities relating to the maintenance and dissemination of the UK’s national time scaledissemination of the UK’s national time scale ● An interesting place to work during the countdown to theAn interesting place to work during the countdown to the start of the new millenniumstart of the new millennium ● Much public concern about the “y2k bug” and the meltdownMuch public concern about the “y2k bug” and the meltdown of civilisation that was forecast to result!of civilisation that was forecast to result!
  • 7. Things I did at NPLThings I did at NPL ● Maintained atomic clocksMaintained atomic clocks ● Programmed the start andProgrammed the start and end of daylight savings timeend of daylight savings time ● Collected and analysed GPSCollected and analysed GPS timing datatiming data ● Operated a satellite earthOperated a satellite earth stationstation ● Published monthly bulletinsPublished monthly bulletins ● Manned an enquiry serviceManned an enquiry service that received hundreds ofthat received hundreds of phone calls, letters andphone calls, letters and emails from the publicemails from the public
  • 8. Return to universityReturn to university (2000–2008)(2000–2008) ● MSc and PhD in particle physics, Royal Holloway,MSc and PhD in particle physics, Royal Holloway, University of LondonUniversity of London ● MSc thesis:MSc thesis: ● Data mining analysis of the search potential for the HiggsData mining analysis of the search potential for the Higgs boson in a notoriously difficult decay channelboson in a notoriously difficult decay channel ● PhD thesis:PhD thesis: ● Multiple key contributions to a real-time multi-stage cascadeMultiple key contributions to a real-time multi-stage cascade classifier that reduces data rate from 60 TB/s to aclassifier that reduces data rate from 60 TB/s to a manageable 300 MB/s that can be written to permanentmanageable 300 MB/s that can be written to permanent storagestorage ● Measured how performance of the data collection system isMeasured how performance of the data collection system is degraded when electronic components in the detector diedegraded when electronic components in the detector die
  • 9. I studied how much data is lostI studied how much data is lost when electronic components diewhen electronic components die Electronic boards in crates mounted on-detector
  • 10. Life as an academicLife as an academic (2008–2017)(2008–2017) ● Particle physicist (2008–2017)Particle physicist (2008–2017) ● Indiana University, USAIndiana University, USA ● California State University,California State University, Fresno, USAFresno, USA ● Wigner Research Centre forWigner Research Centre for Physics, HungaryPhysics, Hungary ● I spent several years based atI spent several years based at the European Organization forthe European Organization for Nuclear Research (CERN) inNuclear Research (CERN) in Geneva and was a member ofGeneva and was a member of the team that discovered thethe team that discovered the Higgs boson, the observation ofHiggs boson, the observation of which led to the award of thewhich led to the award of the 2013 Nobel Prize in Physics2013 Nobel Prize in Physics ● Moved to Hungary in 2013Moved to Hungary in 2013
  • 11. Things I did as a particle physicistThings I did as a particle physicist ● Developed algorithms for real-time particle identification in streamingDeveloped algorithms for real-time particle identification in streaming data at an input rate of 1 GB/s (total data processed to date: 70data at an input rate of 1 GB/s (total data processed to date: 70  PB)PB) ● Performed statistical data analysis for an experiment at CERN whichPerformed statistical data analysis for an experiment at CERN which recreates conditions that are believed to have existed a fraction of arecreates conditions that are believed to have existed a fraction of a second after the Big Bangsecond after the Big Bang ● Used machine learning to develop predictive classification algorithmsUsed machine learning to develop predictive classification algorithms for recognising subatomic particles based on their decay propertiesfor recognising subatomic particles based on their decay properties
  • 12. Data scientistData scientist (2017—present)(2017—present) ● Now I'm at a major milestone againNow I'm at a major milestone again ● Recently started a new role as a data scientist forRecently started a new role as a data scientist for EPAMEPAM ● Opportunity to work with different types of data in differentOpportunity to work with different types of data in different problem domains and have an impact on real-world problemsproblem domains and have an impact on real-world problems ● As a physicist, I learned how to:As a physicist, I learned how to: ● Work with data, including really big dataWork with data, including really big data ● Understand and dissect complex problems and find creativeUnderstand and dissect complex problems and find creative solutionssolutions ● Work in large cross-functional teamsWork in large cross-functional teams ● Visualise and interpret resultsVisualise and interpret results ● Easy to make the switch to data science, just needed to learnEasy to make the switch to data science, just needed to learn the language and toolsthe language and tools