SlideShare a Scribd company logo
1 of 27
Download to read offline
Rainer Sternfeld, CE September 2014
Indexing the real world
March 2, 2015
Stanford School of Engineering
Rainer Sternfeld, CEO of Planet OS
@planet_os
@rsternfeld
2 March 2015
Sensor Data Discovery EngineOcean Data Management
From a small buoy to Big Data
Data Buoys
Market: $2 billion
Competitors: 100+ producers
Scalability: poor to limited
2008 2012 2014
Market: $5 billion
Competitors: 25+
Scalability: good but slow
Market: $100+ billion
Competitors: 15+
Scalability: very scalable and fast
3 March 2015
Sensor Data Discovery EngineOcean Data Management
From a small buoy to Big Data
Market: $2 billion
Competitors: 100+ producers
Scalability: poor to limited
2008 2012 2014
Market: $5 billion
Competitors: 25+
Scalability: good but slow
Market: $100+ billion
Competitors: 15+
Scalability: very scalable and fast
80% 80% time wasted
on arbitrary tasks
expansion of
economic activity
growth of sensor
data volumes
time wasted
on arbitrary tasks
spatio-temporal
data is complex
real-time becoming
the expected
sensor data
too big to move
NOW
data-driven
economies
sensor data
outgrowing social
vs
4D
Data Buoys
4 March 2015
Have you ever thought:
When did weather forecasting
become unreliable?
5 March 2015
Source: www.skepticalscience.com
6 March 2015
And when did it start to be awesome?
7 March 2015
Surfline
Hyperlocal surf weather forecasting
8 March 2015
Forecast.io (Dark Sky)
Hyperlocal weather forecasting
9 March 2015
Weather Underground
Crowdsourced data collection
10 March 2015
Have you ever thought:
What is the operational
root cause of oil spills?
11 March 2015
12 March 2015
Sensor data
will outgrow
social data in 2 years
Sensor data is
too big to move
Data Management
will not scale
as we know it
Oil & Gas is swimming in sensors, drowning in data
13 March 2015
• Contextual data streams across sources
• SCADA
• Weather and environmental data
• Drones and other robotic measurement platforms
• Satellite imagery
• 3D Common Operating Picture
• Full software integration for centralized access to data
• Event notifications
USE CASES
More data needs powerful tools.
Increase the data fluency of your operations.
14 March 2015
Hewlett Packard:
“By 2020, 40% of all data
ever collected by human kind
will be generated by sensors.”
15 March 2015
Case #1: NOAA
Real-time weather and climate data + forecasts
They are working hard on a challenge presented by:
• Tens of thousands of devices deployed in the ocean, on land, and space
• Tens of terabytes coming in every day
• 700 scattered “web services” (FTPs, flat files, Threads servers, no APIs)
• Breaking connections (all.the.time.)
• 25,000 employees
• Critical data for the government, the industry, and citizens
What if all this data would be easily discoverable and machine-readable?
16 March 2015
Example to case #1: Marinexplore.org
40,000+ data streams from 33 organizations of open data
Advanced Data Discovery Raster data / heat map overlays Access with third party applications
Raster data / quiver plots Graph Monitor Build custom datasets
17 March 2015
Example to Case #2: Bravante
Helping to deliver offshore data reports 80% faster
Problems and challenges:
• How to disseminate information to 5 end-customers onshore in parallel?
• How to engage specialists and mangers with the same tool?
• How not to change anything in the equipment on the vessel?
• How to improve speed and quality of the environmental baseline
surveys?
What if all this data would be available in the cloud?
18 March 2015
R/V Jean Charcot
Interactive reporting
Case #2: Bravante
Helping to deliver offshore data reports 80% faster
19 March 2015
Consolidate dataflows, organize and make sense of your data
Access your data with 3rd party tools and systems
One interface to search and discover your local and remote data
Securely exchange, acquire or sell datasets
Build advanced domain specific solutions without hassle
Industrial IoT Platform for Real-World Sensor Networks
designed for ocean, land, air and space data
20 March 2015
Map of all devices on the Internet
August 2, 2014
21 March 2015
Robotic ocean-borne
sensor platforms
increase productivity
LIQUID ROBOTICS WAVE GLIDER
22 March 2015
A decade of growth in
marine acoustics sensor data
summer year-round
2004 2014
2K 400K
n < 10 n > 1000
2D 4D
6 weeks 6 months
sample rate
# of sensors
dimensions
time span
activity
PGS SURVEY VESSEL, 12KM STREAMERS
23 March 2015
Satellites are getting
smaller and cheaper.
150 launched since 2011
(3x of the market estimate)
SPIRE, A SAN FRANCISCO STARTUP BUILDING NON-IMAGING LOW-ORBIT NANOSATELLITES USING RF SENSORS
24 March 2015
Unmanned vehicles
are estimated to grow
10x in 10 years
Image Credit: Northrop Grumman
25 March 2015
Precision Agriculture is
a $3.7 trillion market
Image Credit: http://iphonedroneimagery.com/
26 March 2015
Traditional Data Value Chain is Missing Data Exchange
SATELLITES
DRONES
CARS
BUOYS
OIL PLATFORMS
SHIPS
TRACTORS
LIGHTING
PHYSICAL
CHEMICAL
BIOLOGICAL
OPTICAL
NON-OPTICAL (RF)
TIME-SERIES
RASTER
ARRAYS
VECTORS
SEISMIC
VIDEO
ACOUSTIC
QA/QA
OUTLIER DETECTION
MODELING
DATA FUSION
DATA LOGISTICS
VISUALIZATION
ENHANCEMENT
DERIVATIVES
HARDWARE SENSORS RAW DATA
SOFTWARE
ANALYTICS
CUSTOMER
APPLICATIONS
ENERGY
WEATHER
AGRICULTURE
TRANSPORTATION
INSURANCE
TELECOMMS
LIGHTING
HEALTHCARE
DATA EXCHANGE LIVES HERE
27
Index the real world

More Related Content

What's hot

MMEA final seminar opening speech
MMEA final seminar opening speechMMEA final seminar opening speech
MMEA final seminar opening speechCLIC Innovation Ltd
 
Access. Analyze. Act.
Access. Analyze. Act. Access. Analyze. Act.
Access. Analyze. Act. Pivvot
 
Big Data Competing on analytics - devenport
 Big Data Competing on analytics - devenport Big Data Competing on analytics - devenport
Big Data Competing on analytics - devenportBhargav Mehta
 
Growing Information Intensity of Energy 2014
Growing Information Intensity of Energy 2014Growing Information Intensity of Energy 2014
Growing Information Intensity of Energy 2014Peter C. Evans, PhD
 
Redefining "Clean IT": Rejecting Incremental Improvement
Redefining "Clean IT": Rejecting Incremental ImprovementRedefining "Clean IT": Rejecting Incremental Improvement
Redefining "Clean IT": Rejecting Incremental ImprovementPeter Coffee
 
Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA CLIC Innovation Ltd
 
DataWeave Introduction - Startup Saturday
DataWeave Introduction - Startup SaturdayDataWeave Introduction - Startup Saturday
DataWeave Introduction - Startup SaturdayDataWeave
 
"Big Data" in the Energy Industry
"Big Data" in the Energy Industry"Big Data" in the Energy Industry
"Big Data" in the Energy IndustryPaige Bailey
 
Business Analytics - Big Data
Business Analytics - Big DataBusiness Analytics - Big Data
Business Analytics - Big DataBobby Hurley
 
Use r 2013 tutorial - r and cloud computing for higher education and research
Use r 2013   tutorial - r and cloud computing for higher education and researchUse r 2013   tutorial - r and cloud computing for higher education and research
Use r 2013 tutorial - r and cloud computing for higher education and researchkchine3
 
New California Water Atlas presentation for geo lunch September 5, 2013
New California Water Atlas presentation for geo lunch September 5, 2013New California Water Atlas presentation for geo lunch September 5, 2013
New California Water Atlas presentation for geo lunch September 5, 2013CAWaterAtlas
 
Embedded digital twin
Embedded digital twinEmbedded digital twin
Embedded digital twinIRS srl
 
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...SensorUp
 
Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...
Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...
Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...TOPdesk
 
The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...
The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...
The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...Homin Lee
 
Gavin Starks at TEDxNYC
Gavin Starks at TEDxNYCGavin Starks at TEDxNYC
Gavin Starks at TEDxNYCAMEE
 

What's hot (20)

MMEA final seminar opening speech
MMEA final seminar opening speechMMEA final seminar opening speech
MMEA final seminar opening speech
 
Access. Analyze. Act.
Access. Analyze. Act. Access. Analyze. Act.
Access. Analyze. Act.
 
What if
What ifWhat if
What if
 
Bigdata
Bigdata Bigdata
Bigdata
 
Big Data Competing on analytics - devenport
 Big Data Competing on analytics - devenport Big Data Competing on analytics - devenport
Big Data Competing on analytics - devenport
 
Growing Information Intensity of Energy 2014
Growing Information Intensity of Energy 2014Growing Information Intensity of Energy 2014
Growing Information Intensity of Energy 2014
 
Oozma kappa
Oozma kappaOozma kappa
Oozma kappa
 
Redefining "Clean IT": Rejecting Incremental Improvement
Redefining "Clean IT": Rejecting Incremental ImprovementRedefining "Clean IT": Rejecting Incremental Improvement
Redefining "Clean IT": Rejecting Incremental Improvement
 
Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA Open data & crowdsourcing of environmental observations in MMEA
Open data & crowdsourcing of environmental observations in MMEA
 
DataWeave Introduction - Startup Saturday
DataWeave Introduction - Startup SaturdayDataWeave Introduction - Startup Saturday
DataWeave Introduction - Startup Saturday
 
"Big Data" in the Energy Industry
"Big Data" in the Energy Industry"Big Data" in the Energy Industry
"Big Data" in the Energy Industry
 
Business Analytics - Big Data
Business Analytics - Big DataBusiness Analytics - Big Data
Business Analytics - Big Data
 
Use r 2013 tutorial - r and cloud computing for higher education and research
Use r 2013   tutorial - r and cloud computing for higher education and researchUse r 2013   tutorial - r and cloud computing for higher education and research
Use r 2013 tutorial - r and cloud computing for higher education and research
 
New California Water Atlas presentation for geo lunch September 5, 2013
New California Water Atlas presentation for geo lunch September 5, 2013New California Water Atlas presentation for geo lunch September 5, 2013
New California Water Atlas presentation for geo lunch September 5, 2013
 
S B Goyal
S B GoyalS B Goyal
S B Goyal
 
Embedded digital twin
Embedded digital twinEmbedded digital twin
Embedded digital twin
 
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...
 
Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...
Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...
Data driven success, throughout the chain - Stijn van Balen (Rijkswaterstaat)...
 
The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...
The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...
The Observability Graph; Knowledge Graphs for Automated Infrastructure Observ...
 
Gavin Starks at TEDxNYC
Gavin Starks at TEDxNYCGavin Starks at TEDxNYC
Gavin Starks at TEDxNYC
 

Viewers also liked

Sx sw2012 expo_ceo
Sx sw2012 expo_ceoSx sw2012 expo_ceo
Sx sw2012 expo_ceotcantwell
 
Social Media for Students
Social Media for StudentsSocial Media for Students
Social Media for StudentsKevin Manne
 
Key messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven OrganisationKey messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven OrganisationDeloitte UK
 
Workplace mental health and wellbeing
Workplace mental health and wellbeingWorkplace mental health and wellbeing
Workplace mental health and wellbeingDeloitte UK
 
Fjord CES 2017: What We Saw
Fjord CES 2017: What We SawFjord CES 2017: What We Saw
Fjord CES 2017: What We SawFjord
 
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel IndustryThe Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel Industryaccenture
 
Video Transforming
Video TransformingVideo Transforming
Video Transformingaccenture
 
Video is Changing the World
Video is Changing the WorldVideo is Changing the World
Video is Changing the Worldaccenture
 
Tech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterpriseTech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterpriseDeloitte United States
 
Banking Technology Vision 2017
Banking Technology Vision 2017Banking Technology Vision 2017
Banking Technology Vision 2017accenture
 
Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2Accenture Technology
 
What People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen SurveyWhat People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen Surveyaccenture
 
The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017Deloitte UK
 
4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accountingDeloitte United States
 
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
TMT Outlook 2017:  A new wave of advances offer opportunities and challengesTMT Outlook 2017:  A new wave of advances offer opportunities and challenges
TMT Outlook 2017: A new wave of advances offer opportunities and challengesDeloitte United States
 
Fjord Trends 2017
Fjord Trends 2017 Fjord Trends 2017
Fjord Trends 2017 Fjord
 
Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil Fjord
 
Technology Vision 2017 infographic
Technology Vision 2017 infographicTechnology Vision 2017 infographic
Technology Vision 2017 infographicAccenture Technology
 

Viewers also liked (19)

Sx sw2012 expo_ceo
Sx sw2012 expo_ceoSx sw2012 expo_ceo
Sx sw2012 expo_ceo
 
Social Media for Students
Social Media for StudentsSocial Media for Students
Social Media for Students
 
Key messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven OrganisationKey messages & recommendations to become an Insight Driven Organisation
Key messages & recommendations to become an Insight Driven Organisation
 
Workplace mental health and wellbeing
Workplace mental health and wellbeingWorkplace mental health and wellbeing
Workplace mental health and wellbeing
 
Fjord CES 2017: What We Saw
Fjord CES 2017: What We SawFjord CES 2017: What We Saw
Fjord CES 2017: What We Saw
 
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel IndustryThe Value Game-Changer: Digital Performance in The Post and Parcel Industry
The Value Game-Changer: Digital Performance in The Post and Parcel Industry
 
Video Transforming
Video TransformingVideo Transforming
Video Transforming
 
Video is Changing the World
Video is Changing the WorldVideo is Changing the World
Video is Changing the World
 
Tech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterpriseTech Trends 2017: The kinetic enterprise
Tech Trends 2017: The kinetic enterprise
 
Banking Technology Vision 2017
Banking Technology Vision 2017Banking Technology Vision 2017
Banking Technology Vision 2017
 
Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2Liquid Workforce - Tech Vision 2016 Trend 2
Liquid Workforce - Tech Vision 2016 Trend 2
 
What People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen SurveyWhat People Want: Accenture Public Service Citizen Survey
What People Want: Accenture Public Service Citizen Survey
 
The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017The Deloitte Global Chief Procurement Officer Survey 2017
The Deloitte Global Chief Procurement Officer Survey 2017
 
The Deloitte Millennial Survey 2016
The Deloitte Millennial Survey 2016The Deloitte Millennial Survey 2016
The Deloitte Millennial Survey 2016
 
4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting4 “I wish I would haves” to avoid – Lease management and lease accounting
4 “I wish I would haves” to avoid – Lease management and lease accounting
 
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
TMT Outlook 2017:  A new wave of advances offer opportunities and challengesTMT Outlook 2017:  A new wave of advances offer opportunities and challenges
TMT Outlook 2017: A new wave of advances offer opportunities and challenges
 
Fjord Trends 2017
Fjord Trends 2017 Fjord Trends 2017
Fjord Trends 2017
 
Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil Fjord Trends 2017 - Brasil
Fjord Trends 2017 - Brasil
 
Technology Vision 2017 infographic
Technology Vision 2017 infographicTechnology Vision 2017 infographic
Technology Vision 2017 infographic
 

Similar to Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar 2 2015

Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageSteven Ramage
 
No big data without small data
No big data without small dataNo big data without small data
No big data without small dataNorman Manley
 
Harness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleHarness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleSai Janakiram Penumuru
 
BigDataEurope: Project Introduction @ Year #1 Workshops
BigDataEurope: Project Introduction @ Year #1 WorkshopsBigDataEurope: Project Introduction @ Year #1 Workshops
BigDataEurope: Project Introduction @ Year #1 WorkshopsBigData_Europe
 
Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...InnoTech
 
The 17 V’s of Big Data
The 17 V’s of Big DataThe 17 V’s of Big Data
The 17 V’s of Big DataIRJET Journal
 
Big Data PPT by Rohit Dubey
Big Data PPT by Rohit DubeyBig Data PPT by Rohit Dubey
Big Data PPT by Rohit DubeyRohit Dubey
 
Next-Gen уже здесь
Next-Gen уже здесьNext-Gen уже здесь
Next-Gen уже здесьCEE-SEC(R)
 
Introduction to big data – convergences.
Introduction to big data – convergences.Introduction to big data – convergences.
Introduction to big data – convergences.saranya270513
 
Smart Data Module 1 introduction to big and smart data
Smart Data Module 1 introduction to big and smart dataSmart Data Module 1 introduction to big and smart data
Smart Data Module 1 introduction to big and smart datacaniceconsulting
 
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...Codiax
 
A Review Paper on Big Data: Technologies, Tools and Trends
A Review Paper on Big Data: Technologies, Tools and TrendsA Review Paper on Big Data: Technologies, Tools and Trends
A Review Paper on Big Data: Technologies, Tools and TrendsIRJET Journal
 
Overview of big data in cloud computing
Overview of big data in cloud computingOverview of big data in cloud computing
Overview of big data in cloud computingViet-Trung TRAN
 
SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
SC4 Hangout 1: BDE-Transport Webinar Simon ScerriSC4 Hangout 1: BDE-Transport Webinar Simon Scerri
SC4 Hangout 1: BDE-Transport Webinar Simon ScerriBigData_Europe
 

Similar to Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar 2 2015 (20)

Business with Big data
Business with Big dataBusiness with Big data
Business with Big data
 
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven RamageGeospatial Intelligence Middle East 2013_Big Data_Steven Ramage
Geospatial Intelligence Middle East 2013_Big Data_Steven Ramage
 
No big data without small data
No big data without small dataNo big data without small data
No big data without small data
 
Harness the Power of Big Data with Oracle
Harness the Power of Big Data with OracleHarness the Power of Big Data with Oracle
Harness the Power of Big Data with Oracle
 
BigDataEurope: Project Introduction @ Year #1 Workshops
BigDataEurope: Project Introduction @ Year #1 WorkshopsBigDataEurope: Project Introduction @ Year #1 Workshops
BigDataEurope: Project Introduction @ Year #1 Workshops
 
Big Data et eGovernment
Big Data et eGovernmentBig Data et eGovernment
Big Data et eGovernment
 
Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...Data science and its potential to change business as we know it. The Roadmap ...
Data science and its potential to change business as we know it. The Roadmap ...
 
The 17 V’s of Big Data
The 17 V’s of Big DataThe 17 V’s of Big Data
The 17 V’s of Big Data
 
Big Data PPT by Rohit Dubey
Big Data PPT by Rohit DubeyBig Data PPT by Rohit Dubey
Big Data PPT by Rohit Dubey
 
Next-Gen уже здесь
Next-Gen уже здесьNext-Gen уже здесь
Next-Gen уже здесь
 
Introduction to big data – convergences.
Introduction to big data – convergences.Introduction to big data – convergences.
Introduction to big data – convergences.
 
Smart Data Module 1 introduction to big and smart data
Smart Data Module 1 introduction to big and smart dataSmart Data Module 1 introduction to big and smart data
Smart Data Module 1 introduction to big and smart data
 
Big Data - What the Heck?
Big Data - What the Heck?Big Data - What the Heck?
Big Data - What the Heck?
 
What the Heck is Big Data?
What the Heck is Big Data?What the Heck is Big Data?
What the Heck is Big Data?
 
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
 
A Review Paper on Big Data: Technologies, Tools and Trends
A Review Paper on Big Data: Technologies, Tools and TrendsA Review Paper on Big Data: Technologies, Tools and Trends
A Review Paper on Big Data: Technologies, Tools and Trends
 
Big data Ppt
Big data PptBig data Ppt
Big data Ppt
 
Overview of big data in cloud computing
Overview of big data in cloud computingOverview of big data in cloud computing
Overview of big data in cloud computing
 
Viet stack 2nd meetup - BigData in Cloud Computing
Viet stack 2nd meetup - BigData in Cloud ComputingViet stack 2nd meetup - BigData in Cloud Computing
Viet stack 2nd meetup - BigData in Cloud Computing
 
SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
SC4 Hangout 1: BDE-Transport Webinar Simon ScerriSC4 Hangout 1: BDE-Transport Webinar Simon Scerri
SC4 Hangout 1: BDE-Transport Webinar Simon Scerri
 

More from Burton Lee

Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...
Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...
Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...Burton Lee
 
Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...
Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...
Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...Burton Lee
 
Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...
Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...
Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...Burton Lee
 
Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...
Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...
Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...Burton Lee
 
Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...
Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...
Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...Burton Lee
 
Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...
Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...
Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...Burton Lee
 
Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...
Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...
Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...Burton Lee
 
Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...
Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...
Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...Burton Lee
 
Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...
Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...
Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...Burton Lee
 
Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...
Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...
Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...Burton Lee
 
Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...
Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...
Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...Burton Lee
 
Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...
Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...
Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...Burton Lee
 
Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...
Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...
Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...Burton Lee
 
Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...
Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...
Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...Burton Lee
 
Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...
Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...
Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...Burton Lee
 
Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...
Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...
Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...Burton Lee
 
Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019
Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019
Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019Burton Lee
 
Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...
Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...
Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...Burton Lee
 
Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...
Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...
Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...Burton Lee
 
Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...
Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...
Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...Burton Lee
 

More from Burton Lee (20)

Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...
Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...
Santiago Bassett - Wazuh - Growing Cybersecurity Startups in Granada & Silico...
 
Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...
Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...
Julio Casal - 4iQ & AlienVault - Viaje de un Cybersecurity Startup a Silicon ...
 
Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...
Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...
Burton Lee - Session #7 - Madrid + Granada - Cybersecurity Startups - Spanish...
 
Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...
Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...
Peter Fatelnig - EU Delegation to USA - Content Matters & EU Leadership - Sta...
 
Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...
Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...
Polina Zvyagina - Airbnb - Privacy & GDPR Compliance - Stanford Engineering -...
 
Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...
Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...
Dejan Roljic - Eligma - Growing Bitcoin Cities from Slovenia - Stanford Engin...
 
Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...
Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...
Burton Lee - Session #6 Intro - Bitcoin Cities | GDPR & Stasi Files - Stanfor...
 
Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...
Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...
Burton Lee - Session #5 Intro - European Corporate Venture Capital - Stanford...
 
Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...
Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...
Elif Ceylan - ITU ARI Teknokent & Innogate - University Accelerators in Turke...
 
Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...
Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...
Ege Ertem - Zorlu Ventures - Family Enterprises in Turkey - Stanford Engineer...
 
Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...
Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...
Miray Tayfun - Vivoo - Wellness Startups in Turkey & Silicon Valley - Stanfor...
 
Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...
Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...
Burton Lee - Session #4 - Turkey Innovation Ecosystem - Stanford Engineering ...
 
Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...
Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...
Nathalie Delrue-McGuire - Belgium, Flanders & Belcham USA - Stanford Engineer...
 
Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...
Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...
Dirk Wauters - Flanders & Leuven Tech Ecosystem - Stanford Engineering - 28 J...
 
Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...
Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...
Hendrik Isebaert - Showpad & Ghent - Enterprise Software in Flanders - Stanfo...
 
Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...
Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...
Burton Lee - Session #3 - Flanders :: From WW1 to Global Leadership in Enterp...
 
Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019
Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019
Mirena Taskova - EU GDPR Intro & Update - Stanford Engineering - 14 Jan 2019
 
Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...
Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...
Burton Lee - Session #2 - Berlin Mobile Banking Unicorns & GDPR Update - Stan...
 
Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...
Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...
Burton Lee - Course Intro & Session #1 - Czechia & CEE Ecosystem - Stanford M...
 
Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...
Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...
Burton Lee - AI and Remote Diagnostics of Factory Equipment - IHK München 175...
 

Rainer Sternfeld - Planetary Big Data - PlanetOS - Stanford Engineering - Mar 2 2015

  • 1. Rainer Sternfeld, CE September 2014 Indexing the real world March 2, 2015 Stanford School of Engineering Rainer Sternfeld, CEO of Planet OS @planet_os @rsternfeld
  • 2. 2 March 2015 Sensor Data Discovery EngineOcean Data Management From a small buoy to Big Data Data Buoys Market: $2 billion Competitors: 100+ producers Scalability: poor to limited 2008 2012 2014 Market: $5 billion Competitors: 25+ Scalability: good but slow Market: $100+ billion Competitors: 15+ Scalability: very scalable and fast
  • 3. 3 March 2015 Sensor Data Discovery EngineOcean Data Management From a small buoy to Big Data Market: $2 billion Competitors: 100+ producers Scalability: poor to limited 2008 2012 2014 Market: $5 billion Competitors: 25+ Scalability: good but slow Market: $100+ billion Competitors: 15+ Scalability: very scalable and fast 80% 80% time wasted on arbitrary tasks expansion of economic activity growth of sensor data volumes time wasted on arbitrary tasks spatio-temporal data is complex real-time becoming the expected sensor data too big to move NOW data-driven economies sensor data outgrowing social vs 4D Data Buoys
  • 4. 4 March 2015 Have you ever thought: When did weather forecasting become unreliable?
  • 5. 5 March 2015 Source: www.skepticalscience.com
  • 6. 6 March 2015 And when did it start to be awesome?
  • 7. 7 March 2015 Surfline Hyperlocal surf weather forecasting
  • 8. 8 March 2015 Forecast.io (Dark Sky) Hyperlocal weather forecasting
  • 9. 9 March 2015 Weather Underground Crowdsourced data collection
  • 10. 10 March 2015 Have you ever thought: What is the operational root cause of oil spills?
  • 12. 12 March 2015 Sensor data will outgrow social data in 2 years Sensor data is too big to move Data Management will not scale as we know it Oil & Gas is swimming in sensors, drowning in data
  • 13. 13 March 2015 • Contextual data streams across sources • SCADA • Weather and environmental data • Drones and other robotic measurement platforms • Satellite imagery • 3D Common Operating Picture • Full software integration for centralized access to data • Event notifications USE CASES More data needs powerful tools. Increase the data fluency of your operations.
  • 14. 14 March 2015 Hewlett Packard: “By 2020, 40% of all data ever collected by human kind will be generated by sensors.”
  • 15. 15 March 2015 Case #1: NOAA Real-time weather and climate data + forecasts They are working hard on a challenge presented by: • Tens of thousands of devices deployed in the ocean, on land, and space • Tens of terabytes coming in every day • 700 scattered “web services” (FTPs, flat files, Threads servers, no APIs) • Breaking connections (all.the.time.) • 25,000 employees • Critical data for the government, the industry, and citizens What if all this data would be easily discoverable and machine-readable?
  • 16. 16 March 2015 Example to case #1: Marinexplore.org 40,000+ data streams from 33 organizations of open data Advanced Data Discovery Raster data / heat map overlays Access with third party applications Raster data / quiver plots Graph Monitor Build custom datasets
  • 17. 17 March 2015 Example to Case #2: Bravante Helping to deliver offshore data reports 80% faster Problems and challenges: • How to disseminate information to 5 end-customers onshore in parallel? • How to engage specialists and mangers with the same tool? • How not to change anything in the equipment on the vessel? • How to improve speed and quality of the environmental baseline surveys? What if all this data would be available in the cloud?
  • 18. 18 March 2015 R/V Jean Charcot Interactive reporting Case #2: Bravante Helping to deliver offshore data reports 80% faster
  • 19. 19 March 2015 Consolidate dataflows, organize and make sense of your data Access your data with 3rd party tools and systems One interface to search and discover your local and remote data Securely exchange, acquire or sell datasets Build advanced domain specific solutions without hassle Industrial IoT Platform for Real-World Sensor Networks designed for ocean, land, air and space data
  • 20. 20 March 2015 Map of all devices on the Internet August 2, 2014
  • 21. 21 March 2015 Robotic ocean-borne sensor platforms increase productivity LIQUID ROBOTICS WAVE GLIDER
  • 22. 22 March 2015 A decade of growth in marine acoustics sensor data summer year-round 2004 2014 2K 400K n < 10 n > 1000 2D 4D 6 weeks 6 months sample rate # of sensors dimensions time span activity PGS SURVEY VESSEL, 12KM STREAMERS
  • 23. 23 March 2015 Satellites are getting smaller and cheaper. 150 launched since 2011 (3x of the market estimate) SPIRE, A SAN FRANCISCO STARTUP BUILDING NON-IMAGING LOW-ORBIT NANOSATELLITES USING RF SENSORS
  • 24. 24 March 2015 Unmanned vehicles are estimated to grow 10x in 10 years Image Credit: Northrop Grumman
  • 25. 25 March 2015 Precision Agriculture is a $3.7 trillion market Image Credit: http://iphonedroneimagery.com/
  • 26. 26 March 2015 Traditional Data Value Chain is Missing Data Exchange SATELLITES DRONES CARS BUOYS OIL PLATFORMS SHIPS TRACTORS LIGHTING PHYSICAL CHEMICAL BIOLOGICAL OPTICAL NON-OPTICAL (RF) TIME-SERIES RASTER ARRAYS VECTORS SEISMIC VIDEO ACOUSTIC QA/QA OUTLIER DETECTION MODELING DATA FUSION DATA LOGISTICS VISUALIZATION ENHANCEMENT DERIVATIVES HARDWARE SENSORS RAW DATA SOFTWARE ANALYTICS CUSTOMER APPLICATIONS ENERGY WEATHER AGRICULTURE TRANSPORTATION INSURANCE TELECOMMS LIGHTING HEALTHCARE DATA EXCHANGE LIVES HERE