SlideShare a Scribd company logo
1 of 29
Download to read offline
Big Insights with Big Data
Actionable Leads
Daniel Marcous
Google, Waze, Data Wizard
dmarcous@google.com
Data is Everything.
Apps (and companies) win or lose based on how they use it.
Organize the world’s
information and make it
universally accessible
and useful.
Google’s Mission
3
“
Google excels at collecting, storing, and extracting value from
big quantities of data
Google is a (Big) Data Company
Google in just 1 minute:
1000 new
devices
3M Searches 100 Hours
1B Activated
Devices
100M GB
Search
Content
10+ Years of Tackling Big Data Problems
6
Google
Papers
20082002 2004 2006 2010 2012 2014 2015
GFS
Map
Reduce
Flume
Java
Millwheel
Open
Source
2005
Google
Cloud
Product
s
BigQuery Pub/Sub Dataflow Bigtable
BigTable Dremel PubSub
Apache
Beam
Tensorflow
“Google is living a few years in the
future and sending the rest of us
messages”
Doug Cutting, Hadoop Co-Creator
Capture ProcessStore Analyze
Data on your terms
Capture ProcessStore Analyze
Data on your terms
Machine Learning
“Machine Learning is concerned with computer
programs that automatically improve their
performance through experience. “
Herbert Simon
Turing Award 1975
Nobel Prize in Economics 1978
Machine Learning
“A breakthrough in machine learning would be worth
ten Microsofts” (Bill Gates, Chairman, Microsoft)
“Machine learning is the next Internet”
(Tony Tether, Director, DARPA)
“Machine learning is the hot new thing”
(John Hennessy, President, Stanford)
Google is no stranger to ML
So what do you actually do?
Gain Actionable Insights!
Trending Locations - Hilton TLV
Trending Locations / Day of Week Breakdown
Opening Hours Inference
Optimising - Ad clicks / Time from drive start
Time to Content (US) - Day of week / Category
Irregular Events / Anomaly Detection
Major events, causing out of the ordinary traffic/road blocks etc’ affecting large
numbers of users.
Dangerous Places - Clustering
Find most dangerous areas / streets, using custom developed clustering algorithms
● Alert authorities / users
● Compare & share with 3rd parties (NYPD)
Server Distribution Optimisation
Calculate the optimal routing servers distribution according to geographical load.
● Better experience - faster response time
● Saves money - no need for redundant elastic scaling of servers
Text Mining - Topic Analysis
Topic 1 - ETA Topic 2 - Unusual Topic 3 - Share info Topic 4 - Reports Topic 5 - Jams Topic 6 -Voice
wazers usual road social still morgan
eta traffic driving drivers will ang
con stay info reporting update freeman
zona today using helped drive kanan
usando times area nearby delay voice
real clear realtime traffic add meter
tiempo slower sharing jam jammed kan
carretera accident soci drive near masuk
Text Mining - New Version Impressions
● Text analysis - stemming / stopword detection etc.
● Topic modeling
● Sentiment analysis
Waze V4 update :
● Good - “redesign”, ”smarter”, “cleaner”, “improved”
● Bad - “stuck”
Overall very positive score!
Text Mining - Store Sentiments
Text Mining - Sentiment by Time & Place
Daniel Marcous
dmarcous@google.com
dmarcous@gmail.com

More Related Content

What's hot

Steps towards a Data Value Chain
Steps towards a Data Value ChainSteps towards a Data Value Chain
Steps towards a Data Value ChainPRELIDA Project
 
A Brief History of Big Data
A Brief History of Big DataA Brief History of Big Data
A Brief History of Big DataBernard Marr
 
5. global forum sg grumbach
5. global forum sg grumbach5. global forum sg grumbach
5. global forum sg grumbachGlobalForum
 
Steven adler ibm big data predictions
Steven adler   ibm big data predictionsSteven adler   ibm big data predictions
Steven adler ibm big data predictionsGlobalForum
 
A Short History of Big Data
A Short History of Big DataA Short History of Big Data
A Short History of Big DataGadi Eichhorn
 
Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...
Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...
Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...Rainer Sternfeld
 
Large scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use casesLarge scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use casesPayamBarnaghi
 
Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...
Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...
Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...Rainer Sternfeld
 
Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...
Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...
Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...Rainer Sternfeld
 
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)Hritika Raj
 
A Big Data Timeline
A Big Data TimelineA Big Data Timeline
A Big Data TimelineBig Cloud
 
Big Data LDN 2017: Real World Impact of a Global Data Fabric
Big Data LDN 2017: Real World Impact of a Global Data FabricBig Data LDN 2017: Real World Impact of a Global Data Fabric
Big Data LDN 2017: Real World Impact of a Global Data FabricMatt Stubbs
 
The Critical Role of IoT Data Integration to develop Big Data Applications (f...
The Critical Role of IoT Data Integration to develop Big Data Applications (f...The Critical Role of IoT Data Integration to develop Big Data Applications (f...
The Critical Role of IoT Data Integration to develop Big Data Applications (f...Rainer Sternfeld
 
Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...
Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...
Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...Istituto nazionale di statistica
 
SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...
SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...
SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...BigData_Europe
 

What's hot (20)

Spark
SparkSpark
Spark
 
Datapreneurs
DatapreneursDatapreneurs
Datapreneurs
 
Steps towards a Data Value Chain
Steps towards a Data Value ChainSteps towards a Data Value Chain
Steps towards a Data Value Chain
 
EU FP7 CityPulse Project
EU FP7 CityPulse ProjectEU FP7 CityPulse Project
EU FP7 CityPulse Project
 
A Brief History of Big Data
A Brief History of Big DataA Brief History of Big Data
A Brief History of Big Data
 
Get Big Geo Data
Get Big Geo DataGet Big Geo Data
Get Big Geo Data
 
5. global forum sg grumbach
5. global forum sg grumbach5. global forum sg grumbach
5. global forum sg grumbach
 
Steven adler ibm big data predictions
Steven adler   ibm big data predictionsSteven adler   ibm big data predictions
Steven adler ibm big data predictions
 
A Short History of Big Data
A Short History of Big DataA Short History of Big Data
A Short History of Big Data
 
Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...
Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...
Indexing the Real World Sensor Networks (at RE.WORK Internet of Things Summit...
 
Large scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use casesLarge scale data analytics for smart cities and related use cases
Large scale data analytics for smart cities and related use cases
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...
Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...
Opportunities in Sensor Networks and Big Data in 2014 (for NIKKEI Big Data Co...
 
Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...
Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...
Designing a Better Planet with Big Data and Sensor Networks (for Intelligent ...
 
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
 
A Big Data Timeline
A Big Data TimelineA Big Data Timeline
A Big Data Timeline
 
Big Data LDN 2017: Real World Impact of a Global Data Fabric
Big Data LDN 2017: Real World Impact of a Global Data FabricBig Data LDN 2017: Real World Impact of a Global Data Fabric
Big Data LDN 2017: Real World Impact of a Global Data Fabric
 
The Critical Role of IoT Data Integration to develop Big Data Applications (f...
The Critical Role of IoT Data Integration to develop Big Data Applications (f...The Critical Role of IoT Data Integration to develop Big Data Applications (f...
The Critical Role of IoT Data Integration to develop Big Data Applications (f...
 
Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...
Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...
Giorgio Alleva, Data Innovation in Official Statistics: the Leading Role of O...
 
SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...
SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...
SC6 Workshop 1: Big data (phenomenon) challenges and requirements in official...
 

Viewers also liked

Production-Ready BIG ML Workflows - from zero to hero
Production-Ready BIG ML Workflows - from zero to heroProduction-Ready BIG ML Workflows - from zero to hero
Production-Ready BIG ML Workflows - from zero to heroDaniel Marcous
 
Distributed K-Betweenness (Spark)
Distributed K-Betweenness (Spark)Distributed K-Betweenness (Spark)
Distributed K-Betweenness (Spark)Daniel Marcous
 
Social Commerce Summit
Social Commerce SummitSocial Commerce Summit
Social Commerce SummitAndy Ellwood
 
Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]
Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]
Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]HUB INSTITUTE
 
Waze, the mobile location landscape; avichai bakst
Waze, the mobile  location landscape; avichai bakstWaze, the mobile  location landscape; avichai bakst
Waze, the mobile location landscape; avichai bakstMatthew Robinson
 
LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)
LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)
LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)Localogy
 
Apresentação perimetral - Waze e ônibus
Apresentação perimetral - Waze e ônibusApresentação perimetral - Waze e ônibus
Apresentação perimetral - Waze e ônibusPablo Cerdeira
 
Fábrica de Aplicativos - Demo Day Artemisia
Fábrica de Aplicativos - Demo Day ArtemisiaFábrica de Aplicativos - Demo Day Artemisia
Fábrica de Aplicativos - Demo Day ArtemisiaBernardo Nunes Mazzini
 
Como aplicativos grátis para celulares ou tablets ganham dinheiro?
Como aplicativos grátis para celulares ou tablets ganham dinheiro?Como aplicativos grátis para celulares ou tablets ganham dinheiro?
Como aplicativos grátis para celulares ou tablets ganham dinheiro?B2M Digital
 
Yael Elish - Using the Fun & Cool Factor to Accelerate Viral Growth
Yael Elish - Using the Fun & Cool Factor to Accelerate Viral GrowthYael Elish - Using the Fun & Cool Factor to Accelerate Viral Growth
Yael Elish - Using the Fun & Cool Factor to Accelerate Viral GrowthMIT Forum of Israel
 
Oficina de aplicativos
Oficina de aplicativosOficina de aplicativos
Oficina de aplicativoscdimobilidade
 
Banter! - "Waze for nightlife"
Banter! - "Waze for nightlife"Banter! - "Waze for nightlife"
Banter! - "Waze for nightlife"Gana Lana
 
INNMeeting INNSPIRAL: Google y la Innovación
INNMeeting INNSPIRAL: Google y la InnovaciónINNMeeting INNSPIRAL: Google y la Innovación
INNMeeting INNSPIRAL: Google y la InnovaciónINNSPIRAL LATAM
 
Waze Overview
Waze OverviewWaze Overview
Waze OverviewDee E
 

Viewers also liked (20)

Production-Ready BIG ML Workflows - from zero to hero
Production-Ready BIG ML Workflows - from zero to heroProduction-Ready BIG ML Workflows - from zero to hero
Production-Ready BIG ML Workflows - from zero to hero
 
Distributed K-Betweenness (Spark)
Distributed K-Betweenness (Spark)Distributed K-Betweenness (Spark)
Distributed K-Betweenness (Spark)
 
Social Commerce Summit
Social Commerce SummitSocial Commerce Summit
Social Commerce Summit
 
Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]
Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]
Waze - An introduction to Location Based Marketing on Waze [HUBFORUM]
 
Waze, the mobile location landscape; avichai bakst
Waze, the mobile  location landscape; avichai bakstWaze, the mobile  location landscape; avichai bakst
Waze, the mobile location landscape; avichai bakst
 
LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)
LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)
LSA17: Next-Gen SMB Marketing Platforms (Pinterest, Waze, Square)
 
Apresentação perimetral - Waze e ônibus
Apresentação perimetral - Waze e ônibusApresentação perimetral - Waze e ônibus
Apresentação perimetral - Waze e ônibus
 
Fábrica de Aplicativos - Demo Day Artemisia
Fábrica de Aplicativos - Demo Day ArtemisiaFábrica de Aplicativos - Demo Day Artemisia
Fábrica de Aplicativos - Demo Day Artemisia
 
Waze Rio
Waze RioWaze Rio
Waze Rio
 
Como aplicativos grátis para celulares ou tablets ganham dinheiro?
Como aplicativos grátis para celulares ou tablets ganham dinheiro?Como aplicativos grátis para celulares ou tablets ganham dinheiro?
Como aplicativos grátis para celulares ou tablets ganham dinheiro?
 
Pathway to Success
Pathway to SuccessPathway to Success
Pathway to Success
 
Yael Elish - Using the Fun & Cool Factor to Accelerate Viral Growth
Yael Elish - Using the Fun & Cool Factor to Accelerate Viral GrowthYael Elish - Using the Fun & Cool Factor to Accelerate Viral Growth
Yael Elish - Using the Fun & Cool Factor to Accelerate Viral Growth
 
Waze-NOAH12 London
Waze-NOAH12 LondonWaze-NOAH12 London
Waze-NOAH12 London
 
9&10presentation
9&10presentation9&10presentation
9&10presentation
 
Oficina de aplicativos
Oficina de aplicativosOficina de aplicativos
Oficina de aplicativos
 
Banter! - "Waze for nightlife"
Banter! - "Waze for nightlife"Banter! - "Waze for nightlife"
Banter! - "Waze for nightlife"
 
WAZE
WAZE WAZE
WAZE
 
Google Waze Ads
Google Waze AdsGoogle Waze Ads
Google Waze Ads
 
INNMeeting INNSPIRAL: Google y la Innovación
INNMeeting INNSPIRAL: Google y la InnovaciónINNMeeting INNSPIRAL: Google y la Innovación
INNMeeting INNSPIRAL: Google y la Innovación
 
Waze Overview
Waze OverviewWaze Overview
Waze Overview
 

Similar to Big Data - Big Insights - Waze @Google

Big data tutorial_part4
Big data tutorial_part4Big data tutorial_part4
Big data tutorial_part4heyramzz
 
Improve your Tech Quotient
Improve your Tech QuotientImprove your Tech Quotient
Improve your Tech QuotientTarence DSouza
 
RightScale Webinar: Get Top Performance for Your Games
RightScale Webinar: Get Top Performance for Your GamesRightScale Webinar: Get Top Performance for Your Games
RightScale Webinar: Get Top Performance for Your GamesRightScale
 
Jakarta presentation
Jakarta presentationJakarta presentation
Jakarta presentationGil Brown
 
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Craig Sullivan
 
Big Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile ContextBig Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile ContextInMobi Technology
 
Big data4businessusers
Big data4businessusersBig data4businessusers
Big data4businessusersBob Hardaway
 
Top Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama SoftwareTop Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama SoftwarePanorama Software
 
Technology Trends in 2013-2014
Technology Trends in 2013-2014Technology Trends in 2013-2014
Technology Trends in 2013-2014KMS Technology
 
Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016
Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016
Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016Chris Jang
 
Data Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackData Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackAnant Corporation
 
How Google Does Big Data - DevNexus 2014
How Google Does Big Data - DevNexus 2014How Google Does Big Data - DevNexus 2014
How Google Does Big Data - DevNexus 2014James Chittenden
 
Big Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreBig Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreSoftweb Solutions
 
Data Science in the Real World: Making a Difference
Data Science in the Real World: Making a Difference Data Science in the Real World: Making a Difference
Data Science in the Real World: Making a Difference Srinath Perera
 
Maximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs EditionMaximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs EditionSafe Software
 
Big data and Internet
Big data and InternetBig data and Internet
Big data and InternetSanoj Kumar
 

Similar to Big Data - Big Insights - Waze @Google (20)

Big data tutorial_part4
Big data tutorial_part4Big data tutorial_part4
Big data tutorial_part4
 
Big data business case
Big data   business caseBig data   business case
Big data business case
 
Improve your Tech Quotient
Improve your Tech QuotientImprove your Tech Quotient
Improve your Tech Quotient
 
RightScale Webinar: Get Top Performance for Your Games
RightScale Webinar: Get Top Performance for Your GamesRightScale Webinar: Get Top Performance for Your Games
RightScale Webinar: Get Top Performance for Your Games
 
Jakarta presentation
Jakarta presentationJakarta presentation
Jakarta presentation
 
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
 
Big Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile ContextBig Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile Context
 
Big data4businessusers
Big data4businessusersBig data4businessusers
Big data4businessusers
 
Top Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama SoftwareTop Business Intelligence Trends for 2016 by Panorama Software
Top Business Intelligence Trends for 2016 by Panorama Software
 
Technology Trends in 2013-2014
Technology Trends in 2013-2014Technology Trends in 2013-2014
Technology Trends in 2013-2014
 
Big data
Big dataBig data
Big data
 
Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016
Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016
Google Cloud Platform & rockPlace Big Data Event-Mar.31.2016
 
Data Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackData Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data Stack
 
How Google Does Big Data - DevNexus 2014
How Google Does Big Data - DevNexus 2014How Google Does Big Data - DevNexus 2014
How Google Does Big Data - DevNexus 2014
 
Big Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreBig Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and more
 
Data Science in the Real World: Making a Difference
Data Science in the Real World: Making a Difference Data Science in the Real World: Making a Difference
Data Science in the Real World: Making a Difference
 
Maximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs EditionMaximizing Your Data’s Potential: DOTs & DPWs Edition
Maximizing Your Data’s Potential: DOTs & DPWs Edition
 
Big data and Internet
Big data and InternetBig data and Internet
Big data and Internet
 
Big Data - CRM's Promise Land
Big Data - CRM's Promise LandBig Data - CRM's Promise Land
Big Data - CRM's Promise Land
 
Identifying the new frontier of big data as an enabler for T&T industries: Re...
Identifying the new frontier of big data as an enabler for T&T industries: Re...Identifying the new frontier of big data as an enabler for T&T industries: Re...
Identifying the new frontier of big data as an enabler for T&T industries: Re...
 

More from Daniel Marcous

Cloud AI Platform Notebooks - Kaggle IL
Cloud AI Platform Notebooks - Kaggle ILCloud AI Platform Notebooks - Kaggle IL
Cloud AI Platform Notebooks - Kaggle ILDaniel Marcous
 
Towards Smart Transportation DSS 2018
Towards Smart Transportation DSS 2018Towards Smart Transportation DSS 2018
Towards Smart Transportation DSS 2018Daniel Marcous
 
Distributed Databases - Concepts & Architectures
Distributed Databases - Concepts & ArchitecturesDistributed Databases - Concepts & Architectures
Distributed Databases - Concepts & ArchitecturesDaniel Marcous
 
Prediction of taxi rides ETA
Prediction of taxi rides ETAPrediction of taxi rides ETA
Prediction of taxi rides ETADaniel Marcous
 
Big data real time architectures
Big data real time architecturesBig data real time architectures
Big data real time architecturesDaniel Marcous
 

More from Daniel Marcous (7)

Cloud AI Platform Notebooks - Kaggle IL
Cloud AI Platform Notebooks - Kaggle ILCloud AI Platform Notebooks - Kaggle IL
Cloud AI Platform Notebooks - Kaggle IL
 
S2
S2S2
S2
 
Towards Smart Transportation DSS 2018
Towards Smart Transportation DSS 2018Towards Smart Transportation DSS 2018
Towards Smart Transportation DSS 2018
 
Distributed Databases - Concepts & Architectures
Distributed Databases - Concepts & ArchitecturesDistributed Databases - Concepts & Architectures
Distributed Databases - Concepts & Architectures
 
Prediction of taxi rides ETA
Prediction of taxi rides ETAPrediction of taxi rides ETA
Prediction of taxi rides ETA
 
Big data real time architectures
Big data real time architecturesBig data real time architectures
Big data real time architectures
 
Geo data analytics
Geo data analyticsGeo data analytics
Geo data analytics
 

Recently uploaded

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfNicoChristianSunaryo
 
Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...
Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...
Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...ThinkInnovation
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etclalithasri22
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfnikeshsingh56
 
Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...
Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...
Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...ThinkInnovation
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformationAnnie Melnic
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are successPratikSingh115843
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...Jack Cole
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelBoston Institute of Analytics
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaManalVerma4
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 

Recently uploaded (16)

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdf
 
2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use
 
Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...
Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...
Predictive Analysis - Using Insight-informed Data to Plan Inventory in Next 6...
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etc
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdf
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...
Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...
Decision Making Under Uncertainty - Is It Better Off Joining a Partnership or...
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformation
 
Data Analysis Project: Stroke Prediction
Data Analysis Project: Stroke PredictionData Analysis Project: Stroke Prediction
Data Analysis Project: Stroke Prediction
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are success
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in India
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 

Big Data - Big Insights - Waze @Google

  • 1. Big Insights with Big Data Actionable Leads Daniel Marcous Google, Waze, Data Wizard dmarcous@google.com
  • 2. Data is Everything. Apps (and companies) win or lose based on how they use it.
  • 3. Organize the world’s information and make it universally accessible and useful. Google’s Mission 3 “
  • 4. Google excels at collecting, storing, and extracting value from big quantities of data Google is a (Big) Data Company
  • 5. Google in just 1 minute: 1000 new devices 3M Searches 100 Hours 1B Activated Devices 100M GB Search Content
  • 6. 10+ Years of Tackling Big Data Problems 6 Google Papers 20082002 2004 2006 2010 2012 2014 2015 GFS Map Reduce Flume Java Millwheel Open Source 2005 Google Cloud Product s BigQuery Pub/Sub Dataflow Bigtable BigTable Dremel PubSub Apache Beam Tensorflow
  • 7. “Google is living a few years in the future and sending the rest of us messages” Doug Cutting, Hadoop Co-Creator
  • 10.
  • 11. Machine Learning “Machine Learning is concerned with computer programs that automatically improve their performance through experience. “ Herbert Simon Turing Award 1975 Nobel Prize in Economics 1978
  • 12. Machine Learning “A breakthrough in machine learning would be worth ten Microsofts” (Bill Gates, Chairman, Microsoft) “Machine learning is the next Internet” (Tony Tether, Director, DARPA) “Machine learning is the hot new thing” (John Hennessy, President, Stanford)
  • 13. Google is no stranger to ML
  • 14. So what do you actually do? Gain Actionable Insights!
  • 15. Trending Locations - Hilton TLV
  • 16. Trending Locations / Day of Week Breakdown
  • 18. Optimising - Ad clicks / Time from drive start
  • 19. Time to Content (US) - Day of week / Category
  • 20. Irregular Events / Anomaly Detection Major events, causing out of the ordinary traffic/road blocks etc’ affecting large numbers of users.
  • 21. Dangerous Places - Clustering Find most dangerous areas / streets, using custom developed clustering algorithms ● Alert authorities / users ● Compare & share with 3rd parties (NYPD)
  • 22. Server Distribution Optimisation Calculate the optimal routing servers distribution according to geographical load. ● Better experience - faster response time ● Saves money - no need for redundant elastic scaling of servers
  • 23. Text Mining - Topic Analysis Topic 1 - ETA Topic 2 - Unusual Topic 3 - Share info Topic 4 - Reports Topic 5 - Jams Topic 6 -Voice wazers usual road social still morgan eta traffic driving drivers will ang con stay info reporting update freeman zona today using helped drive kanan usando times area nearby delay voice real clear realtime traffic add meter tiempo slower sharing jam jammed kan carretera accident soci drive near masuk
  • 24. Text Mining - New Version Impressions ● Text analysis - stemming / stopword detection etc. ● Topic modeling ● Sentiment analysis Waze V4 update : ● Good - “redesign”, ”smarter”, “cleaner”, “improved” ● Bad - “stuck” Overall very positive score!
  • 25. Text Mining - Store Sentiments
  • 26. Text Mining - Sentiment by Time & Place
  • 27.
  • 28.