SlideShare a Scribd company logo
1 of 36
BIG DATA ANALYTICS

By

Rahul Kulkarni
 Big Data
Big Data Players in the Market
Hadoop Ecosystems

 Analytics


Machine Learning Algorithms

 SMAC
WHAT IS BIG DATA?
“Big Data” is high-volume, high velocity,
high variety information assets that demand cost effective,
innovative forms of information processing for enhanced
insight and decision making.
By 2020, 1.7 MB of new information will be created for each and every human being on the planet – every second every day.
DATA CONTRIBUTIONS
Personalized for each visitor
HADOOP WAS A KEY PART OF IBMS WATSON
Hadoop analytics and data
discovery abilities were a
big reason that IBM's
Watson computer was able
to win a widely publicized
"Jeopardy“ showdown last
year against a couple of
very successful human
former champions.
BIG DATA PLAYERS
EVOLUTION OF HADOOP
Simple models do
better than experts

LET US GET STARTED
AN INSURANCE PROBLEM
Product
Car Insurance
Life Insurance
Health Insurance
2-wheeler Insurance
Heavy Vehicle Insurance

Revenues in last quarter in
million
110
180
220
90
100
WHAT WE CANNOT EXPLAIN
FIRST MODEL . . .
 Categorize data as VEHICLE and NON-VEHICLE insurance.
 The average of vehicle insurance: 100
 The unexplained = (90-100)2+(100-100)2+(110-100)2=200
 The average non-vehicle insurance = 200
 The unexplained = (180-200)2+(220-200)2= 800
R2
Analytics

Machine Learning : Supervised & Un-supervised Learning

Lets get started with two different techniques
(Supervised) - Classification and Regression
(Un-Supervised) - Clustering
Machine Learning
- Grew out of work in AI
- New capability for computers
Examples:
- Database mining
Large datasets from growth of automation/web.
E.g., Web click data, medical records, biology, engineering
- Applications can’t program by hand.
E.g., Autonomous helicopter,
handwriting recognition,
most of Natural Language Processing (NLP),
Computer Vision.
- Self-customizing programs
E.g., Amazon, Netflix product recommendations
- Understanding human learning (brain, real AI).
SUPERVISED LEARNING
PREDICTION AND FORECASTING
UN-SUPERVISED LEARNING
"Consumer data will be the biggest
differentiator in the next two to three years.
Whoever unlocks the reams of data and uses
it strategically will win“
-Angela Ahrendts, CEO of Burberry

Big Data is key to any Loyalty scheme
The Obama 2012 campaign used data analytics and the experimental method
to assemble a winning coalition vote by vote. The interests of individual voters
were known and addressed.
Online Media and Web Analytics helped Obama beat McCain, changed the
political scene in one of the most powerful nations in the world and how it has
influenced the course of history
- Obama had 2.5 M Facebook friends compared to a paltry 0.5 M Facebook
friends for McCain (seems strange to think of politicians on Facebook though..)
– Obama raised USD 500 M online versus the total amount of USD,
201 M by McCain
Percentage of votes cast for Obama by early voters in Hamilton
Model - 57.68%, Actual 57.16%
Television commercials aired on TV land (National cable level)
Obama campaign - 1,710, Romney campaign - 0

Money spent on online Ads through Mid-October
Romney Campaign - $26 million, Obama Campaign - $52 millions
SMAC will be the platform that will enable
organizations to drive consumerization of
technology, including IT. Early adopters of
SMAC stack would have a clear competitive
edge in their line of business
cloud computing is a synonym for
distributed computing over a network,
and means the ability to run a program
or application on many connected
computers at the same time
THANK YOU . . . . .

More Related Content

What's hot

Emerging Technology, Shiny Objects & The Future of Media - iSummit - Fred Steube
Emerging Technology, Shiny Objects & The Future of Media - iSummit - Fred SteubeEmerging Technology, Shiny Objects & The Future of Media - iSummit - Fred Steube
Emerging Technology, Shiny Objects & The Future of Media - iSummit - Fred SteubeFred Steube
 
Why the Customer Journey is critical to your Integration Architecture
Why the Customer Journey is critical to your Integration ArchitectureWhy the Customer Journey is critical to your Integration Architecture
Why the Customer Journey is critical to your Integration ArchitectureAnthony DeLima
 
Frost & Sullivan - world's top global mega trends to 2025 and implications
Frost & Sullivan - world's top global mega trends to 2025 and implicationsFrost & Sullivan - world's top global mega trends to 2025 and implications
Frost & Sullivan - world's top global mega trends to 2025 and implicationspolenumerique33
 
Post-PC Marketing
Post-PC MarketingPost-PC Marketing
Post-PC MarketingMoxie Pulse
 
Internet of Things forecasts infographic
Internet of Things forecasts infographicInternet of Things forecasts infographic
Internet of Things forecasts infographicEmerald Technology
 
Kemelor Potomac Forum 03 30 10
Kemelor Potomac Forum 03 30 10Kemelor Potomac Forum 03 30 10
Kemelor Potomac Forum 03 30 10Phil Kemelor
 
Mobile: State of the Industry
Mobile: State of the IndustryMobile: State of the Industry
Mobile: State of the IndustryGGV Capital
 
The Impact of Data in Technology Today
The Impact of Data in Technology TodayThe Impact of Data in Technology Today
The Impact of Data in Technology TodayNetApp
 
CTMobileSummit May 6 2015
CTMobileSummit May 6 2015CTMobileSummit May 6 2015
CTMobileSummit May 6 2015Brenda Lewis
 
Internet Trends 2014 - Redesigned
Internet Trends 2014 - RedesignedInternet Trends 2014 - Redesigned
Internet Trends 2014 - RedesignedEmiland
 
INFOGRAPHIC: The mobile landscape
INFOGRAPHIC: The mobile landscapeINFOGRAPHIC: The mobile landscape
INFOGRAPHIC: The mobile landscapeEquinixUK
 
Keynote Daniel Kraft - enera - Dec 2016
Keynote Daniel Kraft - enera - Dec 2016Keynote Daniel Kraft - enera - Dec 2016
Keynote Daniel Kraft - enera - Dec 2016Daniel Kraft
 
The Robos Are Coming - How AI will revolutionize Insurance 0117
The Robos Are Coming - How AI will revolutionize Insurance 0117The Robos Are Coming - How AI will revolutionize Insurance 0117
The Robos Are Coming - How AI will revolutionize Insurance 0117Graham Clark
 
25 Disruptive Technology Trends 2015 - 2016
25 Disruptive Technology Trends 2015 - 201625 Disruptive Technology Trends 2015 - 2016
25 Disruptive Technology Trends 2015 - 2016Brian Solis
 
brandinnovators2015trends-150105172645-conversion-gate01
brandinnovators2015trends-150105172645-conversion-gate01brandinnovators2015trends-150105172645-conversion-gate01
brandinnovators2015trends-150105172645-conversion-gate01FOOK CHUIN NG
 
The New Mega Trends Sarwant Singh Frost Sullivan
The New Mega Trends   Sarwant Singh   Frost SullivanThe New Mega Trends   Sarwant Singh   Frost Sullivan
The New Mega Trends Sarwant Singh Frost SullivanFatine Amante
 

What's hot (19)

Ayushi.ppt
Ayushi.pptAyushi.ppt
Ayushi.ppt
 
Emerging Technology, Shiny Objects & The Future of Media - iSummit - Fred Steube
Emerging Technology, Shiny Objects & The Future of Media - iSummit - Fred SteubeEmerging Technology, Shiny Objects & The Future of Media - iSummit - Fred Steube
Emerging Technology, Shiny Objects & The Future of Media - iSummit - Fred Steube
 
Why the Customer Journey is critical to your Integration Architecture
Why the Customer Journey is critical to your Integration ArchitectureWhy the Customer Journey is critical to your Integration Architecture
Why the Customer Journey is critical to your Integration Architecture
 
Frost & Sullivan - world's top global mega trends to 2025 and implications
Frost & Sullivan - world's top global mega trends to 2025 and implicationsFrost & Sullivan - world's top global mega trends to 2025 and implications
Frost & Sullivan - world's top global mega trends to 2025 and implications
 
Post-PC Marketing
Post-PC MarketingPost-PC Marketing
Post-PC Marketing
 
Paymentus
PaymentusPaymentus
Paymentus
 
Internet of Things forecasts infographic
Internet of Things forecasts infographicInternet of Things forecasts infographic
Internet of Things forecasts infographic
 
Kemelor Potomac Forum 03 30 10
Kemelor Potomac Forum 03 30 10Kemelor Potomac Forum 03 30 10
Kemelor Potomac Forum 03 30 10
 
Mobile: State of the Industry
Mobile: State of the IndustryMobile: State of the Industry
Mobile: State of the Industry
 
Governments Are Going Digital
Governments Are Going DigitalGovernments Are Going Digital
Governments Are Going Digital
 
The Impact of Data in Technology Today
The Impact of Data in Technology TodayThe Impact of Data in Technology Today
The Impact of Data in Technology Today
 
CTMobileSummit May 6 2015
CTMobileSummit May 6 2015CTMobileSummit May 6 2015
CTMobileSummit May 6 2015
 
Internet Trends 2014 - Redesigned
Internet Trends 2014 - RedesignedInternet Trends 2014 - Redesigned
Internet Trends 2014 - Redesigned
 
INFOGRAPHIC: The mobile landscape
INFOGRAPHIC: The mobile landscapeINFOGRAPHIC: The mobile landscape
INFOGRAPHIC: The mobile landscape
 
Keynote Daniel Kraft - enera - Dec 2016
Keynote Daniel Kraft - enera - Dec 2016Keynote Daniel Kraft - enera - Dec 2016
Keynote Daniel Kraft - enera - Dec 2016
 
The Robos Are Coming - How AI will revolutionize Insurance 0117
The Robos Are Coming - How AI will revolutionize Insurance 0117The Robos Are Coming - How AI will revolutionize Insurance 0117
The Robos Are Coming - How AI will revolutionize Insurance 0117
 
25 Disruptive Technology Trends 2015 - 2016
25 Disruptive Technology Trends 2015 - 201625 Disruptive Technology Trends 2015 - 2016
25 Disruptive Technology Trends 2015 - 2016
 
brandinnovators2015trends-150105172645-conversion-gate01
brandinnovators2015trends-150105172645-conversion-gate01brandinnovators2015trends-150105172645-conversion-gate01
brandinnovators2015trends-150105172645-conversion-gate01
 
The New Mega Trends Sarwant Singh Frost Sullivan
The New Mega Trends   Sarwant Singh   Frost SullivanThe New Mega Trends   Sarwant Singh   Frost Sullivan
The New Mega Trends Sarwant Singh Frost Sullivan
 

Similar to Big data analytics

Megatrends-2025-Frost-and-Sullivan.pdf
Megatrends-2025-Frost-and-Sullivan.pdfMegatrends-2025-Frost-and-Sullivan.pdf
Megatrends-2025-Frost-and-Sullivan.pdfMariaCristinaDio
 
Big Data and PA
Big Data and PABig Data and PA
Big Data and PATim Tate
 
South By South Best 2018
South By South Best 2018 South By South Best 2018
South By South Best 2018 James Quinlan
 
End of year review/preview
End of year review/previewEnd of year review/preview
End of year review/previewNigelG
 
2025 Top Global Mega Trends
2025 Top Global Mega Trends2025 Top Global Mega Trends
2025 Top Global Mega TrendsSYGroup
 
50 Powerful Statistics About Tech Megatrends Affecting Every Business
50 Powerful Statistics About Tech Megatrends Affecting Every Business50 Powerful Statistics About Tech Megatrends Affecting Every Business
50 Powerful Statistics About Tech Megatrends Affecting Every BusinessExtreme Networks
 
Eric van Tol - Businesscases & Verdienmodellen
Eric van Tol - Businesscases & VerdienmodellenEric van Tol - Businesscases & Verdienmodellen
Eric van Tol - Businesscases & VerdienmodellenMedia Perspectives
 
Artificial Intellegence Disruption by Machine Part 2 of 3
Artificial Intellegence Disruption by Machine Part 2 of 3Artificial Intellegence Disruption by Machine Part 2 of 3
Artificial Intellegence Disruption by Machine Part 2 of 3Lori Fisher
 
Big data retail_industry_by VivekChutke
Big data retail_industry_by VivekChutkeBig data retail_industry_by VivekChutke
Big data retail_industry_by VivekChutkevchutke
 
Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018
Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018
Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018Laura Jigau
 
MIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitate
MIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitateMIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitate
MIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitateBusiness Days
 
Data - A Big Disrupter!
Data - A Big Disrupter! Data - A Big Disrupter!
Data - A Big Disrupter! Mohit Kapoor
 
Equity Position Deck Sans Video
Equity Position Deck Sans VideoEquity Position Deck Sans Video
Equity Position Deck Sans VideoViamediaCharleston
 
2014 Key trends
2014 Key trends2014 Key trends
2014 Key trendsSean Cho
 
The Future of Premium Content Delivery
The Future of Premium Content DeliveryThe Future of Premium Content Delivery
The Future of Premium Content DeliveryBranded Ltd
 
TENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETING
TENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETINGTENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETING
TENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETINGMeio & Mensagem
 

Similar to Big data analytics (20)

Cloud Revolution Conitnues
Cloud Revolution ConitnuesCloud Revolution Conitnues
Cloud Revolution Conitnues
 
Megatrends-2025-Frost-and-Sullivan.pdf
Megatrends-2025-Frost-and-Sullivan.pdfMegatrends-2025-Frost-and-Sullivan.pdf
Megatrends-2025-Frost-and-Sullivan.pdf
 
Big Data and PA
Big Data and PABig Data and PA
Big Data and PA
 
South By South Best 2018
South By South Best 2018 South By South Best 2018
South By South Best 2018
 
End of year review/preview
End of year review/previewEnd of year review/preview
End of year review/preview
 
2025 Top Global Mega Trends
2025 Top Global Mega Trends2025 Top Global Mega Trends
2025 Top Global Mega Trends
 
50 Powerful Statistics About Tech Megatrends Affecting Every Business
50 Powerful Statistics About Tech Megatrends Affecting Every Business50 Powerful Statistics About Tech Megatrends Affecting Every Business
50 Powerful Statistics About Tech Megatrends Affecting Every Business
 
data, big data, open data
data, big data, open datadata, big data, open data
data, big data, open data
 
Eric van Tol - Businesscases & Verdienmodellen
Eric van Tol - Businesscases & VerdienmodellenEric van Tol - Businesscases & Verdienmodellen
Eric van Tol - Businesscases & Verdienmodellen
 
Artificial Intellegence Disruption by Machine Part 2 of 3
Artificial Intellegence Disruption by Machine Part 2 of 3Artificial Intellegence Disruption by Machine Part 2 of 3
Artificial Intellegence Disruption by Machine Part 2 of 3
 
Big data retail_industry_by VivekChutke
Big data retail_industry_by VivekChutkeBig data retail_industry_by VivekChutke
Big data retail_industry_by VivekChutke
 
Apps as a Marketing Tool
Apps as a Marketing ToolApps as a Marketing Tool
Apps as a Marketing Tool
 
Contagious_IBM
Contagious_IBMContagious_IBM
Contagious_IBM
 
Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018
Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018
Mihai Bonca - Artificial Intelligence - Business Focus Iasi 2018
 
MIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitate
MIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitateMIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitate
MIhai Bonca - Inteligenta Artificiala. Inger, demon sau oportunitate
 
Data - A Big Disrupter!
Data - A Big Disrupter! Data - A Big Disrupter!
Data - A Big Disrupter!
 
Equity Position Deck Sans Video
Equity Position Deck Sans VideoEquity Position Deck Sans Video
Equity Position Deck Sans Video
 
2014 Key trends
2014 Key trends2014 Key trends
2014 Key trends
 
The Future of Premium Content Delivery
The Future of Premium Content DeliveryThe Future of Premium Content Delivery
The Future of Premium Content Delivery
 
TENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETING
TENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETINGTENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETING
TENDÊNCIAS DE NOVOS MODELOS NO MUNDO DO MARKETING
 

Big data analytics

  • 2.  Big Data Big Data Players in the Market Hadoop Ecosystems  Analytics  Machine Learning Algorithms  SMAC
  • 3.
  • 4. WHAT IS BIG DATA? “Big Data” is high-volume, high velocity, high variety information assets that demand cost effective, innovative forms of information processing for enhanced insight and decision making.
  • 5. By 2020, 1.7 MB of new information will be created for each and every human being on the planet – every second every day.
  • 8. HADOOP WAS A KEY PART OF IBMS WATSON Hadoop analytics and data discovery abilities were a big reason that IBM's Watson computer was able to win a widely publicized "Jeopardy“ showdown last year against a couple of very successful human former champions.
  • 11.
  • 12.
  • 13.
  • 14. Simple models do better than experts LET US GET STARTED
  • 15. AN INSURANCE PROBLEM Product Car Insurance Life Insurance Health Insurance 2-wheeler Insurance Heavy Vehicle Insurance Revenues in last quarter in million 110 180 220 90 100
  • 16. WHAT WE CANNOT EXPLAIN
  • 17. FIRST MODEL . . .  Categorize data as VEHICLE and NON-VEHICLE insurance.  The average of vehicle insurance: 100  The unexplained = (90-100)2+(100-100)2+(110-100)2=200  The average non-vehicle insurance = 200  The unexplained = (180-200)2+(220-200)2= 800 R2
  • 18.
  • 19. Analytics Machine Learning : Supervised & Un-supervised Learning Lets get started with two different techniques (Supervised) - Classification and Regression (Un-Supervised) - Clustering
  • 20. Machine Learning - Grew out of work in AI - New capability for computers Examples: - Database mining Large datasets from growth of automation/web. E.g., Web click data, medical records, biology, engineering - Applications can’t program by hand. E.g., Autonomous helicopter, handwriting recognition, most of Natural Language Processing (NLP), Computer Vision. - Self-customizing programs E.g., Amazon, Netflix product recommendations - Understanding human learning (brain, real AI).
  • 24.
  • 25. "Consumer data will be the biggest differentiator in the next two to three years. Whoever unlocks the reams of data and uses it strategically will win“ -Angela Ahrendts, CEO of Burberry Big Data is key to any Loyalty scheme
  • 26. The Obama 2012 campaign used data analytics and the experimental method to assemble a winning coalition vote by vote. The interests of individual voters were known and addressed. Online Media and Web Analytics helped Obama beat McCain, changed the political scene in one of the most powerful nations in the world and how it has influenced the course of history - Obama had 2.5 M Facebook friends compared to a paltry 0.5 M Facebook friends for McCain (seems strange to think of politicians on Facebook though..) – Obama raised USD 500 M online versus the total amount of USD, 201 M by McCain Percentage of votes cast for Obama by early voters in Hamilton Model - 57.68%, Actual 57.16% Television commercials aired on TV land (National cable level) Obama campaign - 1,710, Romney campaign - 0 Money spent on online Ads through Mid-October Romney Campaign - $26 million, Obama Campaign - $52 millions
  • 27.
  • 28.
  • 29.
  • 30. SMAC will be the platform that will enable organizations to drive consumerization of technology, including IT. Early adopters of SMAC stack would have a clear competitive edge in their line of business
  • 31.
  • 32.
  • 33.
  • 34. cloud computing is a synonym for distributed computing over a network, and means the ability to run a program or application on many connected computers at the same time
  • 35.
  • 36. THANK YOU . . . . .