SlideShare a Scribd company logo
1 of 14
1
BIG DATA IN OIL &
GAS
BERT BEALS
CHIEF TECHNOLOGIST – ENERGY INDUSTRIES
BJORN ANDERSSON
SOLUTIONS MARKETING DIRECTOR – ENERGY
INDUSTRIES
2
DEFINING BIG DATA AND ANALYTICS
 Data Volume
‒ Terabytes to Petabytes and beyond
 Data Variety
‒ Many sources, structured data and more unstructured data
 Data Velocity
‒ Streaming from sensors, generated secondary data
 Value
‒ Derived business value
‒ Quicker and more accurate decisions
© Hitachi Data Systems 2013
3
BUSINESS
PROCESS
DATABASE DATA
HUMAN
ENTERPRISE CONTENT,
EXTERNAL SOURCES
MACHINE
SENSOR DATA, COMPLEX DATA
SOURCES OF BIG DATA GROWTH
THE DATA MULTIPLIER EFFECT
More Data with More Complex Relationships…in Real Time and At Scale
To manage, govern and analyze
1X 10X 100XOLTP
EMAIL
DOCUMENTS
WEB LOGS SOCIAL
SENSORS M2M LOG
FILES
RECORDING
VIDEO
SATELLITE
IMAGING BIO-
INFORMATICS
VARIETY
VOLUME
VARIETY
VOLUME
VELOCITY VOLUME
© Hitachi Data Systems 2013
4
BIG DATA – THE PROMISE
The Hype
 Turning data flood into transformative
insight
 Exploration without preconceived
notions
The Reality
 Big Data application stack is complex
 Data is highly fragmented
 New skill sets
 Difficult to know where to start
SORTING THE REALITY FROM THE HYPE
Unstructured
Structured
Semi-structured
Video
WebLogs
HTML
Clickstream
Text
Audio
NoSQL
Hadoop
Machine Data
Database
Analytics
Machine Learning
Visualization
ETL
Business Process
Model
Stream Processing
In Memory DB
Connectors
Virtualization
Search
FederationMPP
MetaData
Social Media
Dark Data
Real Time
NAS
How does Big Data help my Business?
How much will it cost?
What’s the ROI? How risky is it? When will I see results?
© Hitachi Data Systems 2013
BIG DATA DRIVING BIG INNOVATION TODAY
Hitachi
Transportation:
Bullet Trains
• Track/train sensors
• Keep trains on schedule
• Proactive maintenance
• Telemetry from seismic sensors
• Time series data
• Operational data from sensors
• Insight for fleet managers
Hitachi Power:
Power Stations
Hitachi
Construction:
Excavators
Hitachi, Ltd.:
Tokyo Stock
Exchange
• High-speed index service
• 1/100th faster
© Hitachi Data Systems 2013
6
#1 INDUSTRY MEGA DRIVER –
SIMPLY STATED: WE NEED MORE ENERGY
INCREASE PRODUCTION AND KNOWN ENERGY RESERVES
Dramatic increase in demand
from emerging economies
(non-OECD)
Discover new reserves now:
75% of today’s oil was
discovered before 1980
© ExxonMobil 2012© BP 2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
© ExxonMobil 2012
© Hitachi Data Systems 2013
7
OIL&GAS REPRESENT THE MAJORITY OF
THE ENERGY INDUSTRY
 60% of Global Energy demand fulfilled by Oil&Gas
‒ Natural Gas is the fastest growing fuel source
©BP2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
©ExxonMobil2012
© Hitachi Data Systems 2013
8
MORE BIG DATA
 More Volume
‒ New sensor and acquisition technology: Isometrix, WAZ
‒ More data being integrated: Drilling, Production
 More Velocity
‒ Real time data from operations, sensors
‒ Streaming vs batch processing
 More Variety
‒ Structured, Unstructured, semi-structured
‒ Complexity involving multiple disciplines
 Potential Value
‒ Clearer view, better understanding by combining data sources
‒ Capitalizing on opportunities
‒ Lower risk for failures
VOLUME, VELOCITY AND VARIETY
© Hitachi Data Systems 2013
BIG DATA IN ACTION IN OIL&GAS
Exploration
Production
Refining
Distribution
Marketing and retail
Geo-technical applications
Resource planning
Business intelligence
Databases
Office applications
Seismic data
Bore hole sensors
Environmental sensors
Weather data
Production utilization
Storage capacities
Spot pricing (trading)
Transportation
Inventory levels
Demand & forecast
Location data
Big Data Analysis = Value
Business Decisions
E&P Investments
Inventory locations
Production planning
Safety
© Hitachi Data Systems 2013
• Growing data
> 300 MB / Km2 early 90s
> 25 GB / km2 in 2006
> Growing… to PBs / km2
 Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 –
200,000 shots, 50 – 200TB data
 Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB
 Tomorrow: 50GB/s
Sources, Grid Computing Ahmar Abbas:
1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry
2 ML Geovision www.alkorinternational.com
VELOCITY – INGEST MORE DATA FASTER
© Hitachi Data Systems 2013
VOLUME - INSATIABLE APPETITE FOR INFORMATION
 Technology as a
competitive weapon
‒ Pushing technology
boundaries
‒ Never resting, methods
ready for anticipated
technology advances
 Big Data in use
‒ A different scale, PB file
systems as caches
‒ Live in-feed from sensors
from sites world wide
IT STARTS WITH THE DATA,
THEN IT NEEDS TO BE ANALYZED
TO EXTRACT INFORMATION
Source:HenriCalandra,JohnEtgen,
ScottMorton–RiceUniversity
Realtime drilling
operation center, a fully
integrated part of the
Valhall drilling operations
in Norway.
© Hitachi Data Systems 2013
VARIETY: FIND AND PRODUCE FASTER,
SAFER, AND MORE EFFICIENTLY
Upstream Oil&Gas:
 Many interconnected, increasingly complex
and rapidly changing workflows
 Exponential growth in the volume of data
 Computational demands increasing by orders of magnitude
 Manage complexity and increase efficiency
 Facilitate collaborative computing and secure access to data
Increase efficiency and accelerate the TOTAL workflow
Data
Acquisition
Visual
Interpretation
Modeling
Automation
SimulationSeismic
Processing
Property
Modeling
Data
Management
Petrophysical
Analysis
Increase Reserves - Capacity scaling, changing workloads
© Hitachi Data Systems 2013
UNIFIED STORAGE FOR UPSTREAM OIL AND
GAS ORGANIZATIONS
 Accelerated exploration with optimized file storage
‒ Highest per-node IOPs for unpredictable I/O
‒ Ideal for mixed workflows requiring performance for
throughput-oriented and also for random data flows
‒ Easy scalability and high availability
‒ Open file system standards:
‒ CIFS, NFS, iSCSI, Lustre, Hadoop
 One storage platform for E&P and
the entire oil and gas enterprise
‒ Single architecture for file and block
‒ Comprehensive data management
across technologies
‒ No compromise of performance versus control
Structured
Unstructured
Technical
Enterprise
Unified
Reduce Cost - Reduced complexity, higher efficiency
© Hitachi Data Systems 2013
THANK YOU

More Related Content

What's hot

Oil and gas big data analytics data Visualization
Oil and gas big data analytics data VisualizationOil and gas big data analytics data Visualization
Oil and gas big data analytics data VisualizationInfobrandz
 
Digital oilfield
Digital oilfield Digital oilfield
Digital oilfield Cimation
 
Four Steps Toward a Digital Oilfield Future
Four Steps Toward a Digital Oilfield FutureFour Steps Toward a Digital Oilfield Future
Four Steps Toward a Digital Oilfield FutureGE Canada
 
IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...
IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...
IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...DataWorks Summit
 
AI: From Data to ROI
AI: From Data to ROIAI: From Data to ROI
AI: From Data to ROICognizant
 
OilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperOilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperAndre Vieira
 
Logical Data Fabric: Architectural Components
Logical Data Fabric: Architectural ComponentsLogical Data Fabric: Architectural Components
Logical Data Fabric: Architectural ComponentsDenodo
 
Active Governance Across the Delta Lake with Alation
Active Governance Across the Delta Lake with AlationActive Governance Across the Delta Lake with Alation
Active Governance Across the Delta Lake with AlationDatabricks
 
Accenture-Ready-Set-Scale - AI.pdf
Accenture-Ready-Set-Scale - AI.pdfAccenture-Ready-Set-Scale - AI.pdf
Accenture-Ready-Set-Scale - AI.pdfShaneFernandes24
 
The Big Value Shift: How ripple effects are impacting every business
The Big Value Shift: How ripple effects are impacting every businessThe Big Value Shift: How ripple effects are impacting every business
The Big Value Shift: How ripple effects are impacting every businessaccenture
 
Introduction into Oil and Gas Industry. OIL: Part 1
Introduction into Oil and Gas Industry. OIL: Part 1Introduction into Oil and Gas Industry. OIL: Part 1
Introduction into Oil and Gas Industry. OIL: Part 1Fidan Aliyeva
 
Digital transformation, innovation, & inspiration in the mining industry
Digital transformation, innovation, & inspiration in the mining industryDigital transformation, innovation, & inspiration in the mining industry
Digital transformation, innovation, & inspiration in the mining industryJNStarwood
 
The Shifting Economics of Global Manufacturing
The Shifting Economics of Global ManufacturingThe Shifting Economics of Global Manufacturing
The Shifting Economics of Global ManufacturingBoston Consulting Group
 
Digital Transformation Strategy & Framework | By ex-McKinsey
Digital Transformation Strategy & Framework | By ex-McKinseyDigital Transformation Strategy & Framework | By ex-McKinsey
Digital Transformation Strategy & Framework | By ex-McKinseyAurelien Domont, MBA
 
MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...
MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...
MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...McKinsey & Company
 
Capability Design & Data Sourcing
Capability Design & Data SourcingCapability Design & Data Sourcing
Capability Design & Data Sourcingaccenture
 

What's hot (20)

Oil and gas big data analytics data Visualization
Oil and gas big data analytics data VisualizationOil and gas big data analytics data Visualization
Oil and gas big data analytics data Visualization
 
Digital oilfield
Digital oilfield Digital oilfield
Digital oilfield
 
Four Steps Toward a Digital Oilfield Future
Four Steps Toward a Digital Oilfield FutureFour Steps Toward a Digital Oilfield Future
Four Steps Toward a Digital Oilfield Future
 
IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...
IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...
IIoT + Predictive Analytics: Solving for Disruption in Oil & Gas and Energy &...
 
AI: From Data to ROI
AI: From Data to ROIAI: From Data to ROI
AI: From Data to ROI
 
OilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperOilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaper
 
Sprinting to Value in Industry 4.0
Sprinting to Value in Industry 4.0Sprinting to Value in Industry 4.0
Sprinting to Value in Industry 4.0
 
Logical Data Fabric: Architectural Components
Logical Data Fabric: Architectural ComponentsLogical Data Fabric: Architectural Components
Logical Data Fabric: Architectural Components
 
Introduction to Oil and Gas Industry - Upstream Midstream Downstream
Introduction to Oil and Gas Industry - Upstream Midstream DownstreamIntroduction to Oil and Gas Industry - Upstream Midstream Downstream
Introduction to Oil and Gas Industry - Upstream Midstream Downstream
 
Active Governance Across the Delta Lake with Alation
Active Governance Across the Delta Lake with AlationActive Governance Across the Delta Lake with Alation
Active Governance Across the Delta Lake with Alation
 
Accenture-Ready-Set-Scale - AI.pdf
Accenture-Ready-Set-Scale - AI.pdfAccenture-Ready-Set-Scale - AI.pdf
Accenture-Ready-Set-Scale - AI.pdf
 
Paris ML meetup
Paris ML meetupParis ML meetup
Paris ML meetup
 
The Big Value Shift: How ripple effects are impacting every business
The Big Value Shift: How ripple effects are impacting every businessThe Big Value Shift: How ripple effects are impacting every business
The Big Value Shift: How ripple effects are impacting every business
 
Introduction into Oil and Gas Industry. OIL: Part 1
Introduction into Oil and Gas Industry. OIL: Part 1Introduction into Oil and Gas Industry. OIL: Part 1
Introduction into Oil and Gas Industry. OIL: Part 1
 
Digital transformation, innovation, & inspiration in the mining industry
Digital transformation, innovation, & inspiration in the mining industryDigital transformation, innovation, & inspiration in the mining industry
Digital transformation, innovation, & inspiration in the mining industry
 
The Shifting Economics of Global Manufacturing
The Shifting Economics of Global ManufacturingThe Shifting Economics of Global Manufacturing
The Shifting Economics of Global Manufacturing
 
Digital Transformation Strategy & Framework | By ex-McKinsey
Digital Transformation Strategy & Framework | By ex-McKinseyDigital Transformation Strategy & Framework | By ex-McKinsey
Digital Transformation Strategy & Framework | By ex-McKinsey
 
MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...
MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...
MGI: From poverty to empowerment: India’s imperative for jobs, growth, and ef...
 
Sustainability's next frontier
Sustainability's next frontierSustainability's next frontier
Sustainability's next frontier
 
Capability Design & Data Sourcing
Capability Design & Data SourcingCapability Design & Data Sourcing
Capability Design & Data Sourcing
 

Viewers also liked

Imagine the Digital Supply Chain
Imagine the Digital Supply ChainImagine the Digital Supply Chain
Imagine the Digital Supply ChainLora Cecere
 
Big Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialBig Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialHitachi Vantara
 
Import - Export Policy of India (EXIM POLICY)
Import - Export Policy of  India(EXIM POLICY)Import - Export Policy of  India(EXIM POLICY)
Import - Export Policy of India (EXIM POLICY)Sandip Besra
 
Digital transformation of supply chain
Digital transformation of supply chainDigital transformation of supply chain
Digital transformation of supply chainSandip Besra
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use caseselephantscale
 
Creating a Digital Supply Chain: Monsanto's Journey
Creating a Digital Supply Chain:  Monsanto's JourneyCreating a Digital Supply Chain:  Monsanto's Journey
Creating a Digital Supply Chain: Monsanto's JourneyThe Boeing Center
 
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Lora Cecere
 

Viewers also liked (7)

Imagine the Digital Supply Chain
Imagine the Digital Supply ChainImagine the Digital Supply Chain
Imagine the Digital Supply Chain
 
Big Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialBig Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full Potential
 
Import - Export Policy of India (EXIM POLICY)
Import - Export Policy of  India(EXIM POLICY)Import - Export Policy of  India(EXIM POLICY)
Import - Export Policy of India (EXIM POLICY)
 
Digital transformation of supply chain
Digital transformation of supply chainDigital transformation of supply chain
Digital transformation of supply chain
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use cases
 
Creating a Digital Supply Chain: Monsanto's Journey
Creating a Digital Supply Chain:  Monsanto's JourneyCreating a Digital Supply Chain:  Monsanto's Journey
Creating a Digital Supply Chain: Monsanto's Journey
 
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
 

Similar to Big Data in Oil and Gas

Big Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewBig Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewSivashankar Ganapathy
 
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyGuest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyNishant Gandhi
 
Innovating With Data and Analytics
Innovating With Data and AnalyticsInnovating With Data and Analytics
Innovating With Data and AnalyticsVMware Tanzu
 
Capitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationCapitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationHitachi Vantara
 
The Evolution of Data Architecture
The Evolution of Data ArchitectureThe Evolution of Data Architecture
The Evolution of Data ArchitectureWei-Chiu Chuang
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 IBM Sverige
 
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...DataWorks Summit
 
Aws keynote oil and gas calgary industry day - jon guidroz
Aws keynote oil and gas calgary industry day -  jon guidrozAws keynote oil and gas calgary industry day -  jon guidroz
Aws keynote oil and gas calgary industry day - jon guidrozAmazon Web Services
 
Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Joergen Floes
 
Kaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldKaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldQuang PM
 
Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014KMS Technology
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...mattdenesuk
 
Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big dataDigimark
 
Big Data Techcon 2014
Big Data Techcon 2014Big Data Techcon 2014
Big Data Techcon 2014Samir Lad
 
Pouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryPouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryDataWorks Summit
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life RevolutionCapgemini
 

Similar to Big Data in Oil and Gas (20)

Big Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewBig Data - Applications and Technologies Overview
Big Data - Applications and Technologies Overview
 
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyGuest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
 
The New Age of the Industrial Internet
The New Age of the Industrial InternetThe New Age of the Industrial Internet
The New Age of the Industrial Internet
 
Innovating With Data and Analytics
Innovating With Data and AnalyticsInnovating With Data and Analytics
Innovating With Data and Analytics
 
Capitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationCapitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi Innovation
 
The Evolution of Data Architecture
The Evolution of Data ArchitectureThe Evolution of Data Architecture
The Evolution of Data Architecture
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013
 
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
 
The ABCs of Big Data
The ABCs of Big DataThe ABCs of Big Data
The ABCs of Big Data
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Aws keynote oil and gas calgary industry day - jon guidroz
Aws keynote oil and gas calgary industry day -  jon guidrozAws keynote oil and gas calgary industry day -  jon guidroz
Aws keynote oil and gas calgary industry day - jon guidroz
 
Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012
 
Kaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldKaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the world
 
Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
 
Adam wray 945
Adam wray   945Adam wray   945
Adam wray 945
 
Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big data
 
Big Data Techcon 2014
Big Data Techcon 2014Big Data Techcon 2014
Big Data Techcon 2014
 
Pouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryPouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy Industry
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
 

Recently uploaded

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 

Recently uploaded (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 

Big Data in Oil and Gas

  • 1. 1 BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES BJORN ANDERSSON SOLUTIONS MARKETING DIRECTOR – ENERGY INDUSTRIES
  • 2. 2 DEFINING BIG DATA AND ANALYTICS  Data Volume ‒ Terabytes to Petabytes and beyond  Data Variety ‒ Many sources, structured data and more unstructured data  Data Velocity ‒ Streaming from sensors, generated secondary data  Value ‒ Derived business value ‒ Quicker and more accurate decisions © Hitachi Data Systems 2013
  • 3. 3 BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships…in Real Time and At Scale To manage, govern and analyze 1X 10X 100XOLTP EMAIL DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME © Hitachi Data Systems 2013
  • 4. 4 BIG DATA – THE PROMISE The Hype  Turning data flood into transformative insight  Exploration without preconceived notions The Reality  Big Data application stack is complex  Data is highly fragmented  New skill sets  Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video WebLogs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search FederationMPP MetaData Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? © Hitachi Data Systems 2013
  • 5. BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains • Track/train sensors • Keep trains on schedule • Proactive maintenance • Telemetry from seismic sensors • Time series data • Operational data from sensors • Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange • High-speed index service • 1/100th faster © Hitachi Data Systems 2013
  • 6. 6 #1 INDUSTRY MEGA DRIVER – SIMPLY STATED: WE NEED MORE ENERGY INCREASE PRODUCTION AND KNOWN ENERGY RESERVES Dramatic increase in demand from emerging economies (non-OECD) Discover new reserves now: 75% of today’s oil was discovered before 1980 © ExxonMobil 2012© BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012 © Hitachi Data Systems 2013
  • 7. 7 OIL&GAS REPRESENT THE MAJORITY OF THE ENERGY INDUSTRY  60% of Global Energy demand fulfilled by Oil&Gas ‒ Natural Gas is the fastest growing fuel source ©BP2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 ©ExxonMobil2012 © Hitachi Data Systems 2013
  • 8. 8 MORE BIG DATA  More Volume ‒ New sensor and acquisition technology: Isometrix, WAZ ‒ More data being integrated: Drilling, Production  More Velocity ‒ Real time data from operations, sensors ‒ Streaming vs batch processing  More Variety ‒ Structured, Unstructured, semi-structured ‒ Complexity involving multiple disciplines  Potential Value ‒ Clearer view, better understanding by combining data sources ‒ Capitalizing on opportunities ‒ Lower risk for failures VOLUME, VELOCITY AND VARIETY © Hitachi Data Systems 2013
  • 9. BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety © Hitachi Data Systems 2013
  • 10. • Growing data > 300 MB / Km2 early 90s > 25 GB / km2 in 2006 > Growing… to PBs / km2  Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data  Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB  Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision www.alkorinternational.com VELOCITY – INGEST MORE DATA FASTER © Hitachi Data Systems 2013
  • 11. VOLUME - INSATIABLE APPETITE FOR INFORMATION  Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances  Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source:HenriCalandra,JohnEtgen, ScottMorton–RiceUniversity Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway. © Hitachi Data Systems 2013
  • 12. VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas:  Many interconnected, increasingly complex and rapidly changing workflows  Exponential growth in the volume of data  Computational demands increasing by orders of magnitude  Manage complexity and increase efficiency  Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads © Hitachi Data Systems 2013
  • 13. UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS  Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop  One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency © Hitachi Data Systems 2013