In this presentation from the recent AWS Oil & Gas event in Aberdeen we introduce the AWS cloud, its benefits and some of the organisations that are using AWS today.
We also cover some specific use-case and case-studies in the oil and gas sector.
2. Thank You
for joining us at the
AWS for the Oil & Gas Industry
Aberdeen, November 25, 2014
3. ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud Adoption Strategy
ü AWS Cloud for Oil & Gas
4. There is No Compression Algorithm for
Experience and Operational Reliability
ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
5. 2014
Every day, AWS adds
enough server capacity
to power this $7B
enterprise
2003
$ 7B retail business
7,800 employees
A whole lot of servers
6. AWS Global Infrastructure
GovCloud US West US East South America EU Asia Pacific
US ITAR Region N. California Oregon N. Virginia Sao Paulo Ireland Germany Sydney Tokyo Singapore China
11 regions
28 availability zones
51 edge locations
7. AWS Rapid Pace of Innovation
+48
E lastic Load Balancing
Auto Scaling
Amazon VPC
Amazon RDS
2009
+61
Amazon SNS
AWS Identity & Access Management
Amazon Route 53
2010
+82
Amazon SES
AWS Elastic Beanstalk
AWS CloudFormation
Amazon ElastiCache
AWS Direct Connect
GovCloud
2011
+280
Amazon Elastic Transcoder
AWS OpsWorks
Amazon CloudHSM
Amazon AppStream
Amazon CloudTrail
Amazon WorkSpaces
Amazon Kinesis
2013
+159
AWS Storage Gateway
Amazon Dynamo DB
Amazon CloudSearch
Amazon SWF
Amazon Glacier
Amazon Redshift
AWS Data Pipeline
2012
Since inception AWS has:
• Released 1000+ new services and features
• Introduced over 35 major new services
• Announced 45 price reductions
+24
Amazon EBS
Amazon CloudFront
2008
+450
Amazon Aurora
Amazon
Containers
Amazon
CodeDeploy
Amazon
CodePipeline
Amazon
CodeCommit
Amazon KMS
Amazon Cognito
Amazon Mobile
Analytics
Amazon Zocalo
2014
9. 2014 Magic Quadrant for "
Cloud Infrastructure as a Service
Gartner “Magic Quadrant for Cloud Infrastructure as a Service,” Lydia Leong, Douglas Toombs,
Bob Gill, Gregor Petri, Tiny Haynes, May 28, 2014. This Magic Quadrant graphic was published
by Gartner, Inc. as part of a larger research note and should be evaluated in the context of the
entire report. The Gartner report is available at http://aws.amazon.com/resources/analyst-reports/.
Gartner does not endorse any vendor, product or service depicted in its research
publications, and does not advise technology users to select only those vendors with the highest
ratings. Gartner research publications consist of the opinions of Gartner's research organization
and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or
implied, with respect to this research, including any warranties of merchantability or fitness for a
particular purpose.
14. ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
WHY are Customers using AWS?
15. A New Resource Model
Acquire Resources On Demand
Release Resources When No Longer Needed
Pay For What You Use
Turn Fixed Costs Into Variable
Leverage Other’s Core Competencies
17. Enterprises Are Accelerating Time to Market with AWS…
Credit-risk simulation
application
Development & test
environments
Migrated 500 web
properties to AWS in
5 months
Clinical trial
simulations
Decreased "
the average
processing time
from 23 hours to
20 minutes
Development and
test seats access
time reduces from a
week to 1 day
New product
websites from 2
weeks to 2 days
Simulations time
reduced from 60
hours to 1.2 hours
18. Enterprises Are Accelerating Time to Market with AWS…
Credit-risk simulation
application
Development & test
environments
Migrated 500 web
properties to AWS in
5 months
Clinical trial
simulations
Decreased "
the average
processing time
from 23 hours to
20 minutes
Development and
test seats access
time reduces from a
week to 1 day
New product
websites from 2
weeks to 2 days
Simulations time
reduced from 60
hours to 1.2 hours
19. .. And Transforming to leverage the Cloud
Full-In Transformation
Regulatory
Compliance
Improving Customer
Experience
New Mobile
Payment platform
Migrating 2000
Apps to AWS in
18 Months
Running the EU
Solvency Test with
88% savings on
infrastructure needs
Big Data initiative to
extract value from
anonymized CCs
transactions
“AWS was the clear choice in
terms of security and PCI DSS
Level 1 compliance compared to
an on-premises or co-location
datacenter solution”
20. “Based on our experience, I believe that we can be even more secure in
the AWS cloud than in our own data centers.”
-Tom Soderstrom, CTO, NASA JPL
ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
22. AWS Private Compute and Storage Capabilities
Choose the right level of compute isolation for every workload
Fine grained access roles and
groups
Physical isolation
Identity & Access Management
(IAM)
Dedicated Instances
Amazon S3
Amazon EBS
Encrypted object
storage
Encrypted block
storage
23. AWS Governance
Fine-grained access control over data and resources
Control over regional
replication
Policies, resource level
permissions, temporary
credentials
In-depth audits
Geographic data locality
Fine-grained
access control
Amazon AWS CloudTrail
CloudHSM
Private encryption key
management
25. Security
is
a
shared
responsibility
between
AWS
and
our
customers
PlaEorm,
Applica)ons,
Iden)ty
&
Access
Management
Opera)ng
System,
Network
&
Firewall
Configura)on
AWS
Founda+on
Services
Compute
Storage
Database
Networking
AWS
Global
Infrastructure
Availability
Zones
Regions
Edge
Loca+ons
Client-‐side
Data
Encryp)on
Server-‐side
Data
Encryp)on
Network
Traffic
Protec)on
Customer
content
Customers are
responsible for
their security IN
the Cloud
AWS is
responsible for
the security OF
the Cloud
26. Over 35 Major Services introduced in 8 Years
ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
28. Applications
Platform Services
Foundation Services
APIs
Tools and Libraries
Regions
Availability Zones
CDN and Points of Presence
29. Applications
Platform Services
APIs
Tools and Libraries
Storage
(Object, Block and Archive)
Security & Networking
Access Control
Compute
(VMs, Auto-scaling and Load Balancing)
Regions
Availability Zones
CDN and Points of Presence
30. Applications
APIs
Tools and Libraries
Databases
Analytics
App Services
Deployment & Management
Storage
(Object, Block and Archive)
Mobile Services
Security & Networking
Access Control
Compute
(VMs, Auto-scaling and Load Balancing)
Regions
Availability Zones
CDN and Points of Presence
31. Applications
APIs
Tools and Libraries
Databases
Analytics
App Services
Deployment & Management
Storage
(Object, Block and Archive)
Mobile Services
Security & Networking
Access Control
Compute
(VMs, Auto-scaling and Load Balancing)
Regions
Availability Zones
CDN and Points of Presence
Relational
NoSQL
Caching
Hadoop
Real-time
Data
warehouse
Queuing
Orchestration
App streaming
Transcoding
Email
Search
Containers
Dev/ops Tools
Resource
Templates
Identity
Sync
Mobile
Analytics
Notifications
Data
Workflows
Usage
Tracking
Monitoring and
Logs
32. APIs
Databases
Analytics
App Services
Deployment & Management
Storage
(Object, Block and Archive)
Mobile Services
Security & Networking
Access Control
Compute
(VMs, Auto-scaling and Load Balancing)
Regions
Availability Zones
CDN and Points of Presence
Relational
NoSQL
Caching
Hadoop
Real-time
Data
warehouse
Queuing
Orchestration
App streaming
Transcoding
Email
Search
Containers
Dev/ops Tools
Resource
Templates
Identity
Sync
Mobile
Analytics
Notifications
Data
Workflows
Usage
Tracking
Monitoring and
Logs
Virtual Desktops
Collaboration and Sharing
Human
Interaction
Web Console
Command Line
Libraries,
SDK’s
33. Create Agility; Manage Uncertainty; Learn and Pilo
t
Fail Fast and Fail Small
ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
34. Technology adoption goes in stages
Experimentation
Limited Use
Wide-spread Use
Corporate Standard
36. Technology adoption goes in stages
BenefitsUse Cases
Dev & Test
True
Experiment more, with no CapEx
Resource projects instantly
Eliminate idle servers
Maintain consistency across teams
Technology evaluation
Prototyping
Agile Development
In some
Enterprises,
accounts for
more than
50% of the
overall
infrastructure
Production
Mission Critical
All-in
37. • Reduced the cost of development and testing
environments by 75%
• Are creating new test and development
environments in hours rather than weeks
• Scale to support a 2000% increase in web
requests
ME Bank
38. Technology adoption goes in stages
Dev & Test
True
Production
Mission Critical
All-in
Benefits
Develop applications faster
Augment existing data center resources
Multiple data centers for high availability
Auto-scale up and down with demand
Hardware upgrades with no downtime
Easy global deployment
Mobile
apps
Scientific
computing
Public or private web
apps
Big data apps
39. Built a common platform for content delivery
Migrated 500 existing sites in less than 5 months
Easily copy campaigns across regions
Campaign launch went from 2 weeks to 2 days
If a brand manager has an idea, she can
implement it before the competition.
Sreenivas Yalamanchili
Digital Marketing Services (DMS) Global Technical Manager
Site deployment time
On-premises: 2 weeks
AWS: 2 days
AWS enabling digital innovation
41. Enterprises Are Accelerating Time to Market with AWS…
87,000 compute cores
allowed Novartis to
conduct 39 years of
computational chemistry in
9 hours
42. SunPower moved a core application to AWS in 3 weeks..
“The way AWS is set up is very
intuitive. If we’d used a traditional
data center, it would have taken
us three months of planning and
deployment—but with AWS, we
were finished in 3 weeks.”
“Spinning up the resources we needed to get the
InfoLease app installed and get high availability in place
was very straightforward.”
43. Technology adoption goes in stages
Dev & Test
True
Production
Mission Critical
All-in
Benefits
Virtual elimination of IT CapEx
Flexibility in resource assignments
Time to market
Zero hardware maintenance
Multiple availability zone deployment
44. Leveraging Cloud technology
to boost Oil & Gas operations
ü Introduction to AWS
ü Benefits of using AWS Cloud
ü Security and Compliance
ü AWS platform
ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
45. IDC Energy Insights
Top 10 Predictions for Worldwide Oil & Gas in 2014:
• With the change in the global energy supply chain, oil and gas companies will put more focus on
resiliency
• IT security will remain the CIO's top concern, with a growing focus on process control security
• CIOs will concentrate on innovation, analytics and sourcing to keep the attention of business
• Drilling risk mitigation and production optimization will drive further adoption of Big Data and analytics,
new models for machine-to-machine connectivity and field mobility
• Safety and accountability will shape the relationship between owners and service companies
• The concept of smart pipeline will start to gain significant momentum in most regional markets
• Operational design moves to 3D
• Asset integrity will take the spotlight in asset life-cycle management
• Cloud will see an uptick in adoption, mainly for quick deployment and flexibility
• IT spending in oil and gas will increase from $37.6 billion USD in 2011 to $49.4 billion in 2016
46. IDC Energy Insights
Top 10 Predictions for Worldwide Oil & Gas in 2014:
• With the change in the global energy supply chain, oil and gas companies will put more focus on
resiliency
• IT security will remain the CIO's top concern, with a growing focus on process control security
• CIOs will concentrate on innovation, analytics and sourcing to keep the attention of business
• Drilling risk mitigation and production optimization will drive further adoption of Big Data and analytics,
new models for machine-to-machine connectivity and field mobility
• Safety and accountability will shape the relationship between owners and service companies
• The concept of smart pipeline will start to gain significant momentum in most regional markets
• Operational design moves to 3D
• Asset integrity will take the spotlight in asset life-cycle management
• Cloud will see an uptick in adoption, mainly for quick deployment and flexibility
• IT spending in oil and gas will increase from $37.6 billion USD in 2011 to $49.4 billion in 2016
47. Overall O&G Value Chain
Upstream (oil & gas) Midstream Downstream
Exploration Development Production
Storage &
Transportation Refine
Process Transportation
Corporate support functions
On-shore
Off-shore (Deep water, Shallow Water )
Trading
Distribution Marketing
Marketing (gas only)
Decommissioning Recycling
48. Overall O&G Value Chain
Upstream (oil & gas) Midstream Downstream
Exploration Development Production
Storage &
Transportation Refine
Process Transportation
Distribution Marketing
Marketing (gas only)
• 3d/4d seismic data processing,
visualization
• Connected/ Digital oil field/ M2M
• Data streaming and storage
• Smart metering
• Customer engagement
• M2M & Internet of Things
• Energy trading
Cloud benefits
opportunities
49. Exploration Development Production
Sub-surface Geology & Geophysics Sub-surface & Surface development Operations & maintenance management
Computational platforms:
§ High Performance Compute/
Big Data
§ Real-time data streaming &
visualization
§ Sub-surface Data Storage
Collaboration platforms:
§ Mobile collaboration
§ Regional and remote re-deployment,
workspaces
Workflow platforms:
§ ERP/ SCM support
§ BI/ DW support
Upstream Oil & Gas use cases
50. Seismic data processing cycle
Seismic
Data
Processing
Visualiza)on
Acquisi)on
Processing
raw data
Zone of
interest
Compute real
attributes
Raw
data
Central visualization
rooms
Local Users
Remote Users
Processed
data
Recalibrate
Model real attributes
Petrophysically assess
the reservoir
Time-lapse 3D (reservoir monitoring or 4D)
51. Seismic data processing/ simulations
- Scalable, High Performance compute
- Large amount of data acquisition & transfer
- Security of highly sensitive data
- High availability and throughput
AWS cloud accelerates HPC capabilities, providing
instant scalability and elasticity to analyze massive
amounts of scientific data:
• Optimized tools to move large data stored on local
data center
• Performance-optimized Hadoop framework
• CPU intensive instances + placement groups
• Low latency & complete control over virtual
networking environment
52. Reservoir management
- Data collection of multiple sub-surface sensors
- Predictive analytics
- High availability in remote location
- High security level
AWS allows you to increase the speed of research by
running high performance computing in the cloud and to
reduce costs by providing Cluster Compute or Cluster
GPU servers on-demand without large capital
investments:
• Cluster GPU Instances for 3d processing and
visualization rooms
• AppStream for remote offices and on-site 3d
visualization
53. Production optimizations/ digital oil field
- Data collection of multiple surface & sub-surface
sensors
- Prediction to prevent failures and breakdowns
- All components integrate and communicate
- High availability in remote locations
The AWS cloud provides building blocks to create
innovative new applications:
• Big M2M – the convergence of M2M with Big
Data, we provide Big Data services such as EMR
(Hadoop on AWS), S3 and DynamoDB (NoSQL)
• AWS Marketplace provides a software
marketplace for the AWS cloud where clients can
buy third party M2M software platforms
54. ResAssure 1mn simulation in 1 day on AWS cloud
“ • The company demonstrated ResAssure's
Stochastic Simulation is able to
achieve overnight, what until
now would take reservoir
engineers years using
conventional simulation
technology.
Dr Andrew Wadsley
Chief Technology Office
”
capability, by carrying out 1 million realizations
in 1 day for a real field Cartesian model of:
• 200,000 grid cells against
• 28 sensitivity parameters using
• 40 standard processing cores on AWS
cloud
Sysdrill has been fully tested and validated for use on AWS
Source:
hQp://www.stochas)csimula)on.com/resassure/resassure-‐1-‐million-‐reservoir-‐simula)on-‐of-‐model-‐realisa)ons
55. Paradigm offers Sysdrill on Amazon Web Services cloud
“ • Paradigm made the available its Sysdrill well
The rise of cloud computing is
one of the most important
macro-trends in IT
infrastructure… simply put,
customers should be able to
focus more on the application
than on the infrastructure
Arshad Matin
”
President and CEO of Paradigm
planning and drilling engineering solution on
AWS cloud.
• Sysdrill enhances well planning accuracy and
reduces drilling risk and uncertainty.
• Paradigm provides the Deployed Instance
option which installs and fully configures Sysdrill
for immediate use by customers
Sysdrill has been fully tested and validated for use on AWS
Source:
hQp://www.offshore-‐mag.com/ar)cles/2014/02/paradigm-‐offers-‐sysdrill-‐on-‐amazon-‐web-‐services-‐cloud.html
56. Maersk Oil Tests Reservoir Simulations On AWS
“ We wanted to prove that it can
• Maersk Oil simulated an Eclipse cluster in the
be done in a virtual
environment and in a public
cloud environment and with
performance comparable to
what you could get internally.
Tom O’Reilly
Head of server systems
”
cloud to run reservoir simulations
• It also went one step further and simulated a
remote office from that cloud without any of its
own infrastructure as the four offices it operates
near its fields
Source:
hQp://www.enterprisetech.com/2014/04/10/maersk-‐oil-‐tests-‐reservoir-‐simula)ons-‐aws/
57. Hess Uses AWS to Streamline Data Center Migration
• When Hess divested its Energy Marketing
division, the IT department had to create
a separate environment that could be
handed off to a buyer
• Working with APN partner, Nimbo, Hess
packaged and moved the infrastructure,
including 300 servers and almost 500 TB
of data, to the AWS Cloud
• Hess met the six-month divestiture
deadline and transferred the business to
the buyer in a 30-minute meeting
“The flexibility and scale of
AWS enabled us to rapidly
migrate a fully functional
infrastructure for our divested
business in just 6 months.”
Jim McDonald
Lead Architect, Hess
”
“
Hess Corporation is a leading global independent
energy company
58. British Gas brings central heating control to smartphones with AWS
“ • British Gas started a project called Hive, part of its
We launched Hive towards the
end of 2013 and today we
have 75,000 customers… The
speed at which we delivered
Hive is directly related to our
decision to use AWS cloud
Seb Chakraborty
Head of Web and Platform Design
”
Connected Homes Strategy.
• Hive Active Heating allows users to control heating
and hot water remotely from mobile, laptop or
smartphones.
• Such a flexibility allows users to control heating
exactly how they need it and save up to £150 a year
on utility bills
British Gas uses AWS cloud for scaling the
project and to deliver API toolsets around it.
59. Oil & Gas area of cloud benefit
Exploration for new oil
Reservoir management
Risk management &
compliance
Cost optimization
Next generation energy
Extensive geophysical data, comprehensive analytics, faster workflows, and
access to specialized and often scarce expertise
Significantly faster data acquisition, processing, real-time simulation and
optimization of oil & gas reservoir to increase production and reserves
Secure and available data, audit trails and records management for safety,
regulatory and risk management purposes.
IAAS and PAAS’s pay-per-use model will allow companies to respond to
intensifying global competition, constant regulatory changes and cyclical
production to optimize costs, increase flexibility and scalability
Higher pace of innovation of what and how we consume energy – e.g. engaging
customers and suppliers, finding new energy sources, optimising consumptions mix