SlideShare a Scribd company logo
1 of 21
Running Databases in Containers.
How to Overcome the Challenges of Data
Prepared for
Frank Stienhans
CTO
Ocean9
BARE METAL
Subjective Perspective
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 2
Evolution of Enterprise IT
1.More Choices
2.Faster Delivery
3.Higher Density
4.Increased Control
VIRTUALIZATION
CLOUD
CONTAINERS
What is it
• Standardized Application Virtualization
• Application defined as Image, without the OS Kernel
• CPU, RAM, Network, Mount & Process Isolation
• Begin: ~ 2006 @ Google
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 3
Containers
Value
1. Enable quick provisioning and scaling
2. Enable Higher Resource Density
3. Increased Control over workload Placement and Usage
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 4
Containers
June 10, 2017 5
Adoption Phases
1.
Frontends
2.
Applications
3.
Databases
FRONTEND APPLICATION DATABASE
RISK
Blast Radius Single User Many Users All Users
Recovery Minutes Minutes Hours - Days
BENEFIT Cost Savings $ $$ $$$
© Copyright, 2017, Ocean9, Inc., All Rights Reserved
Heavy Containers
“Heavy Containers”
Containers with a lot of State
June 10, 2017 6
Definition
© Copyright, 2017, Ocean9, Inc., All Rights Reserved
Heavy Containers
1. Local State – Focus Today
2. Long Life
3. Highest Security
June 10, 2017 7
Challenges
Available Resources in
Virtual Machine Instance Type
Traditional Cloud Sizing
June 10, 2017 8
Databases before Containers
• DB Sizing: Function of …
– RAM
– CPU
– Network
– I/O
• DB Utilization
– 5% average utilization is normal
– Hence, 95% waste
DB Resources
Required
for a predicted Peek
CPU
RAM
DB Resources
utilized on Average
© Copyright, 2017, Ocean9, Inc., All Rights Reserved
Cloud Native Sizing
June 10, 2017 9
Database with Container
• Fill the DB Host with Apps
(Stateless Containers)
• Grow your DB container as if
those do not exist.
• Keep some resource reserve as
a buffer
Available Resources in
Virtual Machine Instance Type
DB Resources
utilized on Average
App App App App App App
App App App App App App
App App App App App App
CPU
RAM
© Copyright, 2017, Ocean9, Inc., All Rights Reserved
Triple Site Database Setup in one GEO Region
June 10, 2017 10
Cloud Native Maximum High Availability
Available Resources in
Virtual Machine Instance Type
DB Site C
Available Resources in
Virtual Machine Instance Type
DB Site A
App App App App App App
App App App App App App
App App App App App App
Sync DB
Replication
Available Resources in
Virtual Machine Instance Type
DB Site B
App App App App App App
App App App App App App
App App App App App App
Sync DB
Replication
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 11
Network Filesystems for HPC Persistence
DB Host
::
X1.32xlarge
::
Amazon EC2
Network 20G
Your Apps
I/O ~ 10G
AWS
EBS
Ephemeral
Locally Attached
SSD
DB Replication
Data Integration
Network / Cluster
File System for
Tier 1 I/O
Max Max
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 12
Amazon EC2 R4 Family
x x x x
x xx x
x x x x
x x x x
16 X-large
• RAM : 488 GB
• CPU : 64 vCPUs
• Network : 20 Gbps
• EBS I/O :~ 10 Gbps
X-large
• RAM : 30 GB RAM
• CPU : 4 vCPUs
• Network : ~ 1.25 Gbps
• EBS I/O : ~ 0.60 Gbps
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 13
Azure, same answer
DB Host
::
Azure
Virtual Machine
Network 25G
Your Apps
I/O ~ 10G
Azure
Premium
Disks
“Resource Disk”
Locally Attached
SSD
DB Replication
Data Integration
Network / Cluster
File System for
Tier 1 I/O
Max Max
Heavy Containers
1. Intelligent Placement (4D : CPU, RAM, Net, I/O)
2. Real-time Monitoring
3. Data Agility and Data Performance (usually XOR)
4. Density
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 14
Needs
Heavy Containers
1. Running Virtual Machine
2. No Storage
Linux Bash
>> ray docker recover hana2/206
Example uses SUSE Linux 12 SP2 and SAP HANA SPS 12
Demo
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 16
Output:
SAP HANA
System
with
1.2 billion
rows
Storage
Docker Image
Docker Container
One Click Away
June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 17
Inbuilt Automated Fallback
HANA
Production
HANA
Production
Container Virtual Machine
Backup & Recovery
OR
Synchronous
DB Replication
Born in the Cloud SAP-as-a-Service
June 10, 2017 © Copyright, 2017, Ocean9, Inc., All Rights Reserved 18
The Ocean9 Solution
Enterprise Class
• High performance
• High availability
• Strict security
PLUS
• Cloud native capabilities
• Database containers
Ocean9 Intelligent Platform
Database-as-a-Service Business Apps-as-a-Service
B1on
Constantly Growing
June 10, 2017 © Copyright, 2017, Ocean9, Inc., All Rights Reserved 19
Partner Ecosystem
Please Meet Us at our Booth #234
June 10, 2017 © Copyright, 2017, Ocean9, Inc., All Rights Reserved 20
Thank You
Attend our Sessions
• Running Databases in Containers. How
to Overcome the Challenges
Frank Stienhans, CTO Ocean9
Wed, June 7th, 8:30 – 9:05 am
• The “known unknown" of Big Data in IoT
Swen Conrad, CEO Ocean9
Wed, June 7th, 5:00 – 5:35 am
Booth #234
Visit us!
Try Ocean9
Born-in-the-Cloud
solutions for SAP
Thank you
6/10/2017 21
Frank Stienhans
frank@ocean9.io

More Related Content

What's hot

Orchestrate a Data Symphony
Orchestrate a Data SymphonyOrchestrate a Data Symphony
Orchestrate a Data SymphonyAlluxio, Inc.
 
Real World Modern Development Use Cases with RackHD and Adobe
Real World Modern Development Use Cases with RackHD and AdobeReal World Modern Development Use Cases with RackHD and Adobe
Real World Modern Development Use Cases with RackHD and AdobeTimothy Gelter
 
The Power of DataOps for Cloud and Digital Transformation
The Power of DataOps for Cloud and Digital Transformation The Power of DataOps for Cloud and Digital Transformation
The Power of DataOps for Cloud and Digital Transformation Delphix
 
Presto + Alluxio on steroids a romantic drama on Production with happy end
Presto + Alluxio on steroids a romantic drama on Production with happy endPresto + Alluxio on steroids a romantic drama on Production with happy end
Presto + Alluxio on steroids a romantic drama on Production with happy endAlluxio, Inc.
 
Webinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseWebinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseStorage Switzerland
 
Webinar: Multi-Cloud Monitoring
Webinar: Multi-Cloud MonitoringWebinar: Multi-Cloud Monitoring
Webinar: Multi-Cloud MonitoringInfluxData
 
Storage for big-data by Joshua Robinson
Storage for big-data by Joshua RobinsonStorage for big-data by Joshua Robinson
Storage for big-data by Joshua RobinsonData Con LA
 
Achieving compute and storage independence for data-driven workloads
Achieving compute and storage independence for data-driven workloadsAchieving compute and storage independence for data-driven workloads
Achieving compute and storage independence for data-driven workloadsAlluxio, Inc.
 
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data StoresPresto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data StoresAlluxio, Inc.
 
Cornami Accelerates Performance on SPARK: Spark Summit East talk by Paul Master
Cornami Accelerates Performance on SPARK: Spark Summit East talk by Paul MasterCornami Accelerates Performance on SPARK: Spark Summit East talk by Paul Master
Cornami Accelerates Performance on SPARK: Spark Summit East talk by Paul MasterSpark Summit
 
There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?Aerospike, Inc.
 
Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?
Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?
Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?Storage Switzerland
 
Webinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will Win
Webinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will WinWebinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will Win
Webinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will WinStorage Switzerland
 
Iceberg + Alluxio for Fast Data Analytics
Iceberg + Alluxio for Fast Data AnalyticsIceberg + Alluxio for Fast Data Analytics
Iceberg + Alluxio for Fast Data AnalyticsAlluxio, Inc.
 
Reducing large S3 API costs using Alluxio at Datasapiens
Reducing large S3 API costs using Alluxio at Datasapiens Reducing large S3 API costs using Alluxio at Datasapiens
Reducing large S3 API costs using Alluxio at Datasapiens Alluxio, Inc.
 
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stackAccelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stackAlluxio, Inc.
 
How Element 84 Raises the Bar on Streaming Satellite Data
How Element 84 Raises the Bar on Streaming Satellite DataHow Element 84 Raises the Bar on Streaming Satellite Data
How Element 84 Raises the Bar on Streaming Satellite DataAmazon Web Services
 
Alluxio Architecture and Performance
Alluxio Architecture and PerformanceAlluxio Architecture and Performance
Alluxio Architecture and PerformanceAlluxio, Inc.
 
Alluxio 2.0 Deep Dive – Simplifying data access for cloud workloads
Alluxio 2.0 Deep Dive – Simplifying data access for cloud workloadsAlluxio 2.0 Deep Dive – Simplifying data access for cloud workloads
Alluxio 2.0 Deep Dive – Simplifying data access for cloud workloadsAlluxio, Inc.
 

What's hot (20)

Orchestrate a Data Symphony
Orchestrate a Data SymphonyOrchestrate a Data Symphony
Orchestrate a Data Symphony
 
Real World Modern Development Use Cases with RackHD and Adobe
Real World Modern Development Use Cases with RackHD and AdobeReal World Modern Development Use Cases with RackHD and Adobe
Real World Modern Development Use Cases with RackHD and Adobe
 
The Power of DataOps for Cloud and Digital Transformation
The Power of DataOps for Cloud and Digital Transformation The Power of DataOps for Cloud and Digital Transformation
The Power of DataOps for Cloud and Digital Transformation
 
Presto + Alluxio on steroids a romantic drama on Production with happy end
Presto + Alluxio on steroids a romantic drama on Production with happy endPresto + Alluxio on steroids a romantic drama on Production with happy end
Presto + Alluxio on steroids a romantic drama on Production with happy end
 
Webinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseWebinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the Enterprise
 
Webinar: Multi-Cloud Monitoring
Webinar: Multi-Cloud MonitoringWebinar: Multi-Cloud Monitoring
Webinar: Multi-Cloud Monitoring
 
Storage for big-data by Joshua Robinson
Storage for big-data by Joshua RobinsonStorage for big-data by Joshua Robinson
Storage for big-data by Joshua Robinson
 
Achieving compute and storage independence for data-driven workloads
Achieving compute and storage independence for data-driven workloadsAchieving compute and storage independence for data-driven workloads
Achieving compute and storage independence for data-driven workloads
 
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data StoresPresto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
 
Cornami Accelerates Performance on SPARK: Spark Summit East talk by Paul Master
Cornami Accelerates Performance on SPARK: Spark Summit East talk by Paul MasterCornami Accelerates Performance on SPARK: Spark Summit East talk by Paul Master
Cornami Accelerates Performance on SPARK: Spark Summit East talk by Paul Master
 
There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?
 
Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?
Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?
Webinar: Cloud Archiving – Amazon Glacier, Microsoft Azure or Something Else?
 
Elastic Data Warehousing
Elastic Data WarehousingElastic Data Warehousing
Elastic Data Warehousing
 
Webinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will Win
Webinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will WinWebinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will Win
Webinar: NAS vs. Object Storage: 10 Reasons Why Object Storage Will Win
 
Iceberg + Alluxio for Fast Data Analytics
Iceberg + Alluxio for Fast Data AnalyticsIceberg + Alluxio for Fast Data Analytics
Iceberg + Alluxio for Fast Data Analytics
 
Reducing large S3 API costs using Alluxio at Datasapiens
Reducing large S3 API costs using Alluxio at Datasapiens Reducing large S3 API costs using Alluxio at Datasapiens
Reducing large S3 API costs using Alluxio at Datasapiens
 
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stackAccelerating analytics in the cloud with the Starburst Presto + Alluxio stack
Accelerating analytics in the cloud with the Starburst Presto + Alluxio stack
 
How Element 84 Raises the Bar on Streaming Satellite Data
How Element 84 Raises the Bar on Streaming Satellite DataHow Element 84 Raises the Bar on Streaming Satellite Data
How Element 84 Raises the Bar on Streaming Satellite Data
 
Alluxio Architecture and Performance
Alluxio Architecture and PerformanceAlluxio Architecture and Performance
Alluxio Architecture and Performance
 
Alluxio 2.0 Deep Dive – Simplifying data access for cloud workloads
Alluxio 2.0 Deep Dive – Simplifying data access for cloud workloadsAlluxio 2.0 Deep Dive – Simplifying data access for cloud workloads
Alluxio 2.0 Deep Dive – Simplifying data access for cloud workloads
 

Similar to Running Databases in Containers Overcome Challenges

Aem asset optimizations & best practices
Aem asset optimizations & best practicesAem asset optimizations & best practices
Aem asset optimizations & best practicesKanika Gera
 
Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...
Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...
Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...Flink Forward
 
Flink forward sf 17
Flink forward sf 17Flink forward sf 17
Flink forward sf 17Ravi Yadav
 
Flink Forward San Francisco 2017 - Flink meet DC/OS
Flink Forward San Francisco 2017 - Flink meet DC/OSFlink Forward San Francisco 2017 - Flink meet DC/OS
Flink Forward San Francisco 2017 - Flink meet DC/OSpleia2
 
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...Amazon Web Services
 
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...NETWAYS
 
Amazon Elastic File System (EFS) for File Storage
Amazon Elastic File System (EFS) for File StorageAmazon Elastic File System (EFS) for File Storage
Amazon Elastic File System (EFS) for File StorageAmazon Web Services
 
DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of KubernetesDevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of KubernetesDevOps.com
 
STG206_Big Data Data Lakes and Data Oceans
STG206_Big Data Data Lakes and Data OceansSTG206_Big Data Data Lakes and Data Oceans
STG206_Big Data Data Lakes and Data OceansAmazon Web Services
 
Alluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACKAlluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACKAlluxio, Inc.
 
DevOps in Age of Kubernetes
DevOps in Age of KubernetesDevOps in Age of Kubernetes
DevOps in Age of KubernetesMesosphere Inc.
 
A Brave new object store world
A Brave new object store worldA Brave new object store world
A Brave new object store worldEffi Ofer
 
Using DC/OS for Continuous Delivery - DevPulseCon 2017
Using DC/OS for Continuous Delivery - DevPulseCon 2017Using DC/OS for Continuous Delivery - DevPulseCon 2017
Using DC/OS for Continuous Delivery - DevPulseCon 2017pleia2
 
STG316_Optimizing Storage for Big Data Workloads
STG316_Optimizing Storage for Big Data WorkloadsSTG316_Optimizing Storage for Big Data Workloads
STG316_Optimizing Storage for Big Data WorkloadsAmazon Web Services
 
SMACK stack and beyond
SMACK stack and beyondSMACK stack and beyond
SMACK stack and beyondMatt Jarvis
 
Spark Pipelines in the Cloud with Alluxio by Bin Fan
Spark Pipelines in the Cloud with Alluxio by Bin FanSpark Pipelines in the Cloud with Alluxio by Bin Fan
Spark Pipelines in the Cloud with Alluxio by Bin FanData Con LA
 
Pitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWSPitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWSEagleDream Technologies
 
Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...
Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...
Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...DataWorks Summit
 
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...Spark Summit
 

Similar to Running Databases in Containers Overcome Challenges (20)

Aem asset optimizations & best practices
Aem asset optimizations & best practicesAem asset optimizations & best practices
Aem asset optimizations & best practices
 
Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...
Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...
Flink forward SF 2017: Elizabeth K. Joseph and Ravi Yadav - Flink meet DC/OS ...
 
Flink forward sf 17
Flink forward sf 17Flink forward sf 17
Flink forward sf 17
 
Flink Forward San Francisco 2017 - Flink meet DC/OS
Flink Forward San Francisco 2017 - Flink meet DC/OSFlink Forward San Francisco 2017 - Flink meet DC/OS
Flink Forward San Francisco 2017 - Flink meet DC/OS
 
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
STG309_Deep Dive Using Hybrid Storage with AWS Storage Gateway to Solve On-Pr...
 
Amazon EFS 深入採討
Amazon EFS 深入採討Amazon EFS 深入採討
Amazon EFS 深入採討
 
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
 
Amazon Elastic File System (EFS) for File Storage
Amazon Elastic File System (EFS) for File StorageAmazon Elastic File System (EFS) for File Storage
Amazon Elastic File System (EFS) for File Storage
 
DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of KubernetesDevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
 
STG206_Big Data Data Lakes and Data Oceans
STG206_Big Data Data Lakes and Data OceansSTG206_Big Data Data Lakes and Data Oceans
STG206_Big Data Data Lakes and Data Oceans
 
Alluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACKAlluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACK
 
DevOps in Age of Kubernetes
DevOps in Age of KubernetesDevOps in Age of Kubernetes
DevOps in Age of Kubernetes
 
A Brave new object store world
A Brave new object store worldA Brave new object store world
A Brave new object store world
 
Using DC/OS for Continuous Delivery - DevPulseCon 2017
Using DC/OS for Continuous Delivery - DevPulseCon 2017Using DC/OS for Continuous Delivery - DevPulseCon 2017
Using DC/OS for Continuous Delivery - DevPulseCon 2017
 
STG316_Optimizing Storage for Big Data Workloads
STG316_Optimizing Storage for Big Data WorkloadsSTG316_Optimizing Storage for Big Data Workloads
STG316_Optimizing Storage for Big Data Workloads
 
SMACK stack and beyond
SMACK stack and beyondSMACK stack and beyond
SMACK stack and beyond
 
Spark Pipelines in the Cloud with Alluxio by Bin Fan
Spark Pipelines in the Cloud with Alluxio by Bin FanSpark Pipelines in the Cloud with Alluxio by Bin Fan
Spark Pipelines in the Cloud with Alluxio by Bin Fan
 
Pitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWSPitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWS
 
Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...
Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...
Dancing Elephants - Efficiently Working with Object Stores from Apache Spark ...
 
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
 

Recently uploaded

Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 

Recently uploaded (20)

Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 

Running Databases in Containers Overcome Challenges

  • 1. Running Databases in Containers. How to Overcome the Challenges of Data Prepared for Frank Stienhans CTO Ocean9
  • 2. BARE METAL Subjective Perspective June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 2 Evolution of Enterprise IT 1.More Choices 2.Faster Delivery 3.Higher Density 4.Increased Control VIRTUALIZATION CLOUD CONTAINERS
  • 3. What is it • Standardized Application Virtualization • Application defined as Image, without the OS Kernel • CPU, RAM, Network, Mount & Process Isolation • Begin: ~ 2006 @ Google June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 3 Containers
  • 4. Value 1. Enable quick provisioning and scaling 2. Enable Higher Resource Density 3. Increased Control over workload Placement and Usage June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 4 Containers
  • 5. June 10, 2017 5 Adoption Phases 1. Frontends 2. Applications 3. Databases FRONTEND APPLICATION DATABASE RISK Blast Radius Single User Many Users All Users Recovery Minutes Minutes Hours - Days BENEFIT Cost Savings $ $$ $$$
  • 6. © Copyright, 2017, Ocean9, Inc., All Rights Reserved Heavy Containers “Heavy Containers” Containers with a lot of State June 10, 2017 6 Definition
  • 7. © Copyright, 2017, Ocean9, Inc., All Rights Reserved Heavy Containers 1. Local State – Focus Today 2. Long Life 3. Highest Security June 10, 2017 7 Challenges
  • 8. Available Resources in Virtual Machine Instance Type Traditional Cloud Sizing June 10, 2017 8 Databases before Containers • DB Sizing: Function of … – RAM – CPU – Network – I/O • DB Utilization – 5% average utilization is normal – Hence, 95% waste DB Resources Required for a predicted Peek CPU RAM DB Resources utilized on Average
  • 9. © Copyright, 2017, Ocean9, Inc., All Rights Reserved Cloud Native Sizing June 10, 2017 9 Database with Container • Fill the DB Host with Apps (Stateless Containers) • Grow your DB container as if those do not exist. • Keep some resource reserve as a buffer Available Resources in Virtual Machine Instance Type DB Resources utilized on Average App App App App App App App App App App App App App App App App App App CPU RAM
  • 10. © Copyright, 2017, Ocean9, Inc., All Rights Reserved Triple Site Database Setup in one GEO Region June 10, 2017 10 Cloud Native Maximum High Availability Available Resources in Virtual Machine Instance Type DB Site C Available Resources in Virtual Machine Instance Type DB Site A App App App App App App App App App App App App App App App App App App Sync DB Replication Available Resources in Virtual Machine Instance Type DB Site B App App App App App App App App App App App App App App App App App App Sync DB Replication
  • 11. June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 11 Network Filesystems for HPC Persistence DB Host :: X1.32xlarge :: Amazon EC2 Network 20G Your Apps I/O ~ 10G AWS EBS Ephemeral Locally Attached SSD DB Replication Data Integration Network / Cluster File System for Tier 1 I/O Max Max
  • 12. June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 12 Amazon EC2 R4 Family x x x x x xx x x x x x x x x x 16 X-large • RAM : 488 GB • CPU : 64 vCPUs • Network : 20 Gbps • EBS I/O :~ 10 Gbps X-large • RAM : 30 GB RAM • CPU : 4 vCPUs • Network : ~ 1.25 Gbps • EBS I/O : ~ 0.60 Gbps
  • 13. June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 13 Azure, same answer DB Host :: Azure Virtual Machine Network 25G Your Apps I/O ~ 10G Azure Premium Disks “Resource Disk” Locally Attached SSD DB Replication Data Integration Network / Cluster File System for Tier 1 I/O Max Max
  • 14. Heavy Containers 1. Intelligent Placement (4D : CPU, RAM, Net, I/O) 2. Real-time Monitoring 3. Data Agility and Data Performance (usually XOR) 4. Density June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 14 Needs
  • 15. Heavy Containers 1. Running Virtual Machine 2. No Storage Linux Bash >> ray docker recover hana2/206 Example uses SUSE Linux 12 SP2 and SAP HANA SPS 12 Demo
  • 16. June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 16 Output: SAP HANA System with 1.2 billion rows Storage Docker Image Docker Container
  • 17. One Click Away June 10, 2017 © Copyright, 2016, Ocean9, Inc., All Rights Reserved 17 Inbuilt Automated Fallback HANA Production HANA Production Container Virtual Machine Backup & Recovery OR Synchronous DB Replication
  • 18. Born in the Cloud SAP-as-a-Service June 10, 2017 © Copyright, 2017, Ocean9, Inc., All Rights Reserved 18 The Ocean9 Solution Enterprise Class • High performance • High availability • Strict security PLUS • Cloud native capabilities • Database containers Ocean9 Intelligent Platform Database-as-a-Service Business Apps-as-a-Service B1on
  • 19. Constantly Growing June 10, 2017 © Copyright, 2017, Ocean9, Inc., All Rights Reserved 19 Partner Ecosystem
  • 20. Please Meet Us at our Booth #234 June 10, 2017 © Copyright, 2017, Ocean9, Inc., All Rights Reserved 20 Thank You Attend our Sessions • Running Databases in Containers. How to Overcome the Challenges Frank Stienhans, CTO Ocean9 Wed, June 7th, 8:30 – 9:05 am • The “known unknown" of Big Data in IoT Swen Conrad, CEO Ocean9 Wed, June 7th, 5:00 – 5:35 am Booth #234 Visit us! Try Ocean9 Born-in-the-Cloud solutions for SAP
  • 21. Thank you 6/10/2017 21 Frank Stienhans frank@ocean9.io