SlideShare a Scribd company logo
1 of 32
Download to read offline
Why Cloud-Native Kafka Matters:
4 Reasons to Stop Managing It Yourself
Greg Murphy
Senior Product Marketing Manager, Confluent
Data-Driven
Operations
Real-time,
Personalized,
Customer
Experiences
New Business
Models
You know the value of data in motion
The Power of Kafka
80%
Fortune 100 Companies
Using Apache Kafka®
(majority are Confluent customers)
3
I N V E S T M E N T & T I M E
SCALE
The toll and risk of managing Kafka grows over time
● Architecture planning
● Kafka cluster sizing
● Cluster provisioning
● Build & set up source/sink connectors
● Build monitoring and reporting tools
● Maintain software patches and upgrades
● Monitor and react to security and reliability
risks
● Maintain, upgrade, and restart servers
● Monitor Kafka cluster
loading and rebalancing
● Plan and execute cluster
expansions
● Provide utilization visibility
across the organization
● Maintain cluster
performance through infra
upgrades, migrations, etc
● Manage Zookeeper
● And so much more . . .
Core vs. Non-Core
“Whatever is the new thing that creates
differentiation, that’s core.” Meanwhile, context
is any activity that doesn’t differentiate the
company in the eyes of the customer. “If we do
[context] brilliantly, we don’t succeed. If we do
it badly, we get in trouble.”
— Geoffrey Moore, author and management expert
The Move to Cloud-Native Data Systems
6
Storage
Data
Warehousing
Databases
Amazon S3 Blob
storage
Redshift
Snowflake
Google
BigTable
Self managed
hardware and
software
Fully managed
services
Data
Movement
“By 2022, 75% of all databases will be deployed or migrated to a cloud platform.”
- Gartner
The cloud-native difference
with Confluent
Partially Managed
(cloud-hosted)
Manual operations
with tools and/or
support
Ease and speed of use
Low High
Other managed
services for Kafka
Confluent is the only cloud-native Kafka solution
Self-Managed
(DIY)
Development and
maintenance
without support
Fully Managed
(cloud-native)
Automated product
capabilities with no
operational overhead
Confluent Cloud
Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
The 4 Benefits of a Cloud-Native Kafka Service
Scale up instantly
to meet any
demand and scale
back down to avoid
over-provisioning
infrastructure
Elastic
Build and launch
faster with a
complete data in
motion platform
that goes way
beyond Kafka
Complete
Infinite
Store unlimited data
on Confluent to
enhance your
real-time apps and
use cases with a
broader set of data
Global
Create a consistent
data fabric
throughout your
organization by
linking clusters across
your different
environments
Elastic
Elastic Scaling in Confluent Cloud
Confluent Cloud
Milliseconds Minutes
Basic, Standard [0-100Mbps]
*Even in public clouds provider quotas for VMs, disks, security groups can be encountered causing delays. Confluent has these limits raised already.
Dedicated [Mbps - Gbps]
Select CKU from drop down in
cluster management UI and
click Apply Changes
Other Kafka Services
Days - Weeks
Determine how much capacity is needed
Procure capacity*
Configure new brokers
a. Disks b. OS c. Network d. Kafka (application)
Identify partitions on specific brokers to
rebalance & topics they are part of
For each Topic: migrate partitions
a. Increase ISR +1 b. Wait for new replica to sync
c. Failover master d. Reduce ISR -1 e. Delete old replica
Automated 1 Click
Elastic
Infinite
Infinite Retention
Scale up storage without
adding compute
resources by removing
storage limits on topics
to enable infinite data
retention in Kafka
Cluster
Broker 1 Broker 2 Broker 2
Topic 1
Topic 2
Topic 3
Topic 2
Topic 3
Topic 2
Topic 3
Topic 1
Topic 1
Available on AWS and Google Cloud
Infinite Retention
Cluster
Broker 1 Broker 2 Broker 2
Topic 1
Topic 2
Topic 3
Topic 2
Topic 3
Topic 2
Topic 3
Topic 1
Topic 1
Available on AWS and Google Cloud
● Reimagine event streaming
apps that can use both
real-time and historical events
● Faster and better informed
decision making for your
event-driven processes
● Meet regulatory compliance
requirements for data
retention
Infinite
“Confluent gives us the tools we need
to drive innovation. Before Confluent
Cloud, when we had broker outages
that required rebuilds, it could take up
to three days of developers’ time to
resolve. Now, Confluent takes care of
everything for us, so our developers
can focus on building new features
and applications.”
— Jon Vines, Software Development
Team Lead at AO.com
AO.com maintains focus
on value with Confluent
Global
19
Deploy how and where you want
Confluent AWS
MARKETPLACE
Azure
MARKETPLACE
Google Cloud
MARKETPLACE
Start your multi-cloud
journey
Simplify procurement with easy click-though through annual commitments and draw
down against existing Enterprise Agreements in your cloud marketplace of choice
20 regions 16 regions 22 regions
Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc.
Global Access
● Create a consistent data
layer across clouds: easily
share data between fully
independent clusters
● Simplify your architecture:
bridge or migrate data
without needing a separate
Connect cluster
Cluster Linking (preview) requires no additional
infrastructure and fully preserves offsets
Migrate
clusters to
Confluent
Cloud
Access real-time data globally and across public and private clouds
with linked Kafka clusters that sync in real-time
Complete
Build and launch faster
with a Complete data in motion platform
Pre-built
Integrations
Data
Governance
Stream
Processing
Enterprise-Grade
Security
Instantly integrate
clusters to the most
popular data sources
and sinks within the
Kafka ecosystem
Make data backwards
compatible and
future-proof with
Schema Registry &
Validation
Launch real-time and
continuous stream
processing apps with
a lightweight SQL
syntax
Ensure data
confidentiality,
control access
management, and
monitor user activity
Instantly Connect Popular Data Sources & Sinks
Choose from a growing list of fully managed connectors in Cloud Confluent
Sources Sinks
Amazon
Kinesis
Azure Event
Hubs
Datagen GCP
Pub/Sub
Microsoft SQL
Server CDC
Microsoft
SQL Server
MongoDB
Atlas
MySQL CDC MySQL Oracle
Database
Postgres
CDC
Postgres Salesforce
CDC
Elasticsearch
Service
GCP
BigQuery
GCP
Dataproc
AWS
Lambda
Azure
Functions
GCP Cloud
Storage
Microsoft
SQL Server
MongoDB
Atlas
MySQL Postgres Snowflake
Visit confluent.io/hub to see all available connectors
Datadog
Metrics
MongoDB Atlas Source
& Sink Connectors
Build and launch real-time apps faster
with fully managed source & sink
connectors.
Now Generally Available!
Deploy with just a few clicks and
eliminate the efforts to build, test, &
maintain custom integrations
Work with data anywhere with setup
available across all major clouds
including AWS, Azure, and Google Cloud
Drive analysis with real-time data by
connecting Apache Kafka®
and
MongoDB
Manage Schema Registry
Centrally create, edit and view topic schemas,
and compare schema versions
Configure Schema Validation
Enable the feature at the topic level when
creating or editing topics
Simplify Enterprise Schema Management
ksqlDB provides everything you need to build
a complete, end-to-end event streaming
application entirely with SQL syntax
DB
APP
APP
DB
PULL
PUSH
CONNECTORS
STREAM
PROCESSING
STATE STORES
ksqlDB
1 2
APP
Simplify
Your Stream
Processing
Architecture
Protect sensitive
data in the cloud
● SOC 1, SOC 2, SOC 3
● ISO 27001
● PCI, HIPAA1
ready, GDPR
ready
Enterprise grade security and compliance
Secure data against
unwanted access
● Data-at-rest encryption
● Data-in-motion encryption
● Private networking
connectivity
Control access to
cluster & resources
● SAML / SSO
● RBAC & Audit Logs
● Access Control Lists (ACLs)
1
Available on Dedicated clusters only
How much does Kafka cost your
business?
The Cost-Efficient Way to Deploy Kafka
Confluent Cloud
(typical savings)
1
2
3
⬇60
%
Cloud
Infrastructure
Operational
(FTE)
Support and
other spend
Total
self-managed
Confluent
Cloud
Try Confluent Free
De-risk, accelerate, and save with Confluent
Request TCO Assessment
confluent.io/request-kafka-tco-assessment
Thank You
Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself

More Related Content

What's hot

Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
Michael Noll
 

What's hot (20)

A guide through the Azure Messaging services - Update Conference
A guide through the Azure Messaging services - Update ConferenceA guide through the Azure Messaging services - Update Conference
A guide through the Azure Messaging services - Update Conference
 
How a distributed graph analytics platform uses Apache Kafka for data ingesti...
How a distributed graph analytics platform uses Apache Kafka for data ingesti...How a distributed graph analytics platform uses Apache Kafka for data ingesti...
How a distributed graph analytics platform uses Apache Kafka for data ingesti...
 
Evolving from Messaging to Event Streaming
Evolving from Messaging to Event StreamingEvolving from Messaging to Event Streaming
Evolving from Messaging to Event Streaming
 
Elastically Scaling Kafka Using Confluent
Elastically Scaling Kafka Using ConfluentElastically Scaling Kafka Using Confluent
Elastically Scaling Kafka Using Confluent
 
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
Mainframe Integration, Offloading and Replacement with Apache Kafka | Kai Wae...
 
Concepts and Patterns for Streaming Services with Kafka
Concepts and Patterns for Streaming Services with KafkaConcepts and Patterns for Streaming Services with Kafka
Concepts and Patterns for Streaming Services with Kafka
 
Neo4j Graph Streaming Services with Apache Kafka
Neo4j Graph Streaming Services with Apache KafkaNeo4j Graph Streaming Services with Apache Kafka
Neo4j Graph Streaming Services with Apache Kafka
 
Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...
Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...
Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...
 
Building Streaming Data Pipelines with Google Cloud Dataflow and Confluent Cl...
Building Streaming Data Pipelines with Google Cloud Dataflow and Confluent Cl...Building Streaming Data Pipelines with Google Cloud Dataflow and Confluent Cl...
Building Streaming Data Pipelines with Google Cloud Dataflow and Confluent Cl...
 
Stream Processing Live Traffic Data with Kafka Streams
Stream Processing Live Traffic Data with Kafka StreamsStream Processing Live Traffic Data with Kafka Streams
Stream Processing Live Traffic Data with Kafka Streams
 
Building Event Streaming Microservices with Spring Boot and Apache Kafka | Ja...
Building Event Streaming Microservices with Spring Boot and Apache Kafka | Ja...Building Event Streaming Microservices with Spring Boot and Apache Kafka | Ja...
Building Event Streaming Microservices with Spring Boot and Apache Kafka | Ja...
 
Best Practices for Streaming IoT Data with MQTT and Apache Kafka®
Best Practices for Streaming IoT Data with MQTT and Apache Kafka®Best Practices for Streaming IoT Data with MQTT and Apache Kafka®
Best Practices for Streaming IoT Data with MQTT and Apache Kafka®
 
Enhancing Apache Kafka for Large Scale Real-Time Data Pipeline at Tencent | K...
Enhancing Apache Kafka for Large Scale Real-Time Data Pipeline at Tencent | K...Enhancing Apache Kafka for Large Scale Real-Time Data Pipeline at Tencent | K...
Enhancing Apache Kafka for Large Scale Real-Time Data Pipeline at Tencent | K...
 
Axway amplify api management platform
Axway amplify api management platformAxway amplify api management platform
Axway amplify api management platform
 
Apache Kafka at LinkedIn - How LinkedIn Customizes Kafka to Work at the Trill...
Apache Kafka at LinkedIn - How LinkedIn Customizes Kafka to Work at the Trill...Apache Kafka at LinkedIn - How LinkedIn Customizes Kafka to Work at the Trill...
Apache Kafka at LinkedIn - How LinkedIn Customizes Kafka to Work at the Trill...
 
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
Now You See Me, Now You Compute: Building Event-Driven Architectures with Apa...
 
Kafka in Context, Cloud, & Community (Simon Elliston Ball, Cloudera) Kafka Su...
Kafka in Context, Cloud, & Community (Simon Elliston Ball, Cloudera) Kafka Su...Kafka in Context, Cloud, & Community (Simon Elliston Ball, Cloudera) Kafka Su...
Kafka in Context, Cloud, & Community (Simon Elliston Ball, Cloudera) Kafka Su...
 
Building a Modern, Scalable Cyber Intelligence Platform with Apache Kafka | J...
Building a Modern, Scalable Cyber Intelligence Platform with Apache Kafka | J...Building a Modern, Scalable Cyber Intelligence Platform with Apache Kafka | J...
Building a Modern, Scalable Cyber Intelligence Platform with Apache Kafka | J...
 
Build a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud Services
Build a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud ServicesBuild a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud Services
Build a Bridge to Cloud with Apache Kafka® for Data Analytics Cloud Services
 
Mind the App: How to Monitor Your Kafka Streams Applications | Bruno Cadonna,...
Mind the App: How to Monitor Your Kafka Streams Applications | Bruno Cadonna,...Mind the App: How to Monitor Your Kafka Streams Applications | Bruno Cadonna,...
Mind the App: How to Monitor Your Kafka Streams Applications | Bruno Cadonna,...
 

Similar to Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself

Similar to Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself (20)

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdfDIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf
 
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
Streaming Time Series Data With Kenny Gorman and Elena Cuevas | Current 2022
 
Reinventing Kafka in the Data Streaming Era - Jun Rao
Reinventing Kafka in the Data Streaming Era - Jun RaoReinventing Kafka in the Data Streaming Era - Jun Rao
Reinventing Kafka in the Data Streaming Era - Jun Rao
 
DIMT '23 Session_Demo_ Latest Innovations Breakout.pdf
DIMT '23 Session_Demo_ Latest Innovations Breakout.pdfDIMT '23 Session_Demo_ Latest Innovations Breakout.pdf
DIMT '23 Session_Demo_ Latest Innovations Breakout.pdf
 
Hybrid Kafka, Taking Real-time Analytics to the Business (Cody Irwin, Google ...
Hybrid Kafka, Taking Real-time Analytics to the Business (Cody Irwin, Google ...Hybrid Kafka, Taking Real-time Analytics to the Business (Cody Irwin, Google ...
Hybrid Kafka, Taking Real-time Analytics to the Business (Cody Irwin, Google ...
 
Google Cloud Study Jam | GDSC NCU
Google Cloud Study Jam | GDSC NCUGoogle Cloud Study Jam | GDSC NCU
Google Cloud Study Jam | GDSC NCU
 
Best Practices for Building Hybrid-Cloud Architectures | Hans Jespersen
Best Practices for Building Hybrid-Cloud Architectures | Hans JespersenBest Practices for Building Hybrid-Cloud Architectures | Hans Jespersen
Best Practices for Building Hybrid-Cloud Architectures | Hans Jespersen
 
Pivotal Developer-Ready Infrastructure Slides
Pivotal Developer-Ready Infrastructure SlidesPivotal Developer-Ready Infrastructure Slides
Pivotal Developer-Ready Infrastructure Slides
 
Build & Deploy Scalable Cloud Applications in Record Time
Build & Deploy Scalable Cloud Applications in Record TimeBuild & Deploy Scalable Cloud Applications in Record Time
Build & Deploy Scalable Cloud Applications in Record Time
 
Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf
Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdfLuciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf
Luciano Moreira_Jacob Bogie-BRSP005-10.3_22_FINAL.pdf
 
Partner Connect APAC - 2022 - April
Partner Connect APAC - 2022 - AprilPartner Connect APAC - 2022 - April
Partner Connect APAC - 2022 - April
 
Cloud Native Apps
Cloud Native AppsCloud Native Apps
Cloud Native Apps
 
Modern application delivery with Consul
Modern application delivery with ConsulModern application delivery with Consul
Modern application delivery with Consul
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 
AWS + Confluent: Better Together
AWS + Confluent: Better TogetherAWS + Confluent: Better Together
AWS + Confluent: Better Together
 
Data Streaming with Apache Kafka & MongoDB
Data Streaming with Apache Kafka & MongoDBData Streaming with Apache Kafka & MongoDB
Data Streaming with Apache Kafka & MongoDB
 
Qlik and Confluent Success Stories with Kafka - How Generali and Skechers Kee...
Qlik and Confluent Success Stories with Kafka - How Generali and Skechers Kee...Qlik and Confluent Success Stories with Kafka - How Generali and Skechers Kee...
Qlik and Confluent Success Stories with Kafka - How Generali and Skechers Kee...
 
How leading financial services organisations are winning with tech
How leading financial services organisations are winning with techHow leading financial services organisations are winning with tech
How leading financial services organisations are winning with tech
 
Bridge to Cloud: Using Apache Kafka to Migrate to AWS
Bridge to Cloud: Using Apache Kafka to Migrate to AWSBridge to Cloud: Using Apache Kafka to Migrate to AWS
Bridge to Cloud: Using Apache Kafka to Migrate to AWS
 
Using Blueprints to Overcome Multi-speed IT Challenges
Using Blueprints to Overcome Multi-speed IT ChallengesUsing Blueprints to Overcome Multi-speed IT Challenges
Using Blueprints to Overcome Multi-speed IT Challenges
 

More from DATAVERSITY

The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
DATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
DATAVERSITY
 

More from DATAVERSITY (20)

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and Governance
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for You
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling Fundamentals
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic Project
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and Forwards
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement Today
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best Practices
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive Advantage
 

Recently uploaded

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
MarinCaroMartnezBerg
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
amitlee9823
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
amitlee9823
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
JoseMangaJr1
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
AroojKhan71
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 

Recently uploaded (20)

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Predicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science ProjectPredicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science Project
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 

Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing it Yourself

  • 1. Why Cloud-Native Kafka Matters: 4 Reasons to Stop Managing It Yourself Greg Murphy Senior Product Marketing Manager, Confluent
  • 3. The Power of Kafka 80% Fortune 100 Companies Using Apache Kafka® (majority are Confluent customers) 3
  • 4. I N V E S T M E N T & T I M E SCALE The toll and risk of managing Kafka grows over time ● Architecture planning ● Kafka cluster sizing ● Cluster provisioning ● Build & set up source/sink connectors ● Build monitoring and reporting tools ● Maintain software patches and upgrades ● Monitor and react to security and reliability risks ● Maintain, upgrade, and restart servers ● Monitor Kafka cluster loading and rebalancing ● Plan and execute cluster expansions ● Provide utilization visibility across the organization ● Maintain cluster performance through infra upgrades, migrations, etc ● Manage Zookeeper ● And so much more . . .
  • 5. Core vs. Non-Core “Whatever is the new thing that creates differentiation, that’s core.” Meanwhile, context is any activity that doesn’t differentiate the company in the eyes of the customer. “If we do [context] brilliantly, we don’t succeed. If we do it badly, we get in trouble.” — Geoffrey Moore, author and management expert
  • 6. The Move to Cloud-Native Data Systems 6 Storage Data Warehousing Databases Amazon S3 Blob storage Redshift Snowflake Google BigTable Self managed hardware and software Fully managed services Data Movement “By 2022, 75% of all databases will be deployed or migrated to a cloud platform.” - Gartner
  • 8. Partially Managed (cloud-hosted) Manual operations with tools and/or support Ease and speed of use Low High Other managed services for Kafka Confluent is the only cloud-native Kafka solution Self-Managed (DIY) Development and maintenance without support Fully Managed (cloud-native) Automated product capabilities with no operational overhead Confluent Cloud
  • 9. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc. The 4 Benefits of a Cloud-Native Kafka Service Scale up instantly to meet any demand and scale back down to avoid over-provisioning infrastructure Elastic Build and launch faster with a complete data in motion platform that goes way beyond Kafka Complete Infinite Store unlimited data on Confluent to enhance your real-time apps and use cases with a broader set of data Global Create a consistent data fabric throughout your organization by linking clusters across your different environments
  • 11. Elastic Scaling in Confluent Cloud Confluent Cloud Milliseconds Minutes Basic, Standard [0-100Mbps] *Even in public clouds provider quotas for VMs, disks, security groups can be encountered causing delays. Confluent has these limits raised already. Dedicated [Mbps - Gbps] Select CKU from drop down in cluster management UI and click Apply Changes Other Kafka Services Days - Weeks Determine how much capacity is needed Procure capacity* Configure new brokers a. Disks b. OS c. Network d. Kafka (application) Identify partitions on specific brokers to rebalance & topics they are part of For each Topic: migrate partitions a. Increase ISR +1 b. Wait for new replica to sync c. Failover master d. Reduce ISR -1 e. Delete old replica Automated 1 Click
  • 14. Infinite Retention Scale up storage without adding compute resources by removing storage limits on topics to enable infinite data retention in Kafka Cluster Broker 1 Broker 2 Broker 2 Topic 1 Topic 2 Topic 3 Topic 2 Topic 3 Topic 2 Topic 3 Topic 1 Topic 1 Available on AWS and Google Cloud
  • 15. Infinite Retention Cluster Broker 1 Broker 2 Broker 2 Topic 1 Topic 2 Topic 3 Topic 2 Topic 3 Topic 2 Topic 3 Topic 1 Topic 1 Available on AWS and Google Cloud ● Reimagine event streaming apps that can use both real-time and historical events ● Faster and better informed decision making for your event-driven processes ● Meet regulatory compliance requirements for data retention
  • 17. “Confluent gives us the tools we need to drive innovation. Before Confluent Cloud, when we had broker outages that required rebuilds, it could take up to three days of developers’ time to resolve. Now, Confluent takes care of everything for us, so our developers can focus on building new features and applications.” — Jon Vines, Software Development Team Lead at AO.com AO.com maintains focus on value with Confluent
  • 19. 19 Deploy how and where you want Confluent AWS MARKETPLACE Azure MARKETPLACE Google Cloud MARKETPLACE Start your multi-cloud journey Simplify procurement with easy click-though through annual commitments and draw down against existing Enterprise Agreements in your cloud marketplace of choice 20 regions 16 regions 22 regions
  • 20. Copyright 2021, Confluent, Inc. All rights reserved. This document may not be reproduced in any manner without the express written permission of Confluent, Inc. Global Access ● Create a consistent data layer across clouds: easily share data between fully independent clusters ● Simplify your architecture: bridge or migrate data without needing a separate Connect cluster Cluster Linking (preview) requires no additional infrastructure and fully preserves offsets Migrate clusters to Confluent Cloud Access real-time data globally and across public and private clouds with linked Kafka clusters that sync in real-time
  • 22. Build and launch faster with a Complete data in motion platform Pre-built Integrations Data Governance Stream Processing Enterprise-Grade Security Instantly integrate clusters to the most popular data sources and sinks within the Kafka ecosystem Make data backwards compatible and future-proof with Schema Registry & Validation Launch real-time and continuous stream processing apps with a lightweight SQL syntax Ensure data confidentiality, control access management, and monitor user activity
  • 23. Instantly Connect Popular Data Sources & Sinks Choose from a growing list of fully managed connectors in Cloud Confluent Sources Sinks Amazon Kinesis Azure Event Hubs Datagen GCP Pub/Sub Microsoft SQL Server CDC Microsoft SQL Server MongoDB Atlas MySQL CDC MySQL Oracle Database Postgres CDC Postgres Salesforce CDC Elasticsearch Service GCP BigQuery GCP Dataproc AWS Lambda Azure Functions GCP Cloud Storage Microsoft SQL Server MongoDB Atlas MySQL Postgres Snowflake Visit confluent.io/hub to see all available connectors Datadog Metrics
  • 24. MongoDB Atlas Source & Sink Connectors Build and launch real-time apps faster with fully managed source & sink connectors. Now Generally Available! Deploy with just a few clicks and eliminate the efforts to build, test, & maintain custom integrations Work with data anywhere with setup available across all major clouds including AWS, Azure, and Google Cloud Drive analysis with real-time data by connecting Apache Kafka® and MongoDB
  • 25. Manage Schema Registry Centrally create, edit and view topic schemas, and compare schema versions Configure Schema Validation Enable the feature at the topic level when creating or editing topics Simplify Enterprise Schema Management
  • 26. ksqlDB provides everything you need to build a complete, end-to-end event streaming application entirely with SQL syntax DB APP APP DB PULL PUSH CONNECTORS STREAM PROCESSING STATE STORES ksqlDB 1 2 APP Simplify Your Stream Processing Architecture
  • 27. Protect sensitive data in the cloud ● SOC 1, SOC 2, SOC 3 ● ISO 27001 ● PCI, HIPAA1 ready, GDPR ready Enterprise grade security and compliance Secure data against unwanted access ● Data-at-rest encryption ● Data-in-motion encryption ● Private networking connectivity Control access to cluster & resources ● SAML / SSO ● RBAC & Audit Logs ● Access Control Lists (ACLs) 1 Available on Dedicated clusters only
  • 28. How much does Kafka cost your business?
  • 29. The Cost-Efficient Way to Deploy Kafka Confluent Cloud (typical savings) 1 2 3 ⬇60 % Cloud Infrastructure Operational (FTE) Support and other spend Total self-managed Confluent Cloud
  • 30. Try Confluent Free De-risk, accelerate, and save with Confluent Request TCO Assessment confluent.io/request-kafka-tco-assessment