SlideShare a Scribd company logo
1 of 28
Download to read offline
Durable Streaming and Enterprise Messaging
​ Jay Hurst
​ Director, Product Management
​ jhurst@salesforce.com
​ @extraidea
​ John Brock
​ SMTS – Enterprise Messaging
​ jbrock@salesforce.com
​ @_ johnbrock
Safe Harbor
​ Safe harbor statement under the Private Securities Litigation Reform Act of 1995:
​ This presentation may contain forward-looking statements that involve risks, uncertainties, and assumptions. If any such uncertainties
materialize or if any of the assumptions proves incorrect, the results of salesforce.com, inc. could differ materially from the results expressed
or implied by the forward-looking statements we make. All statements other than statements of historical fact could be deemed forward-
looking, including any projections of product or service availability, subscriber growth, earnings, revenues, or other financial items and any
statements regarding strategies or plans of management for future operations, statements of belief, any statements concerning new,
planned, or upgraded services or technology developments and customer contracts or use of our services.
​ The risks and uncertainties referred to above include – but are not limited to – risks associated with developing and delivering new
functionality for our service, new products and services, our new business model, our past operating losses, possible fluctuations in our
operating results and rate of growth, interruptions or delays in our Web hosting, breach of our security measures, the outcome of any
litigation, risks associated with completed and any possible mergers and acquisitions, the immature market in which we operate, our
relatively limited operating history, our ability to expand, retain, and motivate our employees and manage our growth, new releases of our
service and successful customer deployment, our limited history reselling non-salesforce.com products, and utilization and selling to larger
enterprise customers. Further information on potential factors that could affect the financial results of salesforce.com, inc. is included in our
annual report on Form 10-K for the most recent fiscal year and in our quarterly report on Form 10-Q for the most recent fiscal quarter. These
documents and others containing important disclosures are available on the SEC Filings section of the Investor Information section of our
Web site.
​ Any unreleased services or features referenced in this or other presentations, press releases or public statements are not currently available
and may not be delivered on time or at all. Customers who purchase our services should make the purchase decisions based upon features
that are currently available. Salesforce.com, inc. assumes no obligation and does not intend to update these forward-looking statements.
Jay Hurst
Director - Product Management, Salesforce
jhurst@salesforce.com
@extraidea
John Brock
SMTS – Enterprise Messaging
jbrock@salesforce.com
@_ johnbrock
Streaming Data from Salesforce
​ Many customers are facing a set of challenges around pushing
changes out of Salesforce.
​ Raise your hand if you:
•  Have used the Classic or Generic Streaming API in Salesforce
•  Have tried to build synchronization or change detection based on
streaming, but are having issues
•  Have a need for a reliable, durable flow of data in and out of
Salesforce
Enterprise Messaging
Enterprise Messaging
​ The goal is to support the concept of an Event as a first class object
•  An event is an immutable, time-stamped set of values.
•  Can represent multiple values
•  Actions - "A report was generated", "An order has been placed"
•  Measurements – "API limits are at 50%", "1MM records have been created"
•  State Changes - "Account 0010000023234 field Name was updated to 'Acme, Inc.'"
•  Allow a large number of events to flow through the platform
•  Scale to millions of events per minute per pod
•  API first design to support:
•  Publishing events to a message channel
•  Consuming events from a message channel
•  Provide ability to replay events from a defined time-window
Where are we today?
Classic Streaming API
Based on the Bayeux/CometD protocol
•  The client will open up a long polling connection to the Salesforce server and subscribe to a Push Topic
•  The client must regularly reconnect to keep the session alive
•  When a record meets the query, we send an event down the connection to the client
•  The client then reconnects to the long polling connection and waits for the next message
​ Allows you to define a query and have Salesforce send an event to your listener whenever a record
is modified and meets that query
•  The messages are sent in near real time
•  The Streaming API is not loss-less
•  If the client is not connected, the message will not be received, and cannot be replayed
Where are we going tomorrow (or shortly thereafter)?
Durable Streaming API
​ The first implementation of Enterprise Messaging will be to enhance the Streaming API
•  Provide the ability for replay of Generic Streaming API events (Durable Streaming)
•  Existing Streaming Channel pushes will generate the Conduit events
•  Additional Event ID will be provided in message
•  Event ID will be atomic and ever-increasing
•  A new replay method will be available that will replay all events from a provided ID
•  The replay will re-deliver all messages that are after the provided ID
•  Event replay will be available for up to 24 hours
•  Protocol (Bayeux/CometD) will remain and require changes only to take advantage of replay
•  Clients will need to store and provide the Event ID
•  If no event ID provided in subscribe, then the events will be delivered from the tip of the queue
•  This will result in the existing behavior available today
Durable Streaming Demo
Durable Streaming Code Samples
Code Sample
Javascript Client Replay Extension
Code Sample
Javascript CometD Example
Code Sample
Java Client Replay Extension
Code Sample
Java CometD Example
Event Architecture
Enterprise Messaging – Event Time Window
​ The Event Time Window allows for events to be
added in time order to the channel
•  Events are added through a producer API and
retrieved from the channel via the consumer API
•  The "window" will slide with time, and any events
within the window can be replayed
•  Events are ordered
•  Replay events from anywhere in event log window
Event Architecture – Conduit API
​ Conduit API Allows for Producing and Consuming Events
•  Simple publisher and consumer API
Event Architecture – Conduit SPIs
​ Conduit SPI Allows a common API for multiple Time Ordered
Event Log implementations
•  Conduit SPI interface allows multiple concrete event log
implementations
•  Kafka, SQL, HBase, In Memory, etc...
•  Provides a common API across all providers
•  The SPIs will also allow for composing event logs into different SLAs
Streaming API v2
How do Conduit and Streaming v2 Interact
​ Runs as an embedded or stand-alone service
​ Client interface via CometD
​ Event processing pipeline
​ Conduit - SPI
•  Use different data stores
•  Plug and play
•  Holds client information
•  Optimizes event replay
•  Plus much more!
App Server
Oracle
Clients
Current
Streaming
API
Streaming
Events
Table
Conduit
Events
Table
Winter ‘16
App Server
Current
Streaming
API
Clients
Internal
Conduit
Push API
Kafka Cluster
Future
App Server
Kafka Cluster
Clients
Internal
Conduit
Push API
HBase
Future++
Enterprise Messaging – Roadmap (Safe Harbor J)
​ Winter '16
•  Durable Generic Streaming (Limited Pilot)
​ Spring '16
•  Durable Generic Streaming GA
•  Durable Classic Streaming Pilot
​ Summer '16
•  Durable Classic Streaming GA
•  Kafka-Backed Queues
•  Conduit Producer API public implementations for Apex
•  Conduit Consumer API public implementations for Apex
•  Conduit API implementations for Workflow/Process Builder
What did we Learn?
​ Existing Features that begin to support messaging
•  Classic Streaming API
•  Generic Streaming API
​ Information on Durable Streaming
​ Demo of Durable Streaming
•  Showed an example of Generic Durability
•  Showed an example of Classic Durability
​ Roadmap for Event Messaging
Q&A
Share Your Feedback, and Win a GoPro!
3
Earn a GoPro prize entry for
each completed survey
Tap the bell to take a
survey2Enroll in a session1
Thank you

More Related Content

What's hot

Build Amazing Website without coding using Salesforce SiteForce
Build Amazing Website without coding using Salesforce SiteForceBuild Amazing Website without coding using Salesforce SiteForce
Build Amazing Website without coding using Salesforce SiteForce
vraopolisetti
 

What's hot (17)

Modeling and Querying Data and Relationships in Salesforce
Modeling and Querying Data and Relationships in SalesforceModeling and Querying Data and Relationships in Salesforce
Modeling and Querying Data and Relationships in Salesforce
 
Javascript Security and Lightning Locker Service
Javascript Security and Lightning Locker ServiceJavascript Security and Lightning Locker Service
Javascript Security and Lightning Locker Service
 
Migrating Visualforce Pages to Lightning
Migrating Visualforce Pages to LightningMigrating Visualforce Pages to Lightning
Migrating Visualforce Pages to Lightning
 
Secure Development on the Salesforce Platform - Part 3
Secure Development on the Salesforce Platform - Part 3Secure Development on the Salesforce Platform - Part 3
Secure Development on the Salesforce Platform - Part 3
 
Replicate Salesforce Data in Real Time with Change Data Capture
Replicate Salesforce Data in Real Time with Change Data CaptureReplicate Salesforce Data in Real Time with Change Data Capture
Replicate Salesforce Data in Real Time with Change Data Capture
 
Salesforce Tour Paris - Platform Events - Martin Lezer
Salesforce Tour Paris - Platform Events - Martin LezerSalesforce Tour Paris - Platform Events - Martin Lezer
Salesforce Tour Paris - Platform Events - Martin Lezer
 
Advanced Platform Series - OAuth and Social Authentication
Advanced Platform Series - OAuth and Social AuthenticationAdvanced Platform Series - OAuth and Social Authentication
Advanced Platform Series - OAuth and Social Authentication
 
Diving Into Heroku Private Spaces
Diving Into Heroku Private SpacesDiving Into Heroku Private Spaces
Diving Into Heroku Private Spaces
 
Mastering Force.com: Advanced Visualforce
Mastering Force.com: Advanced VisualforceMastering Force.com: Advanced Visualforce
Mastering Force.com: Advanced Visualforce
 
Lightning Data Service: Eliminate Your Need to Load Records Through Controllers
Lightning Data Service: Eliminate Your Need to Load Records Through ControllersLightning Data Service: Eliminate Your Need to Load Records Through Controllers
Lightning Data Service: Eliminate Your Need to Load Records Through Controllers
 
Introduction to Apex for Developers
Introduction to Apex for DevelopersIntroduction to Apex for Developers
Introduction to Apex for Developers
 
Build Amazing Website without coding using Salesforce SiteForce
Build Amazing Website without coding using Salesforce SiteForceBuild Amazing Website without coding using Salesforce SiteForce
Build Amazing Website without coding using Salesforce SiteForce
 
Webinar: Build Apps Customers Love as a Salesforce Developer
Webinar: Build Apps Customers Love as a Salesforce DeveloperWebinar: Build Apps Customers Love as a Salesforce Developer
Webinar: Build Apps Customers Love as a Salesforce Developer
 
Integrating with salesforce
Integrating with salesforceIntegrating with salesforce
Integrating with salesforce
 
Embed Customer Support into your Apps with Snap-ins
Embed Customer Support into your Apps with Snap-insEmbed Customer Support into your Apps with Snap-ins
Embed Customer Support into your Apps with Snap-ins
 
Lightning Updates: Summer, Winter & Beyond
Lightning Updates: Summer, Winter & BeyondLightning Updates: Summer, Winter & Beyond
Lightning Updates: Summer, Winter & Beyond
 
Lightning Components - Advanced Features
Lightning Components - Advanced FeaturesLightning Components - Advanced Features
Lightning Components - Advanced Features
 

Viewers also liked

Viewers also liked (8)

New Powerful API Enhancements for Summer '15
New Powerful API Enhancements for Summer '15 New Powerful API Enhancements for Summer '15
New Powerful API Enhancements for Summer '15
 
Salesforce Admin's guide : the data loader from the command line
Salesforce Admin's guide : the data loader from the command lineSalesforce Admin's guide : the data loader from the command line
Salesforce Admin's guide : the data loader from the command line
 
Salesforce External Objects for Big Data
Salesforce External Objects for Big DataSalesforce External Objects for Big Data
Salesforce External Objects for Big Data
 
Hbase at Salesforce.com
Hbase at Salesforce.comHbase at Salesforce.com
Hbase at Salesforce.com
 
Tagging and Processing Data in Real Time-(Hari Shreedharan and Siddhartha Jai...
Tagging and Processing Data in Real Time-(Hari Shreedharan and Siddhartha Jai...Tagging and Processing Data in Real Time-(Hari Shreedharan and Siddhartha Jai...
Tagging and Processing Data in Real Time-(Hari Shreedharan and Siddhartha Jai...
 
Access External Data in Real-time with Lightning Connect
Access External Data in Real-time with Lightning ConnectAccess External Data in Real-time with Lightning Connect
Access External Data in Real-time with Lightning Connect
 
Secure Kafka at Salesforce.com
Secure Kafka at Salesforce.comSecure Kafka at Salesforce.com
Secure Kafka at Salesforce.com
 
Salesforce enabling real time scenarios at scale using kafka
Salesforce enabling real time scenarios at scale using kafkaSalesforce enabling real time scenarios at scale using kafka
Salesforce enabling real time scenarios at scale using kafka
 

Similar to Durable Streaming and Enterprise Messaging

Business Mashups Best of the Web APIs
Business Mashups Best of the Web APIsBusiness Mashups Best of the Web APIs
Business Mashups Best of the Web APIs
dreamforce2006
 

Similar to Durable Streaming and Enterprise Messaging (20)

Salesforce Streaming Api
Salesforce Streaming ApiSalesforce Streaming Api
Salesforce Streaming Api
 
ISV Monthly Tech Enablement (August 2017)
ISV Monthly Tech Enablement (August 2017)ISV Monthly Tech Enablement (August 2017)
ISV Monthly Tech Enablement (August 2017)
 
Winter 14 Release Developer Preview
Winter 14 Release Developer PreviewWinter 14 Release Developer Preview
Winter 14 Release Developer Preview
 
MuleSoftマイクロサービスとデプロイメントパターン
MuleSoftマイクロサービスとデプロイメントパターンMuleSoftマイクロサービスとデプロイメントパターン
MuleSoftマイクロサービスとデプロイメントパターン
 
Boxcars and Cabooses: When One More XHR Is Too Much
Boxcars and Cabooses: When One More XHR Is Too MuchBoxcars and Cabooses: When One More XHR Is Too Much
Boxcars and Cabooses: When One More XHR Is Too Much
 
Sharing APIs at Scale for a Great Developer Experience
Sharing APIs at Scale for a Great Developer ExperienceSharing APIs at Scale for a Great Developer Experience
Sharing APIs at Scale for a Great Developer Experience
 
モダンなイベント駆動型システム連携を学ぼう〜Platform Events 入門
モダンなイベント駆動型システム連携を学ぼう〜Platform Events 入門モダンなイベント駆動型システム連携を学ぼう〜Platform Events 入門
モダンなイベント駆動型システム連携を学ぼう〜Platform Events 入門
 
Emerging Technologies: Heroku for ISVs (October 13, 2014)
Emerging Technologies: Heroku for ISVs (October 13, 2014)Emerging Technologies: Heroku for ISVs (October 13, 2014)
Emerging Technologies: Heroku for ISVs (October 13, 2014)
 
Business Mashups Best of the Web APIs
Business Mashups Best of the Web APIsBusiness Mashups Best of the Web APIs
Business Mashups Best of the Web APIs
 
Coding in the App Cloud
Coding in the App CloudCoding in the App Cloud
Coding in the App Cloud
 
Salesforce platform session 2
 Salesforce platform session 2 Salesforce platform session 2
Salesforce platform session 2
 
Learn MOAR Winter '20 Developer Community
Learn MOAR Winter '20 Developer Community Learn MOAR Winter '20 Developer Community
Learn MOAR Winter '20 Developer Community
 
Real-Time Data Feeds Using the Streaming API
Real-Time Data Feeds Using the Streaming APIReal-Time Data Feeds Using the Streaming API
Real-Time Data Feeds Using the Streaming API
 
Modern Architectures: Integration Stories from the Field
Modern Architectures: Integration Stories from the FieldModern Architectures: Integration Stories from the Field
Modern Architectures: Integration Stories from the Field
 
Introduction to WebRTC on the Force.com Platform
Introduction to WebRTC on the Force.com PlatformIntroduction to WebRTC on the Force.com Platform
Introduction to WebRTC on the Force.com Platform
 
Salesforce's Trusted Enterprise Platform and Apache Phoenix
Salesforce's Trusted Enterprise Platform and Apache PhoenixSalesforce's Trusted Enterprise Platform and Apache Phoenix
Salesforce's Trusted Enterprise Platform and Apache Phoenix
 
Enterprise API New Features and Roadmap
Enterprise API New Features and RoadmapEnterprise API New Features and Roadmap
Enterprise API New Features and Roadmap
 
Dreamforce 13 developer session: Introduction to Heroku
Dreamforce 13 developer session: Introduction to HerokuDreamforce 13 developer session: Introduction to Heroku
Dreamforce 13 developer session: Introduction to Heroku
 
Unlock SAP - Release the potential of your existing backend systems with Sale...
Unlock SAP - Release the potential of your existing backend systems with Sale...Unlock SAP - Release the potential of your existing backend systems with Sale...
Unlock SAP - Release the potential of your existing backend systems with Sale...
 
Innovation Showcase: How Warner Bros. and iHeartMedia Build Apps on App Cloud
Innovation Showcase: How Warner Bros. and iHeartMedia Build Apps on App CloudInnovation Showcase: How Warner Bros. and iHeartMedia Build Apps on App Cloud
Innovation Showcase: How Warner Bros. and iHeartMedia Build Apps on App Cloud
 

More from Salesforce Developers

More from Salesforce Developers (20)

Sample Gallery: Reference Code and Best Practices for Salesforce Developers
Sample Gallery: Reference Code and Best Practices for Salesforce DevelopersSample Gallery: Reference Code and Best Practices for Salesforce Developers
Sample Gallery: Reference Code and Best Practices for Salesforce Developers
 
Maximizing Salesforce Lightning Experience and Lightning Component Performance
Maximizing Salesforce Lightning Experience and Lightning Component PerformanceMaximizing Salesforce Lightning Experience and Lightning Component Performance
Maximizing Salesforce Lightning Experience and Lightning Component Performance
 
Local development with Open Source Base Components
Local development with Open Source Base ComponentsLocal development with Open Source Base Components
Local development with Open Source Base Components
 
TrailheaDX India : Developer Highlights
TrailheaDX India : Developer HighlightsTrailheaDX India : Developer Highlights
TrailheaDX India : Developer Highlights
 
Why developers shouldn’t miss TrailheaDX India
Why developers shouldn’t miss TrailheaDX IndiaWhy developers shouldn’t miss TrailheaDX India
Why developers shouldn’t miss TrailheaDX India
 
CodeLive: Build Lightning Web Components faster with Local Development
CodeLive: Build Lightning Web Components faster with Local DevelopmentCodeLive: Build Lightning Web Components faster with Local Development
CodeLive: Build Lightning Web Components faster with Local Development
 
CodeLive: Converting Aura Components to Lightning Web Components
CodeLive: Converting Aura Components to Lightning Web ComponentsCodeLive: Converting Aura Components to Lightning Web Components
CodeLive: Converting Aura Components to Lightning Web Components
 
Enterprise-grade UI with open source Lightning Web Components
Enterprise-grade UI with open source Lightning Web ComponentsEnterprise-grade UI with open source Lightning Web Components
Enterprise-grade UI with open source Lightning Web Components
 
TrailheaDX and Summer '19: Developer Highlights
TrailheaDX and Summer '19: Developer HighlightsTrailheaDX and Summer '19: Developer Highlights
TrailheaDX and Summer '19: Developer Highlights
 
Live coding with LWC
Live coding with LWCLive coding with LWC
Live coding with LWC
 
Lightning web components - Episode 4 : Security and Testing
Lightning web components  - Episode 4 : Security and TestingLightning web components  - Episode 4 : Security and Testing
Lightning web components - Episode 4 : Security and Testing
 
LWC Episode 3- Component Communication and Aura Interoperability
LWC Episode 3- Component Communication and Aura InteroperabilityLWC Episode 3- Component Communication and Aura Interoperability
LWC Episode 3- Component Communication and Aura Interoperability
 
Lightning web components episode 2- work with salesforce data
Lightning web components   episode 2- work with salesforce dataLightning web components   episode 2- work with salesforce data
Lightning web components episode 2- work with salesforce data
 
Lightning web components - Episode 1 - An Introduction
Lightning web components - Episode 1 - An IntroductionLightning web components - Episode 1 - An Introduction
Lightning web components - Episode 1 - An Introduction
 
Migrating CPQ to Advanced Calculator and JSQCP
Migrating CPQ to Advanced Calculator and JSQCPMigrating CPQ to Advanced Calculator and JSQCP
Migrating CPQ to Advanced Calculator and JSQCP
 
Scale with Large Data Volumes and Big Objects in Salesforce
Scale with Large Data Volumes and Big Objects in SalesforceScale with Large Data Volumes and Big Objects in Salesforce
Scale with Large Data Volumes and Big Objects in Salesforce
 
Modern Development with Salesforce DX
Modern Development with Salesforce DXModern Development with Salesforce DX
Modern Development with Salesforce DX
 
Get Into Lightning Flow Development
Get Into Lightning Flow DevelopmentGet Into Lightning Flow Development
Get Into Lightning Flow Development
 
Integrate CMS Content Into Lightning Communities with CMS Connect
Integrate CMS Content Into Lightning Communities with CMS ConnectIntegrate CMS Content Into Lightning Communities with CMS Connect
Integrate CMS Content Into Lightning Communities with CMS Connect
 
Introduction to MuleSoft
Introduction to MuleSoftIntroduction to MuleSoft
Introduction to MuleSoft
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 

Durable Streaming and Enterprise Messaging

  • 1. Durable Streaming and Enterprise Messaging ​ Jay Hurst ​ Director, Product Management ​ jhurst@salesforce.com ​ @extraidea ​ John Brock ​ SMTS – Enterprise Messaging ​ jbrock@salesforce.com ​ @_ johnbrock
  • 2. Safe Harbor ​ Safe harbor statement under the Private Securities Litigation Reform Act of 1995: ​ This presentation may contain forward-looking statements that involve risks, uncertainties, and assumptions. If any such uncertainties materialize or if any of the assumptions proves incorrect, the results of salesforce.com, inc. could differ materially from the results expressed or implied by the forward-looking statements we make. All statements other than statements of historical fact could be deemed forward- looking, including any projections of product or service availability, subscriber growth, earnings, revenues, or other financial items and any statements regarding strategies or plans of management for future operations, statements of belief, any statements concerning new, planned, or upgraded services or technology developments and customer contracts or use of our services. ​ The risks and uncertainties referred to above include – but are not limited to – risks associated with developing and delivering new functionality for our service, new products and services, our new business model, our past operating losses, possible fluctuations in our operating results and rate of growth, interruptions or delays in our Web hosting, breach of our security measures, the outcome of any litigation, risks associated with completed and any possible mergers and acquisitions, the immature market in which we operate, our relatively limited operating history, our ability to expand, retain, and motivate our employees and manage our growth, new releases of our service and successful customer deployment, our limited history reselling non-salesforce.com products, and utilization and selling to larger enterprise customers. Further information on potential factors that could affect the financial results of salesforce.com, inc. is included in our annual report on Form 10-K for the most recent fiscal year and in our quarterly report on Form 10-Q for the most recent fiscal quarter. These documents and others containing important disclosures are available on the SEC Filings section of the Investor Information section of our Web site. ​ Any unreleased services or features referenced in this or other presentations, press releases or public statements are not currently available and may not be delivered on time or at all. Customers who purchase our services should make the purchase decisions based upon features that are currently available. Salesforce.com, inc. assumes no obligation and does not intend to update these forward-looking statements.
  • 3. Jay Hurst Director - Product Management, Salesforce jhurst@salesforce.com @extraidea
  • 4. John Brock SMTS – Enterprise Messaging jbrock@salesforce.com @_ johnbrock
  • 5. Streaming Data from Salesforce ​ Many customers are facing a set of challenges around pushing changes out of Salesforce. ​ Raise your hand if you: •  Have used the Classic or Generic Streaming API in Salesforce •  Have tried to build synchronization or change detection based on streaming, but are having issues •  Have a need for a reliable, durable flow of data in and out of Salesforce
  • 7. Enterprise Messaging ​ The goal is to support the concept of an Event as a first class object •  An event is an immutable, time-stamped set of values. •  Can represent multiple values •  Actions - "A report was generated", "An order has been placed" •  Measurements – "API limits are at 50%", "1MM records have been created" •  State Changes - "Account 0010000023234 field Name was updated to 'Acme, Inc.'" •  Allow a large number of events to flow through the platform •  Scale to millions of events per minute per pod •  API first design to support: •  Publishing events to a message channel •  Consuming events from a message channel •  Provide ability to replay events from a defined time-window
  • 8. Where are we today? Classic Streaming API Based on the Bayeux/CometD protocol •  The client will open up a long polling connection to the Salesforce server and subscribe to a Push Topic •  The client must regularly reconnect to keep the session alive •  When a record meets the query, we send an event down the connection to the client •  The client then reconnects to the long polling connection and waits for the next message ​ Allows you to define a query and have Salesforce send an event to your listener whenever a record is modified and meets that query •  The messages are sent in near real time •  The Streaming API is not loss-less •  If the client is not connected, the message will not be received, and cannot be replayed
  • 9. Where are we going tomorrow (or shortly thereafter)? Durable Streaming API ​ The first implementation of Enterprise Messaging will be to enhance the Streaming API •  Provide the ability for replay of Generic Streaming API events (Durable Streaming) •  Existing Streaming Channel pushes will generate the Conduit events •  Additional Event ID will be provided in message •  Event ID will be atomic and ever-increasing •  A new replay method will be available that will replay all events from a provided ID •  The replay will re-deliver all messages that are after the provided ID •  Event replay will be available for up to 24 hours •  Protocol (Bayeux/CometD) will remain and require changes only to take advantage of replay •  Clients will need to store and provide the Event ID •  If no event ID provided in subscribe, then the events will be delivered from the tip of the queue •  This will result in the existing behavior available today
  • 12. Code Sample Javascript Client Replay Extension
  • 14. Code Sample Java Client Replay Extension
  • 17. Enterprise Messaging – Event Time Window ​ The Event Time Window allows for events to be added in time order to the channel •  Events are added through a producer API and retrieved from the channel via the consumer API •  The "window" will slide with time, and any events within the window can be replayed •  Events are ordered •  Replay events from anywhere in event log window
  • 18. Event Architecture – Conduit API ​ Conduit API Allows for Producing and Consuming Events •  Simple publisher and consumer API
  • 19. Event Architecture – Conduit SPIs ​ Conduit SPI Allows a common API for multiple Time Ordered Event Log implementations •  Conduit SPI interface allows multiple concrete event log implementations •  Kafka, SQL, HBase, In Memory, etc... •  Provides a common API across all providers •  The SPIs will also allow for composing event logs into different SLAs
  • 20. Streaming API v2 How do Conduit and Streaming v2 Interact ​ Runs as an embedded or stand-alone service ​ Client interface via CometD ​ Event processing pipeline ​ Conduit - SPI •  Use different data stores •  Plug and play •  Holds client information •  Optimizes event replay •  Plus much more!
  • 24. Enterprise Messaging – Roadmap (Safe Harbor J) ​ Winter '16 •  Durable Generic Streaming (Limited Pilot) ​ Spring '16 •  Durable Generic Streaming GA •  Durable Classic Streaming Pilot ​ Summer '16 •  Durable Classic Streaming GA •  Kafka-Backed Queues •  Conduit Producer API public implementations for Apex •  Conduit Consumer API public implementations for Apex •  Conduit API implementations for Workflow/Process Builder
  • 25. What did we Learn? ​ Existing Features that begin to support messaging •  Classic Streaming API •  Generic Streaming API ​ Information on Durable Streaming ​ Demo of Durable Streaming •  Showed an example of Generic Durability •  Showed an example of Classic Durability ​ Roadmap for Event Messaging
  • 26. Q&A
  • 27. Share Your Feedback, and Win a GoPro! 3 Earn a GoPro prize entry for each completed survey Tap the bell to take a survey2Enroll in a session1