apidays LIVE JAKARTA - Event Driven APIs by Phil Scanlon

1. Event Driven APIs Phil Scanlon VP Field Technology, APAC & ME Solace

2. Talking Points APIs, Events, Event Driven APIs Duality The real time enterprise and its digital patterns Service Mesh and Event Mesh Competing, Complementing, Duality again? Looking for Schrodinger’s Cat – Event Portal Visualizing Event Streams Why Care? Responsive, real time, distributed apps Agility and CX

3. Digital Transformation Events for Real time, responsive apps

4. The Real Time Business Transformation

5. Real Time Digital Transformation To unlock the value of data, you need to set it in motion as Event Streams 5 © Solace Proprietary & Confidential

6. The Evolution of Integration – Event Driven Banking Producer A Consume r A MQ Producer B MQ Producer C MQ Producer A Consume r C Producer B Producer C IBM MQ Point to Point • Technical Interfaces – Producer needs to know the exact end point of the Consumer • No grain for functional capability • Point-to-point model Enterprise Service Bus • Functional capability – Producer needs to know the exact end point for a feature and not Consumer • Coarse grain functional capability • Pub-Sub Model Event Driven Architecture • Dynamic Routing on Taxonomy • Producer need not know end point of system or feature, just connects to the Event Mesh (fabric that connects all end points) • Fine grain functional capability via Event Model (pub-sub+) Producer A Consume r B MQ Producer B MQ Producer C MQ Producer A Consume r C MQ Producer B MQ Producer C MQ Producer A Consume r A Producer B Producer C Consume r B Producer A Producer B Producer C Consume r A Consume r B Consume r C

7. Batch Polling Event Streaming Long Time Real Time Event Driven & APIs ETL  SOA & APIs Event-Driven is the new imperative… Liberate Data at Rest - Identify Real Time Candidates Ask the question – why not real time? Business, or IT problem? Select high visibility, quick win candidates to start the event driven journey

8. API, Events, Event Driven APIs

9. Order Management Event Flow © Solace Proprietary & Confidential ORDER VALIDATOR MICROSERVICE CREDIT CHECK MICROSERVICE INVENTORY CHECK MICROSERVICE PAYMENT PROCESSOR MICROSERVICE ORDER PROCESSOR MICROSERVICE

10. Order Management Event Flow – Insights Consumers © Solace Proprietary & Confidential ORDER VALIDATOR MICROSERVICE CREDIT CHECK MICROSERVICE INVENTORY CHECK MICROSERVICE PAYMENT PROCESSOR MICROSERVICE ORDER PROCESSOR MICROSERVICE CROSS SELL UPSELL MICROSERVICE DATA LAKE INGESTOR MICROSERVICE INSIGHTS AI ML MICROSERVICE

11. Responsive Applications Give Better CX Sync and Async Paths – APIs and Events © Solace Proprietary & Confidential ORDER VALIDATOR MICROSERVICE CREDIT CHECK MICROSERVICE INVENTORY CHECK MICROSERVICE PAYMENT PROCESSOR MICROSERVICE ORDER PROCESSOR MICROSERVICE CROSS SELL UPSELL MICROSERVICE DATA LAKE INGESTOR MICROSERVICE INSIGHTS AI ML MICROSERVICE Synchronous, Fast path Asynchronous, Parallel Path Eventually Consistency Deferred Execution API North South Traffic Event s East West

12. APIs and Events Evolution Separation of API From Service Implementation 1 2© Solace Proprietary & Confidential Subscribe Subscribe Subscribe Publish Publish Subscribe API Sources from : Gartner Application Architecture, Development & Integration Summit 2018

13. • Cloud-native API (Spring, REST and WebSocket) • IoT ready (MQTT) • Enterprise ready (JMS, JCA, REST, AMQP) • Any-to-any interoperability • Open APIs and Protocols • Eliminate platform and protocol lock-in Streaming APIs and Integration 1 3 © Solace Proprietary & Confidential Objective C iOS JavaScript HTML5 .NET Core 2.0 HTTP API RESTC, C++, Java, JavaScript, Python, Go, .NET C, C#/.NET, JMS/JCA, Java Boot, cloud connector, cloud stream, cloud data flow JMS (1.1, 2.0), Python, Ruby, C++, .NET, Perl, Node.js, .NET, Java, .NET(NNMS) Source and Sink seamless Kafka connectors Cloud Native Services Ex: (SQS,SNS, Beam, Kinesis…) Edge Streaming Family

14. Evolving SOA to Event Driven Architecture • Event Aware Messaging moves to the core for routing • Topic namespace is designed • Topic namespace used for Runtime Governance • Runtime Governance via Topic Hierarchies and ACLs • Each event had a topic • Event Cataloguing (REST or messaging) • Versioning, AB testing via Topics • Microservices consume and produce events • Works hand in hand with event cataloguing and governance via ACLs • Self Orchestration Chhoreography - Microservices “subscribe” to events, rather than being “called” • When needed, ESB used as an exception for non standard transformation and orchestration only • When needed, API platforms can front APIs Evolution Steps:

15. • Event driven APIs are described by “Topics” – Topic routing has been around for 20 years and scales better than SOA • TIBCO RV • Capital markets to IoT runs on this – Topic routing is standardized – Topics are routable by Solace as an Event Driven Data River… Tag Events with Routable Topics/URL Message Payload Binary or json or xml, or anything! REST URL : http://host:port/ pay/init/sg/v1/qr/dbs/casa/taxi/comfort Event over REST Message Payload Binary or json or xml, or anything! Topic: pay/init/sg/v1/qr/dbs/casa/taxi/comfort Event over MQTT/JMS Event Routing Enabled Taxonomy REST JMS Publish: pay/init/sg/v1/qr/dbs/casa/taxi/comfort Subscribe – filtered matching: pay/init/sg/v1/> or pay/init/*/v1/qr/>

16. Event Driven Microservices B2B EventDriven Microservices Payment Gateway Init JMS Topic: pay/init/*/v1/> AMQP Topic : pay/init/sg/v1/qr/dbs/casa/taxi/comfort Event Producers Messaging– Eventing Backbone REST URL: http://host:port/ pay/init/sg/v1/qr/dbs/casa/taxi/comfort • Events are published to context based, “/” separated URLs • “/” tokenized string is used for event routing • ACLs apply • Microservices subscribe to events of interest using topic subscriptions • Persistent, Request Reply are also supported. • Wildcard subscriptions supported New channels added easily, just publish on the same event taxonomy Event Mesh Micro Service

17. Agility with Event Routing - Pub Sub Choreography B2B EventDriven Microservices Payment Gateway Init JMS Topic: pay/init/*/v1/> AMQP Topic : pay/init/sg/v1/qr/dbs/casa/taxi/comfort Event Producers Messaging– Eventing Backbone REST URL: http://host:port/ pay/init/sg/v1/qr/dbs/casa/taxi/comfort MQTT Topic: pay/*/sg/*/qr/> QR Campaign Analytics • Microservices subscribe to events of interest using topic subscriptions • Persistent, Request Reply are also supported. • Wildcard subscriptions supported Event Mesh Micro Service Micro Service

18. Event Mesh ESB/Adapters Event Driven Microservices – ESB at the Edge ESB/Adapters B2B Lightweight ESB at the edge (only if needed) - Orchestration | Transformation | Adaptation EventDriven Microservices JMS Topic: pay/*/sg/*/qr/> QR Campaign AnalyticsPayment Gateway Init Legacy Proprietary StandardsJMS Topic: pay/init/*/v1/> AMQP Topic : pay/init/sg/v1/qr/dbs/casa/taxi/comfort Event Producers Messaging– Eventing Backbone REST URL: http://host:port/ pay/init/sg/v1/qr/dbs/casa/taxi/comfort Micro Service Micro Service API Platform

19. Event Mesh Event Driven Microservices API Platform B2B Lightweight Microservices at the edge - Choreography | Transformation | Adaptation EventDriven Microservices JMS Topic: pay/*/sg/*/qr/> QR Campaign AnalyticsPayment Gateway Init Legacy Proprietary StandardsJMS Topic: pay/init/*/v1/> AMQP Topic : pay/init/sg/v1/qr/dbs/casa/taxi/comfort Event Producers Messaging– Eventing Backbone Micro Service Micro Service Micro Service Micro Service Micro Service Micro Service API Platform REST URL: http://host:port/ pay/init/sg/v1/qr/dbs/casa/taxi/comfort

20. Distributed Integration Service Mesh and Event Mesh

21. The East West Traffic Debate – Service Mesh? Event Mesh? 21 © Solace Proprietary & Confidential Microservices were happily coupled But management had a problem Decouple with Sidecars and Service Mesh But not all Microservices want to be serially coupled Some like parallel lives! Service Mesh Loves Event Mesh!

22. • Solace Event Streaming Platform is an end to end foundational architectural layer for SAP Modernization, IOT, Event Driven APIs and Event Driven iPaaS SAP Ecosystem Example - Hybrid Multi Cloud Event Mesh Data Lake, AI, ML Retail Factorie s Trackin g IOT API GW iPaaS EAI/ES B SAP PI/PO Streaming

23. Event Portal Meanwhile, Inside the Box, Schrodinger’s Cat Plans Its Revenge… Source: Open Culture http://www.openculture.com/2019/05/meanwhile-inside-the-box- schrodingers-cat-plans-its-revenge.html

24. Event Portal - Event Choreography And Cataloging

25. Event Portal – Catalog, Discover, Design Event Streaming Event Discovery Event Catalog Event Designer Solace Event Streaming Platform Runtime, Catalogue, Metrics and

26. 2 6 © Solace Proprietary & Confidential Single place to design, create, catalog, visualize, discover, share, secure and manage all events within your ecosystem PubSub+ Event Portal PubSub+ Event Portal Mainframe/ SAP Distributed Apps IoTMicro services Server Less Event Brokers Solace Kafka Others

27. The Foundational Elements of Event Portal 2 7 © Solace Proprietary & Confidential Application A Publisher and/or Subscriber Event Topic address + metadata that references a payload schema Schema Payload object definition JSON, Text, Binary, XML, Avro Application Domain Team, LOB, process (i.e. HR, Inventory, Billing

28. Event Portal – QR payment

30. Event Streaming Platform Event Mesh is the Nervous System 30 iPaaS Low Code Micro Services Analytics and Stream Processing IOT Platform API Management Event Onramp/Offramp CDC, Legacy Connectors, Xform API&Event ProcessingEventStreamingPlatform Hybrid Multi Cloud Event Mesh Solace Event Portal SAP EM is Solace

31. Who are Solace? The “Event Driven” Guys and Gals Docker VM K8S Flavors Cloud SaaS Hardware Appliances 3 1 Award- winning business Solace is free 10,000 msg/sec solace.dev

32. Take Aways APIs, Events, Event Driven APIs Duality The real time enterprise and its digital patterns need both APIs and Events – APIs for North South, Events for East West Traffic Service Mesh and Event Mesh Service Mesh for APIs, Event Mesh for Events Looking for Schrodinger’s Cat – Event Portal Architect, Design, and Visualize Event Streams Codegen and Metrics Design Time and runtime governance Why Care? Responsive, real time, distributed apps Agility and CX

33. Be Event Driven Thank You Phil Scanlon. Solace