This document discusses trends in microservices and fast data architectures. It summarizes Lightbend's Fast Data Platform, which provides streaming engines, pluggable machine learning libraries, a reactive platform, operational tooling, and infrastructure support to enable fast data applications. The platform aims to support real-time use cases like predictive analytics, personalization, financial processes, and industrial IoT by moving from batch to streaming data processing.

1. Copyright (C) 2018 451 Research LLC
Microservices and Fast Data:
Industry and Architecture Trends
Matt Aslett, Research Director, Data Platforms & Analytics at 451 Research
Dean Wampler, Ph.D., VP of Fast Data Engineering at Lightbend

2. Copyright (C) 2018 451 Research LLC
451 Research is a leading IT research & advisory company
2
Founded in 2000
250+ employees, including over 120 analysts
2,000+ clients: Technology & Service providers, corporate
advisory, finance, professional services, and IT decision makers
85,000+ IT professionals, business users and consumers in our 451 Alliance
research community
Over 52 million data points published each quarter and 4,500+ reports
published each year
3,000+ technology & service providers under coverage
451 Research and its sister company, Uptime Institute, are the two divisions of
The 451 Group
Headquartered in New York City, with offices in London, Boston, San
Francisco, Washington DC, Mexico, Costa Rica, Brazil, Spain, UAE, Russia,
Taiwan, Singapore and Malaysia
Research & Data
Advisory
Events
Go 2 Market

3. Copyright (C) 2018 451 Research LLC
3
Lightbend - The Leading Platform For Streaming, Fast
Data, And Reactive Applications
2017
Acquired OpsClarity
6m+ OSS Downloads/month
Launched Fast Data Platform
Investment from IBM
Launched Lagom
Framework
2016
2015
Spark Support
500k+ OSS
Downloads/month
Acquired Play
Framework
Founded by Martin
Odersky, Scala
creator & Jonas
Boner, Akka creator
2012
20132011
2014
Launched
Reactive Platform
Authored The
Reactive Manifesto

4. Copyright (C) 2018 451 Research LLC
Total Data – Beyond Volume, Velocity and Variety
4

5. Copyright (C) 2018 451 Research LLC
5

6. Copyright (C) 2018 451 Research LLC
Fast Data Platform Motivation: Architecture Convergence
Reactive
Systems
Fast Data
Applications
Big
Data
Increasing requirements for scalability & resilience
Streaming data pipelines are being served by Microservices
Increasing requirements for streaming vs. batch
Microservices
Fast
Data
Applications

7. Copyright (C) 2018 451 Research LLC
7
The Value of Data in Motion

8. Copyright (C) 2018 451 Research LLC
Real-Life Fast Data Use Cases
• Accelerate decision
making processes
and optimize
infrastructure costs by
moving from batch to
streaming
Predictive
Analytics
• Apply ML models to
large volumes of
device data to
pre-empt failures /
outages
• Real-time marketing
based on behavior,
location, inventory
levels, product
promotions, etc.
Real-time
Personalization
• Drive better business
outcomes through
real-time risk, fraud
detection, compliance,
audit, governance,
etc.
Real-time Financial
Processes
• Real-time consumer
and industrial Device
and Supply Chain
management at scale
Industrial
IoT
More at: https://www.lightbend.com/customers
Legacy
Modernization

9. Copyright (C) 2018 451 Research LLC
9
Approaches to stream processing

10. Copyright (C) 2018 451 Research LLC
Is Streaming Just “Faster Batch”?
Hadoop
● Great for data lakes
● Great for offline analysis (think
data warehousing)
● Hence, mostly oriented towards
batch and interactive use

11. Copyright (C) 2018 451 Research LLC
Introducing Lightbend Fast Data Platform
1 Stream Processing
1. Streaming Engines
Machine Learning
2. Pluggable ML Libraries
Microservices
3. Reactive Platform
Operational Tooling
4. Intelligent Management and Monitoring
Infrastructure
5. Durable Messaging Backplane
6. Persistence
7. DC/OS - Run anywhere (On-Prem,
Cloud, Hybrid)
23
4
5 6
6
7
More info at: http://lightbend.com/fast-data-platform

12. TECHNICAL OVERVIEW
Lightbend Fast Data Platform
A Technical Overview For Decision Makers
DOWNLOAD NOW (NO SIGN UP)

13. Check out these resources:
Dean’s book
Webinars
etc.
Fast Data Architectures
for Streaming Applications
Getting Answers Now from Data Sets that Never End
By Dean Wampler, Ph. D., VP of Fast Data Engineering
DOWNLOAD NOW
13

14. Copyright (C) 2018 451 Research LLC
Thank You!
matthew.aslett@451research.com
@maslett
www.451research.com
dean@lightbend.com
@deanwampler
http://lightbend.com/fast-data-platform