Submit Search
Upload
Data Processing with Microservices - Michael Minella
•
1 like
•
418 views
VMware Tanzu
Follow
Data Processing with Microservices by Michael Minella at SpringOne Tour 2019
Read less
Read more
Software
Report
Share
Report
Share
1 of 99
Download Now
Download to read offline
Recommended
Give Your Data an Extreme Makeover in Under 5 Minutes (SMX Advanced)
Give Your Data an Extreme Makeover in Under 5 Minutes (SMX Advanced)
Annie Cushing
The Red Hat Way
The Red Hat Way
Software Guru
Intelligent Guides: Architecting systems for context-driven interactions
Intelligent Guides: Architecting systems for context-driven interactions
Tim Caynes
Intelligent Guides: Architecting Systems for Context-driven Interactions
Intelligent Guides: Architecting Systems for Context-driven Interactions
Tim Caynes
Data science training institute in hyderabad
Data science training institute in hyderabad
Kelly Technologies
Dataiku - Big data paris 2015 - A Hybrid Platform, a Hybrid Team
Dataiku - Big data paris 2015 - A Hybrid Platform, a Hybrid Team
Dataiku
DevSecCon London 2017: Their-problems-are-your-problems-devseccon by Tim Kadlec
DevSecCon London 2017: Their-problems-are-your-problems-devseccon by Tim Kadlec
DevSecCon
2951085 dzone-2016guidetobigdata
2951085 dzone-2016guidetobigdata
balu kvm
More Related Content
Similar to Data Processing with Microservices - Michael Minella
Big Data Science at the Digital Catapult
Big Data Science at the Digital Catapult
Chandan Rajah
Innotech Austin 2017: The Path of DevOps Enlightenment for InfoSec
Innotech Austin 2017: The Path of DevOps Enlightenment for InfoSec
James Wickett
Building SADI Services Tutorial - SIB Workshop, Geneva, December 2015
Building SADI Services Tutorial - SIB Workshop, Geneva, December 2015
Mark Wilkinson
Steps to the Big Data Science Epiphany
Steps to the Big Data Science Epiphany
Chandan Rajah
Making big data small
Making big data small
andertech
Big data & analytics for banking new york lars hamberg
Big data & analytics for banking new york lars hamberg
Lars Hamberg
Whole Chain Traceability Consortium
Whole Chain Traceability Consortium
clive boulton
DevSecOps and the New Path Forward
DevSecOps and the New Path Forward
James Wickett
UBC STAT545 2014 Cm001 intro to-course
UBC STAT545 2014 Cm001 intro to-course
Jennifer Bryan
Whole Chain Traceability, pulling a Kobayashi Maru.
Whole Chain Traceability, pulling a Kobayashi Maru.
clive boulton
AppSec California 2018: The Path of DevOps Enlightenment for InfoSec
AppSec California 2018: The Path of DevOps Enlightenment for InfoSec
James Wickett
s2gx2015 who needs batch
s2gx2015 who needs batch
Gunnar Hillert
Open source-secret-sauce-rit-2010
Open source-secret-sauce-rit-2010
Ted Husted
#rstats lessons for #measure
#rstats lessons for #measure
Mark Edmondson
Self adaptive based natural language interface for disambiguation of
Self adaptive based natural language interface for disambiguation of
Nurfadhlina Mohd Sharef
ETL using Big Data Talend
ETL using Big Data Talend
Edureka!
Infrastructure Prowing Pains by David Poblador i Garcia - DevOpsBCN - March 2024
Infrastructure Prowing Pains by David Poblador i Garcia - DevOpsBCN - March 2024
devopsbcnmeetup
Taming Social Data: How Social Data Framing liberates analysis and accelerate...
Taming Social Data: How Social Data Framing liberates analysis and accelerate...
DataSift
SENCER_panel.ppt
SENCER_panel.ppt
nagarajan740445
A Product Manager's Place in a DevOps World
A Product Manager's Place in a DevOps World
Atlassian
Similar to Data Processing with Microservices - Michael Minella
(20)
Big Data Science at the Digital Catapult
Big Data Science at the Digital Catapult
Innotech Austin 2017: The Path of DevOps Enlightenment for InfoSec
Innotech Austin 2017: The Path of DevOps Enlightenment for InfoSec
Building SADI Services Tutorial - SIB Workshop, Geneva, December 2015
Building SADI Services Tutorial - SIB Workshop, Geneva, December 2015
Steps to the Big Data Science Epiphany
Steps to the Big Data Science Epiphany
Making big data small
Making big data small
Big data & analytics for banking new york lars hamberg
Big data & analytics for banking new york lars hamberg
Whole Chain Traceability Consortium
Whole Chain Traceability Consortium
DevSecOps and the New Path Forward
DevSecOps and the New Path Forward
UBC STAT545 2014 Cm001 intro to-course
UBC STAT545 2014 Cm001 intro to-course
Whole Chain Traceability, pulling a Kobayashi Maru.
Whole Chain Traceability, pulling a Kobayashi Maru.
AppSec California 2018: The Path of DevOps Enlightenment for InfoSec
AppSec California 2018: The Path of DevOps Enlightenment for InfoSec
s2gx2015 who needs batch
s2gx2015 who needs batch
Open source-secret-sauce-rit-2010
Open source-secret-sauce-rit-2010
#rstats lessons for #measure
#rstats lessons for #measure
Self adaptive based natural language interface for disambiguation of
Self adaptive based natural language interface for disambiguation of
ETL using Big Data Talend
ETL using Big Data Talend
Infrastructure Prowing Pains by David Poblador i Garcia - DevOpsBCN - March 2024
Infrastructure Prowing Pains by David Poblador i Garcia - DevOpsBCN - March 2024
Taming Social Data: How Social Data Framing liberates analysis and accelerate...
Taming Social Data: How Social Data Framing liberates analysis and accelerate...
SENCER_panel.ppt
SENCER_panel.ppt
A Product Manager's Place in a DevOps World
A Product Manager's Place in a DevOps World
More from VMware Tanzu
What AI Means For Your Product Strategy And What To Do About It
What AI Means For Your Product Strategy And What To Do About It
VMware Tanzu
Make the Right Thing the Obvious Thing at Cardinal Health 2023
Make the Right Thing the Obvious Thing at Cardinal Health 2023
VMware Tanzu
Enhancing DevEx and Simplifying Operations at Scale
Enhancing DevEx and Simplifying Operations at Scale
VMware Tanzu
Spring Update | July 2023
Spring Update | July 2023
VMware Tanzu
Platforms, Platform Engineering, & Platform as a Product
Platforms, Platform Engineering, & Platform as a Product
VMware Tanzu
Building Cloud Ready Apps
Building Cloud Ready Apps
VMware Tanzu
Spring Boot 3 And Beyond
Spring Boot 3 And Beyond
VMware Tanzu
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
VMware Tanzu
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
VMware Tanzu
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
VMware Tanzu
tanzu_developer_connect.pptx
tanzu_developer_connect.pptx
VMware Tanzu
Tanzu Virtual Developer Connect Workshop - French
Tanzu Virtual Developer Connect Workshop - French
VMware Tanzu
Tanzu Developer Connect Workshop - English
Tanzu Developer Connect Workshop - English
VMware Tanzu
Virtual Developer Connect Workshop - English
Virtual Developer Connect Workshop - English
VMware Tanzu
Tanzu Developer Connect - French
Tanzu Developer Connect - French
VMware Tanzu
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
VMware Tanzu
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
VMware Tanzu
SpringOne Tour: The Influential Software Engineer
SpringOne Tour: The Influential Software Engineer
VMware Tanzu
SpringOne Tour: Domain-Driven Design: Theory vs Practice
SpringOne Tour: Domain-Driven Design: Theory vs Practice
VMware Tanzu
SpringOne Tour: Spring Recipes: A Collection of Common-Sense Solutions
SpringOne Tour: Spring Recipes: A Collection of Common-Sense Solutions
VMware Tanzu
More from VMware Tanzu
(20)
What AI Means For Your Product Strategy And What To Do About It
What AI Means For Your Product Strategy And What To Do About It
Make the Right Thing the Obvious Thing at Cardinal Health 2023
Make the Right Thing the Obvious Thing at Cardinal Health 2023
Enhancing DevEx and Simplifying Operations at Scale
Enhancing DevEx and Simplifying Operations at Scale
Spring Update | July 2023
Spring Update | July 2023
Platforms, Platform Engineering, & Platform as a Product
Platforms, Platform Engineering, & Platform as a Product
Building Cloud Ready Apps
Building Cloud Ready Apps
Spring Boot 3 And Beyond
Spring Boot 3 And Beyond
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
tanzu_developer_connect.pptx
tanzu_developer_connect.pptx
Tanzu Virtual Developer Connect Workshop - French
Tanzu Virtual Developer Connect Workshop - French
Tanzu Developer Connect Workshop - English
Tanzu Developer Connect Workshop - English
Virtual Developer Connect Workshop - English
Virtual Developer Connect Workshop - English
Tanzu Developer Connect - French
Tanzu Developer Connect - French
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: The Influential Software Engineer
SpringOne Tour: The Influential Software Engineer
SpringOne Tour: Domain-Driven Design: Theory vs Practice
SpringOne Tour: Domain-Driven Design: Theory vs Practice
SpringOne Tour: Spring Recipes: A Collection of Common-Sense Solutions
SpringOne Tour: Spring Recipes: A Collection of Common-Sense Solutions
Recently uploaded
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Alluxio, Inc.
20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기
Chiwon Song
Program with GUTs
Program with GUTs
Kevlin Henney
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
elliciumsolutionspun
Top Software Development Trends in 2024
Top Software Development Trends in 2024
Mind IT Systems
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
wajrcs
About .NET 8 and a first glimpse into .NET9
About .NET 8 and a first glimpse into .NET9
Jürgen Gutsch
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptx
IntelliSource Technologies
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG time
Neo4j
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - Datacamp
VICTOR MAESTRE RAMIREZ
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
AmeliaSmith90
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
Tobias Schneck
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
Ivo Andreev
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human Beauty
Raymond Okyere-Forson
ERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptx
Autus Cyber Tech
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS Calculator
Shane Coughlan
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
Ivo Andreev
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdf
Brain Inventory
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security Challenges
Shyamsundar Das
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
OnePlan Solutions
Recently uploaded
(20)
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기
Program with GUTs
Program with GUTs
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Top Software Development Trends in 2024
Top Software Development Trends in 2024
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
About .NET 8 and a first glimpse into .NET9
About .NET 8 and a first glimpse into .NET9
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptx
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG time
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - Datacamp
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human Beauty
ERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptx
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS Calculator
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdf
Watermarking in Source Code: Applications and Security Challenges
Watermarking in Source Code: Applications and Security Challenges
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Data Processing with Microservices - Michael Minella
1.
DATA PROCESSING WITH MICROSERVICES
3.
@michaelmine lla @OffHe ap
4.
github.com/mminella/data- microservices
5.
LAY OF THE LAND
6.
SPRING FRAMEWORK
7.
SPRING INTEGRATION
8.
SPRING BATCH
9.
SPRING CLOUD STREAM
10.
SPRING CLOUD TASK
11.
SPRING CLOUD DATA FLOW
12.
WHAT ARE WE GOING TO
TALK ABOUT?
13.
DATA INTEGRATION
14.
EVOLUTI ON
15.
MONOLIT HS
16.
MULTIPLE INTEGRATION FLOWS & BATCH JOBS
17.
LARGE COMPLEX ARTIFAC TS
18.
DIFFIC ULT TO TEST
19.
HARD TO GET TO PRODUCTIO N
20.
BIG DATA PLATFOR MS
21.
GOOD WITH LARGE VOLUMES OF DATA
22.
BAD WITH SMALL VOLUMES OF DATA
23.
LARGE LEARNING CURVE
24.
LITTLE/NO REUSE BETWEEN SOLUTIONS
25.
HEAVY FOOTPRINT IN YOUR CODE
26.
HARD TO TEST
27.
HARD TO GET TO PRODUCTIO N
28.
CATEGORY CAN BE USEFUL JUST
NOT FOR EVERYTHING
29.
DATA MICROSERVI CES
30.
CLOUD NATI VE
31.
DEVELOPED AND TESTED IN ISOLATIO N
32.
INDEPENDANT LY SCALAB LE
33.
FAMILIAR DEVELOPMENT MODEL
34.
SMALL AND SIMPLE TO TEST
35.
OPERATIONALLY EASY TO GOVER N
36.
TWO MAIN PROCESSING MODELS
37.
STREA MS
38.
TAS KS
39.
DATA INTEGRATION AS A
SERVICE
40.
COMPOSTIO N OF MICROSERVI CES
41.
STREAMS AND FLOWS BECOME YOUR “APP”
42.
OPERATIONAL AND ORCHESTRATION COVERAGE
43.
SPRI NG
44.
Spring Spring Integration Spring Batch Spring Cloud Stream Spring Cloud Task
45.
SPRING CLOUD STREA M
46.
MESSAG E DRIV EN
47.
transformertime log
48.
transformertime log
49.
@EnableBinding(Source.class)
50.
@EnableBinding(Processor.class)
51.
@EnableBinding(Sink.class)
53.
USE CASES
54.
DATA INGESTION 1
55.
DATA TRANSFORMATION 2
56.
REAL-TIME DATA PROCESSING 3
57.
IO T 4
58.
Demo DEM O
59.
SPRING CLOUD TAS K
60.
MICROSERVIC ES THAT END
61.
TASK REPOSITORY 1
62.
BATCH INTEGRATION 2
63.
STREAM INTEGRATION 3
64.
@EnableTask
66.
USE CASES
67.
BATCH JOBS 1
68.
ONE OFF PROCESSES 2
69.
ETL PROCESSES 3
70.
DATA SCIENCE 4
71.
FINITE PROCESSING 5
72.
Demo DEM O
73.
SPRING CLOUD DATA FLOW
74.
WHAT IS SPRING CLOUD
DATA FLOW?
75.
DATA FLOW ORCHESTR ATES
78.
TAKES ADVANTAGE OF MODERN PLATFORMS
79.
CLOUDFOUN DRY 1
80.
KUBERNE TES 2
81.
LOC AL 3
82.
http | filter
| hdfs // DSL
83.
http | filter
| hdfs // DSL
84.
NO INSTALLED CONTAIN
85.
EVERYTHIN G IS SPRING
86.
A BOOT APP FOR THE
87.
A BOOT APP FOR THE
88.
ALL BOOT APPS FOR OTB
89.
Data Flow Server
shell app app app browser
90.
Data Flow Server
shell twitter log field-value-counter browser
91.
twitter log field-value-counter
92.
Stream Demo DEM O
93.
BUT WAIT, THERE’S MORE!
94.
TASK/STREAM/B ATCH INTEGRAT ION 1
95.
PARTITIONED STREAMS 2
96.
SCALING STREAMS & TASKS 3
97.
Learn More. Stay
Connected. Spring Cloud Data Flow Project: cloud.spring.io/spring-cloud-dataflow/ Github: github.com/spring-cloud/spring-cloud-dataflow Spring Cloud Stream Project: cloud.spring.io/spring-cloud-stream/ Github: github.com/spring-cloud/spring-cloud-stream Spring Cloud Task Project: cloud.spring.io/spring-cloud-task/ Github: github.com/spring-cloud/spring-cloud-task Pivotal: pivotal.io Twitter: twitter.com/springcentral YouTube: spring.io/video LinkedIn: spring.io/linkedin Google Plus: spring.io/gplus
98.
QUESTIO NS?
99.
Th End
Download Now