This document provides information about a session on batching in the modern enterprise using Spring Batch. The session will cover how batch processing is moving to the cloud along with Spring Batch. It will discuss concepts like jobs, steps, readers, writers, processors and error handling. It will also cover techniques for scaling batch processes and orchestrating them using Spring Cloud Task and Spring Cloud Data Flow.

1. Batching in the Modern
Enterprise
September2-3, 2020
springone.io
#session-batching-for-the-modern-enterprise

2. THANK YOU

3. MICHAEL MINELLA
Lead – Spring Batch &
Spring Cloud Task
JBatch – Committer
Author – The Definitive Guide
to Spring Batch
Speaker - JavaOne Rockstar
Java Champion
Podcast - OffHeap Curmudgeon

4. @michaelminella
@springbatch
@offheap

5. https://www.apress.com/us/book/9781484237236
AVAILABLE
NOW!

9. BATCH IS DEAD!

11. AS WORKLOADS
MOVE TO THE CLOUD
BATCH PROCESSING
FOLLOWS

12. ¯_(ツ)_/¯

13. WHAT IS BATCH
PROCESSING?

14. SPRING BATCH

15. WHAT IS BATCH
PROCESSING?

16. Batch processing, … is defined as
the processing of a finite amount of
data without interaction or interruption
-- Michael Minella
The Definitive Guide to Spring Batch

17. FINITE AMOUNT
OF DATA

18. WITHOUT INTERACTION
OR INTERUPTION

20. BATCH IS MOVING
TO THE CLOUD

21. SPRING BATCH

22. THE DEFACTO STANDARD FOR
BATCH PROCESSING ON THE JVM

23. +

24. USED IN EVERY VERTICAL

25. SERVED AS THE INSPIRATION
OF JSR-352

26. LINGO

27. JOB

28. STEP

29. TASKLET VS CHUNK

30. ITEM

31. CHUNK

32. FLOW OF STEPS/COMPONENT
ItemReader
ItemWriter
ItemProcessor
STEP1
ItemReader
ItemWriter
ItemProcessor
STEP3
ItemReader
ItemWriter
ItemProcessor
STEP2

34. INFRASTRUCTURE
JobRepository
JobLauncher StepJob ItemProcessor
ItemReader
ItemWriter

35. JobInstance
StepExecution
JobExecution
1
*
1
*
date=09/02/2020

37. public interface ItemReader<T> {
@Nullable
T read() throws Exception,
UnexpectedInputException,
ParseException,
NonTransientResourceException;
}

38. AbstractItemCountingItemStreamItemReader
AggregateItemReader
AmqpItemReader
FlatFileItemReader
KafkaItemReader
HibernateCursorItemReader
HibernatePagingItemReader
ItemReaderAdapter
JdbcCursorItemReader
19 OUT OF THE BOX ITEMREADER
IMPLEMENTATIONS
JdbcPagingItemReader
JmsItemReader
JpaPagingItemReader
ListItemReader
MongoItemReader
Neo4jItemReader
RepositoryItemReader
StoredProcedureItemReader
StaxEventItemReader
JsonItemReader

39. public interface ItemProcessor<I, O> {
@Nullable
O process(@NonNull I item) throws
Exception;
}

40. AsycnItemProcessor
BeanValidatingItemProcessor
ClassifierCompositeItemProcessor
CompositeItemProcessor
FunctionItemProcessor
ItemProcessorAdapter
PassThroughItemProcessor
ScriptItemProcessor
ValidatingItemProcessor
OUT OF THE BOX ITEMPROCESSO
IMPLEMENTATIONS

41. public interface ItemWriter<T> {
void write(List<? extends T> items) throws
Exception;
}

42. AbstractItemStreamItemWriter
AmqpItemWriter
CompositeItemWriter
FlatFileItemWriter
GemfireItemWriter
HibernateItemWriter
ItemWriterAdapter
JdbcBatchItemWriter
JmsItemWriter
18 OUT OF THE BOX ITEMWRITER
IMPLEMENTATIONS
JpaItemWriter
KafkaItemWriter
MimeMessageItemWriter
MongoItemWriter
Neo4jItemWriter
PropertyExtractingDelegatingItemWriter
RepositoryItemWriter
StaxEventItemWriter
JsonFileItemWriter

43. public interface ItemStream {
void open(ExecutionContext ec)
throws ItemStreamException;
void update(ExecutionContext ec)
throws ItemStreamException;
void close() throws ItemStreamException;
}

44. ExecutionContext

46. ERROR HANDLING

47. RESTART

48. SKIP

49. RETRY

51. LISTENERS

52. SCALING BATCH
PROCESSES

53. 1MULTITHREADED STEP

54. 2PARALLEL STEPS

55. 3ASYNC
ITEMPROCESSOR/ITEMWRIT

56. 4PARTITIONING

57. 5REMOTE CHUNKIN

58. https://www.youtube.com/watch?v=J6IPlfm7N6w

59. ORCHESTRATION

60. SPRING CLOUD TASK

61. SPRING CLOUD DATA FLOW

64. THANK YOU

67. Stay Connected.
Follow us at @springbatch
What’s Newin Spring Batch – Sept 2 3:05 PM EDT
Spring Cloud Data Flow AMA– Sept 24:05PM EDT
WalkingthroughSpring Cloud Data Flow – Sept 3 12:05PM EDT
#springone@s1p