This document discusses how AWS provides tools for big data and analytics. It notes that AWS offers immediate availability without hardware procurement, secure and compliant services, and broad capabilities to support any big data application. It outlines the modern data architecture as agile and focused on value over work. It provides examples of how AWS services can be used for data acquisition, storage, access, analytics, and more. It also provides an example of how FINRA uses AWS to analyze billions of transactions daily.
4. Big Data on AWS
Immediate Availability. Deploy instantly. No hardware to
procure, no infrastructure to maintain & scale
Trusted & Secure. Designed to meet the strictest
requirements. Continuously audited, including certifications
such as ISO 27001, FedRAMP, DoD CSM, and PCI DSS.
Broad & Deep Capabilities. Over 100 services and 100s
of features to support virtually any big data application &
workload
Hundreds of Partners & Solutions. Get help from a
consulting partner or choose from hundreds of tools and
applications across the entire data management stack.
23. Broad Set of Analytics Capabilities
Batch
Processing
Data
Warehousing
Business
Reporting
Real-time
Processing
Predictive
Analytics
24. Processing & Analytics
T r a n s a c t i o n a l &
R D B M S
DynamoDB
NoSQL DB Relational
Database
Aurora
B I & D a t a
V i s u a l i z a t i o n
Kinesis Streams
& Firehose
B a t c h
EMR
Hadoop, Spark,
Presto
Redshift
Data Warehouse
Athena
Query Service
AWS Batch
Predictive
R e a l - t i m e
AWS Lambda
Apache Storm
on EMR
Apache Flink
on EMR
Spark Streaming
on EMR
Elasticsearch
Service
Kinesis Analytics,
Kinesis Streams
EastiCache DAX
25. FINRA Analyzes Billions of Transactions Daily
To respond to
rapidly changing
market dynamics,
FINRA, moved 75% of
its operations to
Amazon Web
Services, using AWS
to analyze 75B
records a day.
26. FINRA uses Amazon EMR and Amazon S3 to process up to 75 billion
trading events per day and securely store over 5 petabytes of data,
attaining savings of $10-20mm per year.
Fraud Detection
27. • AWS enables you to build sophisticated data strategies and related
analytics applications
• Retrospective, Real-time, Predictive
• You can build incrementally, adding use cases and increasing scale
as you go
• AWS provides a broad range of security and auditing features to
enable you to meet your security requirements
https://aws.amazon.com/big-data/