by Robbie Wright, HEad of Amazon S3 & Amazon Glacier Product Marketing, AWS Learn from AWS on how we've designed S3 and Glacier to be durable, available, and massively scalable. Hear how customers are using these services to enhance the accessibility and usability of their data. We will also dive into the benefits of object storage, its applications, and some best practices to follow.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Robbie Wright
Head of Amazon S3 & Amazon Glacier Product Marketing
Amazon Web Services
Amazon S3 & Amazon Glacier
– Object Storage Overview

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud Data Migration
Direct
Connect
Snow* data
transport
family
3rd Party
Connectors
Transfer
Acceleration
Storage
Gateway
Kinesis Firehose
The AWS Storage Portfolio
Object
Amazon GlacierAmazon S3
Block
Amazon EBS
(persistent)
Amazon EC2
Instance Store
(ephemeral)
File
Amazon EFS

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is Amazon S3?
Object storage built to store and retrieve any amount
of data from anywhere
Unmatched durability,
availability, & scalability
Most comprehensive
security & compliance
capabilities
Flexible management

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Glacier
Archival storage for infrequently accessed data
Amazon Glacier
is optimized for
infrequent retrieval
Stop managing
physical media
Even lower cost than
Amazon S3;
Same high durability

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S3 Standard S3 Standard –
Infrequent Access
Amazon Glacier
Active data Archive dataInfrequently accessed data
Milliseconds Minutes to HoursMilliseconds
$0.021/GB/mo $0.004/GB/mo$0.0125/GB/mo
Choice of storage classes on Amazon S3

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Closer Look: S3-IA and Amazon Glacier
S3 - IA
• Same durability and throughput as S3 Standard
• Instant access
• $0.01/GB on each data retrieval
Amazon Glacier
• Same 11 9s durability as S3 Standard
• 3 types of retrieval (expedited, standard, bulk)
– 1-5 min ($.03/GB), 3-5 hr ($.01/GB), 5-12 hr ($.0025/GB)
• Suitable for tape replacement scenarios
S3 Standard –
Infrequent Access
Amazon Glacier

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Glacier Retrievals: Expedited and Bulk Retrievals
Expedited Standard Bulk
Data Access Time 1 - 5 minutes 3 - 5 hours 5 - 12 hours
Data Retrievals $0.03 per GB $0.01 per GB $0.0025 per GB
Retrieval Requests $0.01 per request $0.05 per 1,000 requests $0.025 per 1,000 requests
• Expedited: designed for occasional urgent access to a small number of archives
• Standard: Low-cost option for retrieving data in just a few hours
• Bulk: Lowest cost option optimized for large retrievals, up to petabytes of data in 12 hours
• Three flexible and powerful retrieval options to access any of your Glacier data

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon S3 Scalability
Amazon S3 Object Growth 2013 - Present

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon S3 and Glacier Durability
4 9s durability
5 9s durability
S3 - IA Glacier
11 9s durability
S3 Standard
VS.

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Durability & Availability
99.999999999% durability
Regional services:
• Data written across 3 physical
facilities (AZs)
• Data remains durable even in the
event of an entire AZ failure
Availability:
• S3 Standard: 99.99%
• S3-IA: 99.9%

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Replication Across AWS Regions

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Security & Compliance
Three forms of encryption
Deeply integrated with AWS
Identity and Access Management
(IAM)
AWS CloudTrail logs, monitors &
retains API call activities
Amazon Macie can detect and alert
on security vulnerabilities
Certifications to meet your needs

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Flexible Management
Classify, report, & visualize trends
Object metadata tagging
Streamlined inventory reporting
Storage class analysis
AWS CloudTrail
AWS CloudWatch

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cross-Region
Replication Lifecycle
Policy
Data
Classification
& Management
Event
Notifications
CloudWatch Metrics S3 Inventory Audit with CloudTrail
Data Events
Storage Analytics
Standard Standard - Infrequent Access Amazon Glacier
Amazon S3 Storage Management

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
-Transition Standard to Standard-IA
-Transition Standard-IA to Amazon Glacier
-Expiration lifecycle policy
-Versioning support
-Prefix support
Object Storage -- Data Lifecycle Management
T T+3 days T+5 days T+ 15 days T + 25 days T + 30 days T + 60 days T + 90 days T + 150 days T + 250 days T + 365 days
Data access frequency over time

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data-driven storage management for S3
• Analyze storage usage to transition the right data to the right storage class
• Understand how storage usage changes as your S3 objects get older
• Discover how much of your storage is retrieved over time

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Manage your data: Object-Level Tags
Data Classification and Management
Manage data based on what it is as opposed to where its located
• Easy data management
• Classify your data
• Tag your objects with key-value pairs
• Write policies once based on the type of data
Classification Lifecycle PolicyAccess Control

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S3 Storage Management features:
Pulling it all together
• SaaS security & compliance solution
• Built on AWS
• On-Premise NAS migration to Amazon S3, Glacier
• Multi-PB migration
• Performant and scalable multi-tenant storage
subsystem
• 1.7PB per-month, growing +110% per-year
• 4000 customers, growing +35% per-year
• Leveraged new AWS Storage Features
• S3 tagging for scalability, lifecycle management
• S3 analytics to understand data access patterns
• Cross-region replication
• Glacier expedited retrieval for multi-region availability
“We couldn’t have completed
the migration, optimized
performance, cost optimized
via lifecycle & classified our
(4000+) customers without
using S3’s new analytics,
tagging and lifecycle features

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Lakes & Query-in-Place
Bring your compute to the data with Amazon EMR, your own
Hadoop cluster, or any number of partners
Serverless analytics directly on data stored in Amazon S3
No ETL necessary
Amazon Athena
Amazon Redshift Spectrum

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S3 Use Case: Data Lake
Use Case
• Quickly ingest data from many sources, and store it efficiently in one location
• Multiple analytics/processing tools (eg, Athena, EMR, Rekognition, Redshift) to speed time to value
• Migrate on-premise Data Warehouses, Hadoop & Big Data clusters to AWS
Value Proposition
• Decouple storage and compute—scale optimally and cost efficiently
• Eliminate silos—centrally manage, govern and access all data
• Use the right analytic tools for the job—seamless evolve as requirements change, with no data
migration
Customer Example: FINRA
• Analyzes & stores 75 Billion events per day with S3, EMR & Redshift
• Securely stores 5PB of historical data on S3 for deeper ad-hoc analytics
• Increased agility and speed to results
• Estimated savings of $10-20M per year over previous on-premise solution

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon S3 & Glacier Ecosystem
Over 90 AWS services
Tens of thousands of partners:
• Consulting
• Systems Integrators
• Independent Software Vendors
AWS Marketplace has pre-configured offerings for AWS
Cloud

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage Partner Solutions
Technology Solutions with AWS Storage Competency
aws.amazon.com/backup-recovery/partner-solutions/ Note: Represents a sample of storage partners
Note: Dell-EMC, IBM and Veritas have solutions and are working towards competency requirements
Backup and RecoveryPrimary Storage/Tiering Archive BCDR
Solutions that leverage file, block, object,
and streamed data formats as an
extension to on-premises storage
Solutions that leverage Amazon S3 for
durable data backup
Solutions that leverage Amazon Glacier
for durable and cost-effective long-term
data backup
Solutions that utilize AWS to enable
recovery strategies focused on RTO
and RPO requirements

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise Backup: Direct Integration or Gateway
Amazon S3
Amazon
Glacier
AWS
Direct
Connect
Internet
Amazon S3-IA
Application
servers
Cloud Gateway
Local disk
Media
server
Cloud Gateway
Application
servers
Cloud Connector/Native Integration
Local disk
Media server
with cloud
connector

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Which On-Premise Backup Software? All of them!
AWS Storage Gateway VTL Native S3 Integration

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S3/Glacier Use Case: Enterprise Backup
Use Case
• On Premise Backup to tape, disk
Value Proposition
• Reduce costs – eliminate tape/hardware or VTL
• Simplify management
• Infinite scale compared to on-prem
• Maintain existing BU Software + paradigms
Customer: Dow Jones
• Before AWS, backup strategy was tape
• 30,000 offsite tapes to manage, poor ROI, and very poor recovery SLAs
• Engaged AWS and Commvault to build next generation on S3 and Glacier
• Now protecting over 4,000 instances at lower cost and higher resiliency.

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Active Archive: Sony DADC
Problem Statement:
• Challenged by on-prem legacy infrastructure.
• Provide a performant, secure, economical media distribution
solution.
• Decrease time to market for their customer’s finished content.
Use of AWS:
• EC2 content processing and SWF, SQS, SNS for media
workflow automation
• S3 for storage, Glacier for content archive
• CloudFront for OTT.
Business Benefits:
• Workflow pipelines can be run in a highly parallelized fashion
through AWS elastic scalability.
• Significantly shorten content delivery SLA with a new AWS
enabled target of 1-hr.
• Fully migrating away from on-prem infrastructure.
On-demand cloud-based media supply chain and delivery solution

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Use Case: Compliant Active Archive
Use Case
• Glacier Vault Lock – WORM storage for retention, legal hold
• Industries: Financial Services (SEC 17a-4), Healthcare (patient records)
• Enterprise: E-Mail, Document archiving w/ retention
Value Proposition
• Low cost, durable, compliant archive
PFPT in AWS
Policy engine MySQL/C*/SolrSocial
Amazon Glacier &
Vault Lock

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Transfer to Amazon S3 & Glacier

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Snow* Family
Snowball Snowball Edge Snowmobile
Petabyte-scale
data migration
Compute & Storage for
Hybrid/Edge workloads
Exabyte-scale data
migration

30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon S3 Transfer Acceleration
S3 Bucket
AWS Edge
Location
Uploader
Optimized
Throughput!
Typically 50%–300% faster
Change your endpoint, not your code
59 global edge locations
No firewall exceptions
No client software required

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rio De
Janeiro
Warsaw New York Atlanta Madrid Virginia Melbourne Paris Los
Angeles
Seattle Tokyo Singapore
Time[hrs]
500 GB upload from these edge locations to a bucket in Singapore
Public InternetS3 Transfer Acceleration
How fast is S3 transfer acceleration?

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
We loved how easy it was to get started with S3 transfer
acceleration — just a simple endpoint change in our
application and done.
S3 transfer acceleration reduces the average time it takes for
us to ingest videos from our global user base by almost half.
This gives our customers the ability to edit and share videos
sooner where speed is a critical factor.
All this for a fraction of the cost of the solution we evaluated
before.
- Brian Kaiser, CTO
”
“
Use Case Example: Media Uploads

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank You