SlideShare a Scribd company logo
1 of 40
Download to read offline
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Guy Farber, AWS Business Development
5/19/2015
Getting Started: Storage with
Amazon S3 and Amazon Glacier
Agenda
• AWS Storage Options
• S3 - Scalable object storage
• Glacier - inexpensive archive storage
• Data ingest options
• Main use cases
• Q&A
AWS Global Infrastructure
11 Regions
28 Availability Zones
52 Edge locations
Control your geographic locality
for performance and compliance
AWS Storage Choices
Amazon S3
Durable object
storage for all types
of data
Amazon EBS
Block storage for use
with Amazon EC2
Amazon Glacier
Archival storage
for infrequently
accessed data
Economics Easy to Use Reduce risk Agility, Scale
Pay as you go
No upfront investment
No commitment
No risky capacity
planning
Self service
administration
SDKs for simple
integration
Durable and Secure
Avoid risks of physical
media handling
Reduce time to market
Focus on your
business, not your
infrastructure
Amazon EFS
File storage for use
with Amazon EC2
Amazon S3
Highly durable object storage for all types of data
Internet-scale storage
Grow without limits
Benefit from AWS’s
massive security
investments
Built-in redundancy
Designed for
99.999999999%
durability and 99.99%
availability
Low price per GB
per month
No commitment
No up-front cost
S3 Key Features
Data Management
• Cost monitoring and controls
• Lifecycle management
Ease of use
• Programmatic access using AWS SDKs
• REST APIs
• Management Console, AWS CLI
Event Notifications
• Delivered using SQS, SNS, or Lambda
• Enable you to trigger workflows, alerts or
other processing
Data protection
• Versioning
• Cross-region replication
Security
• Multi-factor authentication delete
• Flexible access control mechanisms
• Time-limited access to object
• Access logs
• Multiple client and server-side
Encryption options
1 41 81 121
102% year-over-year increase in
data transfer to and from S3
(Q4 2014 vs Q4 2013, not including Amazon use)
S3 usage
S3 scalability: buckets and objects
S3 website: static content
1 PB raw storage
800 TB usable storage
600 TB allocated storage
400 TB application data
S3 capacity pricing—pay only for what you use!
Amazon S3
S3 continuous cost reduction
Available through 11 regions globally
Priced at per GB-month rates
8 price reductions since launch
51% average S3 capacity fee
reduction on 4/1/2014
TCO: comparing on-premises to S3
• Can be challenging for some
customers
• We can help!
Reduced redundancy option
99.99% saves ~20%
Amazon Glacier
Archival storage for infrequently accessed data
Amazon Glacier
is optimized for
infrequent retrieval
Stop managing
physical media
Even lower cost than
Amazon S3;
Same high durability
3-5 hour retrieval latency
%5 free tier on retrievals
$0.01 per GB/month
$123 per TB/year
Replace tape libraries, VTLs
Glacier – 3 ways to ingest data
•Direct Glacier API/SDK
• Direct access to Glacier for deep archives
•S3 lifecycle integration
• Move older data to less expensive archive
tier
•Third party tools and gateways
• Integrate existing backup and archive
applications using an IT-friendly interface
Optimize your storage spending by tiering on AWS
Use Amazon Glacier
for lowest-cost,
durable cold storage
of archival data
Use Amazon S3
for reliable, durable
primary storage
Use Amazon S3 Reduced
Redundancy Storage
for secondary backups
at a lower cost
RRS
S3 lifecycle policies →
Key prefix “logs/”
Transition objects to Glacier 30 days after creation
Delete 365 days after creation date
<LifecycleConfiguration>
<Rule>
<ID>archive-in-30-days</ID>
<Prefix>logs/</Prefix>
<Status>Enabled</Status>
<Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass>
</Transition>
<Expiration>
<Days>365</Days>
</Expiration>
</Rule>
</LifecycleConfiguration
Amazon S3 – advanced
features
• Preserve, retrieve, and restore every version
of every object stored in your bucket
• S3 automatically adds new versions and
preserves deleted objects with delete markers
• Easily control the number of versions kept by
using lifecycle expiration policies
• Easy to turn on in the AWS Management
Console
S3 versioning
Key = photo.gif
ID = 121212
Key = photo.gif
ID = 111111
Versioning
Enabled
PUT
Key = photo.gif
S3 cross-region replication
Automated, fast, and reliable asynchronous replication of data across AWS regions
Source
(Virginia)
Destination
(Oregon)
• Only replicates new PUTs. Once
S3 is configured, all new uploads
into a source bucket will be
replicated
• Entire bucket or prefix based
• 1:1 replication between any 2
regions
• Versioning required
Use cases:
• Compliance—store data hundreds of miles apart
• Lower latency—distribute data to regional customers)
• Security—create remote replicas managed by separate AWS accounts
S3 event notifications
Delivers notifications to Amazon SNS, Amazon SQS, or AWS
Lambda when events occur in S3
S3
Events
SNS topic
SQS queue
Lambda function
Notifications
Foo() {
…
}
Prior to S3 VPCE
S3 virtual private endpoint (VPCE)
Using S3 VPCE
• Public IP on EC2 Instances and IGW
• Private IP on EC2 Instances and NAT
• Access S3 using S3 Private Endpoint (VPE)
without using NAT instances or Gateways
• Increased security
Amazon S3
S3
S3 data encryption options
Client-side encryption use AWS SDKs
• You manage the encryption keys and never send them to AWS
Server-side encryption (SSE) with Amazon S3 managed keys
• “Check-the-box” to encrypt your data at rest. Keys managed by S3
SSE with customer provided keys
• You manage your encryption keys and provide them for PUTs and GETS
SSE with AWS Key Management Service managed keys
• Keys managed centrally in AWS KMS with permissions and auditing of usage
For more details – watch Encryption and Key Management in AWS:
https://www.youtube.com/watch?v=uhXalpNzPU4
AWS data ingest options
AWS Import/
Export
Internet/VPN
AWS Storage Gateway
Service
AWS Direct
Connect
S3 and Glacier use cases
 Cloud Storage for web applications
 Origin store for content distribution
 Staging area and persistent store for Big Data analytics
 Backup and archive target
Druva InSync SaaS: Endpoint Data Protection
Druva relies on Amazon
EC2, S3 and DynamoDB
for inSync Cloud - a fully
automated, secure,
enterprise backup solution
“Building inSync Cloud on
AWS has meant a faster
time market”
Milind Borate, Druva CTO
http://aws.amazon.com/solutions/case-studies/druva/
• S3 can be used as durable
origin for global content
distribution
• Provides single origin for
multiple CDNs, such as
Amazon CloudFront
• Data transfer out of S3 into
CloudFront is now free!
• Optimal for serving static
web assets such as images,
videos and HTML
Single origin storage for content distribution
Amazon S3
Bucket
Edge
Location
Edge
Location
Edge
Location
Edge
Location
Edge
Location
3
3
2
2
Edge
Location
Edge
Location
Amazon CloudFront edge locations
AWS provides full-site,
or media asset, delivery
via a worldwide content
delivery network (CDN)
called Amazon CloudFront.
SoundCloud—leveraging S3 and Glacier
for audio transcoding
• World’s leading social sound platform
• Audio files must be transcoded and
stored in multiple formats
S3 via
CloudFront
Glacier
Big Data analytics is a rapidly growing use case…
• Common staging area for Big
Data analytics jobs
• Use distributed cluster solutions
(i.e. MapReduce) to run large-
scale processing and analysis of
data.
• Scale compute resources
without depending on storage
• Leverage a highly available
object store that can be easily
shared by multiple instances
within a cluster
S3 for staging and persistently storing Big Data
Amazon Simple
Storage Service (S3)
Amazon EMR
Job Flow
Amazon Ec2
Instance
Amazon
CloudWatc
h The Amazon EMR job
flow runs on a cluster of
Amazon EC2
Instances
Input data
Output results
Metrics
Netflix, a global video delivery provider,
uses S3 as the storage layer for Hadoop-
based Big Data applications
S3 Value:
• 11 9’s of durability
• Use Versioning as protection against accidental
deletes and overwrites
• Grew quickly from a few hundred TB to many PBs
• Access the same data in S3 from multiple Hadoop
clusters
• Tight integration with Amazon EMR
S3 for Big Data: Netflix
• Eliminate over-purchasing
and provisioning with virtually
limitless capacity
• Enable Information Lifecycle
Management with automated
tiering between S3 and
Glacier
• Ideal for regulatory and
compliance cases
Archive after
30 days
My S3 bucket Amazon Glacier
rawdata1
rawdata2
rawdata3 Delete after
7 years
Backup and Archive
Easy cloud backup with AWS Storage Gateway
Customer Datacenter
Amazon S3
AWS Storage
Gateway VM
On-Premises HostApplication
Servers
ISCSI
Works with
existing
applications
Direct Attached or
Storage Area Network Disks
AWS Storage
Gateway Service
Replace physical tape with AWS Storage
Gateway-VTL
Customer Datacenter
On-Premises Host
Direct Attached or
Storage Area Network Disks
Backup
Application
SCSI Tape Protocol
over iSCSI
Virtual Tape Library
Software Appliance VM
Amazon S3
AWS Storage
Gateway Service
Amazon Glacier
Virtual Tape
Library
Virtual Tape
Shelf
AWS Technology Partners integrate with S3
and Glacier
Spot Trading implements NetApp SteelStore to
optimize backup process
Spot Trading is a
technology-focused
proprietary trading firm
built on applied
technology, using the
latest in innovation to
solve problems in the
financial markets.
NetApp SteelStore + Amazon S3 value:
• 40 hours/month reclaimed by IT team to
focus on new strategies and systems
• Annual archival cost reduced by 96%
• Two-year ROI for SteelStore appliance,
including cloud storage costs
• $500,000 potential cost avoidance by
eliminating a costly SAN upgrade
• Deduplication reduced dataset by 85%
• Restores in minutes (from cache) or 4–5
hours (from Glacier) vs. days with tape
• Encryption in flight and at rest meets data
security requirements
Glacier
Data Center
AWS
Cloud-integrated
storage appliance
NetApp SteelStore
S3
What’s next?
Getting started with S3 and Glacier:
http://aws.amazon.com/s3/getting-started/
http://aws.amazon.com/glacier/getting-started/
Pricing:
http://aws.amazon.com/s3/pricing/
http://aws.amazon.com/glacier/pricing/
AWS Youtube channel:
https://www.youtube.com/user/AmazonWebServices/playlists
AWS Summit – Chicago: An exciting, free cloud conference designed to educate and inform new
customers about the AWS platform, best practices and new cloud services.
Details
• July 1, 2015
• Chicago, Illinois
• @ McCormick Place
Featuring
• New product launches
• 36+ sessions, labs, and bootcamps
• Executive and partner networking
Registration is now open
• Come and see what AWS and the cloud can do for you.
CTA Script
- If you are interested in learning more about how to navigate the cloud to grow
your business - then attend the AWS Summit Chicago, July 1st.
- Register today to learn from technical sessions led by AWS engineers, hear best
practices from AWS customers and partners, and participate in some of the 30+
paid sessions and labs.
- Simply go to
https://aws.amazon.com/summits/chicago/?trkcampaign=summit_chicago_bootc
amps&trk=Webinar_slide
to register today.
- Registration is FREE.
TRACKING CODE:
- Listed above.
Q&A
Learn more at: http://aws.amazon.com/s3/
http://aws.amazon.com/glacier/
gfarber@amazon.com

More Related Content

What's hot

AWS S3 Tutorial For Beginners | Edureka
AWS S3 Tutorial For Beginners | EdurekaAWS S3 Tutorial For Beginners | Edureka
AWS S3 Tutorial For Beginners | EdurekaEdureka!
 
What is Cloud Computing with Amazon Web Services?
What is Cloud Computing with Amazon Web Services?What is Cloud Computing with Amazon Web Services?
What is Cloud Computing with Amazon Web Services?Amazon Web Services
 
[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018
[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018
[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018Amazon Web Services
 
AWS Monitoring & Logging
AWS Monitoring & LoggingAWS Monitoring & Logging
AWS Monitoring & LoggingJason Poley
 
Understand AWS Pricing
Understand AWS PricingUnderstand AWS Pricing
Understand AWS PricingLynn Langit
 
AWS basics
AWS basicsAWS basics
AWS basicsmbaric
 
Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)Amazon Web Services
 
AWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsAWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsPiyush Agrawal
 
AWS IAM and security
AWS IAM and securityAWS IAM and security
AWS IAM and securityErik Paulsson
 

What's hot (20)

Building-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWSBuilding-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWS
 
AWS S3 Tutorial For Beginners | Edureka
AWS S3 Tutorial For Beginners | EdurekaAWS S3 Tutorial For Beginners | Edureka
AWS S3 Tutorial For Beginners | Edureka
 
What is Cloud Computing with Amazon Web Services?
What is Cloud Computing with Amazon Web Services?What is Cloud Computing with Amazon Web Services?
What is Cloud Computing with Amazon Web Services?
 
Introduction to Amazon Aurora
Introduction to Amazon AuroraIntroduction to Amazon Aurora
Introduction to Amazon Aurora
 
[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018
[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018
[REPEAT] Microsoft Active Directory Deep Dive (WIN303-R) - AWS re:Invent 2018
 
Amazon s3
Amazon s3Amazon s3
Amazon s3
 
AWS RDS
AWS RDSAWS RDS
AWS RDS
 
AWS Monitoring & Logging
AWS Monitoring & LoggingAWS Monitoring & Logging
AWS Monitoring & Logging
 
Understand AWS Pricing
Understand AWS PricingUnderstand AWS Pricing
Understand AWS Pricing
 
AWS basics
AWS basicsAWS basics
AWS basics
 
AWS Elastic Compute Cloud (EC2)
AWS Elastic Compute Cloud (EC2) AWS Elastic Compute Cloud (EC2)
AWS Elastic Compute Cloud (EC2)
 
Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)
 
Building Data Lakes with AWS
Building Data Lakes with AWSBuilding Data Lakes with AWS
Building Data Lakes with AWS
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
Amazon EC2 Masterclass
Amazon EC2 MasterclassAmazon EC2 Masterclass
Amazon EC2 Masterclass
 
Amazon Redshift Masterclass
Amazon Redshift MasterclassAmazon Redshift Masterclass
Amazon Redshift Masterclass
 
AWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsAWS Storage - S3 Fundamentals
AWS Storage - S3 Fundamentals
 
Intro to AWS Lambda
Intro to AWS Lambda Intro to AWS Lambda
Intro to AWS Lambda
 
AWS IAM and security
AWS IAM and securityAWS IAM and security
AWS IAM and security
 
Amazon API Gateway
Amazon API GatewayAmazon API Gateway
Amazon API Gateway
 

Similar to AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon Glacier

Storage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon GlacierStorage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon GlacierAmazon Web Services
 
ENT306 Migrating large Scale Data Sets to the Cloud
ENT306 Migrating large Scale Data Sets to the CloudENT306 Migrating large Scale Data Sets to the Cloud
ENT306 Migrating large Scale Data Sets to the CloudAmazon Web Services
 
An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...
An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...
An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...Amazon Web Services
 
ENT306 Migrating Large Scale Data Sets to the Cloud
ENT306 Migrating Large Scale Data Sets to the CloudENT306 Migrating Large Scale Data Sets to the Cloud
ENT306 Migrating Large Scale Data Sets to the CloudAmazon Web Services
 
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...Amazon Web Services
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloudAmazon Web Services
 
Understanding AWS Storage Options
Understanding AWS Storage OptionsUnderstanding AWS Storage Options
Understanding AWS Storage OptionsAmazon Web Services
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014Amazon Web Services
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage ServicesAmazon Web Services
 
AWS Storage and Data Migration: AWS Innovate Ottawa
AWS Storage and Data Migration: AWS Innovate OttawaAWS Storage and Data Migration: AWS Innovate Ottawa
AWS Storage and Data Migration: AWS Innovate OttawaAmazon Web Services
 
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...Amazon Web Services
 
Choosing the right data storage in the Cloud.
Choosing the right data storage in the Cloud. Choosing the right data storage in the Cloud.
Choosing the right data storage in the Cloud. Amazon Web Services
 
Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...
Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...
Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...Amazon Web Services
 
Moving Data into the Cloud with AWS Transfer Services - May 2017 AWS Online ...
Moving Data into the Cloud with AWS Transfer Services  - May 2017 AWS Online ...Moving Data into the Cloud with AWS Transfer Services  - May 2017 AWS Online ...
Moving Data into the Cloud with AWS Transfer Services - May 2017 AWS Online ...Amazon Web Services
 
AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...
AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...
AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...Amazon Web Services
 
Simplifying migration to aws - everett dolgner
Simplifying migration to aws -   everett dolgnerSimplifying migration to aws -   everett dolgner
Simplifying migration to aws - everett dolgnerAmazon Web Services
 

Similar to AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon Glacier (20)

Storage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon GlacierStorage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon Glacier
 
ENT306 Migrating large Scale Data Sets to the Cloud
ENT306 Migrating large Scale Data Sets to the CloudENT306 Migrating large Scale Data Sets to the Cloud
ENT306 Migrating large Scale Data Sets to the Cloud
 
Aws storage for media overview
Aws storage for media overview Aws storage for media overview
Aws storage for media overview
 
An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...
An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...
An Overview of AWS Services for Data Storage and Migration - SRV205 - Atlanta...
 
ENT306 Migrating Large Scale Data Sets to the Cloud
ENT306 Migrating Large Scale Data Sets to the CloudENT306 Migrating Large Scale Data Sets to the Cloud
ENT306 Migrating Large Scale Data Sets to the Cloud
 
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
AWS Data Transfer Services - AWS Storage Gateway, AWS Snowball, AWS Snowball ...
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloud
 
Understanding AWS Storage Options
Understanding AWS Storage OptionsUnderstanding AWS Storage Options
Understanding AWS Storage Options
 
AWS Storage and Data Migration
AWS Storage and Data MigrationAWS Storage and Data Migration
AWS Storage and Data Migration
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
 
Intro to AWS: Storage Services
Intro to AWS: Storage ServicesIntro to AWS: Storage Services
Intro to AWS: Storage Services
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage Services
 
AWS Storage and Data Migration: AWS Innovate Ottawa
AWS Storage and Data Migration: AWS Innovate OttawaAWS Storage and Data Migration: AWS Innovate Ottawa
AWS Storage and Data Migration: AWS Innovate Ottawa
 
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
 
Choosing the right data storage in the Cloud.
Choosing the right data storage in the Cloud. Choosing the right data storage in the Cloud.
Choosing the right data storage in the Cloud.
 
Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...
Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...
Using AWS for Backup and Restore (backup in the cloud, backup to the cloud, a...
 
Moving Data into the Cloud with AWS Transfer Services - May 2017 AWS Online ...
Moving Data into the Cloud with AWS Transfer Services  - May 2017 AWS Online ...Moving Data into the Cloud with AWS Transfer Services  - May 2017 AWS Online ...
Moving Data into the Cloud with AWS Transfer Services - May 2017 AWS Online ...
 
AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...
AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...
AWS re:Invent 2016: Getting Started with the Hybrid Cloud: Enterprise Backup ...
 
Simplifying migration to aws - everett dolgner
Simplifying migration to aws -   everett dolgnerSimplifying migration to aws -   everett dolgner
Simplifying migration to aws - everett dolgner
 
Migrating Large Scale Datasets
Migrating Large Scale DatasetsMigrating Large Scale Datasets
Migrating Large Scale Datasets
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Recently uploaded

SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 

Recently uploaded (20)

SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 

AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon Glacier

  • 1. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Guy Farber, AWS Business Development 5/19/2015 Getting Started: Storage with Amazon S3 and Amazon Glacier
  • 2. Agenda • AWS Storage Options • S3 - Scalable object storage • Glacier - inexpensive archive storage • Data ingest options • Main use cases • Q&A
  • 3. AWS Global Infrastructure 11 Regions 28 Availability Zones 52 Edge locations Control your geographic locality for performance and compliance
  • 4. AWS Storage Choices Amazon S3 Durable object storage for all types of data Amazon EBS Block storage for use with Amazon EC2 Amazon Glacier Archival storage for infrequently accessed data Economics Easy to Use Reduce risk Agility, Scale Pay as you go No upfront investment No commitment No risky capacity planning Self service administration SDKs for simple integration Durable and Secure Avoid risks of physical media handling Reduce time to market Focus on your business, not your infrastructure Amazon EFS File storage for use with Amazon EC2
  • 5. Amazon S3 Highly durable object storage for all types of data Internet-scale storage Grow without limits Benefit from AWS’s massive security investments Built-in redundancy Designed for 99.999999999% durability and 99.99% availability Low price per GB per month No commitment No up-front cost
  • 6. S3 Key Features Data Management • Cost monitoring and controls • Lifecycle management Ease of use • Programmatic access using AWS SDKs • REST APIs • Management Console, AWS CLI Event Notifications • Delivered using SQS, SNS, or Lambda • Enable you to trigger workflows, alerts or other processing Data protection • Versioning • Cross-region replication Security • Multi-factor authentication delete • Flexible access control mechanisms • Time-limited access to object • Access logs • Multiple client and server-side Encryption options
  • 7. 1 41 81 121 102% year-over-year increase in data transfer to and from S3 (Q4 2014 vs Q4 2013, not including Amazon use) S3 usage
  • 10. 1 PB raw storage 800 TB usable storage 600 TB allocated storage 400 TB application data S3 capacity pricing—pay only for what you use! Amazon S3
  • 11. S3 continuous cost reduction Available through 11 regions globally Priced at per GB-month rates 8 price reductions since launch 51% average S3 capacity fee reduction on 4/1/2014 TCO: comparing on-premises to S3 • Can be challenging for some customers • We can help!
  • 13. Amazon Glacier Archival storage for infrequently accessed data Amazon Glacier is optimized for infrequent retrieval Stop managing physical media Even lower cost than Amazon S3; Same high durability 3-5 hour retrieval latency %5 free tier on retrievals $0.01 per GB/month $123 per TB/year Replace tape libraries, VTLs
  • 14. Glacier – 3 ways to ingest data •Direct Glacier API/SDK • Direct access to Glacier for deep archives •S3 lifecycle integration • Move older data to less expensive archive tier •Third party tools and gateways • Integrate existing backup and archive applications using an IT-friendly interface
  • 15. Optimize your storage spending by tiering on AWS Use Amazon Glacier for lowest-cost, durable cold storage of archival data Use Amazon S3 for reliable, durable primary storage Use Amazon S3 Reduced Redundancy Storage for secondary backups at a lower cost RRS
  • 16. S3 lifecycle policies → Key prefix “logs/” Transition objects to Glacier 30 days after creation Delete 365 days after creation date <LifecycleConfiguration> <Rule> <ID>archive-in-30-days</ID> <Prefix>logs/</Prefix> <Status>Enabled</Status> <Transition> <Days>30</Days> <StorageClass>GLACIER</StorageClass> </Transition> <Expiration> <Days>365</Days> </Expiration> </Rule> </LifecycleConfiguration
  • 17. Amazon S3 – advanced features
  • 18. • Preserve, retrieve, and restore every version of every object stored in your bucket • S3 automatically adds new versions and preserves deleted objects with delete markers • Easily control the number of versions kept by using lifecycle expiration policies • Easy to turn on in the AWS Management Console S3 versioning Key = photo.gif ID = 121212 Key = photo.gif ID = 111111 Versioning Enabled PUT Key = photo.gif
  • 19. S3 cross-region replication Automated, fast, and reliable asynchronous replication of data across AWS regions Source (Virginia) Destination (Oregon) • Only replicates new PUTs. Once S3 is configured, all new uploads into a source bucket will be replicated • Entire bucket or prefix based • 1:1 replication between any 2 regions • Versioning required Use cases: • Compliance—store data hundreds of miles apart • Lower latency—distribute data to regional customers) • Security—create remote replicas managed by separate AWS accounts
  • 20. S3 event notifications Delivers notifications to Amazon SNS, Amazon SQS, or AWS Lambda when events occur in S3 S3 Events SNS topic SQS queue Lambda function Notifications Foo() { … }
  • 21. Prior to S3 VPCE S3 virtual private endpoint (VPCE) Using S3 VPCE • Public IP on EC2 Instances and IGW • Private IP on EC2 Instances and NAT • Access S3 using S3 Private Endpoint (VPE) without using NAT instances or Gateways • Increased security Amazon S3 S3
  • 22. S3 data encryption options Client-side encryption use AWS SDKs • You manage the encryption keys and never send them to AWS Server-side encryption (SSE) with Amazon S3 managed keys • “Check-the-box” to encrypt your data at rest. Keys managed by S3 SSE with customer provided keys • You manage your encryption keys and provide them for PUTs and GETS SSE with AWS Key Management Service managed keys • Keys managed centrally in AWS KMS with permissions and auditing of usage For more details – watch Encryption and Key Management in AWS: https://www.youtube.com/watch?v=uhXalpNzPU4
  • 23. AWS data ingest options AWS Import/ Export Internet/VPN AWS Storage Gateway Service AWS Direct Connect
  • 24. S3 and Glacier use cases  Cloud Storage for web applications  Origin store for content distribution  Staging area and persistent store for Big Data analytics  Backup and archive target
  • 25. Druva InSync SaaS: Endpoint Data Protection Druva relies on Amazon EC2, S3 and DynamoDB for inSync Cloud - a fully automated, secure, enterprise backup solution “Building inSync Cloud on AWS has meant a faster time market” Milind Borate, Druva CTO http://aws.amazon.com/solutions/case-studies/druva/
  • 26. • S3 can be used as durable origin for global content distribution • Provides single origin for multiple CDNs, such as Amazon CloudFront • Data transfer out of S3 into CloudFront is now free! • Optimal for serving static web assets such as images, videos and HTML Single origin storage for content distribution Amazon S3 Bucket Edge Location Edge Location Edge Location Edge Location Edge Location 3 3 2 2 Edge Location Edge Location
  • 27. Amazon CloudFront edge locations AWS provides full-site, or media asset, delivery via a worldwide content delivery network (CDN) called Amazon CloudFront.
  • 28. SoundCloud—leveraging S3 and Glacier for audio transcoding • World’s leading social sound platform • Audio files must be transcoded and stored in multiple formats S3 via CloudFront Glacier
  • 29. Big Data analytics is a rapidly growing use case…
  • 30. • Common staging area for Big Data analytics jobs • Use distributed cluster solutions (i.e. MapReduce) to run large- scale processing and analysis of data. • Scale compute resources without depending on storage • Leverage a highly available object store that can be easily shared by multiple instances within a cluster S3 for staging and persistently storing Big Data Amazon Simple Storage Service (S3) Amazon EMR Job Flow Amazon Ec2 Instance Amazon CloudWatc h The Amazon EMR job flow runs on a cluster of Amazon EC2 Instances Input data Output results Metrics
  • 31. Netflix, a global video delivery provider, uses S3 as the storage layer for Hadoop- based Big Data applications S3 Value: • 11 9’s of durability • Use Versioning as protection against accidental deletes and overwrites • Grew quickly from a few hundred TB to many PBs • Access the same data in S3 from multiple Hadoop clusters • Tight integration with Amazon EMR S3 for Big Data: Netflix
  • 32. • Eliminate over-purchasing and provisioning with virtually limitless capacity • Enable Information Lifecycle Management with automated tiering between S3 and Glacier • Ideal for regulatory and compliance cases Archive after 30 days My S3 bucket Amazon Glacier rawdata1 rawdata2 rawdata3 Delete after 7 years Backup and Archive
  • 33. Easy cloud backup with AWS Storage Gateway Customer Datacenter Amazon S3 AWS Storage Gateway VM On-Premises HostApplication Servers ISCSI Works with existing applications Direct Attached or Storage Area Network Disks AWS Storage Gateway Service
  • 34. Replace physical tape with AWS Storage Gateway-VTL Customer Datacenter On-Premises Host Direct Attached or Storage Area Network Disks Backup Application SCSI Tape Protocol over iSCSI Virtual Tape Library Software Appliance VM Amazon S3 AWS Storage Gateway Service Amazon Glacier Virtual Tape Library Virtual Tape Shelf
  • 35. AWS Technology Partners integrate with S3 and Glacier
  • 36. Spot Trading implements NetApp SteelStore to optimize backup process Spot Trading is a technology-focused proprietary trading firm built on applied technology, using the latest in innovation to solve problems in the financial markets. NetApp SteelStore + Amazon S3 value: • 40 hours/month reclaimed by IT team to focus on new strategies and systems • Annual archival cost reduced by 96% • Two-year ROI for SteelStore appliance, including cloud storage costs • $500,000 potential cost avoidance by eliminating a costly SAN upgrade • Deduplication reduced dataset by 85% • Restores in minutes (from cache) or 4–5 hours (from Glacier) vs. days with tape • Encryption in flight and at rest meets data security requirements Glacier Data Center AWS Cloud-integrated storage appliance NetApp SteelStore S3
  • 37. What’s next? Getting started with S3 and Glacier: http://aws.amazon.com/s3/getting-started/ http://aws.amazon.com/glacier/getting-started/ Pricing: http://aws.amazon.com/s3/pricing/ http://aws.amazon.com/glacier/pricing/ AWS Youtube channel: https://www.youtube.com/user/AmazonWebServices/playlists
  • 38. AWS Summit – Chicago: An exciting, free cloud conference designed to educate and inform new customers about the AWS platform, best practices and new cloud services. Details • July 1, 2015 • Chicago, Illinois • @ McCormick Place Featuring • New product launches • 36+ sessions, labs, and bootcamps • Executive and partner networking Registration is now open • Come and see what AWS and the cloud can do for you.
  • 39. CTA Script - If you are interested in learning more about how to navigate the cloud to grow your business - then attend the AWS Summit Chicago, July 1st. - Register today to learn from technical sessions led by AWS engineers, hear best practices from AWS customers and partners, and participate in some of the 30+ paid sessions and labs. - Simply go to https://aws.amazon.com/summits/chicago/?trkcampaign=summit_chicago_bootc amps&trk=Webinar_slide to register today. - Registration is FREE. TRACKING CODE: - Listed above.
  • 40. Q&A Learn more at: http://aws.amazon.com/s3/ http://aws.amazon.com/glacier/ gfarber@amazon.com