More Related Content
Similar to Data Migration to AWS with DataSync & Transfer for SFTP
Similar to Data Migration to AWS with DataSync & Transfer for SFTP (20)
More from Amazon Web Services
More from Amazon Web Services (20)
Data Migration to AWS with DataSync & Transfer for SFTP
- 1. © 2020, Amazon Web Services, Inc. or its Affiliates.
Ray Wang, Solutions Architect
April 2020
Data Migration to AWS
with DataSync & Transfer for SFTP
- 2. © 2020, Amazon Web Services, Inc. or its Affiliates.© 2020, Amazon Web Services, Inc. or its Affiliates.
Agenda
Challenges - Problem we want to solve
AWS DataSync
AWS Transfer for SFTP
Demo - DataSync & Transfer for SFTP
- 3. © 2020, Amazon Web Services, Inc. or its Affiliates.© 2020, Amazon Web Services, Inc. or its Affiliates.
Challenges
Problem we want to solve
- 4. © 2020, Amazon Web Services, Inc. or its Affiliates.
Do you want to …
Migrate application data & archives to the cloud?
Replicate files for protection and recovery?
Reduce spending on storage hardware and management?
Move data to the cloud for processing?
- 5. © 2020, Amazon Web Services, Inc. or its Affiliates.
Why can’t I just transfer data to the cloud on my own?
With DIY transfers, you own:
Assuring
security and
data validity
Network and
system
complexity
Scaling
transfers
Staff time &
resources
Managing
performance
& throughput
Data transfer at scale can quickly becomes complex and time-consuming
- 6. © 2020, Amazon Web Services, Inc. or its Affiliates.© 2020, Amazon Web Services, Inc. or its Affiliates.
AWS DataSync
- 7. © 2020, Amazon Web Services, Inc. or its Affiliates.
Introducing AWS DataSync
Online transfer service that simplifies, automates, and
accelerates moving data between on-premises storage and AWS
Fast data
transfer
Cost-
effective
The speed and reliability of network acceleration software with
the cost-effectiveness of open source tools
Easy to use Secure and
reliable
Cloud
integrated
AWS
- 8. © 2020, Amazon Web Services, Inc. or its Affiliates.
Deploy agent on
VMware or EC2 for
efficient access to
local NFS or SMB server
Secure highly parallel
transfers using
optimized network
protocol
Optimized reads and
writes to Amazon S3,
Amazon EFS, and Amazon
FSx for Windows File
Server
Fully managed service
scales to send or
receive data from agent
On-Premises Region
AWS DataSyncShared
file system
AWS DataSync
agent
NFS or SMB
TLS
AWS DataSync: How it works
AWS Storage Resources
Amazon S3
Direct to all storage classes
Amazon Elastic File
System
Amazon FSx for
Windows File Server
- 9. © 2020, Amazon Web Services, Inc. or its Affiliates.
Start transferring files quickly
Start the task and
monitor progress
3
Deploy on-premises
agent and connect to
your AWS account
1
Create a task by
configuring storage
locations and options
2
- 10. © 2020, Amazon Web Services, Inc. or its Affiliates.
What can you do with DataSync?
Migration of
active application
data
Transfers for
timely in-cloud
processing
Replication for data
protection and
recovery
Archive to free
up on-premises
storage capacity
- 11. © 2020, Amazon Web Services, Inc. or its Affiliates.
Complex management of 2.4PB of on-premises Data
Domain array
Data retention required data to be retained for many
years
Problem
Solution
Outcome
Chose Amazon S3 for low cost, pay-as-you-go
model as well as versioning support
DataSync to move data to S3 as soon as possible
Performance: transfer rate of ~500 GB/hour.
Successfully transferred and verified 700TB
dataset to S3 in 2.5 months
Leader in 3D design, engineering, and
entertainment software. Autodesk
makes software for people who make
things.
- 12. © 2020, Amazon Web Services, Inc. or its Affiliates.
Call to action
Deploy a DataSync
agent
Configure your
storage locations
Learn more at https://aws.amazon.com/datasync
Start transferring
data today!
Try it out ...
- 13. © 2020, Amazon Web Services, Inc. or its Affiliates.© 2020, Amazon Web Services, Inc. or its Affiliates.
AWS Transfer for SFTP
- 14. © 2020, Amazon Web Services, Inc. or its Affiliates.
Introducing AWS Transfer for SFTP
Cost-effective
Seamless migration of
existing SFTP workflows
Native integration
with AWS services
SimpleFully managed
in AWS
Secure
and compliant
Fully-managed SFTP service enabling transfer of data into Amazon S3
- 15. © 2020, Amazon Web Services, Inc. or its Affiliates.
Transfer for SFTP: How it works
SFTP
users
AWS Cloud
Amazon S3
No changes to end-user
credentials, firewall
configurations, or scripts
Custom identity provider
Amazon
API Gateway
AWS
Lambda
Modernize
your workflow
using cloud
native services
Amazon
Athena
Amazon
Redshift
Amazon
EMR
Amazon
SageMaker
Your VPC or
data center
DIY SFTP server
and data
No need to manage
SFTP infrastructure
AWS Transfer for
SFTP
- 16. © 2020, Amazon Web Services, Inc. or its Affiliates.
AWS Transfer for SFTP Customers
- 17. © 2020, Amazon Web Services, Inc. or its Affiliates.
Problem
• multiple SFTP endpoints
• inconsistent security
• operationally inefficient to manage
Solution
• No infrastructure to manage,
automatic scaling, built-in DR
• Reduced operational burden
• Seamless cutover; using existing
authentication systems
Seamless migration of
existing workflows
”AWS Transfer for SFTP is helping us reduce our
operational burden, keeping S3 as our data lake, while
maintaining critical connection to our existing
authentication systems for external users – so they
don’t experience any disruption as we complete our
migration of SFTP services to AWS.”
~Ranga Rajagopal, Senior Director, FINRA
- 18. © 2020, Amazon Web Services, Inc. or its Affiliates.
Problem
• multiple SFTP endpoints
• inconsistent security
• operationally inefficient to manage
Solution
• No infrastructure to manage,
automatic scaling, built-in DR
• Reduced operational burden
• Seamless cutover; using existing
authentication systems
Simple to use
“AWS Transfer for SFTP was an instant win for
Celgene…We stood up our SFTP endpoint using the
service within minutes, attached it to our bucket,
provisioned users, and were in business in under an
hour. That speed and flexibility is simply not
possible in a traditional on-prem. world.”
~Lance Smith, Associate Director, Global Planning &
Technology, Celgene
- 19. © 2020, Amazon Web Services, Inc. or its Affiliates.
Try out AWS SFTP
Deploy an SFTP
server endpoint
1 Select your target
S3 bucket(s)
2 Set up your users3
Visit console.aws.amazon.com/transfer to get started today!
Pricing
• SFTP server endpoint time: $0.30/protocol/hour
• Data uploads and downloads: $0.04/GB
- 20. © 2020, Amazon Web Services, Inc. or its Affiliates.© 2020, Amazon Web Services, Inc. or its Affiliates.
Demo
DataSync/S3 SFTP/AWSCLI S3 Sync
- 21. © 2020, Amazon Web Services, Inc. or its Affiliates.
Thank you!
Ray Wang, Solutions Architect
hsiawang@amazon.com