Learning Objectives: - Consider why pre-processing data prior to transferring to the cloud can save time and money - Contemplate by learning edge IoT and analytics customer examples and use cases - Conclude why AWS Snowball Edge provides a unique solution to this challenge

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ian Perez Ponce | Sr. Business Development Manager
May 30, 2018
Accelerate Productivity by
Computing at the Edge

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Learning objectives
 Discover the benefits of pre-processing data prior to
ingest to the cloud
 Understand representative use cases and common
workload characteristics for edge computing from
customer examples
 Learn how AWS Snowball Edge with Greengrass
provides a unique solution to extend cloud native
services to the edge for compute

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Drivers for Edge Computing

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Data Lake Elements
Any analytic workload, any scale, at the lowest possible cost
Insights
Analytics
Data Lake
Data Movement
QuickSight SageMaker
Glue
(ETL & Data Catalog)
S3/Glacier
(Storage)
Redshift
+Spectrum
EMR Athena
Elasticsearch service
Kinesis Data Analytics
Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams
Real-time
Comprehend
DW Big data processing Interactive

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Perfectly viable until…

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Law of
physics
Law of
economics
Law of
the land
Value of processing data at the source

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Speed Economics Compliance
Value of processing data at the source

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Moving to the Edge
AWS Snowball Edge with Greengrass extends AWS to your remote edge
locations so local devices and applications can act on the data they
generate while still taking advantage of the cloud.
Data migrated
to the cloud
Data processed
locally

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud
Devices / Applications
Moving to the Edge
AWS
Snowball Edge

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Use Cases for Edge Computing

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Where do we see edge computing in effect?
Various industries ranging from research to transportation necessitate edge
computing capabilities to help cope with environments where data generation
is decentralized, data volumes are significant and network connectivity is either
inaccessible or intermittent.
Research Industrial Healthcare Transportation

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Academic Research
Environmental and ocean ecosystem research
• Collect and analyze oceanic and coastal
images
• Able to migrate and process 60TB of data
per week at a fraction of the cost
Before Snowball Edge:
• Transferred data with many small hard
drives
• Used to take weeks to months to upload
data prior to processing
• $4MM+ in infrastructure investment
• Expensive and inefficient
“With AWS Snowball Edge, we can now
collect 100 TB of data with no
intermediate steps, and we can also
analyze the images immediately using
the onboard compute capabilities. This
allows us to do deeper analysis, and we
can upload all the raw data to the AWS
Cloud by simply shipping the AWS
Snowball Edge device back.”
- Bob Cowen,
Director of Hatfield Marine Research
Center, Oregon State University

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Industrial IoT
A “PIG” is a device to inspect cracks and provide
maintenance for pipelines using smart sensors
• Device fits inside a pipeline and is sent
through to measure quality
• Offloads data at the end of the inspection
• Data volume and analysis can vary
depending on length of pipeline
• Snowball transports this data to AWS for
archival
“PIGs and Snowballs—a match made
in heaven! AWS Snowball 25 TB of
pipeline PIG data to be managed at
AWS. That is our GE PIG we pulled
some of the data from. It’s always fun
to try new AWS features and try to
break them!”
- Ben Wilson,
GE Oil and Gas CTOB

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Healthcare
Using Snowball Edge to support medical
imaging or optical scanning MRI machines
• Store the image files as they are captured
• Gives local users and administration systems
immediate access
• Using a cluster of Snowball Edge devices, to
stage imaging data for later into Amazon S3
without disrupting systems on site
“Snowball Edge enables us to extend
the innovative capabilities of
HealthSuite, our cloud-enabled
connected health ecosystem of devices,
applications and digital tools supported
by AWS, even when there is no network
support.
- Dale Wiggins,
Business Leader, HealthSuite digital
platform, Philips

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Transportation
> Automotive
Problem
Auto manufacturers and suppliers operating
autonomous vehicle fleets for research and
development are challenged with the
increasing volume and sophistication of
instrument data being collected.
Solution
Several leading manufacturers and suppliers
are looking to Snowball Edge to not only
help with migrating data to the cloud, but to
also process the data in smart maintenance
facilities where localized machine learning
and ad-hoc data analysis can be performed.
Impact
Petabyte scale data sets being generated on
a monthly basis no longer have to be
migrated to the cloud in their entirety
reducing both costs and time-to-value as a
result of edge computing.

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is Snowball Edge?

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Snowball AWS Snowball Edge
What is Snowball and why
did we build it?
Moving large volumes of data over the internet can
take years – we ship secure physical devices to you
to transfer your data at the source before shipping it
back for bulk import to the cloud.
The cloud is not always accessible from remote
locations where connectivity is limited or
intermittent – deploy ruggedized devices at the edge
with local storage and compute capacity to process
data without network dependencies.
Traditional shipping of conventional hard drives is
laborious and error prone – our E-Ink shipping label
and chain of custody tracking simplifies logistics at
scale.

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Snowball AWS Snowball Edge AWS Snowmobile
• 80 TB capacity/10 G network
• Data encryption end-to-end
• Rugged 8.5 G impact case
• Rain and dust resistant
• 100 TB capacity/10GE+
networking
• Compute and storage for
hybrid/edge workloads
• Data encryption end-to-end
• Rugged 8.5 G impact case
• Rain and dust resistant
• Rack-mountable, clusterable
• Exabyte-scale 45ft container
• Data encryption end-to-end
• Dedicated security personnel
• GPS tracking, alarm
monitoring, 24/7
surveillance, and optional
additional security
AWS Snow family

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Snowball Edge: Petabyte-scale storage with
onboard compute
Launched at re:Invent 2016
• 100 TB local storage
• 10/25/40 GE networking
• 16 vCPU, 64GB RAM
• Native S3 endpoint & NFS interface
• Cluster dimensions from 5-20 devices
• HIPAA & PCI compliant

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S3-compatible endpoint
File interface (NFS)
Storage and compute
clustering
Run AWS Greengrass
and Lambda functions
Faster data transfer
Hardware enabled
data encryption
Snowball Edge key features

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Not just for bulk data migration
• Snowball Edge supports the ability to capture, store and process data from variable
sources deployed at the edge or in traditional data center environments
• Embedded compute running Greengrass enables server-less application deployment
using Lambda for various processing functions as data is ingested locally (Lambda
functions invoked upon S3 PUT to local bucket)
Collect & Process dataCreate job Ship to AWS Moved to S3

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Common use cases for data pre-processing
Lambda functions can be invoked vis-à-vis Greengrass on Snowball
Edge for stateless data processing such image and video file indexing
and transformation prior to import.

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Common use cases for data pre-processing
Lambda functions can be invoked vis-à-vis Greengrass on Snowball
Edge for lightweight data transformation prior to ingest and analytics
workflow activation in Amazon Athena (or similar).
1. Time series data uploaded
to local S3 from edge various
sources
2. Data indexed and
catalogued in appropriate
format
3. Data imported into
Athena
4. Data immediately
available for analytics

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snowball Edge ordering and setup

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Snowball process

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Select job
profile/type

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Provide shipping
details and
service type

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Specify Snowball
Edge devices
Specify S3 buckets to
be used

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Select Lambda
function(s) and
associate to bucket(s)

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Select KMS
encryption key
Select (default)
IAM Role

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Configure
notifications via
SNS

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job
Verify inputs and
confirm job

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Initiating a Snowball Edge Job

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unlocking a Snowball Edge
Unlock code and
manifest file
accessed via
console.

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unlock the Snowball Edge

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using the S3 endpoint
********
************************************
************************************
********

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Shutdown and return ship the Snowball Edge
Label changes to AWS return
address

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Resources

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Snowball Edge resources
https://aws.amazon.com/snowball-edge/

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Lambda resources
https://aws.amazon.com/lambda/

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Q&A | iperezpo@