More Related Content Similar to Artificial Intelligence (Machine Learning) on AWS: How to Start (20) More from Vladimir Simek (17) Artificial Intelligence (Machine Learning) on AWS: How to Start1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Artificial Intelligence (Machine Learning) on AWS:
How to Start
Vladimir Simek, Senior Solutions Architect, AWS
20th of September, 2018
2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
•Brief history of AI/ML
•AI/ML in Amazon
•AWS Services for AI/ML
•Demo + Q&A
7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fulfilment
& Logistics
At Amazon, we’ve been making investments in
ML for the last 20 years…
8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
At Amazon, we’ve been making investments in
ML for the last 20 years…
Fulfilment
& Logistics
Search &
Discovery
10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
At Amazon, we’ve been making investments in
ML for the last 20 years…
Fulfilment
& Logistics
Existing
Products
Search &
Discovery
12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Put machine learning in the hands of every
developer and data scientist
ML @ AWS: Our mission
19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Amazon Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CUSTOMERS RUNNING MACHINE
LEARNING ON AWS TODAY
21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Amazon Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 P3 Instances ( Oc tober 2017)
• Up to eight NVIDIA Tesla V100 GPUs
• 1 PetaFLOP of computational performance
– 14x better than P2
• 300 GB/s GPU-to-GPU communication
(NVLink) – 9X better than P2
• 16 GB GPU memory with 900 GB/sec peak
GPU memory bandwidth
T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Deep Learning AMI
• Get started quickly with easy-to-launch tutorials
• Hassle-free setup and configuration
• Pay only for what you use – no additional charge for
the AMI
• Accelerate your model training and deployment
• Support for popular deep learning frameworks
https://d1.awsstatic.com/white
papers/nucleus-tensorflow.pdf
24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Amazon Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How do we put ML in the hands of
developers (literally)?
26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DeepLens: A Deep Learning-
Enabled Video Camera for Developers
• Fully programmable video camera
• Optimized for deep-learning on the
device with Apache MXNet, Caffe,
TensorFlow
• Tutorials, sample code, examples,
and pre-built models
27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DeepLens: How Does It Work?
Deep learning models
run in real time on the device
Deploy pre-trained educational models
Deploy custom models from Amazon SageMaker
28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DeepLens: How Does It Work?
Deep learning models
run in real time on the device
Stream live video back to AWS
Integrate with Lambda, SNS, SES, etc.
Video analytics with Amazon Rekognition Video
29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DeepLens: Project Templates
Artistic Style Transfer Hot Dog/Not Hot
Dog Recognition
Object Recognition
30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Machine Learning
• Managed service for building ML models and generating
predictions, enabling the development of robust, scalable
smart applications
• No need for extensive background in ML algorithms and
techniques
• Integrated with AWS (S3, Redshift, RDS)
• APIs for Batch and Real-Time Predictions
• Completely serverless
32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Mechanical Turk
• The first and foremost challenge in
build AI systems is to build ground
truth data
• Need human intelligence to
annotate speech, vision, or
language data sets
34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Mechanical Turk ML Customers
Facebook AI
Research (FAIR)
DigitalGlobe |
Radiant
35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine learning process is hard …
Data wrangling
• Setup and manage
notebook environments
• Get data to
notebooks securely
Experimentation
• Setup and manage
clusters
• Scale/distribute ML
algorithms
Deployment
• Setup and manage
inference clusters
• Manage and auto scale
inference APIs
• Testing, versioning,
and monitoring
Fetch data
Clean &
format data
Prepare &
transform
data
Train model
Evaluate
model
Integrate with
prod
Monitor/
debug/refresh
36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
…and time consuming
Fetch data
Clean &
format data
Prepare &
transform
data
Train model
Evaluate
model
Integrate with
prod
Monitor/
debug/refresh
6–18
months
37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Solution: Amazon SageMaker
A managed service
that provides the quickest and easiest way for
your data scientists and developers to get
ML models from idea to production.
38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
End-to-End
Machine Learning
Platform
Zero setup Flexible Model
Training
Pay by the
second
Amazon SageMaker
Build, train, and deploy machine learning models at scale
$
39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Highly-optimized
machine learning
algorithms
Amazon SageMaker
BuildPre-built notebook
instances
40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Highly-optimized
machine learning
algorithms
Amazon SageMaker
One-click training
for ML, DL, and
custom algorithms
BuildPre-built notebook
instances
Easier training with
hyperparameter
optimization
Train
41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
One-click training
for ML, DL, and
custom algorithms
Easier training with
hyperparameter
optimization
Highly-optimized
machine learning
algorithms
Amazon SageMaker
Deployment
without
engineering effort
Fully-managed
hosting at scale
BuildPre-built notebook
instances
Deploy
Train
42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming
datasets, for
cheaper training
Train faster, in a
single pass
Greater reliability
on extremely
large datasets
Choice of several
ML algorithms
Algorithms designed for huge datasets
44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Amazon Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Object and Scene
Detection
Facial
Analysis
Face
Comparison
Facial
Recognition
Celebrity
Recognition
Image
Moderation
Amazon Rekognition Image: Deep
learning-based image analysis service
47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Results:
| IT’S - 97% |
| MONDAY – 99% |
|but – 97% |keep – 96% |
| Smiling – 99% |
DetectText
Rekognition: Text in Image
48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Real-time face recognition against tens of millions of faces
<0.5 second response time
Up to 10M faces
Enable Immediate response
Rekognition: Real-Time Face Search
49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Image Customers
50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How can we apply these powerful
capabilities to video?
51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Video
Video Analysis
52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Video
One solution for all
Stored Video
Amazon S3
Video Live Stream
Amazon Kinesis Video Stream
Media Search Index
Unsafe Video Detection
Investigative Analysis
Public Safety Immediate Response
Home Monitoring
53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Media and Entertainment Public Safety Smart Home
- Search & Filter
- Immediate Response
- Investigative Analysis
- Monitoring
Amazon Rekognition Video
Primary Use Cases
54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Video
Demo
Traffic Cam - Video
Analysis
55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon confidential
Rekognition Video: Demo
57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
Use Cases
Content Creation
Mobile & Desktop Applications
Internet of Things (IoT)
Education & E-Learning
Telephony
Game Development
Key Features
50+ Voices across 27 languages
Lip-Syncing & Text Highlighting
Fine-grained Voice Control
Custom Vocabularies
58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly Customers
59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe: Automatic Speech
Recognition
Time Stamps
Support for both
regular &
telephony audio
Punctuation
& formatting
§
S3 Integration
Recognize
Multiple
Speakers
Custom
Vocabulary
60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Call
Centers
Subtitles for
VOD
Transcribe
meetings
Broadcast closed
captions
Amazon Transcribe: Use Cases
61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex – Use Cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….
Contact Center Bots
Chatbots for customer service IVR
• Account inquiries
• Bill payment
• Service update ….
63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex Customers
64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
REAL-TIME
TRANSLATION
POWERED BY DEEP
LEARNING
12 LANGUAGE PAIRS
(more to come)
LANGUAGE DETECTION
Amazon Translate: Neural Machine
Translation
66. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend: Natural Language
Processing
Sentiment Entities LanguagesKey phrases Topic modeling
Powered By Deep Learning
67. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , W A a n d w a s f o u n d e d J u l y
5 t h , 1 9 9 4 b y J e f f B e z o s . O u r
c u s t o m e r s l o v e b u y i n g e v e r y t h i n g
f r o m b o o k s t o b l e n d e r s a t g r e a t
p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m : O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h
Amazon Comprehend: Extract Insight
from Text
68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend: Use Cases
Voice of Customer Analytics
Semantic Search
Knowledge Management/Discovery
Analyzing what customer are saying about your brand, products, and services
Making search smarter by searching on keyphrase, sentiment, and topic
Organizing documents, categorizing by topic and personalizing experiences
69. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Multilingual Social Analytics
Twitter
Stream API
Kinesis
Lambda
S3 Athena
Translate Comprehend
Transcribe
70. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
71. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
72. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Multi-lingual Social Analytics: Poll
How long did this take to build?
How much does it cost to run per day?
1 day
$17/day
(to analyze tweets for AWS-size
customer)
73. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Amazon Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
AWS ML Stack
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
74. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Starting point for AI/ML on AWS:
h t t p s : / / a w s . a m a z o n . c o m / m a c h i n e - l e a r n i n g /
75. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Q & A
76. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!