Artificial Intelligence (AI) services on the AWS cloud bring deep learning (DL) technologies like natural language understanding (NLU), automatic speech recognition (ASR), image recognition and computer vision (CV), text-to-speech (TTS), and machine learning (ML) within reach of every developer. In this session, you will be introduced to several new AI services: Amazon Lex, to build sophisticated text and voice chatbots; Amazon Rekognition, for deep learning-based image recognition; and Amazon Polly, for turning text into lifelike speech. The opportunities to apply one or more of these DL services are nearly boundless and this session will provide a number of examples and use cases to help you get started.

1. AWS AI Overview
Dmitri Tchikatilov
Digital Advertising Business Development
dmitrit@amazon.com

2. More Users
More Data
A Flywheel For Data
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data

3. A Flywheel For Data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
More Users
More Data Better Analytics
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data

4. A Flywheel For Data
Machine Learning
Deep Learning
AI
More Users Better Products
More Data Better Analytics
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data

5. Machine Learning &
Artificial Intelligence
Big Data Analytics
More Users Better Products
More Data Better Analytics
A Flywheel For Data

6. AI @ Amazon

7. Artificial Intelligence
At Amazon (1995)

9. Amazon AI
Intelligent Services Powered By Deep Learning

10. AWS AI Suite

11. Amazon AI
AI Engines

12. One-Click GPU
Deep Learning
AWS Deep Learning AMI
Up to~40k CUDA cores
MXNet
TensorFlow
Theano
Caffe
Torch
Pre-configured CUDA drivers
Anaconda, Python3
+ CloudFormation template
+ Container Image

13. MXNet: Scalable Deep Learning Framework

14. Amazon AI
AI Platforms

15. Hot Homes
There's an 80% chance this home will sell in the next 11 days – go tour it soon.

16. Ingest/
Collect
Consume/
visualize
Store
Process/
analyze
Data
1 4
0 9
5
Amazon S3
Data lake
Amazon EMR
Amazon
Kinesis
Amazon RedShift
Answers &
Insights
Hot HomesUsers
Properties
Agents
User Profile
Recommendation
Hot Homes
Similar Homes
Agent Follow-up
Agent Scorecard
Marketing
A/B Testing
Real Time Data
…
Amazon
DynamoDB
BI / Reporting

17. Amazon AI
AI Services
Life-like Speech
Polly Lex
Conversational
Engine
Rekognition
Image Analysis

18. Amazon Polly
Life-like Speech

19. Converts text
to life-like speech
47 voices 24 languages Low latency,
real time
Fully managed
Polly: Life-like Speech Service
Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
Articles and Blogs
Training Material
Chatbots (Lex)
Public Announcements

20. Amazon Polly: Quality
Natural sounding speech
A subjective measure of how close TTS output is to human speech.
Accurate text processing
Aability of the system to interpret common text formats such as abbreviations, numerical
sequences, homographs etc.
Today in Las Vegas, NV it's 54°F.
"We live for the music", live from the Madison Square Garden.
Highly intelligibile
A measure of how comprehensible speech is.
”Peter Piper picked a peck of pickled peppers.”

21. Amazon Polly: Language Portfolio
Americas:
• Brazilian Portuguese
• Canadian French
• English (US)
• Spanish (US)
A-PAC:
• Australian English
• Indian English
• Japanese
EMEA:
• British English
• Danish
• Dutch
• French
• German
• Icelandic
• Italian
• Norwegian
• Polish
• Portuguese
• Romanian
• Russian
• Spanish
• Swedish
• Turkish
• Welsh
• Welsh English

22. Demo

23. Amazon Polly is cost-effective
• Pay-as-You-go
• $4 for 1M characters
• Free Tier of 5M characters/month - first year
• You can store and reuse generated speech
• news article - $0.03
• Charles Dickens „A Christmas Carol” – $0.66
• Tolkien „Lord of the Rings” 3 books - $1.89

24. Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where
users help translate the web and rate translations.
With Amazon Polly our users
benefit from the most lifelike
Text-to-Speech voices
available on the market.
Severin Hacker
CTO, Duolingo
”
“ • Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech

25. Amazon Rekognition
Image Analysis

26. Images – explosive growth trends
Source: InfoTrends Worldwide Consumer Photos Captured and Stored.
2013 -2017 prepared for Mylio.

27. Amazon Rekognition
Deep learning-based image recognition service
Search, verify, and organize millions of images
Object and Scene
Detection
Facial
Analysis
Face
Comparison
Facial
Recognition
Integrated with S3, Lambda, Polly, Lex

28. Object and Scene Detection
Generate labels for thousands of objects, scenes, and
concepts, each with a confidence score
• Search, filter, and
curate image
libraries
• Smart searches for
user generated
content
• Photo, travel, real
estate, vacation
rental applications
Maple
Plant
Villa
Garden
Water
Swimming Pool
Tree
Potted Plant
Backyard

29. Facial Analysis
Locate faces within images and analyze face attributes to
detect emotion, pose, facial landmarks, and features
• Avoid faces when cropping
images and overlaying ads
• Capture user demographics
and sentiment
• Recommend the best photos
• Improve online dating match
recommendations
• Dynamic, personalized ads

30. Face Comparison
Measure the likelihood that faces in two images are of the
same person
• Add face verification to
applications and devices
• Extend physical security
controls
• Provide guest access to VIP-
only facilities
• Verify users for online
exams and polls

31. Facial Recognition
Identify people in images by finding the closest match for an
input face image against a collection of stored face vectors
• Add friend tagging to social
and messaging apps
• Assist public safety officers
find missing persons
• Identify employees as they
access sensitive locations
• Identify celebrities in
historical image archives

32. Amazon Rekognition Summary
• Fully managed
• Low Cost
• Scale
• Integration with AWS services
• Pay-as-you Go
• Free Tier – 5000 images per month for first 12
months

33. Amazon Rekognition – Pricing Details
Image Analysis Tiers Price per 1000
images processed
First 1 million images processed* per month $1.00
Next 9 million images processed* per month $0.80
Next 9 million images processed* per month $0.80
Next 90 million images processed* per month $0.60
Over 100 million images processed* per month $0.40
*Images processed: For APIs with image as input, it’s the number of images analyzed. For APIs with no image input 1 API call = 1 image processed.

34. Early Feedback
“Rekognition simplifies the process of tagging and organizing end
users’ photos to help them quickly find relevant images”
“it is all very exciting and it was shocking how easy it was to set up”
“Since Rekognition accepts Amazon S3 URLs, it is a huge time-saver to
detect objects, scenes, and faces without having to move images around”

35. Amazon Lex
Conversational
Engine

36. Advent of Conversational Interactions
1st Gen:
Punch Cards & Memory Registers
2nd Gen:
Pointers & Sliders
3nd Gen:
Conversational Interfaces

37. Developer Challenges
Speech
Recognition Language
Understanding
Business Logic
Disparate
Systems
Authentication
Messaging
platforms
Scale Testing
Security
Availability
Mobile
Conversational interfaces need to combine a large number of
sophisticated algorithms and technologies

38. Amazon Lex - Features
Text and Speech language understanding: Powered by the same technology as
Alexa
Enterprise SaaS Connectors: Connect to enterprise systems
Deployment to chat services
Designed for Builders: Efficient and intuitive tools to build
conversations; scales automatically
Versioning and alias support

39. AWS Mobile Hub Integration
Authenticate users
Analyze user behavior
Store and share media
Synchronize data
More ….
Track retention
Conversational Bots
LexAWS Mobile SDKs
AWS Mobile Hub

40. Enterprise Connectors with Mobile Hub
Amazon Lex
Mobile App
Mobile Hub
SaaS Connector
Amazon API
Gateway
AWS
Lambda
1: Understand
user intent
Amazon API
Gateway
AWS
Lambda
3: Translate REST
response into
natural language
Mobile Hub
Custom Connector
2: Invoke a SaaS
application or an existing
business application
Business
Application
Firewall
User Input

41. Amazon Lex – Use Cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….

42. Customer Testimonials: HubSpot
“Through Amazon's Lex, we're adding sophisticated natural language processing capabilities that helps
GrowthBot provide a more intuitive UI for our users. Amazon Lex lets us take advantage of advanced A.I.
and machine learning without having to code the algorithms ourselves.”
“HubSpot's GrowthBot is an all-in-one chatbot which helps marketers and sales people
be more productive by providing access to relevant data and services using a
conversational interface. With GrowthBot, marketers can get help creating content,
researching competitors, and monitoring their analytics.”

43. Amazon Lex Pricing
Text Speech
Price per 1000 requests $0.75 $4.00
Free Tier*
(requests per month) 10,000 5,000
*Available for the first year upon sign-up to new Amazon Lex customers

44. Alexa VS Lex
• Alexa is coming with the eco-system (devices, install
base, 1st party and 3rd party skills)
• Lex is for single tenant chatbot to integrate with own
users

45. Summary of AWS Analytics, Database & AI
Tools Amazon Redshift
Enterprise Data Warehouse
Amazon EMR
Hadoop/Spark
Amazon Athena
Clusterless SQL
Amazon Glue
Clusterless ETL
Amazon Aurora
Managed Relational Database
Amazon Machine Learning
Predictive Analytics
Amazon Quicksight
Business Intelligence/Visualization
Amazon ElasticSearch Service
ElasticSearch
Amazon ElastiCache
Redis In-memory Datastore
Amazon DynamoDB
Managed NoSQL Database
Amazon Rekognition
Deep Learning-based Image Recognition
Amazon Lex
Voice or Text Chatbots
Amazon Kinesis
Real-Time streaming Analytics
GPU for deep learning
workloads

46. Reference
• AWS AI Blog
• Getting Started with Amazon Polly
• Getting Started with Amazon Lex
• Getting Started with Amazon Rekognition
• Getting Started with Deep Learning
• Getting Started with Amazon Kinesis Analytics
• AWS Big Data Blog

47. Questions