SlideShare a Scribd company logo
1 of 98
Download to read offline
©2015, Amazon Web Services, Inc.
Yian Han
Senior Business Development Manager, AWS
2017 09 14
Amazon Web Services AI
What to Expect from the Session
Why AI?
A Flying Wheel for Data
AI Example in Amazon and AWS
The Challenges
How We can Help You
43,252,003,274,489,856,000
43	QUINTILLION	
UNIQUE	COMBINATIONS
SOLVED IN 0.9 SECONDS
F2 U' R' L F2 R L' U'
Learning
function
F2 U' R' L F2 R L' U'
Learning
function
1%
accuracy
R U r U R U2 r U2%
accuracy
Learning
function
20%
accuracy
40%
accuracy
60%
accuracy
80%
accuracy
95%
accuracy
2%
accuracy
Learning
function
95%
accuracy
?
F2 R F R′ B′ D F D′ B D F
Behind The Scene
A Flywheel For Data
Machine Learning
Deep Learning
AI
More Users Better Products
More Data Better Analytics
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Machine Learning &
Artificial Intelligence
Big Data
More Users Better Products
More Data Better Analytics
A Flywheel For Data
Algorithms
Data
Programming
Models
GPUs	&
Acceleration
The Advent of Deep Learning
image understanding
natural language
processing
speech recognition
autonomy
AI Applications on AWS
Zillow
• Zestimate (using Apache Spark)
Howard Hughes Corp
• Lead scoring for luxury real estate
purchase predictions
FINRA
• Anomaly detection, sequence matching,
regression analysis, network/tribe analysis
Netflix
• Recommendation engine
Pinterest
• Image recognition search
Fraud.net
• Detect online payment fraud
DataXu
• Leverage automated & unattended ML at
large scale (Amazon EMR + Spark)
Mapillary
• Computer vision for crowd sourced maps
Hudl
• Predictive analytics on sports plays
Upserve
• Restaurant table mgmt & POS for
forecasting customer traffic
TuSimple
• Computer Vision for Autonomous Driving
Clarifai
• Computer Vision APIs
AI on AWS and Amazon
AI Applications on AWS
Pinterest Lens
Netflix Recommendation Engine
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Enhance
Existing Products
Define New
Product
Categories
Bring Machine
Learning To All
Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Artificial Intelligence At Amazon
Artificial Intelligence
At Amazon (1995)
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Enhance
Existing Products
Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Enhance
Existing Products
Define New
Product
Categories
Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Enhance
Existing Products
Define New
Product
Categories
Bring Machine
Learning To All
Artificial Intelligence At Amazon
Sounds interesting!
Is there any challenges?
Data Training Prediction
The Challenge For Artificial Intelligence: SCALE
Tons of GPUs and CPUs
Serverless
At the Edge, On IoT Devices
Prediction
The Challenge For Artificial Intelligence: SCALE
Tons of GPUs
Elastic capacity
Training
Pre-built images
Aggressive migration
New data created on AWS
Data
PBs of existing data
Can We Help Customers
Put Intelligence At The Heart Of
Every Application & Business?
Machine Learning &
Artificial Intelligence
Big Data
More Users Better Products
More Data Better Analytics
A Flywheel For Data
Amazon AI
Intelligent Services Powered By Deep Learning
Amazon AI: New Deep Learning Services
Life-like Speech
Polly Lex
Conversational
Engine
Rekognition
Image Analysis
Deep Learning
Frameworks
MXNet, TensorFlow,
Theano, Caffe, Torch
DIY	Deep	Learning
for	Custom	Models
AI	Enabled
Managed	API
Services
Amazon AI: New Deep Learning Services
Polly LexRekognition
Deep Learning
Frameworks
MXNet, TensorFlow, Theano, Caffe, Torch
CONTROL
USABILITY&
SIMPLICITY
AWS offers a range of tools to make AI/ML more accessible
PollyLex Rekognition
Deep Learning FrameworksMachine Learning PlatformsAmazon AI/ML Services
Usability/simplicity:
leverages AWS AI/ML expertise
Greater control:
customer-specific models
These solutions are underpinned by proven,
scalable AWS products and services
AWS
Greengrass
AWS
IoT
AWS
Lambda
Amazon EC2
(P2 and G2 GPUs)
Amazon
S3
Amazon
DynamoDB
Amazon
Redshift
Amazon EC2
(CPUs)
Amazon EC2
(ENA)
Amazon ML
Spark & EMR
Kinesis
Batch
ECS
MXNet, TensorFlow, Theano, Caffe, Torch
One-Click GPU
Deep Learning
AWS Deep Learning AMI
Up to~40k CUDA cores
MXNet
TensorFlow
Theano
Caffe
Torch
Pre-configured CUDA drivers
Anaconda, Python3
+ CloudFormation template
+ Container Image
MXNet: Scalable Deep Learning Framework
Amazon Polly
Converts text
to life-like speech
47 voices 24 languages Low latency,
real time
Fully managed
Polly: Life-like Speech Service
Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
Articles and Blogs
Training Material
Chatbots (Lex)
Public Announcements
Today in Las Vegas, NV it's 54°F
"We live for the music", live from the Madison Square Garden
St. Mary's Church is at 226 St. Mary's St.
Richard’s number is 2025551212
My name is Hermione. It is spelled Hermione
Jesus Manuel Corona is a professional footballer
Still lost in the forest, Marry started to whisper:
"Don't make any noise, they will find us"
Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where
users help translate the web and rate translations.
With Amazon Polly our users
benefit from the most lifelike
Text-to-Speech voices
available on the market.
Severin Hacker
CTO, Duolingo
”
“ • Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech
Polly (Salli)
Duolingo
Old voice
Winner!
”The new voice is a huge improvement ! I really like it, the old one was
terrible at times.”
Amazon Lex
1st Gen: Machine-oriented
interactions
2nd Gen: Control-oriented
& translated
3rd Gen:
Intent-oriented
The Advent Of Conversational Interactions
Voice & Text
“Chatbots”
Powers
Alexa
Voice interactions
on mobile, web
& devices
Text interaction
with Slack & Messenger
Enterprise
Connectors
(with more coming) Salesforce
Microsoft Dynamics
Marketo
Zendesk
Quickbooks
Hubspot
Lex: Build Natural, Conversational
Interactions In Voice & Text
Improving human interactions…
• Contact, service, and support center interfaces (text + voice)
• Employee productivity and collaboration (minutes into seconds)
Origin
Destination
Departure Date
Flight Booking
“Book a flight
to London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Intent /
Slot model
London Heathrow
Origin
Destination
Departure Date
Flight Booking
“Book a flight
to London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Intent /
Slot model
London Heathrow
LocationLocation
Seattle
Origin
Destination
Departure Date
Flight Booking
“Book a flight
to London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Intent /
Slot model
London Heathrow
LocationLocation
Seattle
Prompt
“When would you like to fly?”
“When would you
like to fly?”
Polly
Origin
Destination
Departure Date
Flight Booking
London Heathrow
Seattle
Prompt
“When would you like to fly?”
“When would you
like to fly?”
Polly
“Next Friday”
Origin
Destination
Departure Date
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Next Friday
Utterances
Natural Language
Understanding
Flight booking
02 / 24 / 2017
Intent /
Slot model
London Heathrow
Seattle
02/24/2017
Origin
Destination
Departure Date
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Next Friday
Utterances
Natural Language
Understanding
Flight booking
02 / 24 / 2017
Intent /
Slot model
London Heathrow
Seattle
02/24/2017
Confirmation
“Your flight is booked for next Friday”
“Your flight is booked
for next Friday”
Polly
Origin
Destination
Departure Date
Flight Booking
“Next Friday”
Automatic
Speech Recognition
Next Friday
Utterances
Natural Language
Understanding
Flight booking
02 / 24 / 2017
Intent /
Slot model
London Heathrow
Seattle
02/24/2017
Hotel Booking
Amazon Rekognition
Rekognition: Search & Understand Visual Content
Real-time &
batch image
analysis
Object & Scene
Detection
Facial Detection Face SearchFacial Analysis
Amazon Rekognition
Deep learning-based image recognition service
Search, verify, and organize millions of images
Object and Scene
Detection
Facial
Analysis
Face
Comparison
Facial
Recognition
Integrated with S3, Lambda, Polly, Lex
Rekognition: Object & Scene Detection
Demo
Let’s try it out
Object and Scene Detection
Generate labels for thousands of objects, scenes, and
concepts, each with a confidence score
• Search,	filter,	and	
curate	image	
libraries
• Smart	searches	for	
user	generated	
content
• Photo,	travel,	real	
estate,	vacation	
rental	applications
Maple
Plant
Villa
Garden
Water
Swimming Pool
Tree
Potted Plant
Backyard
Facial Analysis
Locate faces within images and analyze face attributes to
detect emotion, pose, facial landmarks, and features
• Avoid	faces	when	cropping	
images	and	overlaying	ads
• Capture	user	demographics	
and	sentiment
• Recommend	the	best	photos
• Improve	online	dating	match	
recommendations
• Dynamic,	personalized	ads
Age	Range 38-59
Beard:	False 84.3%
Emotion:	Happy 86.5%
Eyeglasses:	False 99.6%
Eyes	Open:	True 99.9%
Gender:	Male 99.9%
Mouth	Open:	False86.2%
Mustache:	False 98.4%
Smile:	True 95.9%
Sunglasses:	False 99.8%
Bounding	Box
Height: 0.36716..
Left: 0.40222..
Top: 0.23582..
Width: 0.27222..
Landmarks
EyeLeft
EyeRight
Nose
MouthLeft
MouthRight
LeftPupil
RightPupil
LeftEyeBrowLeft
LeftEyeBrowRight
LeftEyeBrowUp
:
Quality
Brightness 52.5%
Sharpness 99.9%
Rekognition: Facial Search
Facial
comparison
Face
Search
Visual Similarity
Search
(compare two faces) (compare many faces) (find similar faces)
Face Comparison
Face Comparison
Measure the likelihood that faces in two images are of the
same person
• Add	face	verification	to	
applications	and	devices
• Extend	physical	security	
controls
• Provide	guest	access	to	
VIP-only	facilities
• Verify	users	for	online	
exams	and	polls
Facial	Search
Identify people in images by finding the closest match for an
input face image against a collection of stored face vectors
• Add	friend	tagging	to	
social	and	messaging	apps
• Assist	public	safety	officers	
find	missing	persons
• Identify	employees	as	they	
access	sensitive	locations
• Identify	celebrities	in	
historical	media	archives
Image Moderation
Hierarchical taxonomy
Confidence score
"ModerationLabels": [
{
"Confidence": 82.7555923461914,
"Name": "Suggestive",
"ParentName": ""
},
{
"Confidence": 82.7555923461914,
"Name": "Female Swimwear or Underwear",
"ParentName": "Suggestive"
},
{
"Confidence": 50.11056137084961,
"Name": "Nudity and Sexuality",
"ParentName": ""
Travel and Hospitality
Anticipatory guest experiences for hotels using Amazon
Rekognition for facial recognition and sentiment capture
Kaliber is using Amazon Rekognition to help front desk agents
enhance relationships with guests:
• Recognize guests early for instant and personalized service
• Receive rich, contextualized guest information in real time
• Track guest sentiment throughout their stay
• Drive an 80% increase in guest satisfaction scores
Media Case Study
Identify who is on camera at what time for
each of 8 networks so that recorded video
streams can be indexed and searched
Video frame-sampling facial recognition
solution using Amazon Rekognition:
• Indexed 97,000 people into a face collection in
1 day
• Sample frames every 6 secs and test for image
variance
• Upload images to S3 and call Rekognition to
find best facial match
• Store time stamp and faceID metadata
Celebrity Recognition
Influencer Marketing Case Study
Associate influencers with objects and scenes in social media
images in order to create high impact campaigns for clients
Using Rekognition for metadata extraction:
• Create rich media indexes of images from social media feeds, which
the application associates with influencers
• Enable analytics to profile environments where influence is strongest
• Connect client brands with the influencers most likely to have impact
Rekognition Customers
Media and Entertainment
Public Safety
Law Enforcement
Digital Asset Management
Influencer Marketing
Digital Advertising
Education
Consumer Storage
Amazon AI Services
• Leveraging Amazon internal experiences with AI / ML
• Managed API services with embedded AI for maximum
accessibility and simplicity
• Full stack of platforms and engines for specialized deep
learning applications
Q&A
Remember to complete
your evaluations!
Thank You
Yi-an Han
yianhan@amazon.com

More Related Content

What's hot

How to Build Scalable Serverless Applications
How to Build Scalable Serverless ApplicationsHow to Build Scalable Serverless Applications
How to Build Scalable Serverless Applications
Amazon Web Services
 
AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017
AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017
AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017
Amazon Web Services Korea
 
AWS Summit 2011: AWS 101 Overview
AWS Summit 2011: AWS 101 OverviewAWS Summit 2011: AWS 101 Overview
AWS Summit 2011: AWS 101 Overview
Amazon Web Services
 

What's hot (20)

How to Build Scalable Serverless Applications
How to Build Scalable Serverless ApplicationsHow to Build Scalable Serverless Applications
How to Build Scalable Serverless Applications
 
Journey Towards Scaling Your Application to Million Users
Journey Towards Scaling Your Application to Million UsersJourney Towards Scaling Your Application to Million Users
Journey Towards Scaling Your Application to Million Users
 
BDA301 An Introduction to Amazon Rekognition
BDA301 An Introduction to Amazon RekognitionBDA301 An Introduction to Amazon Rekognition
BDA301 An Introduction to Amazon Rekognition
 
BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...
BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...
BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...
 
Introduction to GraphQL and AWS Appsync on AWS - iOS
Introduction to GraphQL and AWS Appsync on AWS - iOSIntroduction to GraphQL and AWS Appsync on AWS - iOS
Introduction to GraphQL and AWS Appsync on AWS - iOS
 
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
 
Supercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMakerSupercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMaker
 
Getting Started with Amazon Machine Learning
Getting Started with Amazon Machine LearningGetting Started with Amazon Machine Learning
Getting Started with Amazon Machine Learning
 
AI on The AWS Platform
AI on The AWS PlatformAI on The AWS Platform
AI on The AWS Platform
 
CMP211_Getting Started with Serverless Architectures
CMP211_Getting Started with Serverless ArchitecturesCMP211_Getting Started with Serverless Architectures
CMP211_Getting Started with Serverless Architectures
 
RDS and DynamoDB - Module 3 Part 2 - AWSome Day 2017
RDS and DynamoDB - Module 3 Part 2 - AWSome Day 2017RDS and DynamoDB - Module 3 Part 2 - AWSome Day 2017
RDS and DynamoDB - Module 3 Part 2 - AWSome Day 2017
 
LFS301-SAGE Bionetworks, Digital Mammography DREAM Challenge and How AWS Enab...
LFS301-SAGE Bionetworks, Digital Mammography DREAM Challenge and How AWS Enab...LFS301-SAGE Bionetworks, Digital Mammography DREAM Challenge and How AWS Enab...
LFS301-SAGE Bionetworks, Digital Mammography DREAM Challenge and How AWS Enab...
 
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDBSRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
 
Amazon Lex and Amazon Polly Workshop
Amazon Lex and Amazon Polly WorkshopAmazon Lex and Amazon Polly Workshop
Amazon Lex and Amazon Polly Workshop
 
Optimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot InstancesOptimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot Instances
 
Intro to AWS: Amazon EC2 and Compute Services
Intro to AWS: Amazon EC2 and Compute ServicesIntro to AWS: Amazon EC2 and Compute Services
Intro to AWS: Amazon EC2 and Compute Services
 
AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017
AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017
AWS 클라우드를 통한 교육 및 연구 혁신 - AWS Summit Seoul 2017
 
AWSome Day Glasgow | Technical Track
AWSome Day Glasgow | Technical TrackAWSome Day Glasgow | Technical Track
AWSome Day Glasgow | Technical Track
 
Amazon DynamoDB - Auto Scaling Webinar - v3.pptx
Amazon DynamoDB - Auto Scaling Webinar - v3.pptxAmazon DynamoDB - Auto Scaling Webinar - v3.pptx
Amazon DynamoDB - Auto Scaling Webinar - v3.pptx
 
AWS Summit 2011: AWS 101 Overview
AWS Summit 2011: AWS 101 OverviewAWS Summit 2011: AWS 101 Overview
AWS Summit 2011: AWS 101 Overview
 

Similar to An Overview of the AI on the AWS Platform

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
An Overview of AI on the AWS Platform - February 2017 Online Tech Talks
An Overview of AI on the AWS Platform - February 2017 Online Tech TalksAn Overview of AI on the AWS Platform - February 2017 Online Tech Talks
An Overview of AI on the AWS Platform - February 2017 Online Tech Talks
Amazon Web Services
 
AI & Deep Learning At Amazon - April 2017 AWS Online Tech Talks
AI & Deep Learning At Amazon - April 2017 AWS Online Tech TalksAI & Deep Learning At Amazon - April 2017 AWS Online Tech Talks
AI & Deep Learning At Amazon - April 2017 AWS Online Tech Talks
Amazon Web Services
 
An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...
An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...
An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...
Amazon Web Services
 

Similar to An Overview of the AI on the AWS Platform (20)

Introduction to Artificial Intelligence (AI) at Amazon
Introduction to Artificial Intelligence (AI) at Amazon Introduction to Artificial Intelligence (AI) at Amazon
Introduction to Artificial Intelligence (AI) at Amazon
 
AWS re:Invent 2016: Machine Learning State of the Union Mini Con (MAC206)
AWS re:Invent 2016: Machine Learning State of the Union Mini Con (MAC206)AWS re:Invent 2016: Machine Learning State of the Union Mini Con (MAC206)
AWS re:Invent 2016: Machine Learning State of the Union Mini Con (MAC206)
 
Amazon AI: soluzioni di intelligenza artificiale pronte per l'uso
Amazon AI: soluzioni di intelligenza artificiale pronte per l'usoAmazon AI: soluzioni di intelligenza artificiale pronte per l'uso
Amazon AI: soluzioni di intelligenza artificiale pronte per l'uso
 
Artificial Intelligence on the AWS Platform
Artificial Intelligence on the AWS PlatformArtificial Intelligence on the AWS Platform
Artificial Intelligence on the AWS Platform
 
An Introduction to the AI services at AWS - AWS Summit Tel Aviv 2017
An Introduction to the AI services at AWS - AWS Summit Tel Aviv 2017An Introduction to the AI services at AWS - AWS Summit Tel Aviv 2017
An Introduction to the AI services at AWS - AWS Summit Tel Aviv 2017
 
Building Serverless AI-powered Apps on AWS
Building Serverless AI-powered Apps on AWSBuilding Serverless AI-powered Apps on AWS
Building Serverless AI-powered Apps on AWS
 
AWS FSI Symposium 2017 NYC - Amazon AI for FS
AWS FSI Symposium 2017 NYC - Amazon AI for FSAWS FSI Symposium 2017 NYC - Amazon AI for FS
AWS FSI Symposium 2017 NYC - Amazon AI for FS
 
AI and Innovations on AWS
AI and Innovations on AWSAI and Innovations on AWS
AI and Innovations on AWS
 
Artificial Intelligence on AWS
Artificial Intelligence on AWS Artificial Intelligence on AWS
Artificial Intelligence on AWS
 
Introduction to Deep Learning
Introduction to Deep LearningIntroduction to Deep Learning
Introduction to Deep Learning
 
An Overview of AI on the AWS Platform - June 2017 AWS Online Tech Talks
An Overview of AI on the AWS Platform - June 2017 AWS Online Tech TalksAn Overview of AI on the AWS Platform - June 2017 AWS Online Tech Talks
An Overview of AI on the AWS Platform - June 2017 AWS Online Tech Talks
 
Artificial Intelligence on AWS
Artificial Intelligence on AWSArtificial Intelligence on AWS
Artificial Intelligence on AWS
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Building an AI-based service with Rekognition, Polly and Lex
Building an AI-based service with Rekognition, Polly and LexBuilding an AI-based service with Rekognition, Polly and Lex
Building an AI-based service with Rekognition, Polly and Lex
 
An Overview of AI on the AWS Platform - February 2017 Online Tech Talks
An Overview of AI on the AWS Platform - February 2017 Online Tech TalksAn Overview of AI on the AWS Platform - February 2017 Online Tech Talks
An Overview of AI on the AWS Platform - February 2017 Online Tech Talks
 
How Amazon AI Can Help You Transform Your Education Business | AWS Webinar
How Amazon AI Can Help You Transform Your Education Business | AWS WebinarHow Amazon AI Can Help You Transform Your Education Business | AWS Webinar
How Amazon AI Can Help You Transform Your Education Business | AWS Webinar
 
AWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - TorontoAWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - Toronto
 
Amazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current OfferingAmazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current Offering
 
AI & Deep Learning At Amazon - April 2017 AWS Online Tech Talks
AI & Deep Learning At Amazon - April 2017 AWS Online Tech TalksAI & Deep Learning At Amazon - April 2017 AWS Online Tech Talks
AI & Deep Learning At Amazon - April 2017 AWS Online Tech Talks
 
An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...
An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...
An Overview of AI at AWS - Amazon Lex, Amazon Polly, Amazon Rekognition - Dev...
 

More from Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 
Come costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSCome costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWS
 

An Overview of the AI on the AWS Platform

  • 1. ©2015, Amazon Web Services, Inc. Yian Han Senior Business Development Manager, AWS 2017 09 14 Amazon Web Services AI
  • 2.
  • 3. What to Expect from the Session Why AI? A Flying Wheel for Data AI Example in Amazon and AWS The Challenges How We can Help You
  • 4.
  • 5.
  • 7.
  • 8. SOLVED IN 0.9 SECONDS
  • 9. F2 U' R' L F2 R L' U' Learning function
  • 10. F2 U' R' L F2 R L' U' Learning function 1% accuracy R U r U R U2 r U2% accuracy
  • 12. Learning function 95% accuracy ? F2 R F R′ B′ D F D′ B D F
  • 14. A Flywheel For Data Machine Learning Deep Learning AI More Users Better Products More Data Better Analytics Object Storage Databases Data warehouse Streaming analytics BI Hadoop Spark/Presto Elasticsearch Click stream User activity Generated content Purchases Clicks Likes Sensor data
  • 15. Machine Learning & Artificial Intelligence Big Data More Users Better Products More Data Better Analytics A Flywheel For Data
  • 16. Algorithms Data Programming Models GPUs & Acceleration The Advent of Deep Learning image understanding natural language processing speech recognition autonomy
  • 17. AI Applications on AWS Zillow • Zestimate (using Apache Spark) Howard Hughes Corp • Lead scoring for luxury real estate purchase predictions FINRA • Anomaly detection, sequence matching, regression analysis, network/tribe analysis Netflix • Recommendation engine Pinterest • Image recognition search Fraud.net • Detect online payment fraud DataXu • Leverage automated & unattended ML at large scale (Amazon EMR + Spark) Mapillary • Computer vision for crowd sourced maps Hudl • Predictive analytics on sports plays Upserve • Restaurant table mgmt & POS for forecasting customer traffic TuSimple • Computer Vision for Autonomous Driving Clarifai • Computer Vision APIs
  • 18. AI on AWS and Amazon
  • 19. AI Applications on AWS Pinterest Lens Netflix Recommendation Engine
  • 20. Thousands Of Employees Across The Company Focused on AI Discovery & Search Fulfilment & Logistics Enhance Existing Products Define New Product Categories Bring Machine Learning To All Artificial Intelligence At Amazon
  • 21. Thousands Of Employees Across The Company Focused on AI Discovery & Search Artificial Intelligence At Amazon
  • 23. Thousands Of Employees Across The Company Focused on AI Discovery & Search Fulfilment & Logistics Artificial Intelligence At Amazon
  • 24.
  • 25. Thousands Of Employees Across The Company Focused on AI Discovery & Search Fulfilment & Logistics Enhance Existing Products Artificial Intelligence At Amazon
  • 26. Thousands Of Employees Across The Company Focused on AI Discovery & Search Fulfilment & Logistics Enhance Existing Products Define New Product Categories Artificial Intelligence At Amazon
  • 27.
  • 28.
  • 29. Thousands Of Employees Across The Company Focused on AI Discovery & Search Fulfilment & Logistics Enhance Existing Products Define New Product Categories Bring Machine Learning To All Artificial Intelligence At Amazon
  • 30.
  • 31.
  • 32.
  • 33. Sounds interesting! Is there any challenges?
  • 34. Data Training Prediction The Challenge For Artificial Intelligence: SCALE
  • 35. Tons of GPUs and CPUs Serverless At the Edge, On IoT Devices Prediction The Challenge For Artificial Intelligence: SCALE Tons of GPUs Elastic capacity Training Pre-built images Aggressive migration New data created on AWS Data PBs of existing data
  • 36. Can We Help Customers Put Intelligence At The Heart Of Every Application & Business?
  • 37. Machine Learning & Artificial Intelligence Big Data More Users Better Products More Data Better Analytics A Flywheel For Data
  • 38.
  • 39. Amazon AI Intelligent Services Powered By Deep Learning
  • 40. Amazon AI: New Deep Learning Services Life-like Speech Polly Lex Conversational Engine Rekognition Image Analysis Deep Learning Frameworks MXNet, TensorFlow, Theano, Caffe, Torch
  • 41. DIY Deep Learning for Custom Models AI Enabled Managed API Services Amazon AI: New Deep Learning Services Polly LexRekognition Deep Learning Frameworks MXNet, TensorFlow, Theano, Caffe, Torch CONTROL USABILITY& SIMPLICITY
  • 42. AWS offers a range of tools to make AI/ML more accessible PollyLex Rekognition Deep Learning FrameworksMachine Learning PlatformsAmazon AI/ML Services Usability/simplicity: leverages AWS AI/ML expertise Greater control: customer-specific models These solutions are underpinned by proven, scalable AWS products and services AWS Greengrass AWS IoT AWS Lambda Amazon EC2 (P2 and G2 GPUs) Amazon S3 Amazon DynamoDB Amazon Redshift Amazon EC2 (CPUs) Amazon EC2 (ENA) Amazon ML Spark & EMR Kinesis Batch ECS MXNet, TensorFlow, Theano, Caffe, Torch
  • 43. One-Click GPU Deep Learning AWS Deep Learning AMI Up to~40k CUDA cores MXNet TensorFlow Theano Caffe Torch Pre-configured CUDA drivers Anaconda, Python3 + CloudFormation template + Container Image
  • 44. MXNet: Scalable Deep Learning Framework
  • 46. Converts text to life-like speech 47 voices 24 languages Low latency, real time Fully managed Polly: Life-like Speech Service Voice Quality & Pronunciation 1. Automatic, Accurate Text Processing 2. Intelligible and Easy to Understand 3. Add Semantic Meaning to Text 4. Customized Pronunciation Articles and Blogs Training Material Chatbots (Lex) Public Announcements
  • 47. Today in Las Vegas, NV it's 54°F
  • 48. "We live for the music", live from the Madison Square Garden
  • 49. St. Mary's Church is at 226 St. Mary's St.
  • 50. Richard’s number is 2025551212
  • 51. My name is Hermione. It is spelled Hermione
  • 52. Jesus Manuel Corona is a professional footballer
  • 53. Still lost in the forest, Marry started to whisper: "Don't make any noise, they will find us"
  • 54. Duolingo voices its language learning service Using Polly Duolingo is a free language learning service where users help translate the web and rate translations. With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market. Severin Hacker CTO, Duolingo ” “ • Spoken language crucial for language learning • Accurate pronunciation matters • Faster iteration thanks to TTS • As good as natural human speech
  • 55. Polly (Salli) Duolingo Old voice Winner! ”The new voice is a huge improvement ! I really like it, the old one was terrible at times.”
  • 57. 1st Gen: Machine-oriented interactions 2nd Gen: Control-oriented & translated 3rd Gen: Intent-oriented The Advent Of Conversational Interactions
  • 58. Voice & Text “Chatbots” Powers Alexa Voice interactions on mobile, web & devices Text interaction with Slack & Messenger Enterprise Connectors (with more coming) Salesforce Microsoft Dynamics Marketo Zendesk Quickbooks Hubspot Lex: Build Natural, Conversational Interactions In Voice & Text Improving human interactions… • Contact, service, and support center interfaces (text + voice) • Employee productivity and collaboration (minutes into seconds)
  • 59.
  • 60. Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Intent / Slot model London Heathrow
  • 61. Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Intent / Slot model London Heathrow LocationLocation Seattle
  • 62. Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Intent / Slot model London Heathrow LocationLocation Seattle Prompt “When would you like to fly?” “When would you like to fly?” Polly
  • 63. Origin Destination Departure Date Flight Booking London Heathrow Seattle Prompt “When would you like to fly?” “When would you like to fly?” Polly “Next Friday”
  • 64. Origin Destination Departure Date Flight Booking “Next Friday” Automatic Speech Recognition Next Friday Utterances Natural Language Understanding Flight booking 02 / 24 / 2017 Intent / Slot model London Heathrow Seattle 02/24/2017
  • 65. Origin Destination Departure Date Flight Booking “Next Friday” Automatic Speech Recognition Next Friday Utterances Natural Language Understanding Flight booking 02 / 24 / 2017 Intent / Slot model London Heathrow Seattle 02/24/2017 Confirmation “Your flight is booked for next Friday” “Your flight is booked for next Friday” Polly
  • 66. Origin Destination Departure Date Flight Booking “Next Friday” Automatic Speech Recognition Next Friday Utterances Natural Language Understanding Flight booking 02 / 24 / 2017 Intent / Slot model London Heathrow Seattle 02/24/2017 Hotel Booking
  • 68. Rekognition: Search & Understand Visual Content Real-time & batch image analysis Object & Scene Detection Facial Detection Face SearchFacial Analysis
  • 69. Amazon Rekognition Deep learning-based image recognition service Search, verify, and organize millions of images Object and Scene Detection Facial Analysis Face Comparison Facial Recognition Integrated with S3, Lambda, Polly, Lex
  • 70. Rekognition: Object & Scene Detection
  • 71. Demo
  • 72.
  • 73.
  • 74.
  • 75.
  • 77.
  • 78. Object and Scene Detection Generate labels for thousands of objects, scenes, and concepts, each with a confidence score • Search, filter, and curate image libraries • Smart searches for user generated content • Photo, travel, real estate, vacation rental applications Maple Plant Villa Garden Water Swimming Pool Tree Potted Plant Backyard
  • 79. Facial Analysis Locate faces within images and analyze face attributes to detect emotion, pose, facial landmarks, and features • Avoid faces when cropping images and overlaying ads • Capture user demographics and sentiment • Recommend the best photos • Improve online dating match recommendations • Dynamic, personalized ads
  • 80. Age Range 38-59 Beard: False 84.3% Emotion: Happy 86.5% Eyeglasses: False 99.6% Eyes Open: True 99.9% Gender: Male 99.9% Mouth Open: False86.2% Mustache: False 98.4% Smile: True 95.9% Sunglasses: False 99.8% Bounding Box Height: 0.36716.. Left: 0.40222.. Top: 0.23582.. Width: 0.27222.. Landmarks EyeLeft EyeRight Nose MouthLeft MouthRight LeftPupil RightPupil LeftEyeBrowLeft LeftEyeBrowRight LeftEyeBrowUp : Quality Brightness 52.5% Sharpness 99.9%
  • 81. Rekognition: Facial Search Facial comparison Face Search Visual Similarity Search (compare two faces) (compare many faces) (find similar faces)
  • 83. Face Comparison Measure the likelihood that faces in two images are of the same person • Add face verification to applications and devices • Extend physical security controls • Provide guest access to VIP-only facilities • Verify users for online exams and polls
  • 84. Facial Search Identify people in images by finding the closest match for an input face image against a collection of stored face vectors • Add friend tagging to social and messaging apps • Assist public safety officers find missing persons • Identify employees as they access sensitive locations • Identify celebrities in historical media archives
  • 85. Image Moderation Hierarchical taxonomy Confidence score "ModerationLabels": [ { "Confidence": 82.7555923461914, "Name": "Suggestive", "ParentName": "" }, { "Confidence": 82.7555923461914, "Name": "Female Swimwear or Underwear", "ParentName": "Suggestive" }, { "Confidence": 50.11056137084961, "Name": "Nudity and Sexuality", "ParentName": ""
  • 86. Travel and Hospitality Anticipatory guest experiences for hotels using Amazon Rekognition for facial recognition and sentiment capture Kaliber is using Amazon Rekognition to help front desk agents enhance relationships with guests: • Recognize guests early for instant and personalized service • Receive rich, contextualized guest information in real time • Track guest sentiment throughout their stay • Drive an 80% increase in guest satisfaction scores
  • 87.
  • 88. Media Case Study Identify who is on camera at what time for each of 8 networks so that recorded video streams can be indexed and searched Video frame-sampling facial recognition solution using Amazon Rekognition: • Indexed 97,000 people into a face collection in 1 day • Sample frames every 6 secs and test for image variance • Upload images to S3 and call Rekognition to find best facial match • Store time stamp and faceID metadata
  • 90. Influencer Marketing Case Study Associate influencers with objects and scenes in social media images in order to create high impact campaigns for clients Using Rekognition for metadata extraction: • Create rich media indexes of images from social media feeds, which the application associates with influencers • Enable analytics to profile environments where influence is strongest • Connect client brands with the influencers most likely to have impact
  • 91. Rekognition Customers Media and Entertainment Public Safety Law Enforcement Digital Asset Management Influencer Marketing Digital Advertising Education Consumer Storage
  • 92.
  • 93.
  • 94. Amazon AI Services • Leveraging Amazon internal experiences with AI / ML • Managed API services with embedded AI for maximum accessibility and simplicity • Full stack of platforms and engines for specialized deep learning applications
  • 95. Q&A
  • 96.