Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Pop-up Loft
Build an Image-Based Automatic Alert System
with Amazon Rekognition
Kashif Imran, Sr. Solutions Architect

What to expect?
• Goal: Learn how to build computer vision based smart applications
• Overview of Amazon Rekognition
• Outline of the Workshop Scenario
• Preview of the Lab/Instructions

The Amazon Machine Learning Stack
FRAMEWORKS & INTERFACES
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Chainer Keras Gluon
AWSDeepLearningAMIs
AmazonSageMaker
Rekognition Transcribe Translate Polly Comprehend Lex
AWS
DeepLens
EDUCATION
PLATFORM SERVICES
APPLICATION SERVICES
AmazonMechanical Turk

Deep learning-based image and video analysis service
Object and Scene
Detection
Facial
Analysis
Face Search
& Match
Text in ImageUnsafe Image
Detection
Celebrity
Recognition
Amazon Rekognition
We encourage law enforcement agencies to work with local government officials to
develop acceptable use policies for facial recognition technologies that both protects
the rights of citizens and enables law enforcement to do their job.

Boat 99.3%
Plant 95.1%
Harbor 94.8%
Yacht 78.1%
Dock 75.7%
City 72.4%
Architecture 71.8%
Urban 63.9%
Building 62.3%
Marina 60.3%
Plaza 51.1%
Spire 50.8%
Neighborhood 50.7%
Flower 50.6%
Waterfront 94.8%
Object and Scene Detection

Unsafe Image Detection
Suggestive 98.7%
Female Swimwear or
Underwear 98.7%

Facial Detection and Analysis
smart cropping
& ad overlays
demographic &
sentiment analysis
face redaction &
privacy protection
Age Range: 38-57
Beard: False 97.3%
Emotion: Happy 87.1%
Eyeglasses: False 99.6%
Eyes Open: True 99.9%
Gender: Male 99.9%
Mouth Open: False 86.2%
Mustache: False 99.8%
Smile: True 95.9%
Sunglasses: False 99.8%

FaceID: 4c55926e-69b3-5c80-8c9b-78ea01d30690
Similarity: 97
FaceID: 02e56305-1579-5b39-ba57-9afb0fd8782d
Similarity: 92
FaceID: 02e56305-1579-5b39-ba57-9afb0fd8782d
Similarity: 85
Real-time search against tens of millions of faces
Face Search
Index Faces Collection Search Faces
MaxFaces
FaceMatchThreshold

Combatting Human Trafficking
• Machine learning and analytics platforms for
law enforcement
• Match photos of exploited children to those on
the dark web
• Reduces the time and effort to identify and
rescue victims

Celebrity Guests at the Royal Wedding
• “Who’s Who Live” function
• Celebrity guests identified in live
stream
• On Screen captions of relation to the
royal couple

Sports Media: Player Tracking and
Recognition

Image API – Request and Response
DetectLabels
{
"Image": {
"Bytes": blob,
"S3Object": {
"Bucket": "string",
"Name": "string",
"Version": "string"
}
},
"MaxLabels": number,
"MinConfidence": number
}
{
"Labels": [
{
"Confidence": number,
"Name": "string”
}
],
"OrientationCorrection": "string"
}

Video API – Request and Response
GetLabelDetection
StartLabelDetection
{
“ClientRequestToken": "string",
"JobTag": "string",
"MinConfidence": number,
"NotificationChannel": {
"RoleArn": "string",
"SNSTopicArn": "string”
},
"Video": {
"S3Object": {
"Bucket": "string",
"Name": "string",
"Version": "string”
}
}
}
{
"JobStatus": string,
"StatusMessage": string,
"VideoMetadata": {
"Format": string,
"Codec": string,
"DurationMillis": number,
"FrameRate": float,
"FrameWidth": number,
"FrameHeight": number
},
"NextToken": string,
"Labels": [
{
"Timestamp": number,
"Label":
{
"Name": string,
"Confidence": float
}
}
],
...
JobId

Other Services You Will Use Today

Amazon Elastic Compute Cloud (EC2)
Match Capacity and
Demand
Global Footprint Elasticity
Provision Servers in
Minutes
Infrastructure as
Code
Programmatic
Networking

Amazon Kinesis Data Firehose

AWS Lambda
No Servers to Manage Continuous Scaling Don’t Pay for Idle Capacity
Lambda allows you to run
application logic without
provisioning servers or worrying
about the health or security of
underlying resources
Lambda scales infrastructure
beneath your application logic;
just send requests and events
and Lambda will automatically
scale to accommodate it
With Lambda, you’re billed in
100ms increments of execution
time and number of requests
and you’re never charged for
anything when your code isn’t
running

Amazon DynamoDB
• Fast and flexible NoSQL database service
for any scale
Dead Simple
• GetItem(primaryKey)
• PutItem(item)
Robust Depth
• Fine-Grained Access Control
• Streams
• Triggers
• Global Tables
• Encryption
• DynamoDB local
• Free-text search
• Strong consistency option
• Atomic counters

Amazon Simple Storage Service (S3)
• Durable, massively scalable object storage
• Designed for 99.999999999% durability and
99.99% availability
• Stores trillions of objects and regularly handles millions of requests per
second
• Effectively infinite storage without provisioning capacity

Workshop Overview

Architecture

Extension

Workshop Step by Step Guide
• https://github.com/aws-samples/aws-developer-
workshop/blob/master/episode2/Instructions.md
https://bit.ly/2tdSmH8

Pop-up Loft
aws.amazon.com/activate
Everything and Anything Startups
Need to Get Started on AWS

Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition

Similar to Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition