AWS Community Day Kochi 2019 - Creating Digital Human using AWS Sumerian and Cognitive Services by Ilanchezhian Ganesamurthy , Enterprise Architect - EVRY

2. Adding Human Touch to Technology:
Create Digital Human using Sumerian, Lex, Rekognition
Ilanchezhian Ganesamurthy | Kochi | 2019

3.  Principal Architect – Cloud & CUI
 Working on Emerging Technologies,
Cloud-Native Architecture, AWS Cloud
& Cognitive Service
 Currently focusing on Conversational
AI, Sumerian & Alexa
 5 years of working expertise in AWS
Cloud
 Working with EVRY India and driving
initiatives at Digital Innovation Labs
 Leading Nordic Technology Provider
 Revenue USD 1.5 Billion
 #1 Financial Services in Nordics
 #1 Norway and #4 Sweden in IT Services
 Offices : 11 Countries / Employees : 9,000
Ilanchezhian Ganesamurthy
(Ilan)

4. Kiri
Yumi
Rachel
Roman
LiaImage Source:
• www.faceme.com
• www.soulmachines.com/

5. Digital Human
Visual ability : See & Recognize
Audio ability : Hear & Comprehend
Responsive ability : Speak & Respond in a
natural way
Intelligence ability : Understand & learn
Expression ability : To display Gestures
& Emotions
Image Source:
• www.soulmachines.com/

6. What
‘Intelligent Digital Avatar’ which looks like a real
human-being and helps machine to interact with user
in a more human like natural way
Provides a ‘face’ to computers and make machines
look almost human-like
Provides emotional response & non-verbal
communication cues
Why
To go away with the boring menus & forms when we
interact with computers
Enrich the digital experience and help brands to creatively
connect with customers at an emotional level
Helps you create highly personalized brand experience
Revolutionize the Human-Computer interaction. It helps
customer to create "Emotional Connection" with machine,
powered by ‘Conversational AI’

7. Video Source:
• www.faceme.com

8. Voice Only &
Multi modal
Touch
Immersive
Keyboard
Mouse
Natural &
Immersive
NUI

9. • Cloud based tool to create AR/VR and primarily VR
• Sumerian takes cloud first approach to Assets
• Sumerian apps are browser-based: build once … deploy widely
• Uses Web XR. Sumerian is based on WebGL Compatible browser - WebGL JS API for graphic
rendering and WebVR JS API for VR devices
• Enables nearly any developer to develop AR, VR & 3D apps in very easy manner
• It comprises web-based IDE, API, pre-build templates & asset libraries to enable developers to build
& publish apps easily

10. VR App Development Process - General

11. VR App Development Process – Multiple Devices

12. VR App Development Process - Sumerian
Type equation here.
1
2 3 4

13. Sumerian Hosts

14. •Animated human like
Digital character,
which can speak and
express emotion
(gestures & emotes)
It helps to converse
with users in bi-
directional way
It democratizes the
way we create Digital
Human
Sumerian Hosts - What & Why

15. Customize
color & logo
Customize
Gestures
Lip Sync
Eye
Contact
Customize
voice

16. Use Cases - EVRY

17. To hear & Comprehend what has spoken – AWS Lex
How
To see & recognize – AWS Rekognition
To speak & respond in natural way – AWS Polly / Lex
To understand & learn – AWS Lex
To display gestures & emotions – AWS Sumerian

18. Automatic Speech
Recognition (ASR)Speech
Natural Language
Understanding
(NLU)
IntentText
Intent
Response
(Text)
Validation &
Business Logic
Amazon Lex
TextToSpeech
Amazon Polly
Lex - Under the Hood
Text To Speech (TTS), it turns text into lifelike speech
52 natural-sounding human voice & spanning 24 Languages
Can speak in Indian Accent
Can customize voice thru lexicons & SSML to change pronunciation, volume,
pitch, speed rate, etc.

19. Use Cases
Fidelity
Labs
Virtual
Concierge
Interactive
Training

21. “You will never be
alone with Digital
Human”
Thank You