Making 'Things' talk: Why we need voice interfaces for the IoT1. © 2016 Nuance Communications, Inc. All rights reserved. 1
The walls and
appliances are talking( )
2. © 2016 Nuance Communications, Inc. All rights reserved. 2
billion
Devices will be connected by 2020 – that’s nearly
3x as many as in 2014.
According to Strategy Analytics
3. © 2016 Nuance Communications, Inc. All rights reserved. 3
There are smart homes…
© 2016 Nuance Communications, Inc. All rights reserved. 3
4. © 2016 Nuance Communications, Inc. All rights reserved. 4
In New York City and
Chicago, the smart city is
here – and it’s keeping track
of everything
Plans are underway to create the
nation’s first “quantified community” in
New York City. 17 million square feet of
commercial and residential land will
track data on air quality, pedestrian
traffic, energy production and
consumption, and the health and
activity levels of workers and residents.
…and even
smart cities.
© 2016 Nuance Communications, Inc. All rights reserved. 4
5. © 2016 Nuance Communications, Inc. All rights reserved. 5
The Internet of Things
permeates life at home, in
the workplace, and on the
go.
6. © 2015 Nuance Communications, Inc. All rights reserved. 6
Safe
driving
Workplace
productivity
Retail
experiences
Home
automation
& securityHealth &
fitness
Home
entertainment
© 2016 Nuance Communications, Inc. All rights reserved. 6
7. © 2016 Nuance Communications, Inc. All rights reserved. 7
From 2014 to 2020, the
number of connected
smart home devices will
grow by 1,448%.
According to Strategy Analytics
8. © 2016 Nuance Communications, Inc. All rights reserved. 8
And by 2020, consumer
spending on smart
systems for the
household will reach $130
billion globally.
According to Strategy Analytics
9. © 2015 Nuance Communications, Inc. All rights reserved. 9
Today, the industry is still in its
nascent stages; manufacturers
are innovating according to their
own rules.
© 2016 Nuance Communications, Inc. All rights reserved. 9
10. © 2016 Nuance Communications, Inc. All rights reserved. 10
Unique form factors are
being designed for each
environment and
application.
11. © 2016 Nuance Communications, Inc. All rights reserved. 11
Home
entertainment
Home
automation
Workplace
productivity
Health &
fitness
© 2016 Nuance Communications, Inc. All rights reserved. 11
12. © 2016 Nuance Communications, Inc. All rights reserved. 12
By being connected, these
devices offer new levels of
intelligence – but
additional features or
intelligence shouldn’t
mean more complexity.
13. © 2016 Nuance Communications, Inc. All rights reserved. 13
It’s the user interface that should make
it easy to tap into this intelligence.
© 2016 Nuance Communications, Inc. All rights reserved. 13
14. © 2016 Nuance Communications, Inc. All rights reserved. 14
Multimodal design
featuring touch, gesture,
and voice allows you to
interact with these
devices in many different
ways and in many
different environments.
15. © 2016 Nuance Communications, Inc. All rights reserved. 15
But with new types of IoT
devices emerging, voice is
becoming the most
natural interface across
these varying form
factors.
16. © 2016 Nuance Communications, Inc. All rights reserved. 16
Menus, buttons, and screens look
different or are nonexistent device
to device.
© 2016 Nuance Communications, Inc. All rights reserved. 16
17. © 2016 Nuance Communications, Inc. All rights reserved. 17
Speech is the unifying modality.
© 2016 Nuance Communications, Inc. All rights reserved. 17
18. © 2016 Nuance Communications, Inc. All rights reserved. 18
And it’s becoming more and more
popular.
© 2016 Nuance Communications, Inc. All rights reserved. 18
19. © 2016 Nuance Communications, Inc. All rights reserved. 19
billion+
average interactions from connected smart
devices are handled each month by the Nuance
Mobile Cloud.
20. © 2016 Nuance Communications, Inc. All rights reserved. 20
In 2014, the number of
smart TV customers using
their voice to find content
grew by 230%.
Data from Nuance Mobile Cloud
21. © 2016 Nuance Communications, Inc. All rights reserved. 21
Why? It’s
easy,
natural, and
accurate.
© 2016 Nuance Communications, Inc. All rights reserved. 21
22. © 2016 Nuance Communications, Inc. All rights reserved. 22
Even the industrial,
manufacturing, and
construction markets
have the potential to be
transformed by IoT
devices.
23. © 2016 Nuance Communications, Inc. All rights reserved. 23
The Atheer AiR 3D smart glasses boosting worker productivity
through voice and gesture interaction.
© 2016 Nuance Communications, Inc. All rights reserved. 23
24. © 2016 Nuance Communications, Inc. All rights reserved. 24
As each of these IoT
devices and form factors are
being designed to serve
very specific functions
within specific settings, the
voice solutions for these
devices need to be just as
specialized.
25. © 2016 Nuance Communications, Inc. All rights reserved. 25
You wouldn’t talk to your
thermostat the same way
as your smartfridge, or
talk to your coffee maker
the same way as your
home robot, right?
26. © 2016 Nuance Communications, Inc. All rights reserved. 26
“What can I
make for a side
dish that pairs
well with
tuna?”
© 2016 Nuance Communications, Inc. All rights reserved. 26
27. © 2016 Nuance Communications, Inc. All rights reserved. 27
“Where do
I go to find
the
treasure?”
© 2016 Nuance Communications, Inc. All rights reserved. 27
28. © 2016 Nuance Communications, Inc. All rights reserved. 28
So, how do we make sure
we are continually
meeting these burgeoning
user expectations?
29. © 2016 Nuance Communications, Inc. All rights reserved. 29
It all starts with the
developer.
© 2016 Nuance Communications, Inc. All rights reserved. 29
30. © 2016 Nuance Communications, Inc. All rights reserved. 30
Voice is quickly becoming
an integral part of a
developers’ toolkit.
As such, developer
programs are expanding.
31. © 2016 Nuance Communications, Inc. All rights reserved. 31
“Voice recognition is an exciting
new method of interaction for
Pebble and it has created an
opportunity for developers to
enhance their existing applications,
or create highly engaging new
applications designed around the
spoken word.”
32. © 2016 Nuance Communications, Inc. All rights reserved. 32
It’s essential that voice
solutions are not only
customizable, but that they’re
flexible – allowing developers
to design for the experience
they want without limitations.
© 2016 Nuance Communications, Inc. All rights reserved. 32
33. © 2016 Nuance Communications, Inc. All rights reserved. 33
Voice
recognition
Text-to-
speech
Natural
language
understanding
Like these tools…
…that are supported by
34. © 2016 Nuance Communications, Inc. All rights reserved. 34
Vincent, do something funny
Let’s look at an example:
35. © 2016 Nuance Communications, Inc. All rights reserved. 35
Without a customized speech and NLU
model, you could choose to hard-code
that sentence and map it to the
appropriate functions in your app.
This is funny?
If (UserSaid == “Vincent, do something funny.”) {
putHatOn(“red”, “party”) {
}
36. © 2016 Nuance Communications, Inc. All rights reserved. 36
But other users might say…
If (UserSaid == “Vincent, do something funny.”) {
putHatOn(“red”, “party”) {
} else if (UserSaid == “Can you show me something funny?”) {
putHatOn(“red”, “party”) {
} else if (UserSaid == “I need a laugh.”) {
putHatOn(“red”, “party”) {
} else if (UserSaid == “Do something funny with a hat.”) {
putHatOn(“red”, “party”) {
} else if (UserSaid == “Make me laugh please.”) {
putHatOn(“red”, “party”) {
Make me laugh please.
Can you show me
something funny?
I need a laugh.
Do something funny with a hat.
37. © 2016 Nuance Communications, Inc. All rights reserved. 37
Custom speech and NLU
allows you to deal with many,
many permutations of user
requests, providing the
scalability, flexibility, and the
framework to be responsive
with your data.
38. © 2016 Nuance Communications, Inc. All rights reserved. 38
With the right tools and
access to data,
developers can build for
the IoT – continually
improving user
experiences as their
devices get ‘smarter’
over time.
© 2016 Nuance Communications, Inc. All rights reserved. 38
39. © 2016 Nuance Communications, Inc. All rights reserved. 39
So what does the future of
the future look like?
© 2016 Nuance Communications, Inc. All rights reserved. 39
40. © 2016 Nuance Communications, Inc. All rights reserved. 40
Eventually, as IoT evolves,
some manufacturers (and
developers) will begin
building more with cross-
platform interfaces and
connectivity in mind.
41. © 2016 Nuance Communications, Inc. All rights reserved. 41
TVLike this
smart
home
hub.
© 2016 Nuance Communications, Inc. All rights reserved. 41
42. © 2016 Nuance Communications, Inc. All rights reserved. 42
Interoperability between
IoT systems is critically
important to capturing
maximum value;
manufacturers today are
aware of (or beginning to
discover) this potential that
could be unlocked through
IoT.
© 2016 Nuance Communications, Inc. All rights reserved. 42
43. © 2016 Nuance Communications, Inc. All rights reserved. 43
For this to happen on a
large scale, manufacturers
will have to work together
and develop standards for
interoperability.
44. © 2016 Nuance Communications, Inc. All rights reserved. 44
Some organizations have
already started.
45. © 2016 Nuance Communications, Inc. All rights reserved. 45
In this model, voice will
remain at the core of the
interface, because…
46. © 2016 Nuance Communications, Inc. All rights reserved. 46
It’s natural
and intuitive. © 2016 Nuance Communications, Inc. All rights reserved. 46
47. © 2016 Nuance Communications, Inc. All rights reserved. 47
And as IoT evolves, there will
continue to be waves of new-to-
market innovative devices that will
still require their own distinct
interfaces and voice experiences.
© 2016 Nuance Communications, Inc. All rights reserved. 47
48. © 2016 Nuance Communications, Inc. All rights reserved. 48
New
devices
like social
robots.
© 2016 Nuance Communications, Inc. All rights reserved. 48
49. © 2016 Nuance Communications, Inc. All rights reserved. 49
“Social robots like Jibo will
redefine the way people interact
with technologies in their home,
and among Jibo’s sensorial inputs,
none is more vital to the consumer
experience than voice.”
-Steve Chambers, CEO, Jibo
50. © 2016 Nuance Communications, Inc. All rights reserved. 50
Using voice as a means of
interaction is here to stay.
51. © 2016 Nuance Communications, Inc. All rights reserved. 51
After all, it’s
human nature
to have a
conversation –
whether those
be with another
human or with
a device.
© 2016 Nuance Communications, Inc. All rights reserved. 51
52. © 2016 Nuance Communications, Inc. All rights reserved. 52
Armed with the right tools,
developers will be able to
create specialized voice
experiences for the
billions of connected
devices yet to come.
53. © 2016 Nuance Communications, Inc. All rights reserved. 53
Developers, are you ready for
the IoT?
See how you can get started with Nuance
Mix Beta.
Sign up now