Asystenci Głosowi zdobyli olbrzymią popularność za wielką wodą. Alexa szturmem trafiła do salonów, sprzedając się w 10 milionach tylko w ostatnim kwartale poprzedniego roku. Google od niedawna obsługuje język polski. To najlepszy moment żeby nauczyć Twój produkt mówić i trafić nie tylko do przeglądarki internetowej czy telefonu, ale również salonu Twoich klientów. W ramach wystąpienia dowiesz się jak zacząć, porozmawiamy o tym czym różni się UX rozwiązań głosowych w stosunku do aplikacji na urządzenia z ekranem, z jakich klocków składają się podstawowe “akcje” (bo tak określane są aplikacje na głośniki), i jak obudować ją dodatkowymi możliwościami. Porównamy ekosystem Googla i Amazonu - czym różnią się od siebie? Który daje więcej możliwości programistom? Zapraszamy na 52 IT Akademię j-labs!

1. G O O G L E A S S I STA N T & A L E X A
A S Y S T E N C I G Ł O S O W I
M O Ż L I W O Ś C I , P O D O B I E Ń S T WA , R Ó Ż N I C E
A R T U R S KO W R O Ń S K I

2. S M A R T S P E A K E R S U S E R S I N U S
57M

3. B I L L I O N O F P E O P L E U S I N G I N 2 0 2 3
1.2

4. E X T E R N A L PA R T N E R S D U R I N G T H I S Y E A R C E S
76

5. M I N O R I T Y R E P O R T
?

6. M I N O R I T Y R E P O R T
2 0 0 2

7. M O B I L E P H O N E S
2 0 0 9

8. K I N E C T
2 0 1 0

9. N AT U R A L U S E R I N T E R FA C E S
2 0 1 0

10. K I N E C T

11. T I R I N G

12. I M P R A C T I C A L

13. M I N O R I T Y R E P O R T
2 0 0 2

16. S I R I
2 0 1 1

17. S I R I F L O P S

18. A M A Z O N E C H O
2 0 1 4

19. A M A Z O N A L E X A

20. I V O N A S O F T WA R E
2 0 1 3

21. S I R I F L O P S

22. S I R I F L O P - P H O N E

23. C O N T E X T

24. S I R I F L O P - I N T E G R AT I O N S

25. M A R K E T P L A C E

26. R A C E S TA R T E D

27. A M A Z O N E C H O D E V I C E S

28. C O R TA N A F R O M M I C R O S O F T

29. B I X B Y F R O M S A M S U N G

30. H O M E P O D

31. G O O G L E A S S I S TA N T

32. G O O G L E N O W

34. S M A R T S P E A K E R S

35. A N D R O I D

36. A N D R O I D A U T O

37. A N D R O I D W E A R

38. H E A D S E T S

39. A N D R O I D T V / C H R O M E C A S T

40. A N D R O I D T V / C H R O M E C A S TN O T O N LY V O I C E

41. A N D R O I D T V / C H R O M E C A S TN O T O N LY V O I C E

42. A N D R O I D T V / C H R O M E C A S TV O I C E - C E N T R I C

43. A N D R O I D T V / C H R O M E C A S TI N T E N T- C E N T R I C

44. A N D R O I D T V / C H R O M E C A S TR E A L P E R S O N I L L U S I O N

45. G O O G L E I D Z I E Z N A C Z N I E S Z E R Z E J
G O O G L E I S M O R E A M B I T I O U S

47. FRAGMENTATION

48. T I M E T O S TA R T D E V E L O P E R P E R S P E C T I V E

49. D I S C O V E R A B I L I T Y

50. M A R K E T P L A C E

51. M A R K E T P L A C E

52. I N S TA L L AT I O N S

53. I N S TA L L AT I O N S

54. C O N V E R S AT I O N S

55. D I R E C T F L O W

56. D I R E C T F L O W
OK Google, open Direct Flow

57. D I R E C T F L O W
Hello from ITAcademy.You don’t
have events today.

58. C O N V E R S AT I O N A L F L O W

59. C O N V E R S AT I O N A L F L O W
OK Google, open Reply Flow

60. C O N V E R S AT I O N A L F L O W
Hello from ITAcademy.What do you
want to do?

61. C O N V E R S AT I O N A L F L O W
Register me to the next event.

62. C O N V E R S AT I O N A L F L O W
Ok! You are registered

63. I N T E N T F L O W

64. I N T E N T F L O W
OK Google, tell ITAcademy to
register me to the next event.

65. I N T E N T F L O W
Ok! You are registered

66. N O T I F I C AT I O N S F L O W

67. N O T I F I C AT I O N S F L O W

68. N O T I F I C AT I O N S F L O W
Alexa, what are my notifications?

69. N O T I F I C AT I O N S F L O W
You have notification from IT
Academy

70. L AY E R S

71. C O N V E R S AT I O N F L O W
INTENTLAYER
VOICELAYER
BUSINESSLOGIC
LAYER

72. V O I C E L AY E R

73. V O I C E L AY E R
Alexa,

74. V O I C E L AY E R
Alexa,

75. V O I C E L AY E R
Alexa, open IT academy

76. V O I C E L AY E R
Alexa, open IT academy

77. V O I C E L AY E R
Speech-To-Text
Natural Language Understanding
Processing Request
Text-To-Speech

78. C O N V E R S AT I O N F L O W
INTENTLAYER
VOICELAYER
BUSINESSLOGIC
LAYER

79. C O N V E R S AT I O N F L O W
INTENTLAYER
BUSINESSLOGIC
LAYER
VOICELAYER

80. BUSINESS LOGIC LAYER

81. ALEXA SKILLS KIT

82. ACTIONS ON GOOGLE SDK

83. SIMPLEST SKILL
import * as functions from 'firebase-functions';
import { actionssdk } from 'actions-on-google';
const app = actionssdk({debug: true});
app.intent('actions.intent.MAIN', (conv) => {
conv.ask('Hi! from IT Academy');
});
export const academyAssistant = functions.https.onRequest(app);

84. SIMPLEST SKILL
import * as functions from 'firebase-functions';
import { actionssdk } from 'actions-on-google';
const app = actionssdk({debug: true});
app.intent('actions.intent.MAIN', (conv) => {
conv.ask('Hi! from IT Academy');
});
export const academyAssistant = functions.https.onRequest(app);

85. SIMPLEST SKILL
import * as functions from 'firebase-functions';
import { actionssdk } from 'actions-on-google';
const app = actionssdk({debug: true});
app.intent('actions.intent.MAIN', (conv) => {
conv.ask('Hi! from IT Academy');
});
export const academyAssistant = functions.https.onRequest(app);

86. SIMPLEST SKILL
import * as functions from 'firebase-functions';
import { actionssdk } from 'actions-on-google';
const app = actionssdk({debug: true});
app.intent('actions.intent.MAIN', (conv) => {
conv.ask('Hi! from IT Academy');
});
export const academyAssistant = functions.https.onRequest(app);

87. C O N V E R S AT I O N F L O W
INTENTLAYER
BUSINESSLOGIC
LAYER
VOICELAYER

88. C O N V E R S AT I O N F L O W
INTENTLAYER
VOICELAYER
BUSINESSLOGIC
LAYER

89. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": "pizza portal",
"intents": [
{
"name": "pizza",
"samples": [
"I want to order Pizza"
]
}
]}}}

90. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": "pizza portal",
"intents": [
{
"name": "pizza",
"samples": [
"I want to order Pizza"
]
}
]}}}

91. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": "pizza portal",
"intents": [
{
"name": "pizza",
"samples": [
"I want to order Pizza"
]
}
]}}}

92. INTENT LAYER
Alexa, tell Pizza Portal…

93. INTENT LAYER
Alexa, tell Pizza Portal…

94. INTENT LAYER
Alexa, tell Pizza Portal…
…I want to order Pizza
INTENTLAYER

95. INTENT LAYER
Alexa, tell Pizza Portal…
…I want to order Pizza
INTENTLAYER
ORDER_PIZZA_INTENT

96. INTENT LAYER
Alexa, tell Pizza Portal…
…I want to order Pizza
INTENTLAYER
Hey, I ordered Pizza for you

97. INTENT LAYER
Alexa, tell Pizza Portal I want to order Pizza

98. INTENT LAYER
Wake Word
Alexa, tell Pizza Portal I want to order Pizza

99. INTENT LAYER
Operation
Alexa, tell Pizza Portal I want to order Pizza

100. INTENT LAYER
Invocation Name
Alexa, tell Pizza Portal I want to order Pizza

101. INTENT LAYER
Utterance/Sample
Alexa, tell Pizza Portal I want to order Pizza

102. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": "pizza portal",
"intents": [
{
"name": "pizza",
"samples": [
"I want to order Pizza"
]
}
]}}}

103. REQUEST
{
"version": "1.0",
"session": {
"new": true,
"sessionId": "amzn1.echo-api.session.bbd3b5e5-1bea-41d2-8e53-1ff9d0f201bc",
"application": {
"applicationId": "amzn1.ask.skill.71b81b75-3cca-4e8f-8534-7505c7a7a39c"
},
"user": {
}
},
"context": {
"System": {
"application": {
"applicationId": "amzn1.ask.skill.71b81b75-3cca-4e8f-8534-7505c7a7a39c"
},
"user": {
},
"device": {
"supportedInterfaces": {}
},
"apiEndpoint": "https://api.amazonalexa.com",
}
},
"request": {
"type": "LaunchRequest",
"requestId": "amzn1.echo-api.request.54d9b137-f12c-4333-9a43-9d95225c48e1",
"timestamp": "2019-03-14T22:27:36Z",
"locale": "en-US",
"shouldLinkResultBeReturned": false
}
}

104. RESPONSE
INTENTLAYER
Hey, I ordered Pizza for you
{
"body": {
"version": "1.0",
"response": {
"outputSpeech": {
"type": "SSML",
"ssml": "<speak>Welcome in IT academy, you can say Hello or Help. Which would you like to try?</speak>"
},
"reprompt": {
"outputSpeech": {
"type": "SSML",
"ssml": "<speak>Welcome in IT academy, you can say Hello or Help. Which would you like to try?</speak>"
}
},
"shouldEndSession": false,
"type": "_DEFAULT_RESPONSE"
},
"sessionAttributes": {},
"userAgent": "ask-node/2.3.0 Node/v8.10.0"
}
}

105. UTTERANCES
Alexa, tell Pizza Portal…
…I want to order Pizza
…to bring me favourite Pizza
…I’m hungry

106. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": "pizza portal",
"intents": [
{
"name": "pizza",
"samples": [
"I want to order Pizza",
"to bring me favourite Pizza",
“I’m hungry",
]
}
]}}}

107. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": "pizza portal",
"intents": [
{
"name": "pizza",
"samples": [
"I want to order Pizza",
"to bring me favourite Pizza",
“I’m hungry",
]
}
]}}}

108. INTENT LAYER
Alexa, tell Pizza Portal…
…I want to order Pizza
…to bring me favourite Pizza
…I’m hungry
ORDER_PIZZA_INTENT
INTENTLAYER

109. N O T T E R M I N A L !

110. S S M L

111. SIMPLEST SKILL
import * as functions from 'firebase-functions';
import { actionssdk } from 'actions-on-google';
const app = actionssdk({debug: true});
app.intent(‘actions.intent.pizza’, (conv) => {
conv.ask('Hey, I ordered Pizza for you <break time=“2s” /> Bon Apeti');
});
export const academyAssistant = functions.https.onRequest(app);

112. SIMPLEST SKILL
import * as functions from 'firebase-functions';
import { actionssdk } from 'actions-on-google';
const app = actionssdk({debug: true});
app.intent(‘actions.intent.pizza’, (conv) => {
conv.ask('Hey, I ordered Pizza for you <break time=“2s” /> Bon Apeti');
});
export const academyAssistant = functions.https.onRequest(app);

113. RESPONSE
INTENTLAYER
Hey, I ordered Pizza for you
{
"body": {
"version": "1.0",
"response": {
"outputSpeech": {
"type": "SSML",
"ssml": "<speak>Hey, I ordered Pizza for you <break time=“2s” /> Bon Apetit</speak>"
},
"shouldEndSession": false,
"type": "_DEFAULT_RESPONSE"
},
"sessionAttributes": {},
"userAgent": "ask-node/2.3.0 Node/v8.10.0"
}
}

114. SSML Response
Alexa, tell Pizza Portal…
…I want to order Pizza Hey, I ordered Pizza for you
<break time=“2s”>
Bon Appetite
INTENTLAYER

115. S L O T S

116. INTENT LAYER
Alexa, tell Pizza Portal…
…I want to order Pepperoni
INTENTLAYER

117. INTENT LAYER
Utterance/Sample
Alexa, tell Pizza Portal I want to order Peperoni

118. INTENT LAYER
Alexa, tell Pizza Portal I want to order Peperoni
Slot

119. INTENT LAYER
Alexa, tell Pizza Portal…
…I want to order Pepperoni
INTENTLAYER
ORDER_PIZZA_INTENT
SLOTS:
KIND: PEPPERONI

120. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": “Pizza Portal",
"intents": [
{
"name": “order pizza",
"slots": [
{
"name": “kind",
"type": “AMAZON.Food"
}
],
"samples": [
“I want to order {kind}",
“bring me {kind}",
]
}
]}}}

121. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": “Pizza Portal",
"intents": [
{
"name": “order pizza",
"slots": [
{
"name": “kind",
"type": “AMAZON.Food"
}
],
"samples": [
“I want to order {kind}",
“bring me {kind}",
]
}
]}}}

122. RESPONSE
{
"interactionModel": {
"languageModel": {
"invocationName": “Pizza Portal",
"intents": [
{
"name": “order pizza",
"slots": [
{
"name": “kind",
"type": “AMAZON.Food"
}
],
"samples": [
“I want to order {kind}",
“bring me {kind}",
]
}
]}}}

123. SLOTS TYPES
https://developer.amazon.com/docs/custom-skills/slot-type-reference.html

124. ALEXA SKILLS CONSOLE

125. AMAZON LEX

126. AMAZON LEX

127. AMAZON POLLY

128. ACTIONS ON GOOGLE CONSOLE

129. API.AI

130. DIALOGFLOW

131. I N T E R N E T O F T H I N G S

132. A L E X A V O I C E S E R V I C E S

133. G O O G L E A S S I S TA N T S D K

134. INTEGRATIONS

135. M O N E T I Z AT I O N

136. A D S A R E P R O H I B I T E D

137. “ B E A U T Y & B E A S T ” A D

138. B U R G E R K I N G ’ S A D

139. A M A Z O N PAY S C R E AT O R S

140. I N - S K I L L P R O D U C T S
O N E - T I M E P U R C H A S E S
C O N S U M A B L E S
S U B S C R I P T I O N S

141. O N LY I N U S

142. A L E X A E C O S Y S T E M I S B E T T E R …

143. … G O O G L E H A S P O T E N T I A L

144. G O O G L E D U P L E X

145. A N D R O I D E C O S Y S T E M

146. GQ U E S T I O N S ?