Jason Brenier of Georgian Partners presents on how conversational and natural language interfaces, including chatbots, are rapidly becoming a way to engage consumers in consumer-focused industries outside of healthcare. Jason introduces the trends driving this change and a framework of principles for adopting it successfully in your organization.
3. georgianpartners.com
Conversational Business
Jason M. Brenier
• Director of Strategy @Georgian Partners
• Ph.D. Linguistics
• Research @Stanford
– Spoken dialogue systems, natural language processing, text-to-speech
synthesis, discourse processing, deception detection, acoustic
phonetics
• Previous affiliations:
– CTO @Idibon; Adaptive AI, human-in-the-loop NLP
– Forensic Technology @Ernst & Young; fraud, risk & compliance,
forensic investigations, active machine learning and NLP for e-
discovery, electronic communications surveillance, insider threat
detection, AML
– Speech Design @Nuance; expressive text-to-speech, data-driven
voices
– Linguistics @Cataphora; email/IM behavior analytics, emotive tone,
sentiment, linguistic style
4. georgianpartners.com
Conversational Business
• More than 100 years’ collective experience
applying analytics, machine learning, and
artificial intelligence to industry-specific
business problems
• Work directly with portfolio companies
through workshops, applied research,
product development, engineering
• Facilitate resource acquisition and sharing
– Georgian Data Union
• Practitioners of AI for our own business –
Spring sourcing engine
Georgian Impact
Madalin Mihailescu
VP, Impact Team
Hershel Harris
Engineering
Justin LaFayette
Managing Partner
Jason Brenier
Conversational Business
Yevgeniy Vahlis
Security First
Ji Chao Zhang
Software Development
Parinaz Sobhani
Machine Learning
5. Conversationa
l Business
Applications that enable long-
running, real-time, bi-directional
transmissions of text or voice
messages.
• Just the right amount of UX for the task
• Conversational
• Immediate and long-running transactions
• Seamlessly weaves robust services together
• Natural language vs. menu-driven interfaces
• Multiple signals (text, emoji, images)
• Dynamic views and flows
• Known participants
8. georgianpartners.com
Conversational Business
Messaging defines a new customer interaction paradigm.
• Mobile app usage is declining by 20% YoY
• Most users spend 50% of their time in only one app
— usually messaging.
• 75% of smartphone users use at least one
messaging app.
• Number of messaging users have surpassed social
network users.
• 5 of the all-time top 10 apps are messaging apps.
• 55% of messaging push notifications are read.
• 63% of Facebook users have increased messaging
with businesses over the last year
Source: https://insights.fb.com/2016/12/01/messaging-means-business/
9. georgianpartners.com
Conversational Business
The journey from apps to chat requires a new approach.
WEB TO APPS
Humans learn apps
From “and mobile” to “mobile first”
Platform = OS & app store
Discoverability
Visual navigation / menu-driven UX
Move to cloud
Similar design process
Designing around the device
APPS TO CHAT
Apps learn to be human
From “and bots” to Conversational Business
Platform = messaging, voice, bot stores
Discoverability
Language-based UX
Start in the cloud
New design process
Designing around the language and dialogue
11. georgianpartners.com
Conversational Business
Chatbots: unique customer interactions at scale.
• No two conversations are the same
• Scale engagement across a large user population
• Live in messaging platforms, on SMS
or in conversational devices
• Automate complex tasks
• Act as direct participants or assistants
• Use rules, machine learning or AI
11k
bots in 3 months
23k
bot developers
900M
active users
12. georgianpartners.com
Conversational Business
Trends: Users desire effortless, natural, engaging interactions.
Cultivate rapport
Users desire engaging, personalized, private interactions
with friends, colleagues, businesses and brands
Humanize the interface
Trend toward intuitive, physiologically grounded UX
and conversational intelligence
Summon function when it is needed
Desire to access rich insights and services through
a simple interface with minimal effort
13. georgianpartners.com
Conversational Business
What are the challenges?
• User expectations are high
• Conversational intelligence is low
• New interfaces must be better than apps
• Discoverability, management, and
switching
• Finding users and keeping them engaged
• Graceful failure, iterative improvement
• Security, privacy & trust
15. georgianpartners.com
Conversational Business
Maturity Levels
Capability and Ingredients
– Intrinsic company assets or strategic intent that give an advantage
– Basic understanding of priorities and opportunities, few specialist skills in
org
Readiness & Process Advantage
– Formalized company standards, practices, skills that give an advantage
– Partially documented approach and priorities
Execution Advantage
– Exploiting advantages with mature processes that capture outcomes
– Applying data and insights to drive continuous improvement
– Complete documentation of approach and skills to execute
Level
1
Level
2
Level
3
16. georgianpartners.com
Conversational Business
Principles of Conversational Business
4. Content enables conversations.
5. Capture user context.
6. Design for conversation.
7. Personify your business.
8. Bot or not?
1. Identify where you’ll have the greatest conversational impact.
2. Understand your audience.
3. Build complete experiences.
9. Keep private conversations private.
Purpose
Data
Design
Integrity
17. georgianpartners.com
Conversational Business
Identify where you’ll have the greatest
conversational impact.
Customer expectations are changing. Anticipate opportunities to meet their
unstated needs.
1
Purpose
Level 1 Level 2 Level 3
Opportunities identified in an ad-
hoc manner.
Business processes partially
documented and prioritized.
All business processes prioritized,
roadmap developed.
18. georgianpartners.com
Conversational Business
Identify where you’ll have the greatest
conversational impact.
1
Purpose
1. Identify all possible business processes,
both informational and transactional.
2. Prioritize processes that help you meet
your strategic business needs.
3. Develop a roadmap for conversational
business that will drive high customer
satisfaction and company value.
- High friction
- Routine, boring workflows
- Multi-turn
- Already conversational
- Better experience than mobile
19. georgianpartners.com
Conversational Business
Understand your audience.
Your users are already having conversations through messaging and voice
interfaces. Understand your users’ preferred platforms, channels and
devices and engage with them there.
2
Purpose
Level 1 Level 2 Level 3
Basic understanding of the
platforms the audience is using.
Research and testing used to
develop a complete understanding
of audience preferences.
Interaction data used to refine
understanding of audience’s
preferences.
20. georgianpartners.com
Conversational Business
Understand your audience.2
Purpose
a. Identify your current and potential audiences.
b. Use internal data, surveys, interviews, and third-
party research to learn about your users.
c. Segment users by demographics, engagement
level, platform, and business value.
d. Join conversations where they are already taking
place.
e. Take advantage of existing social communities.
f. Support text, voice and other engagement channels.
g. Be inclusive of all devices that users expect to use.
21. georgianpartners.com
Conversational Business
Build complete experiences.
Ensure that you have all of the right connections to the systems needed for
an end-to-end conversation.
3
Purpose
Level 1 Level 2 Level 3
Some back-end service
integrations accessible.
All service integrations required
for end-to-end conversations
identified, most are accessible.
Optimized integrations for
complete end-to-end
conversational experiences.
“The bot is just a user interface.”
- Amir Shevat
22. georgianpartners.com
Conversational Business
Build complete experiences.3
Purpose
a. Map out the services needed to deliver the end-to-end business
process.
b. Ensure that you have access to the full range of required API services to
build complete experiences.
23. georgianpartners.com
Conversational Business
Content enables conversations.
Businesses should capture, curate and create content to deliver the
best possible set of conversational interactions.
4
Data
Level 1 Level 2 Level 3
Examples of traditional customer
interactions captured over time.
Process in place to capture and
integrate all relevant customer
interactions.
Content is refined and expanded
based on measurements of
relevance, quality and
completeness.
25. georgianpartners.com
Conversational Business
Natural Language Generation
• Retrieval-based methods – select pre-determined responses
• Generative models – create customized responses
• Short vs. long conversations – require dialogue manager
• Open vs. Closed Domain – world knowledge vs. task knowledge
• Diversity of response
26. georgianpartners.com
Conversational Business
Capture user context.
The best conversations are those in which the participants know
something about each other. Remember who your users are, what
they’ve said and what they’ve done to make conversations efficient,
engaging, and meaningful.
5
Data
Level 1 Level 2 Level 3
Basic contextual data for customer
interactions captured from internal
sources.
Broad contextual data from both
internal and third-party sources
captured and integrated.
Contextual data expanded by
learning from every customer
interaction.
27. georgianpartners.com
Conversational Business
Capture user context.5
Data
a. Context improves experience by personalizing
interactions, reducing friction, and streamlining the
conversational flow.
b. Record rich contextual data about each interaction:
a. Demographics
b. Interests and preferences
c. Activities
d. Mood
e. Transactional
c. Monitor context and continuously improve your
understanding of the user to improve the quality and
effectiveness of future interactions.
28. georgianpartners.com
Conversational Business
Design for conversation.
Make it easy for users to complete the task at hand. Consider
participants, purpose, language, communication style, and channel
throughout your design process. Use interaction data to iteratively
improve the experience over time.
6
Design
Level 1 Level 2 Level 3
Limited set of user intents and
responses, support scripted
conversations.
Wide range of user intents and
responses, use some
conversational conventions and
natural language.
Set of intents and responses
continuously expanded, extensive
use of natural language and
conversational conventions.
29. georgianpartners.com
Conversational Business
The journey from apps to chat requires a new approach.
WEB TO APPS
Humans learn apps
From “and mobile” to “mobile first”
Platform = OS & app store
Discoverability
Visual navigation / menu-driven UX
Move to cloud
Similar design process
Designing around the device
APPS TO CHAT
Apps learn to be human
From “and bots” to Conversational Business
Platform = messaging, voice, bot stores
Discoverability
Language-based UX
Start in the cloud
New design process
Designing around the language and dialogue
30. georgianpartners.com
Conversational Business
Design for conversation.6
Design
a. Understand intent.
b. Respond appropriately.
c. Be perceptive.
d. Learn from every conversation.
e. Simplify the interface and reduce cognitive load.
f. Minimize context switching.
g. Provide conversational and navigational grounding.
h. Make functionality discoverable.
i. Don’t be brittle: recover from errors gracefully and graciously.
j. Set realistic expectations with users from the outset.
k. Engage in compatible language.
l. Engage regularly to anticipate needs and eliminate obstacles.
31. georgianpartners.com
Conversational Business
Natural Language Understanding
Technique Question Example
Intent Detection What does your user want to do? “I want to travel from SFO to JFK on Tuesday.”
[Intent=book_flight]
Information Extraction What are the relevant people, places and things that
your user is mentioning?
“I want to travel from SFO to JFK on Tuesday.” [Origin=SFO;
Destination=JFK; Departure_date=Tuesday]
Sentiment Analysis How is your user feeling? “I have a question about my bill, and I’ve been trying to get
through to an agent for the last 45 minutes!!! 😩”
[Sentiment=frustrated]
Dialogue Act Classification What is the nature of your user’s response? Is it a
question, a statement, a confirmation, or something
else?
“Yes, that is the correct destination.”
[Dialogue_act=confirmation]
Discourse Processing / Discourse
Markers
What clues is your user leaving to indicate attitude
toward the discussion? What’s your user doing to
control the flow of the conversation and turn taking?
“...however that’s not what I was led to believe when I signed
up.” [Discourse_marker=contrast]
Language Identification Which language and dialect is your user speaking? Is
your user a native speaker?
“I’d like to order two in the same colour.” [Dialect=non-
US_english]
Linguistic Style Detection Is your user responding with formal or informal
language?
“In spite of the efforts that I made to update the password, it
remained unchanged.” [Formality=formal]
“I tried updating, but it didn’t work.” [Formality=informal]
Topic Classification What’s the general theme of the conversation? “Will you be serving ice cream sundaes?” [Topic=in-flight_meals]
32. georgianpartners.com
Conversational Business
Advances in speech technology make spoken interaction possible.
Speech Recognition (input)
- Reduced error rate to 5.1%
Speech Synthesis (output)
- Mean opinion score improved 50%
33. georgianpartners.com
Conversational Business
Personify your business.
Develop personas that engage users and represent your brand. Built trust
and loyalty as you deliver key business functions via customized, engaging
conversational experiences.
7
Design
Level 1 Level 2 Level 3
Some brand values and
characteristics identified.
Persona designed to display key
traits to support brand strategy.
Brand impact of persona
measured and monitored to drive
improvements.
34. georgianpartners.com
Conversational Business
Develop trust and loyalty with users to
learn more about them and better serve
their needs.
Trustworthy
Reduce friction by engaging with users
in a consistent fashion. Don’t require
users to adapt to changing interfaces.
Consistent
Make the experience memorable
enough to share. Get users to return
and pick up where they left off.
Memorable
Make sure that your bot serves the
user’s desired purpose. Nobody wants a
Spambot.
Relevant
Get users excited about engaging with
your brand. Build rapport and an
ongoing relationship.
Engaging & Friendly
Your bot represents your brand and
company culture. Ensure that it is
recognizable and differentiated.
Recognizable
Design: Persona Design – Core Traits
35. georgianpartners.com
Conversational Business
Personify your business.7
Design
a. Develop the right persona.
b. Stay aligned.
c. Transform the business process into a conversation with a trusted agent.
d. Design personas to be consistent, recognizable, engaging, relevant and
memorable.
e. Develop deep, ongoing relationships with users.
f. Develop tailored personas for individual users and user segments.
36. georgianpartners.com
Conversational Business
Bot or not?
Make sure that the right person or technology is taking part in the
conversation. Utilize ‘humans in the loop’ as necessary to compensate for
current technology limitations and to help generate interaction data where
none exists.
8
Design
Level 1 Level 2 Level 3
Strengths and limitations of
automated and human- in-the-loop
conversations understood.
Design process identifies
opportunities for automating
conversations.
Processes automated and
optimized through seamless
collaboration between humans
and machines.
37. georgianpartners.com
Conversational Business
Bot or not?8
Design
a. Understand the value, limitations and risks of bots and humans.
b. Deliver engaging and scalable conversations with bots.
c. Use human input as an onramp to future automation.
d. Determine the best role for each participant
(e.g. user, trainer, validator).
e. Identify appropriate handoff points in the conversation.
f. Make handoffs seamless.
38. georgianpartners.com
Conversational Business
Keep private conversations private.
Conversational interactions come with higher expectations of privacy from
users. Have a conversational privacy policy, and proactively make security
a part of the conversational design process. Set higher expectations on
conversational privacy than the market norm to create competitive barriers.
Integrity
Level 1 Level 3 Level 5
You provide a blanket privacy
policy that covers the use of
conversational data.
You have a conversational privacy
policy and make security part of
your conversational design
process.
You proactively implement
security controls for all interactions
in support of an explicit and
differentiating privacy policy.
9
39. georgianpartners.com
Conversational Business
Keep private conversations private.
Integrity
a. Interactions with conversational interfaces come with greater
intimacy and trust than web- and app-based interactions.
b. Set expectations with users explicitly about how conversational
data will be used.
c. Explain how users benefit from analysis of their conversational
data to build trust.
d. Develop a conversational privacy policy and update it to reflect
changes in your product and the user experience.
e. Privacy is part of design.
“My daughter got this in the mail!” he said.
“She’s still in high school, and you’re
sending her coupons for baby clothes and
cribs? Are you trying to encourage her to
get pregnant?”
9
40. georgianpartners.com
Conversational Business
Principles of Conversational Business
4. Content enables conversations.
5. Capture user context.
6. Design for conversation.
7. Personify your business.
8. Bot or not?
1. Identify where you’ll have the greatest conversational impact.
2. Understand your audience.
3. Build complete experiences.
9. Keep private conversations private.
Purpose
Data
Design
Integrity
Today going to share with you GP’s view on the rise of conversational interfaces and the opportunities that they present for growth-stage B2B SaaS companies.
Growth stage investor based in Toronto, B and above, product-market fit, >$6MM ARR
Thesis-driven, started back in 2008 focus on Applied Analytics
Evolved to include Applied AI, Security First and Conversational Business (chatbots, messaging, conversational interfaces)
First, a bit about myself
Joined GP from the bay area over the summer
Lead the development of GP’s investment thesis on Conversational Business, includes messaging, chatbots and personal assistants
Computational linguist by training, focus on human discourse, NLP and speech processing
Applied NLP in a number of areas, human dialogue and linguistics at the center of all of it
Much of my career reading other peoples’ emails and chat logs, looking for bad behavior in forensic investigations (fraud, rogue trading, insider threat) and e-discovery, primarily in financial services
Also spent a lot of time developing speech processing systems: Nuance: expressive TTS (Siri/Amazon Alexa), call center/IVR, speech analytics (deception detection), dialogue systems (reading tutors) in the education space
Help start ups that have an opportunity to use conversational interfaces and NLP to accelerate the growth and success of their business
Spend most of my time working with GP network through workshops and engagements, helping with chatbot design and execution, building data science teams, applications of ML/AI/Analytics to businesses
Conversational business encompasses a variety of conversational interfaces.
These interfaces are not just mobile apps used to broadcast a message through social media (in a uni-directional manner).
Support back-and-forth dialogue, which can be more engaging, facilitate development of a relationship with customers
Interface without a learning curve, physiologically grounded that allow business to carry on long-running, personalized interactions with large numbers of customers simultaneously.
An interface based in human physiology.
Interface that can use context to deliver an intuitive, engaging and long-running conversation with users.
Ordering part from junkyard, back and forth
Where are the biz opps for back-and-forth dialogue
Helps solve a specific problem
And the most common conversational interfaces these days is messaging
It’s important to note that as it has become more popular as a mode of communication, none of the other channels have really disappeared
On my journey to becoming a Canadian resident, I recently sent a fax
It’s used for social and business communications, and even content publishing
And so we are faced with the challenge of determining when a particular channel is most appropriate and figuring out where our customers are, what their switching behavior might be from one mode of communication to another, making their journey frictionless
Customer confusion: not either or, it’s an AND situation. Look to the kids. Don’t send an email or call them.
Slide: mocking the noreply@business.com – it’s a diode, info goes one way, not the other, makes no sense, can’t respond with buy
Twilio deck: how customers prefer to interact: https://techcrunch.com/2016/09/12/twilio-study-most-consumers-now-want-to-use-messaging-to-interact-with-businesses/
ADD DATES, broken line, space move to left, some time is represented
We are experiencing a paradigm shift in the way we communicate!
Many indicators that users are suffering app fatigue – declining use, shift to messaging
Messaging has already surpassed social media usage
FB study published in DEC shows that users strongly prefer engaging with businesses through messaging
So, MESSAGING IS THE PLACE TO MEET AND INTERACT WITH YOUR CUSTOMERS!
https://insights.fb.com/2016/12/01/messaging-means-business/
[As hard as the move from web to mobile was, the move to conversational interfaces is going to be even more difficult]
Before: design around the device, now design around the interface.
Now, it’s really about designing around language and dialogue, complex user flows, whereas before it was about fitting web functionality or a portion of it into an app with a little less screen real estate
As businesses move to meet users in this new environment, there are some challenges that are reminiscent of the move from web to apps (discoverability)
But some aspects of the move to conversational interfaces are very different
Biggest difference: before humans were forced to learn apps, now apps will need to learn to be human
We thought mobile was hard it wasn’t
What’s the backend process you are going to manifest in front of these people
As businesses move to meet users in this new environment, some challenges that are reminiscent of the move from web to apps
But some aspects of the move to conversational interfaces are very different
Now, it’s really about designing around language and dialogue, complex user flows, whereas before it was about fitting web functionality or a portion of it into an app with a little less screen real estate
Messaging vs. app
Heavy to medium to light
All will co-exist
It’s difficult because it’s not just slack, FB messenger, we’re talking about a number of channels and devices that will continue to evolve
it’s about all of them and more, b/c of the nature of UX, the trend will continue
Google Home: ok google turn the lights down, Alexa: send me a cab
Subtle but not insignificant task, driven by increasingly sophisticated back-end services
With voice, the chat experience is moving from eyes down to eyes up; hands occupied to hands free
And with all these devices, interactions are becoming ambient, frictionless
- Thought messaging and chatbots are the most common conversational interfaces at the moment
- They are not the only ones
- Seeing a number of new interfaces appear that support natural language dialogue
Of course, ubiquity of language-enabled platforms and devices also opens up the opp for bots and automation
Allows us to carry on more frequent, engaging interactions and develop deeper relationships with more users.
Bots provide an opportunity to carry on unique, personalized conversations at scale.
Interface + automation creates an opportunity to have deeper, more engaging relationship with users in parallel
Google home automation >> automation everywhere
Automation in the context of messaging yields bots
This will allow businesses to reach a large audience where they are already having conversations
Interface + automation creates an opportunity to have deeper, more engaging relationship with users in parallel
Overall, we see that users are drawn to:
more natural and engaging experiences,
that are uncluttered and sleek, don’t have a learning curve
that allow them to accomplish tasks effortlessly, if possible will things to happen, or engage using just a few words
Many challenges, expectations are high, interface is challenging and new, development tools are limited
We don’t yet fully know what works, and what doesn’t
In an effort to address some of these issues, we have developed our 10 principles of Conversational Business
To facilitate conversations with chatbot/conversation ux companies and help our own portfolio companies, we’ve developed a set of principles for evaluation
Set of things that are indicators of maturity in this space, increase likelihood of product success
Purpose: We talked about web to mobile, now conv interfaces, but need to think about what functions are best delivered through the conversational paradigm. Which are most appropriate? What is the purpose, impact, cost, value for your business?
Context: Data required for successful interactions. Constantly engage, collect context, deliver contextually-appropriate responses.
Interface: Have to design for it, no interface, text interface, button interface, speech interface? Conversational design, persona design, guiding user flows.
Intelligence: Finding how to introduce automation, how to learn from context. How informed, implemented, optimized?
Integrity: Opp for messing up, use customer data carefully, or we may overstep our bounds, create unsettling experiences for users. Be aware of the risks that come along with a conversational interface. Don’t be creepy.
Challenge your thinking, know what conversations are taking place in your business
Apply conversation where it has the biggest impact.
Deliver a seamless experience, end-to-end, actionable interactions, make interactions rich enough, design interactions to be rich enough for the task at hand
Relationship memory: built on having memory, think/fell/behave/act, empathy, qr code scan to save on next purchase / which location?
MEMORY
Intelligence: NLP, parsing, sentiment, Luis
Understanding=intelligence/Context = memory / Capability=context/purpose what problem are you trying to solve;
Interface, predicted responses, static keyboards (buttons) hard vs. soft
Conversation: either/or
#1 (where) what form should it take: sms, native app, website integrated
#2 Accuracy trumps persona at this point: can it handle a purchase inquiry, customer service inquiry, people are in disbelief state
#3 icing on top, can we make sure it matches our brand identity, match the conversation to the person who is typing it, mimic style, does that match our brand attributes, identify a style of typing
Maturity: (1) Do you have the ingredients/conditions to do it (2) strategic intent (3) have they done things yet? Present vs. Potential?
Core advantage for CB: captive audience/notifications/mobile app/interaction/natural extension of current interaction/existing two-way communication?, audience size, audience demographic, mindshare, biz function/data
(1) Unfair advantage/ingredients/readiness, (2) clarity of strategy, vision lock (3) execution/how much have you taken advantage of it/implementation
(1) Context, Integrity, Interface (2) Purpose (3) Interface, Understanding
First principle is about identifying, prioritizing, and selecting the conversational experiences that will bring the most to your business.
Not all functions are best delivered through language: Visual mapping function, for example.
Others, however, can benefit greatly from conversation. Using messaging for multi-turn flight/hotel booking, for example.
In terms of maturity levels, companies that have documented their business functions, have a process for evaluating their practicality, and developed a roadmap will be best prepared for conversational business.
Messaging and voice-based conversational interfaces are a powerful way to engage users, but won’t be the answer for every business process or function. Have a strategy for identifying where conversational interactions will create the most value.
Apply conversation where it has the biggest impact on your business
Apply conversation where it has the biggest impact
Analyze your business to identify conversational impact
Understand the conversations that are taking place in your business
Deliver the most important business functions via conversation
Focus on the business
Mapped out the customer journey
Started by providing merchants with the ability to share their inventory via keyboard with Shopkey
“Discover us” button
Shopping in messenger, check-out view
Receipts, order notifications to start conversation, engage users
In going through the process, they developed a strategy for conversational commerce, developed roadmap to knit them all together
Signpost: same process for marketing, conversations between merchants and their customers, automatically execute email marketing campaigns
How horizontal can we go?
L1: CB afterthought, L2: some context, L3: PM includes all aspects of CB in roadmap
Know what biz functions are, how they map against people, then what interactions
Level 0: no CB roadmap, L1 started; L3: PM includes specific CB functions in roadmap
Where do we have friction? By product, function, audience * Opportunity to determine where to extend biz
Maturity: (1) Do you have the ingredients/conditions to do it (2) strategic intent (3) have they done things yet? Present vs. Potential?
Core advantage for CB: audience size, mindshare, biz function/data
(1) Unfair advantage/ingredients, (2) clarity of strategy, (3) execution/how much have you taken advantage of it
Data scientists: Be aware of what is currently possible, and what the potential complexity and cost of it might be. This will help with the prioritization. Know for example that there are few dialogue management systems available, but speech recognition is becoming more accessible.
High-friction product interactions / workflows / multi-turn
Routine, boring tasks
Conversations that are already taking place
Informational & transactional interactions
Opp for better experience than mobile
MS: command line to conversational interface
Amir: focus on workflows, smaller problems first
Example: GP marketing bot, workplace bot to help deal process, including interface to our automatic company scoring model
Q: What are the properties of problems that are best solved through conversational interactions.
Because we at GP see ourselves as a fintech enterprise software company, we recently went through the business function mapping and prioritization process and are currently developing a roadmap for chatbots that will help us more efficiently work through the deal flow process. Carefully considered which chatbot ideas would have the greatest impact on our business, with the most engaging experience, for the lowest cost,
Stay tuned for news on George/Georgina!
Apply conversation where it has the biggest impact on your business
Apply conversation where it has the biggest impact
Analyze your business to identify conversational impact
Undertand the conversations that are taking place in your business
Deliver the most important business functions via conversation
Focus on the business
Mapped out the customer journey
Started by providing merchants with the ability to share their inventory via keyboard with Shopkey
“Discover us” button
Shopping in messenger, check-out view
Receipts, order notifications to start conversation, engage users
In going through the process, they developed a strategy for conversational commerce, developed roadmap to knit them all together
Signpost: same process for marketing, conversations between merchants and their customers, automatically execute email marketing campaigns
How horizontal can we go?
L1: CB afterthought, L2: some context, L3: PM includes all aspects of CB in roadmap
Know what biz functions are, how they map against people, then what interactions
Level 0: no CB roadmap, L1 started; L3: PM includes specific CB functions in roadmap
Where do we have friction? By product, function, audience * Opportunity to determine where to extend biz
Maturity: (1) Do you have the ingredients/conditions to do it (2) strategic intent (3) have they done things yet? Present vs. Potential?
Core advantage for CB: audience size, mindshare, biz function/data
(1) Unfair advantage/ingredients, (2) clarity of strategy, (3) execution/how much have you taken advantage of it
It’s critical to understand that your customers are already communicating through text and voice.
Don’t try to pull them in, join the conversation. Leverage users’ existing communities and social connections to your advantage.
Make it as easy as adding a friend to their friend list. Avoid making them download yet another app.
User research, metrics, demographics.
Begin to get an understanding of what their ideal experience would be: start on web, switch to mobile as you walk to your car, hands-free, eyes-free while driving.
Q: Methods for getting to know your audience? How do you determine which platform/channel to build on?
The challenge, of course, is meeting them everywhere that they might be.
Some development tools are emerging to help with interoperability – can save development time, but require some concessions wrt user experience. May not be able to fully exploit the unique properties of each platform.
Most important thing is to understand current and potential audiences and having a strategy for reaching them articulated in your product roadmap.
Design session yesterday (Amanda @Automat): user metrics, understand segments, learn about your users in real-time and over time to customize interactions, ask interesting questions
Message.io interoperability platform, enterprise bots that work everywhere, bot translation, unified messaging language, one-click deploymentSlack, HipChat, Skype
Microsoft bot framework
x.ai, riptide, ryde.ai email vs. sms
Where we are heading: web to chat to voice
L1: best platform L2: all platforms L3: seamlessly switch across
Second principle stresses the importance of delivering an end-to-end, uninterrupted experience for users.
It’s about avoiding task/interface switching, about knitting together rich functions on the back end, possibly through APIs and service integrations.
Ideally, the customer journey will be measurably improved with conversation.
Mapped out the customer journey
Started by providing merchants with the ability to share their inventory via keyboard with Shopkey
“Discover us” button
Shopping in messenger, check-out view
Receipts, order notifications to start conversation, engage users
In going through the process, they developed a strategy for conversational commerce, developed roadmap to knit them all together
Signpost: same process for marketing, conversations between merchants and their customers, automatically execute email marketing campaigns
How horizontal can we go?
L1: CB afterthought, L2: some context, L3: PM includes all aspects of CB in roadmap
Know what biz functions are, how they map against people, then what interactions
Level 0: no CB roadmap, L1 started; L3: PM includes specific CB functions in roadmap
Where do we have friction? By product, function, audience * Opportunity to determine where to extend biz
Maturity: (1) Do you have the ingredients/conditions to do it (2) strategic intent (3) have they done things yet? Present vs. Potential?
Core advantage for CB: audience size, mindshare, biz function/data
(1) Unfair advantage/ingredients, (2) clarity of strategy, (3) execution/how much have you taken advantage of it
Example from our portfolio: Shopify delivered end-to-end e-commerce experience to their customers using conversation.
Started by mapping out the complete customer journey, from product recommendation to purchase, shipping and customer support.
Translated these steps into conversational paradigm.
Selected a starting point, product discovery / merchant inventory sharing, and over time expanded the experience to include all steps.
Started by providing merchants with the ability to share their inventory via keyboard with Shopkey
“Discover us” button
Shopping in messenger, check-out view
Receipts, order notifications to start conversation, engage users
In going through the process, they developed a strategy for conversational commerce, developed roadmap to knit them all together
Signpost: similar process for marketing, conversations between merchants and their customers, automatically execute email marketing campaigns
Data Science perspective: know rich set of integrations that might be available to you, from intent extractors to payment and shipping, notifications
Apply conversation where it has the biggest impact on your business
Apply conversation where it has the biggest impact
Analyze your business to identify conversational impact
Understand the conversations that are taking place in your business
Deliver the most important business functions via conversation
Focus on the business
Mapped out the customer journey
Started by providing merchants with the ability to share their inventory via keyboard with Shopkey
“Discover us” button
Shopping in messenger, check-out view
Receipts, order notifications to start conversation, engage users
In going through the process, they developed a strategy for conversational commerce, developed roadmap to knit them all together
Signpost: same process for marketing, conversations between merchants and their customers, automatically execute email marketing campaigns
How horizontal can we go?
L1: CB afterthought, L2: some context, L3: PM includes all aspects of CB in roadmap
Know what biz functions are, how they map against people, then what interactions
Level 0: no CB roadmap, L1 started; L3: PM includes specific CB functions in roadmap
Where do we have friction? By product, function, audience * Opportunity to determine where to extend biz
Maturity: (1) Do you have the ingredients/conditions to do it (2) strategic intent (3) have they done things yet? Present vs. Potential?
Core advantage for CB: audience size, mindshare, biz function/data
(1) Unfair advantage/ingredients, (2) clarity of strategy, (3) execution/how much have you taken advantage of it
Capture interaction data, verbatims, third party data on social media
Topical relevancy, bias, linked to outcomes, stylistically felicitous
Create: script writers and editors
Continue to improve over time
Assist loan officers with SMB commercial loans
Virtual assistant named Andi who recommends best terms that will increase the chances of closing the loan and optimize the loan portfolio
Out of vocabulary intent/questions: routed to human agents via slack, response is captured and used by Andi the next time
Content management system
Retrieval – bank of responses
Generative models – personalized, require training corpus of responses
Long convo – needs dialogue state and decision criteria for moving from one to the next
http://www.wildml.com/2016/04/deep-learning-for-chatbots-part-1-introduction/
No conversation should take place in a vacuum.
As a chatbot developer, you want to avoid cold-start interactions.
Build a user model that tells you who your users are, when you last interacted with them, and what they’ve said. Predict what they might want to do at this very moment.
Data scientists: This model can be informed by account level data, including user preferences, as well as behavioral data, like what time they usually start a session.
Use the discourse itself to infer things about the user – pay close attention and be a good listener, and you’ll be surprised what you can learn.
Good example is Toronto’s own automatic meeting scheduler, zoom.ai, which builds up rich contextual data over time by observing user meeting behavior (time, place, participants), and pulling in 3rd party data sources (linkedin, receptiviti) and proactively makes recommendations.
Probably the most important thing to keep in mind from a design perspective is to identify and eliminate all sources of friction
Eliminate task switching, understand who you are talking to, match the communication style, and adapt as much as you can to the user.
[As hard as the move from web to mobile was, the move to conversational interfaces is going to be even more difficult]
Before: design around the device, now design around the interface.
Now, it’s really about designing around language and dialogue, complex user flows, whereas before it was about fitting web functionality or a portion of it into an app with a little less screen real estate
As businesses move to meet users in this new environment, there are some challenges that are reminiscent of the move from web to apps (discoverability)
But some aspects of the move to conversational interfaces are very different
Biggest difference: before humans were forced to learn apps, now apps will need to learn to be human
We thought mobile was hard it wasn’t
What’s the backend process you are going to manifest in front of these people
As businesses move to meet users in this new environment, some challenges that are reminiscent of the move from web to apps
But some aspects of the move to conversational interfaces are very different
Now, it’s really about designing around language and dialogue, complex user flows, whereas before it was about fitting web functionality or a portion of it into an app with a little less screen real estate
Messaging vs. app
Heavy to medium to light
All will co-exist
Provide navigational grounding by letting the user know what they can say
Set expectations wrt functionality
Engage regularly with users so that you can anticipate needs and remove obstacles in a preemptive manner
Concierge bots
Connect to multiple devices, multiple services
Hide complexity from the user, make an effortless experience
Thington, concierge for smart devices, smarter home
All through conversational interface
Eliminate the need to speak directly with every device, concierge mediates conversations and manages complex tasks
“secure the house” turn off lights, lock doors, arm alarm
Workbot, slackbot, automates complex business processes, weaves them together, triggerable via simple commands in slack
Command over 150 apps from Slack, CRM Salesforce, lead notifications, real-time opportunity summary; customer support
https://developers.google.com/actions/design/principles
On the perception side
Intent detection, extract mentions of people, places, products
Sentiment analysis and speech analytics to determine user state
Dialogue act classification: question vs. statement vs. confirmation
Linguistic Style Detection: formal vs. informal, reading level of user
Speech: huge advances
Speech reco error rates close to humans
TTS huge improvements in mean opinion score and intelligibility
2017/2018 will see personalized voices
Your conversational interface is a representative for your brand.
As a result, you should put some thought into how the chatbot behaves, what decisions it makes, how it reacts to customers, how it embodies your company values.
With engagement in mind, you may want to develop different personas for different users and user segments
The more relatable, the more likely users are to engage and get value out of the interaction
These are just a few qualities that have been identified in our workshops
Recognizable and consistent, yet personalized
Challenge: not losing yourself, but accommodating user needs
Name, profile, characteristic phrases, tying responses to explicit company policies (may require editorial input)
A couple of examples worth mentioning
Neither one is wrong
One Alexa for all users, very limited personalization
Represent you or act as conversational companion
Other end of the spectrum, emergence of highly personalized bots
Replika, to create conversational agent from past interactions, even from the deceased
Olabot, a bot for every user, used to represent yourself, CEO used as a virtual resume, job interviews
Bot or not? That is the question
Question should be: what parts of the interaction can be automated?
Can they be automated sufficiently to create an engaging, effective interaction?
Most complex functions delivered through chatbots/messaging today still have human in the loop, even if just for backup
If you do have human in the loop, make sure there is a seamless handoff
Meya is a great example of how this is done
They take a collaborative view on human-machine conversational interaction, provide a platform that makes customer support easy – handoff goes both ways and each participant plays to its strengths
Precision Lender helps identify low confidence chatbot customer interactions and routes them through Slack, remembering how to respond next time
Users have a higher expectation of privacy with conversational interactions, because they most closely resemble private human-to-human interactions
It’s important to set expectations with users about what is stored, what isn’t, and how data will be used
If that data is used out of context, then it could erode trust and lead to abandonment
Make sure you have an explicit privacy policy for chat and that you communicate it to users
2 factor authentication, end-to-end encryption, diff priv
An example of this going wrong “massive privacy fail”
Recently a psychiatrist noticed that FB was recommending her patients friend each other – recommendation engine, potentially violate HIPAA privacy rules, creepy and dangerous and risky to your business
Purpose: We talked about web to mobile, now conv interfaces, but need to think about what functions are best delivered through the conversational paradigm. Which are most appropriate? What is the purpose, impact, cost, value for your business?
Context: Data required for successful interactions. Constantly engage, collect context, deliver contextually-appropriate responses.
Interface: Have to design for it, no interface, text interface, button interface, speech interface? Conversational design, persona design, guiding user flows.
Intelligence: Finding how to introduce automation, how to learn from context. How informed, implemented, optimized?
Integrity: Opp for messing up, use customer data carefully, or we may overstep our bounds, create unsettling experiences for users. Be aware of the risks that come along with a conversational interface. Don’t be creepy.
Challenge your thinking, know what conversations are taking place in your business
Apply conversation where it has the biggest impact.
Deliver a seamless experience, end-to-end, actionable interactions, make interactions rich enough, design interactions to be rich enough for the task at hand
Relationship memory: built on having memory, think/fell/behave/act, empathy, qr code scan to save on next purchase / which location?
MEMORY
Intelligence: NLP, parsing, sentiment, Luis
Understanding=intelligence/Context = memory / Capability=context/purpose what problem are you trying to solve;
Interface, predicted responses, static keyboards (buttons) hard vs. soft
Conversation: either/or
#1 (where) what form should it take: sms, native app, website integrated
#2 Accuracy trumps persona at this point: can it handle a purchase inquiry, customer service inquiry, people are in disbelief state
#3 icing on top, can we make sure it matches our brand identity, match the conversation to the person who is typing it, mimic style, does that match our brand attributes, identify a style of typing
Maturity: (1) Do you have the ingredients/conditions to do it (2) strategic intent (3) have they done things yet? Present vs. Potential?
Core advantage for CB: captive audience/notifications/mobile app/interaction/natural extension of current interaction/existing two-way communication?, audience size, audience demographic, mindshare, biz function/data
(1) Unfair advantage/ingredients/readiness, (2) clarity of strategy, vision lock (3) execution/how much have you taken advantage of it/implementation
(1) Context, Integrity, Interface (2) Purpose (3) Interface, Understanding
- Would love to hear about your own experiences building bots and building bot businesses.