VR/AR + xAPI: Tracking Next-Gen Learning

VR/AR + xAPI:
Tracking Next-Gen Learning
A discussion on next-gen learning and training
with Chad Udell, Hugh Seaton and Melissa Milloway

Today’s Agenda
● Introduction to xAPI and AR/VR
● Chad Udell, Float
● Hugh Seaton, Aquinas Training
● Melissa Milloway, Amazon
● Moderated Discussion
● Panelist Takeaways
intro chad hugh mel q&a takeaways
Welcome!
Thanks for
joining us!

What is xAPI?
xAPI is experience data, a combination of
activity, learning, behavior, and
performance data.
By unifying data from across organizational
data sources, insights into engagement,
learning effectiveness, information use, and
team behaviors can be identified and
applied to improve business outcomes.
intro chad q&a takeawayshugh mel

How is experience data collected?
Experience Data is collected using the
Experience API (xAPI), a standardized
Actor — Verb — Object data format.
This interoperable data structure allows
you to activate information across tools
and technologies where Experience
Data is created in real-time.

How is experience data collected?
Because xAPI is designed around
activity-based data collection, xAPI data
can provide high-resolution insights into
specific learner activity.
For example, watching a video is actually
a summation of many, much more
granular, actions. This information can
show us how engaging or valuable an
experience is for a learner.

What is Augmented Reality?
Augmented reality
(AR) overlays digital
elements to your live
view, often through a
camera.
Ex. Pokemon Go,
Snapchat and Quartz

What is Virtual Reality?
Virtual reality (VR) is an
immersive experience in a
fully digital environment. VR is
a new experience in a digital
world disconnected from the
physical world.
Ex. Oculus Rift, Google
Daydream, Google
Cardboard

What about Mixed Reality?
A mixed reality (MR)
experience combines AR and
VR allowing users to interact
with real-world and digital
objects at the same time.
Ex. Microsoft HoloLens, Upskill
Skylight, JARVIS

Why does it matter to eLearning, L&D and HR?
intro chad q&a takeaways
Read the full report here.
hugh mel

So what
does
AR/VR
look like? Not like
this.

With this
level of
engagement!
More
like this!
intro chad q&a takeawaysmelhugh

And more
collaborative
with others! Even at
work?

Chad Udell
Realities 360 AR
Event App
Melissa Milloway
“Scenes Around Seattle”
xAPI Cohort
Hugh Seaton
Virtual Reality
Micro-Simulations
intro chad q&a takeawaysmel
Let’s hear from the experts!
hugh

Chad Udell
Managing Partner
intro chad q&a takeawaysmel
Realities360
AR-Enabled Event App
hugh

Our Expertise
● Management team former Accenture, 20 plus years experience in enterprise
software, doing both OTS and custom implementation
● Numerous Industry and Client awards for excellence in design
● Curriculum Designers, ATD Certified Instructors in Mobile Learning
● Nielsen Norman Group (NNG) Trainers in Mobile Design for Augmented Reality
● Faculty for over 10 years at Bradley University in Interactive Media
● Awarded eLearning Guild Guild Master, recognition for contributions to the industry -
Chad Udell
● Author of Learning Everywhere: How Mobile Content Strategies are Transforming
Training - Chad Udell
● Editor and Authors of Mastering Mobile Learning: Tips and Techniques for Success -
Chad Udell and Gary Woodil, Dr. Ed.D. (contributing authors from the Float team)
● Author of The Mobile Learning Edge - Gary Woodil, Dr. Ed.D.
15

How can event apps
be better?
What makes them not fun to use?
What’s with all the extra features?
Why are they not better integrated into the
live event experience? Photo by Marcos Luiz Photograph on Unsplash

Why haven’t people explored this yet?
What can happen when you combine them?
How can they enrich the experience?
How can xAPI and AR
work together?
Photo by Scott Webb on Unsplash

Let’s build a better conference app.
Let’s embrace the newest learning tech
and bring it to an interested audience.
Photo by Rodion Kutsaev on Unsplash - https://unsplash.com/photos/xkEtD4Stn0I

An AR event experience combined with
xAPI for iOS and Android
1. Contextual
2. Simple
3. Relevant
Download it now… play with it immediately.
Introducing Float’s
Event AR App

20
1. AR Viewer
2. Flexible Media Playback
3. Session List
4. Event Map
5. User Agenda
6. Check ins
7. Expo/Public Area List
8. Reminders
9. What’s Next?
Core App Features

The app’s use case and features
are easy to access and engaging.
It’s AR focused, lightweight and
simple to use.
A Quick Video

Heavy Usage during the event – Hundreds of
app downloads, over 13,000 interactions
recorded during the conference.
Feedback was positive - App was easy to use,
fast and brought a new dimension to the
conference.
Was this this the largest single event xAPI
cohort for non DoD? Jury is still out.
Outcomes and
More Info...

Follow these steps to log in:
1. Go to http://trial.yetanalytics.io
2. At the bottom, click ‘Have an Account? Log
In’
3. Enter the login credentials
Email Address: realities360@yet.com
Password: YetAnalytics!
4. Click ‘Realities360-Production’ to enter the
LRS
Contact us at hello@yetanalytics.com to learn more
or visit https://www.yetanalytics.com/demo.
See the Realities360 App Data in the
Yet Analytics Learning Record Store

It’s clear that xAPI is primed and ready to be
used at scale with live events and AR
experiences.
We’ve published a case study on our site with
lots more details.
Next steps: Markerless AR and publishing an
AR xAPI Profile.
Where can we go
from here?
http://info.gowithfloat.com/examining-the-realities360-app

Bringing Learning to
Life with Virtual Reality
Micro-Simulations Hugh Seaton
CEO

Background
Much of training is about how we “perform:”
● Public speaking
● Meeting moderation
● Negotiation
● Sales
● Delivering Feedback
● And More

Immersive, Authentic Learning
Virtual Reality Offers Authentic learning:
● Able to experience what is being trained
● Non-verbal communication
● Modeling the frameworks & ideas based on
the performance of others

Two Step Practice
Skills Demonstrated in VR Skills Practiced in VR

Feedback
● Gaze Tracking
● Voice Analysis
(“Um” & “Ah”)
● Heartbeat
● Time spent
● Completion of
content

Incredible Flexibility
Built using WebVR
Essentially a new website each
time - we can readily produce
thousands of personalized
versions.

xAPI
We’re tracking lots of fuzzy stuff.
xAPI makes it possible to gather this into meaningful representations.
Examples:
1. How much should you look people in the eye?
2. How much is a given learner improving their engagement with the team?
3. How much does a given learner need to improve their pacing?

Feedback & xAPI
Across hundreds of learners, we can begin to automate feedback.
Improvement of performance requires:
● Focused practice
● Immediate feedback
● Specific, actionable feedback
Prior to xAPI, this was possible, but always in a siloed, one-off way

xAPI works with others
The whole point is we can now share unstructured, behavioral data
so others can use it.
Data that systems already create, modified to work with LRS &
other xAPI-enabled systems

Pre/Post xAPI
{
"action" : "opened",
"chid" : "0",
"cid" : "-KjB4M5LSrF76C_HOPGe",
"details" : 0,
"email" : "hugh@aquinas.io",
"mid" : "-KnUr-nVQQw7JkmllujI",
"nid" : "-KmwurXUMJdmz8YrGIuQ",
"org" : 1,
"time" : 1498404359391,
"timestamp" : "Sun, 09 Nov 2017 21:38:14 GMT",
"uuid" : "149F1ECC-9B89-4476-9BD6-A84464E25240"
}
"id": "5a03cda8-8321-4500-a50f-e1ea5f20e7a1",
"actor": {
"name": "Hugh Seaton",
"mbox": "hugh@aquinas.io"
},
"verb" : {
"display": "opened"
},
"object": {
"objectType": "Activity",
"id": "-KmwurXUMJdmz8YrGIuQ",
"definition": {
"name": {
"en": "Opened Notification"
},
"type": "http://id.tincanapi.com/activitytype/opened",
"moreInfo": "-KjB4M5LSrF76C_HOPGe"
}
},
"timestamp": "2017-11-09T21:38:14.772Z",
"stored": "2017-11-09T21:38:14.772Z",
"version": "1.0.0"
}

Remember
it is still
early days!

Virtual Reality is Unique
We can track everything, because VR is 100% rendered.
If an action, an expression, a tone is conveyed to, or from the learner, it went
through a computer. So we will find a way to analyze it.
This means everything from how you enunciate to how many “Ums & “ahs” to
how much you gesture could all be analyzed, and feedback offered.

Virtual Reality’s Uniqueness Is Made Viable by xAPI
SCORM cannot handle VR.
When we are able to measure an arbitrary set of in-training actions, we can
continue measuring, iterating and improving as we learn to use VR for training.
We don’t know if gaze will help us. Or galvanic skin response. Or perhaps we’ll
learn to track gestures, or verbal tone.

“Scenes Around Seattle”
Fall 2017 xAPI Cohort
Project
Melissa Milloway
Senior Learning Experience
Designer, Amazon

Time for
Q&A!
What do
you
think?

Where is this
all going? A final
word.

What next?
Go explore an LRS for yourself —
https://www.yetanalytics.com/demo
Get a Yet xAPI LRS Sandbox —
https://www.yetanalytics.com/free-sandbox-account
Register for beta access to the Yet Adapter —
https://www.yetanalytics.com/yetadapter
The Yet Adapter allows non-technical users an easy way to upload
spreadsheet data and to transform it into xAPI data which can be
sent to any Learning Record Store.
Thank you to
our panelists
and attendees!

● Winner, Nielsen Data Visionary Award
at TechCrunch Disrupt SF 2015
● Winner, Best of E-Learning 2016
Excellence Award
● Ranked #1 LRS by the Craig Weiss Group
Contact us at:
hello@yetanalytics.com

VR/AR + xAPI: Tracking Next-Gen Learning

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to VR/AR + xAPI: Tracking Next-Gen Learning

Similar to VR/AR + xAPI: Tracking Next-Gen Learning (20)

More from Margaret Roth

More from Margaret Roth (16)

Recently uploaded

Recently uploaded (20)

VR/AR + xAPI: Tracking Next-Gen Learning