The document discusses the WEKIT project, which aims to develop a wearable experience training methodology. This methodology involves capturing an expert's experience, enabling trainees to re-enact it wearing augmented reality devices, and then evaluating the training. The WEKIT platform and prototype use various sensors and AR tools to match trainee performance to expert data. The project is evaluating the approach in industrial settings like aircraft maintenance and healthcare imaging. The goal is to provide innovative learning that transfers experts' tacit knowledge through immersive experience sharing.

1. Wearable Experiences
for Knowledge Intensive Training
Mikhail Fominykh, PhD
Europlan UK Molde University College
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 1
Learning Methodology and Technology Design
Regional session

2. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 2
June 28-30, 2016 • Vancouver, BC, Canada
#WEKIT
#tcc22nd

3. About me
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 3
Project manager in
workplace training with
Augmented Reality
and Wearables
Associate Professor
and researcher in
Emergency Management
training
Adjunct Professor and teacher
in Virtual Reality
Software developer in
psychological treatment
training
Software developer in cooperation
training for medical students
Project manager in
workplace experience
capturing with 360 videos,
Augmented Reality and
Virtual Reality

4. What is WEKIT?
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 4
Funding: EU Horizon 2020, ICT-20 2015: Technologies
for better human learning and teaching
Budget: EUR 2.753.143,75
WEKIT Community https://wekit-community.org/
WEKIT project website http://wekit.eu/

5. WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING20/04/2017 5

6. Augmented Reality

7. https://www.youtube.com/watch?v=qAsu-RoVgWc
Past

8. https://www.youtube.com/watch?v=7d59O6cfaM0
Present

9. https://www.youtube.com/watch?v=YJg02ivYzSs
Future

10. Ori Inbar, AWE 2016

11. Ori Inbar, AWE 2016

12. 20/04/2017 12

13. 20/04/2017 13

14. # 14
Logistics
https://youtu.be/gnUK-HTn4ZA?t=41s

15. # 15
Maintenance
https://youtu.be/VGtCQWROytw?t=39s

16. # 16
Energy
https://youtu.be/lkH88TTgt6A?t=1m20s

17. https://vimeo.com/133828847
Enriching the ‘real’ world with
virtual visual overlays
Giuseppe Scavo, Fridolin Wild and Peter Scott(2015) The GhostHands UX: telementoring with hands-on
augmented reality instruction, DOI: 10.3233/978-1-61499-530-2-236

18. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 18
Working example
Kaj Helina, Timo Kuulaa, Jaakko Karjalainena, Iina Aaltonena, Fridolin Wildb, Juhani Viitaniemia, Antti
Väätänena (2015) Usability of the ARgh! Augmented Reality system for on-the-job learning

19. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 19
Working example

20. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 20
Working example

21. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 21
Kaj Helina, Timo Kuulaa, Jaakko Karjalainena, Iina Aaltonena, Fridolin Wild, Juhani Viitaniemia, Antti
Väätänena (2015) Usability of the ARgh! Augmented Reality system for on-the-job learning

22. Training with AR – knowledge
conversion

23. Object-
centric
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 23
Action-
centric

24. Information
communication
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 24
Experience-
communication
Images: http://www.unmuseum.org/, http://en.wikipedia.org/, http://digitalxtrememedia.com/;
https://www.youtube.com/watch?v=7d59O6cfaM0, https://www.microsoft.com/en-us/research/project/holoportation/

25. Experience and knowledge
Learning = converting
experience to knowledge
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 25
Mikhail Fominykh, Fridolin Wild, Carl Smith, Victor Alvarez and Mikhail Morozov: "An Overview of Capturing
Live Experience with Virtual and Augmented Reality”, DOI: 10.3233/978-1-61499-530-2-298.

26. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
separated
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 26

27. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 27

28. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 28

29. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 29

30. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 30

31. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 31

32. Experience and knowledge
Learning =
= converting experience to knowledge
immediate experience
(aka ‘practice’)
information for a master
level
(aka ‘theory’)
Experiencedlearner
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 32

33. Mikhail Fominykh, Fridolin Wild, Carl Smith, Victor Alvarez and Mikhail Morozov: "An Overview of Capturing
Live Experience with Virtual and Augmented Reality”, DOI: 10.3233/978-1-61499-530-2-298.
Capture | Re-Enact
WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING20/04/2017 33

34. Methodology
What is Wearable Experience?
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 34
The Wearable Experience training methodology aims to provide an
innovative learning method that is based on the idea of capturing
the experience of an expert and enabling trainees to wear it while
re-enacting, thus giving the trainee access to the tacit knowledge of
the expert and enabling master-apprentice knowledge sharing.
Capture Re-enact Evaluate

35. WEKIT methodology
Phase A
Capturing

36. WEKIT methodology
Phase B
Re-enactment

37. WEKIT methodology
Phase C
Evaluation

38. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 38
Capturing

39. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 39
Re-enactment

40. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 40
Evaluation

41. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 41
Task Classifications
Transfer
mechanism
Highprecision
Highspeed
Decisiontaking
Collaborative
tasks
Highmemory
load
Perceptualtask
Assertivetask
Dualtask
Performance
Managing
Uncertainty
HighSpatial
Task
Slow motion
Zoom 3 13
Think aloud protocol 1 8
Object enrichment 2
Contextualization 3, 9 3
Self awareness of physical state 14
Directed focus 15
Case identification 16
Spatial Simulation 18
In Situ Real-time Feedback 4 17
Mobile control
Virtual Post its 5 5
Haptic hints
5,
12
Virtual/Tangible Manipulation 6
3,
10,
11
Remote symmetrical tele-
assistance
7 7
Literature
1Schraagen, 1993
2Tang et al., 2003
3Quarles et al., 2008
4BMW AR system, 2010
5Sabine et al., 2011
6Lahanas V et al., 2014
7Chinthammit et al., 2014
8Lundgrén-Laine et al, 2010
9Curtis et al., 1998
10Seichter, 2004
11Wang, Chen, Gong, & Hsieh, 2007
12Khademi et al., 2012
13Mulloni, Dünser &Schmalstieg 2010
14Larkin, 1983
15Jarodzka et al., 2013
16Mulzoff, 1990
17Kotranza, Lind, Pugh & Lok 2009
18Martin-Gutierrez et al., 2010

42. WEKIT.one technological
platform and prototype

43. Technology
What is Wearable Experience?
An experience that is facilitated by devices located on or in
the body that can include:
tracking user activity, biometric and environmental data
matching and mapping user performance
augmenting user’s activity with another user’s data
adapting user’s activity and behavior
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 43

44. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 44
Software architecture
Recorder

45. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 45
Augmented
Reality
Learning
Experience
Model
P15891 working group of the
IEEE standards association
http://arlem.cct.brookes.ac.uk

46. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 46
Hardware
design

47. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 47
Hardware
design

48. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 48
Wearable
design

49. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 49
Wearable
design

50. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 50
Hardware
design

51. WEKIT evaluation
in industrial cases

52. # 52
Maintenance workers
in Aeronautics
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING

53. # 53
Imaging and diagnostic
workers in Healthcare IT
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING

54. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING # 54
Sub-system integration,
operation & maintenance
in Space

55. What is WEKIT?
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 55
TEL community – driven project

56. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 56

57. 20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 57

59. jTEL summer schooler
jTEL summer schooler
jTEL summer schooler
jTEL summer schooler
jTEL summer schooler
jTEL summer schooler
jTEL summer schooler

60. 20/04/2017
http://bit.ly/wekit-facebook
http://bit.ly/wekit-twitter
http://bit.ly/wekit-linkedin
http://bit.ly/wekit-plus
http://bit.ly/wekit-youtube
WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 60

61. Disclaimer
This project has received funding from the European Union’s
Horizon 2020 research and innovation programme under
grant agreement No 687669. http://wekit.eu/
Q & A
Presented by Mikhail Fominykh
mikhail.fominykh@europlan-uk.eu
http://www.mikhailfominykh.com/
http://slideshare.net/mfominykh/
20/04/2017 WEARABLE EXPERIENCE FOR KNOWLEDGE-INTENSIVE TRAINING 61
#WEKIT