Industry 4.0 is on the rise and this coordinated push for automation, big data, and internet-of-things in the smart factory is already causing (and will continue to) disruption in the job market. New skills for 'new collar' jobs are needed and intelligent assistance systems with Augmented Reality, Smart Glasses, and other forms of wearable computing may help to deliver them. In this talk, Dr. Wild will introduce to the concept of Performance Augmentation and illustrate how challenges for the future can be met at the hand of several examples of intelligent training and live guidance applications in aircraft maintenance, space assembly, and medical diagnostics.

1. Professional TEL 4.0
Performance Augmentation for Industry 4.0
Dr Fridolin Wild
Performance Augmentation Lab
OXFORD
BROOKES
UNIVERSITY
+

2. Overview
• The context: Work 4.0
• The solution: Human Performance Augmentation
• WEKIT
• Framework
• Reference Architecture
• Standards
• Garment
• Film
• Findings

3. Context (aka ‘the problem’)
OXFORD
BROOKES
UNIVERSITY

4. Source:
Siemens

5. Photo: BMW
DIGITAL MANUFACTURING
OXFORD
BROOKES
UNIVERSITY
12:15 maintenance needed

6. Overview of Digital Manufacturing
Initiatives across Europe
Germany
Industrie 4,0
Smart Service World
Autonomik fur Industrie 4.0
It's OWL (Ostwestfalen-Lippe)
Allianz Industrie 4.0 (Baden-
Württemberg)
Netherlands
Smart Industry
France
Usine du Futur
FoF Ile-de-France
United Kingdom
High Value Manufacturing
Innovate UK
Action Plan for Manufacturing (Scotland)
Spain
Estrategia Fabricacion Avanzada
(Basque region)
Italy
Fabbrica Intelligente
Ass. Fabbr. Intell. Lombardia
Sweden
Produktion 2030
Belgium
Made Different
Flanders Make/iMinds (Flanders)
EU-level Initiatives
Application PPPs: FoF, SPIRE
I4MS
Smart Anything Everywhere
ICT PPPs
Multi-region Initiatives
Vanguard
Austria
Produktion der Zukunft
Portugal
Produtech
European Commission
DG CONNECT, Unit A3, ML
European initiatives are in red
National initiatives are in blue
Regional initiatives are in green
Finland
FIMECC PPP Programmes
(MANU, S-STEP, SIMP,
S4FLeet)
Industrial Internet Business
Revolution
IoT pilot Factory (IoT PFF)
Greece
Operational Programme in
Region Western Greece
Poland
INNOMOTO
INNOLOT
Digital manufacturing for the SME
(Mazovia)
DIGITAL MANUFACTURING INITIATIVES ACROSS
EUROPE

7. http://bit.ly/jobgone

8. GO WITH THE TIMES
OR GO WITH TIME
(Grace et al., 2017)
“Overall, we find that,
on average across
the 21 OECD countries,
9% of jobs are automatable.“
(Arntz, Gregory, & Zieran, 2016)

9. THE SKILLS GAP
9
(CIPD, 2016; UKCESS, 2015)

10. SKILLS GAP: RISING DEMANDS

11. Solution: Performance Augmentation
OXFORD
BROOKES
UNIVERSITY

12. • Smart Assistance: Intelligent
Training and Guidance Systems
• Healthy workplaces: ergonomic,
safe, facilitating fitness
• New work models
HUMAN
PERFORMANCE
AUGMENTATION

13. EXPERIENCE PERCEPTION GATEWAY
REAL VIRTUAL
MULTIPLEXER
SENSORS
COMPETENCE
PERFORMANC
E
OBSERVE
REALTIME
FEEDBACK
PLAN & CONTROL
ACTION
E-, SS-, M-
MEMORY
MONITOR
PERFORMANCE
AUGMENTATION
KSAOs
13

14. PRESENTING DATA
IN CONTEXT: AR
“Augmented Reality refers to
enhancing human perception with
additional, artificially generated
sensory input to create a new
experience including, but not
restricted to, enhancing human vision
by combining natural with digital
offers.”
(Wild et al., 2016, ARLEM spec)

15. Wearable Experience for Knowledge Intensive Training
(WEKIT)
OXFORD
BROOKES
UNIVERSITY

16. capture expert
experience
trainees wear expert
experience
analysis and post
processing
OK
16

17. WEKIT FRAMEWORK: Task x Transfer Mechanisms
17
References
Task
Transfer Mechanisms Perceptual ability High Memory Collaborative
ability
Decision making High speed Motor
performance
High precision
Interactive virtual objects Seichter, H.,
(2004)
Nilsson et al
(2011)
Lahanas V et. al.
(2014)
Quarles et. al.
(2008) a
Rhienmora et al.
(2010)
Evans et al.
(2014)
Haptic feedback Rozenblit et al.
(2014)
Lahanas V et. al.
(2014)
Matassa &
Morreale (2016)
Khademi et al.
(2012)
Highlight object of Interest Roads et. al (2016) Hahn et al.
(2015)
Kotranza et al.
(2009)
Directed Focus
Jarodzka et al.
(2013)
Henderson &
Fernier (2011)
Biocca et al.
(2006)

19. https://vimeo.com/channels/pal/226297643 (0:00 to 0:55)

20. ARCHITECTURE

21. ARLEM
21

22. ARLEM JSON BINDING
22
workplace modelactivity model

23. TDOC
CAD, CAE
EPC
PLM
CRM
DITA
DocBook MuMaSy
S1000D
Parts catalogue,
incl. 3D models of
parts
Customer
inventory,
modifications,
machines
plans,
3D models
Part numbers, machine
numbers, modifications
001010
Reduction,
scrambling,
adaptation
LMS
Learning and
training content
KB

24. WEARABLE
SOLUTION

25. https://vimeo.com/channels/pal/226297643 (0:55 to 2:15)

26. Findings
OXFORD
BROOKES
UNIVERSITY

27. EVALUATION (CYCLE 1)
– Technology Acceptance and Use
– Simulator Sickness
– Usability of the Software
– User Satisfaction with the Hardware
– User Interaction Satisfaction
– Use of Transfer Mechanisms
27

28. SYSTEM USABILITY
(Brooke, 2013)
66.4 (mean)

29. 29

30. Transfer Mechanisms (All)
Strongly
Disagree
Disagree
Somewhat
Disagree
Neither agree
or disagree
Somewhat
agree
Agree
Strongly
Agree
DF1 DF2 AP2 AP1 AM2 AP2. AM3 GT2 AM1 HL1 IVO1 POV1 CUE1ANN1 OE1 ANI1 CI1 TA2 TA1 FB1

33. OUTLOOK on CYCLE 2
– Effectiveness:
Higher rate of skill transferability
– Efficiency:
Increased efficiency in assembly task
– Memorability:
Better percentage of long term memory recall
– Cognitive Load:
Simulations of phenomena overlaid
reduce cognitive load
33

34. THE END.
wild@brookes.ac.uk http://pal.cct.brookes.ac.uk