SlideShare a Scribd company logo
1 of 41
Integrating Mixed Reality
Pedagogy into Education
DR JAMES BIRT
Dr. James Birt
bond.edu.au/profile/dr-james-birt
Multi-dimensional defines my 20 year
industry and academic career, but
gaming is my 34 year passion
THE FUTURE OF JOBS
CHECK YOUR
Affinity
What you love
LackPassion
Opportunity
What is wanted
Ability
What you’re good
at
CHOOSING A JOB: PASSION OR PRAGMATISM?
Sweet Spot
MY FIRST JOB
WITH GAMES
(1999-2000)
Farming Lower Guk in
Vanilla EverQuest in search
of the Shining Metallic
Robes, Short Sword of
Ykesha and the Flowing
Black Silk Sash and selling
on eBay
Affinity
What you love:
Playing
EverQuest
Ability
What you’re
good at:
Farming
Opportunity
What is
wanted: Virtual
Loot
MY CURRENT JOB
WITH GAMES
(2010 - Today)
Affinity
What you love:
Games and
Education
Ability
What you’re
good at:
Communicating
Opportunity
What is wanted:
Communicators
that understand
Tech and
Games
Associate Professor and
discipline lead for Interactive
Media and Design where I
coordinate the Mixed Reality
Research Lab and
Communicate on Technology
and Games
My Office – Still
Features Kings Quest,
World of Warcraft and
EverQuest!
YOUR FUTURE JOB COULD
INVOLVE CREATING
PERSONALITIES FOR
ROBOTS
Jobs Aussies can expect to emerge in the
future
Melanie Burgess News Corp May 11, 2018
BUT IS THIS JUST A TECHNOLOGY GIMMICK?
youtu.be/cUR-eYDAz9w
GOOGLE DUPLEX DEMO: Google IO (May 9, 2018)
youtu.be/bd1mEm2Fy08?t=1m10s youtu.be/bd1mEm2Fy08?t=3m
NEW roles are created daily as a result of changing technologies and
customer expectations. Workers hoping to remain employable must look
ahead and prepare for what is coming.
WHAT ABOUT A JOB IN ESPORTS?
The Project – Game on – rise of eSports
“Most of the job titles will be the same as today … we will still have carpenters, nurses, road repairers, even teachers ... but the
nature of what they do and the skills they need will change … just as they have over the past 20 years”
Ron Johnston Executive Director, Australian Centre for Innovation, University of Sydney; The Conversation (Aug 2, 2016)
AREN’T ALL
MILLENNIALS
DIGITAL NATIVES?
• “[Millennials] are prolific users of [digital
technology] … do not assume that they are
[proficient users] … the increased use of
technology is primarily for [social media and
communications] … use doesn't mean learning
deeper skills … that requires explicit teaching”
• Australian Curriculum Assessment and Reporting
Authority CEO; ABC News (Nov 17, 2015)
PROLIFIC USERS OF DIGITAL
TECHNOLOGY
WHAT ARE THE SKILLS
AND STRATERGIES
REQUIRED TO THRIVE
IN THE NEW
LANDSCAPE?
Gartner 2018 Emerging Technology Hype Cycle
“Very clear, strong trend between the creative content of a job and its probability of
computerisation and replacement by robots” - Oxford Professor Michael Osbourne
2018 Future of Jobs Report – Core Work Skills
T H E C H A N G E I N D E M A N D F O R C O R E W O R K - R E L AT E D S K I L L S
Its not about any one
technology or learning a tool it’s
about:
communication, creative
thinking, problem solving, agility,
digital skills and
entrepreneurship
Changing Face of Classrooms
EDUCAUSE Horizon Report: 2018 Higher Education Edition
Samantha Adams Becker, Malcolm Brown, Eden Dahlstrom, Annie Davis, Kristi DePaul, Veronica Diaz,
and Jeffrey Pomerantz. NMC Horizon Report: 2018 Higher Education Edition. Louisville, CO:
EDUCAUSE, 2018.
NMC/CoSN Horizon Report: 2017 K-12 Edition
Freeman, A., Adams Becker, S., Cummins, M., Davis, A., and Hall Giesinger, C. (2017). NMC/CoSN
Horizon Report: 2017 K–12 Edition. Austin, Texas: The New Media Consortium.
Mixed Reality – Intersection of Virtual & Physical Realities
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on
Information and Systems, 77(12), 1321-1329.
Mixed Reality Relevance for Teaching & Learning
Mixed Reality Research Lab
www.mixedrealityresearch.com
Research Led Teaching Approach
www.mixedrealityresearch.com/#spatialCommTraditional Teaching Method
Comparative Design Visualisation of Space & Place
Traditional Teaching Method
27
www.mixedrealityresearch.com/#anatomy
Learning Anatomy & Physiology
www.mixedrealityresearch.com/#networkModeling
Traditional Teaching Method
28
Simulating Network Packet Flow
www.mixedrealityresearch.com/#paramedics
Traditional Teaching Method
29
Simulating Airways Training for Paramedics
How do we achieve this?
Pedagogy before Technology
Traditional Teaching Method
“this course is a 'skills' learning course
… there should be a way for us to
actually get more time doing skills …
distance students at a severe
disadvantage … I am missing out … you
can read about the skills but its
impossible to get feedback and to know
if you’re doing it right … no substitution
for experience … any software or
equipment to at least go through the
motions of doing the skills?” Paramedic Student
Learner(s) (201x-2014)
32
Paramedic Distance Education: The Problem
• [Discipline expert] we need every student to have a
portable airways mannequin & cheap tools to practice the
skills - but cost is prohibitive … residential schools work
… but not held early enough for students
• [Mixed Reality Team] tools could be provided to students
by 3D printing them (cost/set) ~ $1 AUD + postage
• [Mixed Reality Team] Airways mannequin could be
simulated virtually using a mobile phone
• [Discipline expert] students would need both hands free,
so the phone would need to be mounted in their eyeline
• [Mixed Reality Team] we can provide a hat and 3d printed
hat mount
• [Mixed Reality Team] A simulation app can then be
constructed using a free game engine [Unity3d] that could
observe and monitor [learner] skills
33
Paramedic Distance Education: Solving
Needtocreatea1:1mappingoftheskills
34
Paramedic Distance Education: Technology V1
• [Learners] were very excited … [practice] the skills at home ... [learner]
more involved in the course & less isolated
• [Observers] found most [learners] struggled with the setup of the
equipment & progression through the required steps … especially when
introducing the Magill forceps & removing the foreign body
• [Learners] commented “my hands seem to pass by the [simulated
airways manikin]” ... “spent too much time focusing on the markers & not
on the [simulated airways manikin] … resulting in frustration when the
simulation would present red boxed & restart
• Many [learners] commented that they did not get around to using the
[simulation] highlighting time struggles and being “extra” work
• [Head Paramedic] on reflection should have encouraged more frequent
use of the simulation with a reminder & linkage to the learning tasks
35
Paramedic Distance Education: Reflection
SolveV1issuesbutkeeplearningoutcomes
36
Paramedic Distance Education: Revision
• Unity3d game engine (www.unity3d.com)
• Vuforia augmented reality plugin
(www.vuforia.com)
• MySQL (www.mysql.com)
• Php (secure.php.net)
• Google Cardboard headset
(vr.google.com/cardboard)
• Makerbot 3D Printer (www.makerbot.com)
• Oculus Rift (www.oculus.com)
• Leap Motion (www.leapmotion.com)
• HTC VIVE (www.vive.com)
• Adobe Creative
(www.adobe.com/CreativeCloud)
• MANY MORE!
37
MIXED REALITY AND VIRTUAL PROTOTYPING TOOLS
BACHELOR OF INTERACTIVE MEDIA & DESIGN
bond.edu.au/imd
Latest News in Technology, Design & Society
flip.it/0TTuUW
Creative problem solving through
design & the latest technology
WHERE ARE THEY NOW?
Front End Engineer
Airwallex (pre Deloitte Digital)
TAYLOR
BETT
Interactive Experience Design Manager
Deloitte Digital
PAUL
CIAPPARA
SAXON
CAMERON
Senior Front End Consultant
Deloitte Digital
Directors Assistant
Seven Network
GEORDI AVILA
Interactive Experience Designer
Apple
AMY McGINTY PRISCILLA FOX
Digital Designer + Developer
Oracle
Education is about mentoring
inspiring young minds full of
inquisitive thought, entrepreneurship,
a love of creativity, design and
technology, and helping them set
goals and channel their creative
energies to solve real world
problems.
Integrating Mixed Reality
Pedagogy into Education
www.mixedrealityresearch.com
DR JAMES BIRT
Questions?

More Related Content

What's hot

20201213 jim spohrer icis augmented intelligence v6
20201213 jim spohrer icis augmented intelligence v620201213 jim spohrer icis augmented intelligence v6
20201213 jim spohrer icis augmented intelligence v6ISSIP
 
From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...
From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...
From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...Pete Bell
 
Qsite Presentation computational thinking 2013
Qsite Presentation   computational thinking 2013Qsite Presentation   computational thinking 2013
Qsite Presentation computational thinking 2013Paul Herring
 
Service thinking cases 20130702 v1
Service thinking cases 20130702 v1Service thinking cases 20130702 v1
Service thinking cases 20130702 v1ISSIP
 
Ert 20200420 v11
Ert 20200420 v11Ert 20200420 v11
Ert 20200420 v11ISSIP
 
CS Standards Superintendents December 2018
CS Standards Superintendents December 2018 CS Standards Superintendents December 2018
CS Standards Superintendents December 2018 Aaron Maurer
 
Google - A story of three entrepreneurs
Google - A story of three entrepreneursGoogle - A story of three entrepreneurs
Google - A story of three entrepreneursVaibhav Doshi
 
The future of Jobs Conference-MayJune2016
The future of Jobs Conference-MayJune2016The future of Jobs Conference-MayJune2016
The future of Jobs Conference-MayJune2016Siri Wheeler
 
Japan 20200724 v13
Japan 20200724 v13Japan 20200724 v13
Japan 20200724 v13ISSIP
 
IEEE
IEEEIEEE
IEEEUofT
 
Piedmont Education Speaker Series - Code.org
Piedmont Education Speaker Series - Code.orgPiedmont Education Speaker Series - Code.org
Piedmont Education Speaker Series - Code.orgPiedmont Makers
 
Cogswell college 20200120 v8 copy
Cogswell college 20200120 v8 copyCogswell college 20200120 v8 copy
Cogswell college 20200120 v8 copyISSIP
 
Denmark 20190418 v5
Denmark 20190418 v5Denmark 20190418 v5
Denmark 20190418 v5ISSIP
 

What's hot (14)

20201213 jim spohrer icis augmented intelligence v6
20201213 jim spohrer icis augmented intelligence v620201213 jim spohrer icis augmented intelligence v6
20201213 jim spohrer icis augmented intelligence v6
 
From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...
From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...
From ICT to Computing. Presentation for the inaugral meeting of the Calderdal...
 
Qsite Presentation computational thinking 2013
Qsite Presentation   computational thinking 2013Qsite Presentation   computational thinking 2013
Qsite Presentation computational thinking 2013
 
Service thinking cases 20130702 v1
Service thinking cases 20130702 v1Service thinking cases 20130702 v1
Service thinking cases 20130702 v1
 
Ert 20200420 v11
Ert 20200420 v11Ert 20200420 v11
Ert 20200420 v11
 
CS Standards Superintendents December 2018
CS Standards Superintendents December 2018 CS Standards Superintendents December 2018
CS Standards Superintendents December 2018
 
Google - A story of three entrepreneurs
Google - A story of three entrepreneursGoogle - A story of three entrepreneurs
Google - A story of three entrepreneurs
 
The future of Jobs Conference-MayJune2016
The future of Jobs Conference-MayJune2016The future of Jobs Conference-MayJune2016
The future of Jobs Conference-MayJune2016
 
Japan 20200724 v13
Japan 20200724 v13Japan 20200724 v13
Japan 20200724 v13
 
IEEE
IEEEIEEE
IEEE
 
Piedmont Education Speaker Series - Code.org
Piedmont Education Speaker Series - Code.orgPiedmont Education Speaker Series - Code.org
Piedmont Education Speaker Series - Code.org
 
Cogswell college 20200120 v8 copy
Cogswell college 20200120 v8 copyCogswell college 20200120 v8 copy
Cogswell college 20200120 v8 copy
 
Denmark 20190418 v5
Denmark 20190418 v5Denmark 20190418 v5
Denmark 20190418 v5
 
ARI5902
ARI5902ARI5902
ARI5902
 

Similar to Integrating Mixed Reality Pedagogy into Education

Pedagogy before Technology (Weaving Tech 2019)
Pedagogy before Technology (Weaving Tech 2019)Pedagogy before Technology (Weaving Tech 2019)
Pedagogy before Technology (Weaving Tech 2019)Michael A. Cowling
 
Thoughts about Computing in the 21st Century Elementary Classroom
Thoughts about Computing in the 21st Century Elementary ClassroomThoughts about Computing in the 21st Century Elementary Classroom
Thoughts about Computing in the 21st Century Elementary ClassroomLO*OP Center, Inc.
 
Rosebank College 2022 final [Autosaved].pptx
Rosebank College 2022 final [Autosaved].pptxRosebank College 2022 final [Autosaved].pptx
Rosebank College 2022 final [Autosaved].pptxPhutiRagophala1
 
Learning and exploring with new technology at Dundee and Angus College
Learning and exploring with new technology at Dundee and Angus CollegeLearning and exploring with new technology at Dundee and Angus College
Learning and exploring with new technology at Dundee and Angus CollegeJisc
 
Digital Technologies in the NZ classroom
Digital Technologies in the NZ classroomDigital Technologies in the NZ classroom
Digital Technologies in the NZ classroomDavid Kinane
 
Online Whiteboard.pptx
Online Whiteboard.pptxOnline Whiteboard.pptx
Online Whiteboard.pptxTandrimaTithi
 
Developing 21st century skills copy
Developing 21st century skills   copyDeveloping 21st century skills   copy
Developing 21st century skills copyDods Dodong
 
The Future for Technologies in Schools: FutureSchools 2017
The Future for Technologies in Schools: FutureSchools 2017The Future for Technologies in Schools: FutureSchools 2017
The Future for Technologies in Schools: FutureSchools 2017Michael A. Cowling
 
Design and modeling ii
Design and modeling iiDesign and modeling ii
Design and modeling iiHCS
 
Cyber securityeducation may2015
Cyber securityeducation may2015Cyber securityeducation may2015
Cyber securityeducation may2015Mark Guzdial
 
Blended Learning Meets Digital Media
Blended Learning Meets Digital MediaBlended Learning Meets Digital Media
Blended Learning Meets Digital MediaJosé Bidarra
 
Cais aace edmedia_quest_atlantis
Cais aace edmedia_quest_atlantisCais aace edmedia_quest_atlantis
Cais aace edmedia_quest_atlantisAlex Makosz
 
21c learning amd emerging edtech trends
21c learning amd emerging edtech trends21c learning amd emerging edtech trends
21c learning amd emerging edtech trendsMichael Coghlan
 
Educational Technology.pptx
Educational Technology.pptxEducational Technology.pptx
Educational Technology.pptxTandrimaTithi
 
STEM Innovation in Education
STEM Innovation in EducationSTEM Innovation in Education
STEM Innovation in EducationHeidi Stobart
 
Teta spotlight
Teta spotlightTeta spotlight
Teta spotlightJan Coley
 
Developing 21st century skills
Developing 21st century skillsDeveloping 21st century skills
Developing 21st century skillsDods Dodong
 

Similar to Integrating Mixed Reality Pedagogy into Education (20)

Pedagogy before Technology (Weaving Tech 2019)
Pedagogy before Technology (Weaving Tech 2019)Pedagogy before Technology (Weaving Tech 2019)
Pedagogy before Technology (Weaving Tech 2019)
 
Thoughts about Computing in the 21st Century Elementary Classroom
Thoughts about Computing in the 21st Century Elementary ClassroomThoughts about Computing in the 21st Century Elementary Classroom
Thoughts about Computing in the 21st Century Elementary Classroom
 
Rosebank College 2022 final [Autosaved].pptx
Rosebank College 2022 final [Autosaved].pptxRosebank College 2022 final [Autosaved].pptx
Rosebank College 2022 final [Autosaved].pptx
 
Learning and exploring with new technology at Dundee and Angus College
Learning and exploring with new technology at Dundee and Angus CollegeLearning and exploring with new technology at Dundee and Angus College
Learning and exploring with new technology at Dundee and Angus College
 
Power up learning
Power up learningPower up learning
Power up learning
 
Ma ccs
Ma ccsMa ccs
Ma ccs
 
Digital Technologies in the NZ classroom
Digital Technologies in the NZ classroomDigital Technologies in the NZ classroom
Digital Technologies in the NZ classroom
 
Online Whiteboard.pptx
Online Whiteboard.pptxOnline Whiteboard.pptx
Online Whiteboard.pptx
 
Developing 21st century skills copy
Developing 21st century skills   copyDeveloping 21st century skills   copy
Developing 21st century skills copy
 
The Future for Technologies in Schools: FutureSchools 2017
The Future for Technologies in Schools: FutureSchools 2017The Future for Technologies in Schools: FutureSchools 2017
The Future for Technologies in Schools: FutureSchools 2017
 
Design and modeling ii
Design and modeling iiDesign and modeling ii
Design and modeling ii
 
Learning technologies in South Africa
Learning technologies in South AfricaLearning technologies in South Africa
Learning technologies in South Africa
 
Cyber securityeducation may2015
Cyber securityeducation may2015Cyber securityeducation may2015
Cyber securityeducation may2015
 
Blended Learning Meets Digital Media
Blended Learning Meets Digital MediaBlended Learning Meets Digital Media
Blended Learning Meets Digital Media
 
Cais aace edmedia_quest_atlantis
Cais aace edmedia_quest_atlantisCais aace edmedia_quest_atlantis
Cais aace edmedia_quest_atlantis
 
21c learning amd emerging edtech trends
21c learning amd emerging edtech trends21c learning amd emerging edtech trends
21c learning amd emerging edtech trends
 
Educational Technology.pptx
Educational Technology.pptxEducational Technology.pptx
Educational Technology.pptx
 
STEM Innovation in Education
STEM Innovation in EducationSTEM Innovation in Education
STEM Innovation in Education
 
Teta spotlight
Teta spotlightTeta spotlight
Teta spotlight
 
Developing 21st century skills
Developing 21st century skillsDeveloping 21st century skills
Developing 21st century skills
 

More from Bond University

Preparing Learners for Future Jobs
Preparing Learners for Future JobsPreparing Learners for Future Jobs
Preparing Learners for Future JobsBond University
 
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...Bond University
 
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...Bond University
 
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...Bond University
 
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...Bond University
 
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
Interactive Mixed Reality for Enhanced Learning, Skills and EngagementInteractive Mixed Reality for Enhanced Learning, Skills and Engagement
Interactive Mixed Reality for Enhanced Learning, Skills and EngagementBond University
 
The future of jobs focusing on Interactive Media and Design
The future of jobs focusing on Interactive Media and DesignThe future of jobs focusing on Interactive Media and Design
The future of jobs focusing on Interactive Media and DesignBond University
 
Introductory Augmented Reality in Unity with Android and Vuforia
Introductory Augmented Reality in Unity with Android and VuforiaIntroductory Augmented Reality in Unity with Android and Vuforia
Introductory Augmented Reality in Unity with Android and VuforiaBond University
 
Gaze detection with Virtual Reality and Unity 3d
Gaze detection with Virtual Reality and Unity 3dGaze detection with Virtual Reality and Unity 3d
Gaze detection with Virtual Reality and Unity 3dBond University
 
Introductory Virtual Reality in Unity3d
Introductory Virtual Reality in Unity3dIntroductory Virtual Reality in Unity3d
Introductory Virtual Reality in Unity3dBond University
 
DIY Mobile VR with Unity 3d & Cardboard SDK
DIY Mobile VR with Unity 3d & Cardboard SDKDIY Mobile VR with Unity 3d & Cardboard SDK
DIY Mobile VR with Unity 3d & Cardboard SDKBond University
 
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
Towards a Pedagogy of Comparative Visualization in 3D Design DisciplinesTowards a Pedagogy of Comparative Visualization in 3D Design Disciplines
Towards a Pedagogy of Comparative Visualization in 3D Design DisciplinesBond University
 
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...Bond University
 
Visualization and Interactive Prototyping with Unity3D
Visualization and Interactive Prototyping with Unity3DVisualization and Interactive Prototyping with Unity3D
Visualization and Interactive Prototyping with Unity3DBond University
 
Getting Serious about the Future of Design and Games
Getting Serious about the Future of Design and GamesGetting Serious about the Future of Design and Games
Getting Serious about the Future of Design and GamesBond University
 
Effect of mixed media visualization on learner perceptions and outcomes
Effect of mixed media visualization on learner perceptions and outcomesEffect of mixed media visualization on learner perceptions and outcomes
Effect of mixed media visualization on learner perceptions and outcomesBond University
 
Setup for Visualisation & Interactive Prototyping with Unity3D
Setup for Visualisation & Interactive Prototyping with Unity3DSetup for Visualisation & Interactive Prototyping with Unity3D
Setup for Visualisation & Interactive Prototyping with Unity3DBond University
 

More from Bond University (17)

Preparing Learners for Future Jobs
Preparing Learners for Future JobsPreparing Learners for Future Jobs
Preparing Learners for Future Jobs
 
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
 
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
 
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
 
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
 
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
Interactive Mixed Reality for Enhanced Learning, Skills and EngagementInteractive Mixed Reality for Enhanced Learning, Skills and Engagement
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
 
The future of jobs focusing on Interactive Media and Design
The future of jobs focusing on Interactive Media and DesignThe future of jobs focusing on Interactive Media and Design
The future of jobs focusing on Interactive Media and Design
 
Introductory Augmented Reality in Unity with Android and Vuforia
Introductory Augmented Reality in Unity with Android and VuforiaIntroductory Augmented Reality in Unity with Android and Vuforia
Introductory Augmented Reality in Unity with Android and Vuforia
 
Gaze detection with Virtual Reality and Unity 3d
Gaze detection with Virtual Reality and Unity 3dGaze detection with Virtual Reality and Unity 3d
Gaze detection with Virtual Reality and Unity 3d
 
Introductory Virtual Reality in Unity3d
Introductory Virtual Reality in Unity3dIntroductory Virtual Reality in Unity3d
Introductory Virtual Reality in Unity3d
 
DIY Mobile VR with Unity 3d & Cardboard SDK
DIY Mobile VR with Unity 3d & Cardboard SDKDIY Mobile VR with Unity 3d & Cardboard SDK
DIY Mobile VR with Unity 3d & Cardboard SDK
 
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
Towards a Pedagogy of Comparative Visualization in 3D Design DisciplinesTowards a Pedagogy of Comparative Visualization in 3D Design Disciplines
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
 
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
 
Visualization and Interactive Prototyping with Unity3D
Visualization and Interactive Prototyping with Unity3DVisualization and Interactive Prototyping with Unity3D
Visualization and Interactive Prototyping with Unity3D
 
Getting Serious about the Future of Design and Games
Getting Serious about the Future of Design and GamesGetting Serious about the Future of Design and Games
Getting Serious about the Future of Design and Games
 
Effect of mixed media visualization on learner perceptions and outcomes
Effect of mixed media visualization on learner perceptions and outcomesEffect of mixed media visualization on learner perceptions and outcomes
Effect of mixed media visualization on learner perceptions and outcomes
 
Setup for Visualisation & Interactive Prototyping with Unity3D
Setup for Visualisation & Interactive Prototyping with Unity3DSetup for Visualisation & Interactive Prototyping with Unity3D
Setup for Visualisation & Interactive Prototyping with Unity3D
 

Recently uploaded

How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationRosabel UA
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 
Presentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptxPresentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptxRosabel UA
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
The Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World PoliticsThe Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World PoliticsRommel Regala
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxVanesaIglesias10
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 

Recently uploaded (20)

How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translation
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 
Presentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptxPresentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
The Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World PoliticsThe Contemporary World: The Globalization of World Politics
The Contemporary World: The Globalization of World Politics
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptx
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 

Integrating Mixed Reality Pedagogy into Education

  • 1. Integrating Mixed Reality Pedagogy into Education DR JAMES BIRT
  • 2. Dr. James Birt bond.edu.au/profile/dr-james-birt Multi-dimensional defines my 20 year industry and academic career, but gaming is my 34 year passion
  • 3. THE FUTURE OF JOBS CHECK YOUR
  • 4. Affinity What you love LackPassion Opportunity What is wanted Ability What you’re good at CHOOSING A JOB: PASSION OR PRAGMATISM? Sweet Spot
  • 5. MY FIRST JOB WITH GAMES (1999-2000) Farming Lower Guk in Vanilla EverQuest in search of the Shining Metallic Robes, Short Sword of Ykesha and the Flowing Black Silk Sash and selling on eBay Affinity What you love: Playing EverQuest Ability What you’re good at: Farming Opportunity What is wanted: Virtual Loot
  • 6. MY CURRENT JOB WITH GAMES (2010 - Today) Affinity What you love: Games and Education Ability What you’re good at: Communicating Opportunity What is wanted: Communicators that understand Tech and Games Associate Professor and discipline lead for Interactive Media and Design where I coordinate the Mixed Reality Research Lab and Communicate on Technology and Games
  • 7. My Office – Still Features Kings Quest, World of Warcraft and EverQuest!
  • 8. YOUR FUTURE JOB COULD INVOLVE CREATING PERSONALITIES FOR ROBOTS Jobs Aussies can expect to emerge in the future Melanie Burgess News Corp May 11, 2018
  • 9. BUT IS THIS JUST A TECHNOLOGY GIMMICK? youtu.be/cUR-eYDAz9w
  • 10. GOOGLE DUPLEX DEMO: Google IO (May 9, 2018) youtu.be/bd1mEm2Fy08?t=1m10s youtu.be/bd1mEm2Fy08?t=3m NEW roles are created daily as a result of changing technologies and customer expectations. Workers hoping to remain employable must look ahead and prepare for what is coming.
  • 11. WHAT ABOUT A JOB IN ESPORTS? The Project – Game on – rise of eSports
  • 12. “Most of the job titles will be the same as today … we will still have carpenters, nurses, road repairers, even teachers ... but the nature of what they do and the skills they need will change … just as they have over the past 20 years” Ron Johnston Executive Director, Australian Centre for Innovation, University of Sydney; The Conversation (Aug 2, 2016)
  • 13. AREN’T ALL MILLENNIALS DIGITAL NATIVES? • “[Millennials] are prolific users of [digital technology] … do not assume that they are [proficient users] … the increased use of technology is primarily for [social media and communications] … use doesn't mean learning deeper skills … that requires explicit teaching” • Australian Curriculum Assessment and Reporting Authority CEO; ABC News (Nov 17, 2015) PROLIFIC USERS OF DIGITAL TECHNOLOGY
  • 14. WHAT ARE THE SKILLS AND STRATERGIES REQUIRED TO THRIVE IN THE NEW LANDSCAPE?
  • 15. Gartner 2018 Emerging Technology Hype Cycle
  • 16. “Very clear, strong trend between the creative content of a job and its probability of computerisation and replacement by robots” - Oxford Professor Michael Osbourne 2018 Future of Jobs Report – Core Work Skills
  • 17.
  • 18. T H E C H A N G E I N D E M A N D F O R C O R E W O R K - R E L AT E D S K I L L S Its not about any one technology or learning a tool it’s about: communication, creative thinking, problem solving, agility, digital skills and entrepreneurship
  • 19. Changing Face of Classrooms
  • 20. EDUCAUSE Horizon Report: 2018 Higher Education Edition Samantha Adams Becker, Malcolm Brown, Eden Dahlstrom, Annie Davis, Kristi DePaul, Veronica Diaz, and Jeffrey Pomerantz. NMC Horizon Report: 2018 Higher Education Edition. Louisville, CO: EDUCAUSE, 2018.
  • 21. NMC/CoSN Horizon Report: 2017 K-12 Edition Freeman, A., Adams Becker, S., Cummins, M., Davis, A., and Hall Giesinger, C. (2017). NMC/CoSN Horizon Report: 2017 K–12 Edition. Austin, Texas: The New Media Consortium.
  • 22. Mixed Reality – Intersection of Virtual & Physical Realities Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321-1329.
  • 23. Mixed Reality Relevance for Teaching & Learning
  • 24. Mixed Reality Research Lab www.mixedrealityresearch.com
  • 30. How do we achieve this?
  • 32. Traditional Teaching Method “this course is a 'skills' learning course … there should be a way for us to actually get more time doing skills … distance students at a severe disadvantage … I am missing out … you can read about the skills but its impossible to get feedback and to know if you’re doing it right … no substitution for experience … any software or equipment to at least go through the motions of doing the skills?” Paramedic Student Learner(s) (201x-2014) 32 Paramedic Distance Education: The Problem
  • 33. • [Discipline expert] we need every student to have a portable airways mannequin & cheap tools to practice the skills - but cost is prohibitive … residential schools work … but not held early enough for students • [Mixed Reality Team] tools could be provided to students by 3D printing them (cost/set) ~ $1 AUD + postage • [Mixed Reality Team] Airways mannequin could be simulated virtually using a mobile phone • [Discipline expert] students would need both hands free, so the phone would need to be mounted in their eyeline • [Mixed Reality Team] we can provide a hat and 3d printed hat mount • [Mixed Reality Team] A simulation app can then be constructed using a free game engine [Unity3d] that could observe and monitor [learner] skills 33 Paramedic Distance Education: Solving
  • 35. • [Learners] were very excited … [practice] the skills at home ... [learner] more involved in the course & less isolated • [Observers] found most [learners] struggled with the setup of the equipment & progression through the required steps … especially when introducing the Magill forceps & removing the foreign body • [Learners] commented “my hands seem to pass by the [simulated airways manikin]” ... “spent too much time focusing on the markers & not on the [simulated airways manikin] … resulting in frustration when the simulation would present red boxed & restart • Many [learners] commented that they did not get around to using the [simulation] highlighting time struggles and being “extra” work • [Head Paramedic] on reflection should have encouraged more frequent use of the simulation with a reminder & linkage to the learning tasks 35 Paramedic Distance Education: Reflection
  • 37. • Unity3d game engine (www.unity3d.com) • Vuforia augmented reality plugin (www.vuforia.com) • MySQL (www.mysql.com) • Php (secure.php.net) • Google Cardboard headset (vr.google.com/cardboard) • Makerbot 3D Printer (www.makerbot.com) • Oculus Rift (www.oculus.com) • Leap Motion (www.leapmotion.com) • HTC VIVE (www.vive.com) • Adobe Creative (www.adobe.com/CreativeCloud) • MANY MORE! 37 MIXED REALITY AND VIRTUAL PROTOTYPING TOOLS
  • 38. BACHELOR OF INTERACTIVE MEDIA & DESIGN bond.edu.au/imd Latest News in Technology, Design & Society flip.it/0TTuUW Creative problem solving through design & the latest technology
  • 39. WHERE ARE THEY NOW? Front End Engineer Airwallex (pre Deloitte Digital) TAYLOR BETT Interactive Experience Design Manager Deloitte Digital PAUL CIAPPARA SAXON CAMERON Senior Front End Consultant Deloitte Digital Directors Assistant Seven Network GEORDI AVILA Interactive Experience Designer Apple AMY McGINTY PRISCILLA FOX Digital Designer + Developer Oracle
  • 40. Education is about mentoring inspiring young minds full of inquisitive thought, entrepreneurship, a love of creativity, design and technology, and helping them set goals and channel their creative energies to solve real world problems.
  • 41. Integrating Mixed Reality Pedagogy into Education www.mixedrealityresearch.com DR JAMES BIRT Questions?