Immersive Virtual Reality is slowly changing the way we build cars, treat phobias or train people. Here's an introduction to the applications of IVR, its immersive systems, the hardware and brain tricks that are used today.
1. Immersive Virtual Reality
Sébastien Kuntz
http://cb.nowan.net/blog
Sebastien.Kuntz@nowan.net
Last update
November 2012
Friday, November 16, 12
2. License
”Immersive Virtual Reality Introduction” by Sebastien Kuntz is
licensed under a Creative Commons Attribution-ShareAlike 3.0
Unported License. http://creativecommons.org/licenses/by/3.0/
• With the understanding that:
You are free: • Waiver — Any of the above conditions can be
• to Share — to copy, distribute and transmit the waived if you get permission from the copyright
work holder.
• Public Domain — Where the work or any of its
• to Remix — to adapt the work
elements is in the public domain under applicable
• to make commercial use of the work law, that status is in no way affected by the license.
Under the following conditions: • Other Rights — In no way are any of the following
• Attribution — You must attribute the work in the rights affected by the license:
manner specified by the author or licensor (but not in ◦ Your fair dealing or fair use rights, or other
any way that suggests that they endorse you or your use applicable copyright exceptions and limitations;
of the work). ◦ The author's moral rights;
• You must attribute “Immersive VR introduction” to ◦ Rights other persons may have either in the
(with this link): work itself or in how the work is used, such as
• Sébastien Kuntz - http://cb.nowan.net/blog publicity or privacy rights.
• Notice — For any reuse or distribution, you must
make clear to others the license terms of this work.
The best way to do this is with a link to this web
page.
Friday, November 16, 12
3. Plan
Definitions
VR Systems
Applications
Techniques
Friday, November 16, 12
4. WHO AM I ?
• Founder editor of
• http://www.imin-vr.com
• AFRV - French VR association: Board member - http://www.af-rv.fr
• VR Geeks association: President - http://www.vrgeeks.org
• Blog: http://cb.nowan.net/blog
• Twitter: @Cb_VRGeek
• 10 years in VR
• Virtools / Dassault Systèmes
• SNCF - French railways
Friday, November 16, 12
7. Immersive VR = iVR
iVR is the science and technology required for a user to
feel present, via perceptive, cognitive
and functional immersion and interaction, in a
(computer) generated environment.
Friday, November 16, 12
9. What is VR ?
Realtime 3D != VR
Stereoscopy != VR
3D Tracking != VR But everything
Haptics != VR combined can be VR
3D Sound != VR
3D Interactions != VR
Friday, November 16, 12
10. Ridiculous
If it’s real VR,
you probably
look ridiculous
Friday, November 16, 12
11. Why now ?
Already changing world in industry and research
Democratization
Are we in the future ? No ! We’re still in prehistory !
WE can make a difference, invent systems, applications,
businesses, interactions
Friday, November 16, 12
13. Measure presence ?
Can’t objectively measure presence (qualia)
What you can measure is if people respond to
this Virtual Environment as if it is real, which is
a result of presence
Compare real-life behavior vs virtual
If avatar: brain zone activates when user
accepts the avatar as real
Friday, November 16, 12
14. Immersion parameters
Graphics framerate
Extent of tracking
Tracking latency (measure?)
Quality of the images
Field of view
Plausibility of behaviors
Range of sensory modalities
...
Friday, November 16, 12
33. Barco - RP-360
http://www.youtube.com/watch?v=3EbrQwpOx24
Friday, November 16, 12
34. 6 users: stereo + tracking
Weimar University (DE)
http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html
Friday, November 16, 12
35. 6 users
stereoscopy + tracking
• video
Weimar University (DE)
http://www.uni-weimar.de/cms/medien/vr/research/display-systems/c1x6-a-stereoscopic-six-user-display-for-co-located-collaboration-in-shared-virtual-environments.html
Friday, November 16, 12
36. Screen based
Full-scale NexCAVE developed and deployed by Calit2 for Saudi
Arabia's King Abdullah University of Science and Technology -
http://www.calit2.net/newsroom/release.php?id=1743
Friday, November 16, 12
40. Projector based VR Systems
(-)
(Very) expensive !
Lots of space ! ( front and behind, AC... )
Not 360°
Cluster hard to program !
(+)
+/- Collaborative
Not much to wear
High resolution, big FOV
Friday, November 16, 12
41. HMD
Head mounted displays
Friday, November 16, 12
48. OCULUS RIFT
• Developer kit
• 90° horizontal
FOV
• 1280x800
• 640x800 per
eye
Friday, November 16, 12
49. HMD
(-)
Low resolution, low FOV
Must wear, adjust
No peripheral vision
(+)
Lightweight
Compact
Easier to program
360° tracking
Friday, November 16, 12
50. Summary
Projector/screen based
Cave, holostage, workbench
Collaborative, high FOV
Expensive, Complex
HMD
360°
“Cheap”
Low Fov/resolution
Friday, November 16, 12
55. Stereoscopy
You perceived depth without stereoscopy !
Friday, November 16, 12
56. Depth perception
Monoscopic cues : Stereoscopic cues :
perspective
eye accomodation
atmospheric artifacts (fog)
relative sizes
eye convergence
angle
occlusion
parallax disparity between left
shadows and right images
Parallax can be more important for depth perception!
Stereoscopy is important for size and distance
evaluation
Friday, November 16, 12
74. What system can we create
with only one graphics card?
Friday, November 16, 12
75. What can we do with one
graphics card?
Friday, November 16, 12
76. Nvidia SLI - ATI Crossfire
Use two graphics card for output on only one
graphics cards
Alternate frame rendering
Split frame rendering
Friday, November 16, 12
77. Scalable graphics
Image decomposition ( ~= SLI )
Useful if application is fill-rate limited
frame rate decreases with increasing number of pixels (i.e. when the image resolution increases)
Friday, November 16, 12
78. Scalable graphics
Database decomposition
Useful if application is CPU limited
frame rate decreases with increasing size of 3D scenes
Friday, November 16, 12
82. How ?
Matrox DualHead2Go
Matrox TripleHead2Go
Multiple graphics card in a single PC
Often max 2 graphics cards
Cyviz
Friday, November 16, 12
83. Multiple graphics cards in
one PC
Multi-pipe ~= Multi-GPU
One rendering context per GPU
Problems of resources sharing, threading
Need specific graphics engine adaptations
But best performances
Friday, November 16, 12
84. NVidia Quadro Plex
•Up to :
•4 GPU
•4 outputs
•16gb memory
•Can combine two Quadro Plex
Friday, November 16, 12
85. Quadro Mosaic Mode
Mosaic mode hides
multi-gpu
Only shows one gpu
to system
Can have 4 outputs
with 1 plex without
needing multi-pipe
adaptation
Good performances
Friday, November 16, 12
114. IVR Applications
Design, prototyping
Marketing
Training
Medical
Research
Geoscience, finance, archeologie, urbanism, sport, art...
Friday, November 16, 12
115. iVR Applications
Design, prototyping
Car, aircraft, boat, tractors,
house appliances
Collaborative design review (c) Peugeot PSA
Experience from user’s
point of view
Easy and fast to prototype
More iterations, better
products
(c) Miele
Friday, November 16, 12
116. PSA Peugeot-Citroen - http://www.youtube.com/watch?v=WhMh191RltQ
Friday, November 16, 12
117. FORD
http://cb.nowan.net/blog/2010/10/12/more-about-fords-vr-facilities/
Friday, November 16, 12
118. VR4D
http://vr4d.ingenierium.com/
Friday, November 16, 12
119. Ergo-Wide
http://www.clarte.asso.fr/realite-virtuelle.php/en/ERGOWIDE%C2%B3/
https://www.youtube.com/watch?v=aczLiNtVyDI
Friday, November 16, 12
120. Lockheed Martin
http://www.youtube.com/watch?v=itOxIpj68Mw
Friday, November 16, 12
121. Mockup-builder
http://www.youtube.com/watch?v=ZxJD9DXDB1E
Friday, November 16, 12
122. iVR Applications
Marketing
Product experience (c) University of Gronigen
Shopping experience
Procter&Gamble
Kimberley Clarke
(c) Virtools
Friday, November 16, 12
123. iVR Applications
Training
Repeatability
Controlled environment
(c) SNCF
Can practice rare / dangerous situations
Can analyze / quantify performance
No health risk for patients
Easy accessibility
Reduced costs
Adaptable difficulty and assistance
Multiple users trained at same time
(c) University of Florida
Attractive
Friday, November 16, 12
126. Saint-Gobain & Clarte
Use less material
Environment friendly
No water, nothing to clean
Faster to setup
http://www.youtube.com/watch?v=FEnalzHVmdI
Friday, November 16, 12
127. RE-lion
http://vimeo.com/25032061
Friday, November 16, 12
128. ESCIN - Sivic - Crime scene investigation
http://www.youtube.com/watch?v=FC0gHv-Snmw
Friday, November 16, 12
139. VR Techniques
3D User Interactions
Bowman classification for generic interactions
Selection
Specifying one or more objects from a set
Manipulation
Modifying object properties (position, orientation,
scale, shape, color, texture, behavior, etc.)
Navigation
Travel
Wayfinding
System Control
Menus
Issuing command
Changing mode
Choosing tool
Symbolic Input
Other interactions
Measuring
…?
http://www.3dui.org
Friday, November 16, 12
140. Navidget
http://www.youtube.com/watch?v=wpaKjLZll80
Friday, November 16, 12
148. Body representation in VR
Proteus effect : virtual appearance can transform our
behaviors towards other people ( Jeremy Bailenson )
It seems possible to transfer our body in virtual bodies
Friday, November 16, 12
149. Rubber hand illusion
http://www.youtube.com/watch?v=TCQbygjG0RU
Friday, November 16, 12
150. Body transfer
http://www.youtube.com/watch?v=8oF8sQvnTlM
Friday, November 16, 12
151. Barbie doll illusion
http://www.youtube.com/watch?v=_z8pSTMfGSo
Friday, November 16, 12
152. First person VR illusion
http://www.youtube.com/watch?v=DlbSVnVRLTU
Friday, November 16, 12
155. Perceptive Illusions
Play with perception’s limits
Our perception is dominated by visual sense
Balance
Redirected Walking :
(c) Franck Steinicke
Friday, November 16, 12
161. Perceptive illusions
Learn about human perception through its limitations
Improve VR experience by taking advantage of those
limitations
Friday, November 16, 12
162. Conclusion
It is possible to transfer your body in VR
Reality is not what you think
VR is just another reality
Friday, November 16, 12
170. VR Challenges
What we must solve
VR is mainly a SOFTWARE problem
“3DUI is a hard and unexplored software engineering (and ergonomic) problem”
Markerless tracking
Minimum latency
HMDs
Lightweight
Wide FOV
Wireless
Full body haptics
Multi-sensorial experience
Locomotion
Avatars
VR For All
Friday, November 16, 12
171. VR “Experiences”
Your goal :
Create presence
And don’t break it !!!
Verdun 1916-Time machine
http://www.youtube.com/watch?v=ZBfYIefenp0
Friday, November 16, 12