Talk about Virtual Reality and Google Cardboard Houssem Eddine Lassoued Google Developers Group Tunis

1. VR and Google Cardboard
a new experience
Houssem Eddine Lassoued
DevFest Constantine 2015
8 December 2015

2. EDUCATOR

3. What’s Virtual Reality
VR: Virtual Reality

4. VR is a Computer Generated artificial environment that allows a user to
view and explore.

5. • Two miniature display screens that produce the stereo scopic images
• An optical position tracking system that tracks the orientation of the humans head in the Virtual
world.
The Head mounted display consists of:
Head Mounted Display or HMD

6. VIRTUAL ENVIRONMENTS
BEGINNING WITH FLIGHT SIMULATORS, ADVANCING THROUGH SCIENTIFIC APPLICATIONS, AND INTO
THE ENTERTAINMENT ARENA, VIRTUAL ENVIRONMENTS HAVE BEEN DEVELOPED TO PROVIDE AN
IMMERSIVE SIMULATED EXPERIENCE WITHOUT THE EXPENSE AND RISK ASSOCIATED WITH THE REAL
THING.
BOEING
787
FLIGHT
SIMULATO
R FROM
ALTEON
MOLECULAR
SIMULATION AT
ARGONNE
NATIONAL
LABORATORY
MATTEL POWER GLOVE, VECTREX
3D IMAGER, AND NINTENDO

7. DIGITAL 3D ADVANCES IN DIGITAL PHOTOGRAPHY AND STEREOSCOPY HAVE
ENABLED FILMMAKERS TO AFFORDABLY PRODUCE 3D FILMS AND
THEATRE OWNERS TO AFFORDABLY SHOW THEM.
A 3D DIGITAL CAMERA RECORDS
VIDEO, CIRCULARLY POLARIZING THE
RIGHT VIEWPOINT USING RIGHT-
HANDED POLARIZATION...
...WHILE RECORDING THE LEFT
VIEWPOINT USING LEFT-HANDED
CIRCULAR POLARIZATION.
BOTH IMAGES ARE PROJECTED
SIMULTANEOUSLY ONTO THE THEATRE
SCREEN, IN A MANNER THAT
GUARANTEES THAT THE VIEWPOINTS
ARE SYNCHRONIZED.
THE MOVIEGOER WEARS POLARIZED
GLASSES THAT ONLY ALLOW THE RIGHT-
HANDED POLARIZED IMAGES TO PASS
THROUGH THE RIGHT LENS AND THE LEFT-
HANDED POLARIZED IMAGES TO PASS
THROUGH THE LEFT LENS.

8. VERGENCE VS. ACCOMMODATION
PROJECTING A 3D IMAGE ONTO A 2D
SCREEN OR TELEVISION DISPLAY
TENDS TO PLAY TRICKS WITH ONE’S
VISUAL PERCEPTION.
IN THE REAL WORLD, WHEN A PERSON
TRIES TO FOCUS ON A DISTANT OBJECT,
THE EYES EXPERIENCE VERGENCE, WHERE
THEY BOTH ROTATE ON THEIR OWN
VERTICAL AXES UNTIL THEY BOTH POINT
AT THE OBJECT.MEANWHILE, THE EYES EXPERIENCE
ACCOMMODATION, WHERE THEY
REFLEXIVELY FOCUS ON THE OBJECT IN
ITS DISTANT POSITION, CAUSING
NEARBY OBJECTS TO GO OUT OF
FOCUS.WITH 3D IMAGES, HOWEVER, THE EYES
ROTATE SO THEY ARE POINTED TO
WHERE THE OBJECT SEEMS TO BE, BUT
THE REFLEXIVE FOCUS MUST ADJUST TO
THE SCREEN’S ACTUAL LOCATION,
ELIMINATING THE NATURAL BLURRING
THIS RESULTS IN
SERIOUS EYESTRAIN
AND HEADACHES FOR
MANY 3D AUDIENCE

9. SIMULATOR SICKNESS
EFFORTS TO MAKE VR
SIMULATIONS AS
REALISTIC AS POSSIBLE
FREQUENTLY HAVE
UNPLEASANT SIDE
EFFECTS.FOR EXAMPLE, PROVIDING
A VISUAL HEADBOB (LIKE
THE ONE ILLUSTRATED AT
RIGHT), WITHOUT AN
ACCOMPANYING PHYSICAL
MOTION, CAN RESULT IN
MOTION SICKNESS AND
NAUSEA.
SIMILAR PROBLEMS TEND TO OCCUR
WITH RAPID CHANGES IN ACCELERATION
AND RAPID SHIFTS IN PERSPECTIVE.

10. BALANCE & THE INNER EAR
THE SEMICIRCULAR
CANALS WITHIN THE
INNER EAR CONTAIN HAIR
CELLS THAT REACT TO
BODY MOVEMENTS.
THESE REACTIONS ARE
TRANSMITTED BY MEANS
OF THE VESTIBULAR
NERVE TO THE BRAIN,
WHICH SUBCONSCIOUSLY
SENDS MESSAGES TO
THE BODY’S TRUNK AND
LIMBS TO MAINTAIN
WHEN THE EYES SEND THE BRAIN A
DIFFERENT MESSAGE REGARDING THE
BODY’S MOVEMENTS, THE BRAIN MAY

11. WHEN THE VR SYSTEM’S
PROCESSING TIME IS
EXCESSIVE, ITS REACTIONS TO
THE USER’S ACTIONS WILL LAG
BEHIND, WHICH DESTROYS THE
ILLUSION OF IMMERSION WHEN
IT BECOMES NOTICEABLE TO
THE USER. LATENCY IS
PARTICULARLY
PROBLEMATIC IN
“AUGMENTED
REALITY”
APPLICATIONS,
WHERE VIRTUAL
OBJECTS ARE
OVERLAID ON THE
USER’S REAL
WORLD SETTING,
VR LATENCY

12. Head-Mounted Display
(Coated in white markers)
Camera
(Tracks markers to record
user’s head position)
Head Straps
Circuit Board
Screen
Diopter Adjustment
(Rotate to fine tune so
eyeglasses aren’t
needed)
Lenses
(Three pairs are
provided to
accommodate
good, moderate,
and heavy
nearsightedness)
Foam Padding
(Fits to face)
OCULUS RIFT

13. Oculus has been acquired by Facebook. $ 2,000,000,000
Mark Zuckerberg - March 25,
2014

14. VR market has been like crazy growth.

15. Oculus Rift - 350$

16. Samsung Gear VR - 199.99$

17. Razer OSVR Hacker Dev Kit - 199.99$

18. Sony Project Morpheus - ???$
• 1

19. many others …
and…

20. Oculus Rift Carl Zeiss Cinemizer Silicon Micro Display
ST1080
Sony HMZ-T2
640x800 Resolution 870x500 Resolution 1920x1080 Resolution 1280x720 Resolution
90° Horizontal FOV 30° Horizontal FOV 39° Horizontal FOV 45° Horizontal FOV
13.4 Ounces 4.2 Ounces 6.3 Ounces 11.6 Ounces
7˝ Diagonal Display 0.39˝ Diagonal Display 0.74˝ Diagonal Display 0.7˝ Diagonal Display
Liquid Crystal Display Organic Light-Emitting
Diode
Liquid Crystal on Silicon Organic Light-Emitting
Diode
$300 $749 $799 $894
VR HEADSETS

21. THE OCULUS RIFT EXPERIENCE

22. GOOGLE CARDBOARD
It’s just a cardboard

23. Google Cardboard

24. Fold-out Cardboard smartphone mount!

25. Cardboard Begins
• designed by Google
• no official manufacture
• was part of a Google 20% project
• simple and inexpensive device
• Open Source Pattern
since Google I/O 2014

26. 1 million units of the cardboard has been used all over the world.

27. Cardboard
($2)
Lenses
($10)
Magnets
($6)
Velcro
($3)
Rubber Band
(1¢)
Google’s response to the $350
Oculus Rift Developer’s Kit is
this do-it-yourself “Oculus Rift”
which turns Android devices into
portable VR viewers, using an
open source software
developers kit.
Side by Side 3D View
(SBS3D)
What’s inside ?

28. Minimum size: 8.75in (22cm) by 22in (56cm), and 0.06in (1.5mm) thickness.
1- Ordinary Cardboard

29. Two Asymmetric-BiConvex optical lenses.
With 45mm focal distance.
Biconvex lenses work best because they prevent distortion around the edges.
2- Two Lenses

30. One neodymium ring magnet and one ceramic disk magnet
2- Magnet (Optional)

31. Custom Cardboard and DIY at Home
DIY Instructions Can get in Google Cardboard site

32. A lot of the design have been made in freedom

33. It was released from a lot of company
https://www.google.com/get/cardboard/get-cardboard/

34. • DODO Case - 19.95 $
• I am Cardboard - 19.99 $
• Knox Labs - 14.95 $
• Unofficial Cardboard - 14.95 $ - 26.90 $
Take my money

35. Viewer Profile Generator
https://www.google.com/get/cardboard/viewerprofilegenerator/
You also create a cardborad, it will be able to register your profiles

36. Cardboard 2015 (+iOS +6inch)
It supports the iOS and 6 inch sizes.
Support for screens up to 6 inches

37. Cardboard app (Android/iOS)
When the smartphone in a vertical it is reset.
• The cardboard app comes with 7 experiences:
• Earth: Fly where your fancy takes you on Google Earth.
• Tour Guide: Visit Versailles with a local guide.
• YouTube: Watch popular YouTube videos on a massive screen.
• Exhibit: Examine cultural artifacts from every angle.
• Photo Sphere: Look around the photo spheres you’ve captured.
• Street View: Drive through Paris on a summer day.
• Windy Day: Follow the story (and the hat) in this interactive
animated short from Spotlight Stories.
Earth
Home
Exhibit

38. Type of VR Contents

39. Old Experience VS New Experience

40. Google Play Cardboard apps
https://play.google.com/store/apps/collection/promotion_3001527_cardboard_apps

41. Apps:
Android
iOS

42. VR Jam 2015
$1,000,000
VR Jam 2015
1789 people are registered for this challenge
https://vrjam.challengepost.com/submissions
https://vrjam.challengepost.com

43. Games and architecture, and there are a variety of apps,
such as works of art. It is a treasure trove of ideas

44. Cardboard SDK
• for Android
https://developers.google.com/cardboard/android/
• for Unity
Unity 4.5 pro / Unity 5 (free)
Individual developers, small
company you can use for free.
Features:
1. Lens distortion correction.
2. Head tracking.
3. 3D calibration.
4. Side-by-side rendering.
5. Stereo geometry configuration.
6. User input event handling.

45. Tips for VR

47. Using a Reticle

48. Using a Reticle

49. UI Depth & Eye Strain (Oculus case)
It becomes difficult to see, even if too far away or too close.
This is the same as the stereoscopic movie subtitles.

50. UI Depth & Eye Strain

51. Using non Constant Velocity

52. Maintaining Head Tracking

53. Guiding with Light

54. Leveraging Scale

55. Parallax (~6.5cm)
Human eyes are roughly 6.5cm away

56. Spatial Audio

57. Spatial Audio
It is boring without any movie sound

58. Spatial Audio

59. Gaze Cues
Do not to be directed where to focus

60. Gaze Cues Make it Beautiful

61. Single Color Icons

62. Shorter Experiences
It is different from the movie. To enjoy in five minutes.

63. Google
JUMP
(Google +GoPro)

65. Jump Assembler
Resolution is 4K-TV x 5
VideoStitch Studio / Kolor Autopano video
You can use a variety of tools.

66. It is very expensive.
$500 x 16 = +8000 $

67. Try it !
https://goo.gl/GnvPM1

68. www.youtube.com/360 It now handles a panoramic video on YouTube.

69. Panorama Camera
Sphericam 2 / RICOH Theta / PhotoSphere
You can use a panoramic photographic equipment.

70. Google
Spotlight

71. Google Spotlight 360 movie projects for Mobile devices

72. Justin Lin, used a digital camera of 6K resolution
Resolution:6K
Price: 8500$

73. Result: Unique 360 Movie experience

74. Resources
Twitter @googlecardboard
Google+ +GoogleCardboard
Cardboard design guide
http://www.google.com/design/spec-vr/
stackoverflow #google-cardboard
Codelabs https://io2015codelabs.appspot.com
Facebook Groups : 360 Video Professionals
g.co/expeditionsEXPEDITIONS

75. Thank you