Paul Reynolds

1. Mixing Realities
Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354
Unprecedented access to perception

2. Geographical & Professional Record of Paul Reynolds • 1975 - Present
Over 16 years of interactive 3D software
and experience development.
Blast Off Inc
Jellyvision
Electronic Arts
SolWorks
Atari
Magic Leap
F**K YEAH PORTLAND!
All kinds of other stuff too.

3. Magic Leap Headquarters • 2014 • Stirling Road, Fort Lauderdale, Florida, USA, Earth
In 2014, I saw the future…in Florida?

4. Optical Engineer Eric Browy • Image: http://www.wired.com/2016/04/magic-leap-vr/
It was kind of like this.
(But not this.)

5. “It’s cool...
but your demos kinda’ suck.”
Honesty • Transparency • Integrity

6. Reynolds Residence • 2014 • Alexandria Ave, Myrtle Beach, South Carolina, USA, Earth
This company needs my help.
We are moving to Florida.

7. Dragons in the room.
(Sorry, no photos. Imagination required for this slide.)
Photos Not Allowed • Imagination Required

8. “What did I just feel?”
Powerful New Experiences • Image: https://www.flickr.com/photos/-akayphotography/12657383523

9. My theory on reality.
Pioneer Square • Image: https://www.flickr.com/photos/adavey/8699673325

10. Sensory Overload • Image: https://www.flickr.com/photos/weeklydig/6146537969
Presence
(Highly Simplified)
Proprioception
Sense of one’s own body
Exteroception
Sense of external stimuli
Forces • Touch • Sound • Light

11. Digital Brain Rendering • Image: https://www.flickr.com/photos/healthblog/8384110298
Incoming signals are
processed and our reality is
modeled in our mind.

12. True mixed reality happens when
the digital signals are sufficient
enough to pass the checks and
balances of the perception system.
Image: https://www.flickr.com/photos/dianasch/15505299296

13. Vision is one of the most powerful input
signals into our perception of reality.
A Focus on Vision • Image: https://www.flickr.com/photos/23560963@N03/4509631223/

14. Step 1: Wire a powerful
computer directly into
the visual cortex.
Brain Jacks • Image: https://www.flickr.com/photos/minnemom/12708596515

15. Just kidding.
Gotcha!

16. Organic Visual Cortex Interface • Image: https://www.flickr.com/photos/civilon/5425730840
These are wired in pretty well already.

17. Photons Are Cool
In the analog world, we are
bombarded by photons.
These light signals come
from physical objects
containing color, brightness,
and distance cues.

18. “We do not scan the world like
a photocopier scans a
document. Rather, we
sporadically sample what is in
front of our eyes.”
Arne Dietrich • “Introduction to Consciousness”
Image: https://www.flickr.com/photos/emzee/167706499

19. Image: http://jov.arvojournals.org/article.aspx?articleid=2122611

20. Image: http://jov.arvojournals.org/article.aspx?articleid=2122611
The problem with
traditional 3D display
techniques has been
this mismatch
between the focal and
vergence distance.
This incorrect signal
puts our mind in “high
alert” and, in the worst
cases, causes
discomfort.

21. Organic Visual Cortex Interface • Image: https://www.flickr.com/photos/civilon/5425730840
With optical view-through displays,
the user is processing the analog world
in a relaxed state.
If the digital content is a sufficiently
similar signal, we receive the benefit of
the full perception system.
At times, even creating non-visual
sensations.

22. Mixed Reality display technology is amplified
with environmental awareness.
“Aligning 3D Models to RGB-D Images of Cluttered Scenes” • Image: https://people.eecs.berkeley.edu/~sgupta/

23. Input is becoming more natural too.
“Aligning 3D Models to RGB-D Images of Cluttered Scenes” • Image: https://people.eecs.berkeley.edu/~sgupta/

24. Mixed Reality is going to give
us unprecedented ability to
create dynamic interactive
digital content that people will
have difficulty discerning from
the analog world.
Image: https://www.flickr.com/photos/99574551@N04/14723454269

25. Image: https://www.flickr.com/photos/accidentdesigns/6137308437/
“Sounds great, but how do I create with it?”

26. Good News • Bad News
BAD NEWS
Everything is rendered in realtime 3D.
Current tools and workflows come
from video game technology. If you
want to start making things now, the
learning curve may be steep.
GOOD NEWS
Tools will evolve to be more intuitive
and accessible. And, most of you have
lived your entire life in a 3D world!

27. Image: https://www.flickr.com/photos/accidentdesigns/6137308437/
It’s early days.
Get in the headspace first.

28. Image: https://www.flickr.com/photos/accidentdesigns/6137308437/
Unlike traditional media, you no longer
control the context.
Think sparse: First generation AR/MR
tech will be best utilized for “magical
moments” and VR is best suited for
“magical worlds”
Native experiences that take
advantage of the unique capabilities
will always win.

29. Kiki the Elephant • Magic Leap, Inc.

30. (Quick aside.)
Reddit • https://www.reddit.com/r/oculus/comments/2m0owl/i_got_into_the_magic_leap_beta/
“I got into the Magic Leap Beta!”

31. Mixed Reality Grocery Game • Source: http://hyper-reality.co

32. Source: Artefact Group • https://www.artefactgroup.com/articles/mixed-reality-without-rose-colored-glasses
Laws of Mixed Reality
proposed by @John_Rousseau
Law 1: The Individual
Mixed reality must enhance our capacity for mindful attention.
Law 2: Society
Mixed reality must embody a shared human experience.
Law 3: Economics
Mixed reality must respect boundaries between commerce and data.
“The Laws provide a foundation for identifying preferable outcomes
that should be considered in the creation of new products, services
and business models.”

33. Mixed Reality Grocery Game • Source: http://hyper-reality.co

34. Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354
Thoughtful design always wins over novelty.
“Is this better?”
“Is this building the world I want to live in?”
Let’s help each other make cool stuff!
@MugOfPaul • paul@vertexlabs.co

35. Fourth Edition
Applied Mixed Reality
Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354
Paul Reynolds