Highly Efficient Immersive AR Glasses with Gaze-locked Exit Pupil Steering high level architecture and technology explanation given by Boris Greenberg at SPIE 2021

1. 1
Highly Efficient Immersive AR Glasses
Using Gaze-locked Exit Pupil Steering
By Boris Greenberg

2. 2
the AR experience
Immersive
Practical
we all know this

3. 3
AR everywhere
there are dozens of gen II devices including Magic Leap, Hololens II and
others. they show massive advancements but still lacking:

4. 4
today many of these are believed to be
MUTUALLY EXCLUSIVE

5. 5
system approach
• forget everything about common AR architecture
• to overcome these challenges, EyeWay has taken a
completely different approach:
• there are no screens
• follow the physiology of the eye
• track eye behavior

6. 6
Classical vs. EyeWay architecture
Moving small exit pupil
Projection follows the eye-
movement directing emitted light
into the pupil
EyeWay approach
Fixed large exit pupil
Excess light always flooding the
Eye regardless of pupil position
Classical approach

7. 7
• Eye-tracking
Accurate, high-speed eye-tracking using IR lasers that directs the
projection according to the users’ gaze
• Exit pupil shifter
A dynamic system that can move the exit pupil or the optical system
to maintain collinearity with the visual axis and overlap with the eye
pupil
• Direct retinal projection
Low-power lasers project a single pixel at a time directly onto the
users' retina without the use of screens or other intermediary
images, at any level of brightness and contrast. An image is
projected at the eye’s natural resolution only where it is needed at
the center of the field of view - foveation
EyeWay combined approach
Exit pupil
shifter

8. 8
Directretinalprojection

9. 9
Eyetracking
EyeWay's system utilizes infrared light
scattered from the retina (which back
illuminates the pupil), and the reflection
from the cornea. This method allows
EyeWay to track gaze direction by
following the optical axis of the eye.

10. 10
Eyeway Projects an image
DIRECTLY on the retina and
MOVES IT according to the
eye’s movements
Tapping into the Human-Vision

11. 11
Fovea
the eye

12. 12
Foveation
The EyeWay system takes advantage of
the eye's natural peripheral and foveal
vision and addresses these areas
separately.
When projected into the fovea
at 1 pixel per arcmin (or 60
pixels/degree), the eye will perceive a
pixel-less, "natural resolution" image.
Using this method of projecting 2 SVGA
images per eye, the EyeWay system
achieves the equivalence of 5K projectors
per eye and is thus 40 times more
efficient.

13. 13
13

14. 14
Projection system
Artist rendition
14
• The system move exit
pupil in 4 degrees of
freedom
• Result:
Small exit pupil constantly
moved to follow an eye
Patents:
“Eye Projection System” - US10042161
“Image Projection System” - US10623707

15. 15
General system schematic
15
Sharing same optical path
When MEMS move to correct
the tracking:
it also moves the projected
image accordingly!
Patents:
“Image Projection System” - WO2018220608A1
“MEMS based light deflecting device and method” - WO2020212984

16. 16
EyeWay
Best –of-class AR
Natural eye resolution

17. 17
Vari-Focal
EyeWay
Best –of-class AR
Virtual Content and User Focus ALWAYS MATCH
Virtual Content and User Focus DONT MATCH

18. 18
Working in bright light
EyeWay
Best –of-class AR

19. 19
Technology summary
• Image is super-bright indoors and even outdoors
• Ultra-wide perceived FOV
• The virtual objects’-focus matches real objects in the room
• Pixelization-free image that matches the eye resolution
• ‘Hard-AR’ - non-ghost-like virtual images
• Power Efficiency – one-pixel-at-a-time

20. 20
2014 2020 12 - 24 Months
Project
Product
Core
Direct
Retinal Projection
Eye
Tracking
Hard AR
Work Outside
Eye Resolution
Color Gamut
On Axis
Laser Based
Ultra Fast
First Moving
Eye Box AR
First adjustable
Graphical Pipeline
First
Dynamic
FOV
First
Fully- Immersive
AR
First Gaze
Based Projection
Pixel Flow
Innovation Matrix
First Gaze Based
Vergence
Accommodation
Now

21. 21
2021 Combined system
Lots of perception finetuning work to be done…

22. 22
Thank You
info@eyeway-vision.com