Pick up any smart phone and gestures to operate it are nearly universal. Put on a set of smart glasses or play a mobile AR game and they are hobbled by out dated UX/UI standards that interfere with the new opportunities on the emerging AR platforms for spacial computing. In contrast to the UX/UI guidelines for WIMP interfaces; precious little has been written about best practices for AR. With screenless information, spatial computing, floating menus, mid air gestures, restyled 3DOF and 6DOF controllers, new graphics, audio, and haptics AR offers novel interaction patterns that demand new interface language and standards. Come join us for a dive into the emerging UX / UI standards for AR and spatial computing with inspiring examples from Leap Motion, North, mixed reality, Magic Leap, as well as some from XEO's own laboratory and latest experiments.

1. XEODesignNicole Lazzaro
Taming the Metaverse, Advanced UX Standards for
Spatial Computing for Enterprise and Games
AWE, Santa Clara
May 31, 2019
@NicoleLazzaro

2. Thought Leader
How Emotion Drives Tech Engagement
Advanced the art of game design
1st iPhone game @NicoleLazzaro
Interaction Design Language
Inspired Millions of Developers
“Every designer should learn
to read this language.”
Will Wright, Designer of The Sims
The 4 Keys to Fun
Globally Recognized Expert on Emotion and Play 26 Years

3. XEODesign© 2019 XEODesign, Inc.
4 Keys to Fun
Add Life to The Sims
Emotion framework for NPC AI Sims 2 on
Sold 13M+ units 2007
Second best selling PC game
of all time (the original Sims #1)
Hands Free AR/VR UI to Eyefluence
Eyetracking UI
AR/VR UI design for a productivity
operating system purchased
by Google 2016
Wonder to Myst
Riven, Myst Online, Myst V
Player experience design Feedback and
localization. Riven 4.5M units 4 years.
Feel The Force Unleashed
Player experience design (+12 other titles)
1.5M first week 7M copies fastest selling

4. XEODesign© 2019 XEODesign, Inc.
XR Clients
XEODesign’s strong track
record raises the bar with
leading XR organizations.
From consulting to HTC Vive
Focus launch partners our
proven innovation methods
deliver next gen experiences
for AR and VR.

5. 4 Keys Changing the Face of Technology, Enterprise, Games, and Politics
Samantha Bee Gamify Midterms The Future of Work Singapore TV

6. XEODesign© 2019 XEODesign, Inc.

7. UI vs UX
UI
The Interface
Visuals Audio &
Hardware
UX
Experience
Of the UI in Use
Most will be here

8. 4 Years XR Development

9. XR Interface 3 Systems
Virtual World
System
Real World
Person

10. Eye to the Future: Trapped Particle Displays

11. Avoiding Hyper-Reality Nightmare: Keiichi Matsuda

12. Clipping Clutter & See Through Walls

13. Need Agency And Options to Reduce Cutter

14. Gravity Assist (my desk)

15. White
Space

16. Just Because We Can Occlude Reality While Driving
Doesn’t Mean We Should

17. White Space In Control

18. Loss of Agency Can Lead to Depression

19. Avoid Forced Bystander Syndrome

20. Additive Light

21. Need Context to Shine Through

22. Vignette Mask Context Eagles Flight (for fast motion)

23. Emotion
2

24. XEODesign© 2018 XEODesign, Inc. Confidential and Proprietary
HardFun
CoreLoopChallenges.
EasyFunMicroloop
ExploreBubbleWrap
PeopleFun
ShareExperiences
SeriousFunMetaGame
ImpactUser’sLifeOutside
OfGame
4KeystoFunApplied

25. XEODesign© 2019 XEODesign, Inc.
4 Keys to Fun
Emotion Engine

26. XEODesign© 2019 XEODesign, Inc.
DOSE
Dopamine
Oxytocin
Serotonin
Endorphin

27. Spatial
Camera3

28. First Person Context and Anchors

29. Follow the White Rabbit

30. Individual vs Shared Cameras

31. ML1 Mesh vs Plant Clover and Chase Seeds Babble Rabbit

32. UI Anchors
& Controls4

33. 1DoF
2DoF Gestures & Eyes
3 DoF 6DoF Finger Position
<-------- Graceful Degradation

34. Modified Grips Proof We Have a Long Way to Go

35. Spatial UI/UX• Tilt Brush UI

36. Anchor

37. Keiichi Matsuda

38. Pinch and Drag

39. Support Hand Controller, Head, and Object Orientation in a
way that Clarifies and Provides Feedback on Intended Pose

40. Buttons and Keyboards

42. Gaze and Depth Cursors

43. Gestures
5

44. XEODesign© 2016 XEODesign, Inc. All Rights Reserved
xxx
Gestures “Unspoken” Want to Feel Like ThisXEODesign®

45. Effortless Exploration and Novelty [EF]

46. Gestures Discrete, Motion, and 3D

47. Finger Spells Aladdin’s Cave

48. Context
& AI6

49. Menus Anchor Experiences

50. Semantic Identification

51. Digital Twin & Overlays

52. Digital Twins Overlays and Video Screens

53. Designing the Context

54. More than a Digital Layer How Do We Interact With It?

55. GPS Nodes Spells and Collection [HF SF]

56. Incorporate Context

57. Change Real World Objects and Context Part of Story
Follow the White Rabbit

58. Social
7

59. Face to Face Interaction Tilt 5

60. Collaboration Needs Eyeline to Communicate Emotion

61. Context Story Personalize

62. Shareable Wonder

63. Haptics
8

64. PBR for Haptics

65. PBR for Haptics

66. PBR for Haptics

67. Audio
9

68. VR Audio Ø Position Direction Distance
Traditional
VR

70. A Few XR UX UI Standards
1. Augment Reality Don’t Replace It
2. Offer People Enough Physical, Sensory, Psychological Room To Interact And
Experience In
3. Offer Controls And Overrides At Any Time
4. Design Interactive Emotions To Enhance The Goals
5. Focus On Creating Emotions That Enhance The Human Condition
6. Anchor Experiences In World View In A Way That Is Natural And
Comfortable
7. Make Calibration And Meshing Fun Activity Themed To The World
8. Support Graceful Degradation Between Control Systems
9. Support Hand Controller, Head, And Object Orientation In A Way That
Clarifies And Provides Feedback On Intended Pose
10. Incorporate Context Of The World As Well As Data Displayed To Provide
More Value

71. XEODesign© 2019 XEODesign, Inc.
For More XR Standards and Slides
Drop off Biz Card or Tweet @NicoleLazzaro
Nicole@xeodesign.com
@NicoleLazzaro
XEODesign.com
510-658-8077Free Download
4K2F.com
Follow the
White Rabbit
TiltWorld.com