2. 3D Gesture Documentation is an attempt to provide an overview of
possible 3D gestures, which can be implemented in gestural user
interfaces for variety of purposes. It highlights possible functionality
associated with it. The functionalities given in this document are
general purpose, it may vary with the context and its users
It is gathered from existing literature and initial research activity
(ongoing) on identification of appropriate gestures for social acceptance
in collaboration with IBM Research (India). This documentation is the
first draft, which will further be updated at various stages and intimated
3. The document is divided into three major sections:
• Upper body gestures
Gestures that involve upper body (above waist)
• Lower body gestures
Gestures that involve lower body (below waist)
• Full body gestures
Gestures that involve full body
4. These three categories are further sub divided into static gestures and
dynmaic gestures.
Static Gesture
Static gestures are postures that does not take movements into
account. For example, stop gesture can be performed to stop ongoing
video. Posture of “palm facing” is detected to activate stop action, but
the movement of hand is not considered.
5. These three categories are further sub divided into static gestures and
dynmaic gestures.
Dynamic Gesture
Dynamic gestures are movements. Dynamics in a gesture provide a
meaning, which are taken into consideration to activate an action. For
example, in drag gesture, initial and last position of hand movement is
interpreted to activate appropriate action
7. Upper Body 3 Dimensional Gestures
Static Gestures
Stare Narrowed eyes
Wink Wink with tilted neck
(left/right)
Delete a choice; unlike a
choice or provide
alternative choices
Zoom-in a choice;
maximize a choice;
increase brightness of a
system
Favourite a choice;
select or confirm a
choice
Favourite choice on
extreme side (right/left);
select or confirm a
choice on extreme side
(right/left)
8. Huh I Ponh (left)
Ponh (right) Tongue out
Remove favourite tag of
a choice; provide
alternative choice
Select or confirm a
choice on left side
Select or confirm a
choice on right side
Remove favourite tag of
a choice; delete a choice;
provide alternative
choice
Upper Body 3 Dimensional Gestures
Static Gestures
9. Head up Head down
Head sideways (left) Head sideways (right)
Scroll up; increase
properties of a choice
(e.g. Increase volume of
a selected song)
Scroll down; decrease
properties of a choice
(e.g. Decrease volume of
selected song)
Scroll left side Scroll right side
Upper Body 3 Dimensional Gestures
Static Gestures
10. Head scratching Binocular
Call me Hands covering lips
Help required; provide
clues for appropriate
actions
Zoom-in a choice;
increase resolution of
screen
Call or connect to
selected choice
Mute; decrease volume
Upper Body 3 Dimensional Gestures
Static Gestures
11. Elbow bend Victory
Fist Thumbs up
Pause an ongoing
activity
Select or confirm a
choice; favourite a
choice
Grab and select or
confirm a choice
Increase properties of a
function; favourite a
choice
Upper Body 3 Dimensional Gestures
Static Gestures
12. Thumbs down Salute
Hold Sshhh!!
Decrease properties of a
function; remove
favourite tag of a choice
Select or confirm a
choice; upgrade a choice
to most priority contents
Select multiple choices
together
Mute; decrease volume
Upper Body 3 Dimensional Gestures
Static Gestures
13. Surprise Eat
Hands folded Stop
Help required; activate
favorite choice
Select or confirm food
related choice
Pause; start a system Stop ongoing activity
Upper Body 3 Dimensional Gestures
Static Gestures
14. Slap (fear) Perfect
Delete a choice; hide a
choice
Select or confirm a
choice; favourite a
choice
Palm upwards Palm downwards
Increase properties of a
function; scroll up
Decrease properties of a
function; scroll down
Upper Body 3 Dimensional Gestures
Static Gestures
15. Shoot Think
Select or confirm a
choice; fire bullets in
action games
Help required
Hook Hands behind ears
Select or confirm a
choice; tag a choice
Increase sound/volume
of a selected choice
Upper Body 3 Dimensional Gestures
Static Gestures
17. Pinch in & Pinch out
Increase/decrease properties of a choice;
majorly used in zoom in/out an image
Pak pakkapak
Dislike a choice; provide alternative choice
Upper Body 3 Dimensional Gestures
Dynamic Gestures
18. Snapping
Select or confirm a choice; fire bullets in
action games
Driving
Controlling of car in car games
Upper Body 3 Dimensional Gestures
Dynamic Gestures
19. In-air tap
Select or confirm a choice;
Both hands open & close (horizontal)
Increase/decrease properties of selected
choice (e.g. Increase/decrease of a volume
of selected song)
Upper Body 3 Dimensional Gestures
Dynamic Gestures
20. Both hands open & close (vertical)
Increase/decrease properties of selected
choice (e.g. Increase/decrease of a volume
of selected song)
Forward hand push
Select or confirm a choice
Upper Body 3 Dimensional Gestures
Dynamic Gestures
21. Grab and drag
Grab a choice and drag it to desired place
Wave
Start the system; go back to main menu of
a system
Upper Body 3 Dimensional Gestures
Dynamic Gestures
22. Swipe (left to right)
Horizontal scrolling of contents in left to
right direction
Swipe (right to left)
Horizontal scrolling of contents in right to
left direction
Upper Body 3 Dimensional Gestures
Dynamic Gestures
23. Punch
Delete a choice; in some cases, select a
choice (e.g. punch to blast away your calories)
Yesss!!
Select or confirm a choice; favourite a
choice
Upper Body 3 Dimensional Gestures
Dynamic Gestures
25. Cut-throat
Delete a choice; deselect a choice
Fist opening
Select or confirm a choice to activate it
Upper Body 3 Dimensional Gestures
Dynamic Gestures
26. Swipe right hand (sideways)
Horizontal scrolling from left-right
direction
Swipe left hand (sideways)
Horizontal scrolling from right to left
direction
Upper Body 3 Dimensional Gestures
Dynamic Gestures
27. Grab and drag
Grab and drag a choice and move to drop
Upper Body 3 Dimensional Gestures
Dynamic Gestures
28. Spit
Delete a choice; dislike a choice; deselect a
choice
Upper body movement (both sides)
Horizontal scrolling from left-to-right
direction and vice versa
Upper Body 3 Dimensional Gestures
Dynamic Gestures
29. Head butt
Delete a choice
Head movement (only one
time) like “Yes”
Select or confirm a choice
Upper Body 3 Dimensional Gestures
Dynamic Gestures
30. Head movement (only one
time) like “No”
Deselect a choice; delete a choice;
remove choice from favourite tag
Upper Body 3 Dimensional Gestures
Dynamic Gestures
32. Lower Body 3 Dimensional Gestures
Static Gestures
Right leg upwards Left leg upwards
Left leg forward kick Right leg forward kick
Select or confirm a
choice on right side;
horizontal scrolling from
right side
Select or confirm a
choice on left side;
horizontal scrolling from
left side
Delete a choice; kick a
choice; Select or confirm
a choice on lower left
side; increase
properties of a choice
Delete a choice; kick a
choice; Select or confirm
a choice on lower right
side; increase properties
of a choice
33. Left leg backward Right leg backward
Jump Crossed legs
Select or confirm a
choice on left side;
horizontal scrolling from
left side; decrease
properties of a choice
Select or confirm a
choice on right side;
horizontal scrolling from
right side; decrease
properties of a choice
Select or confirm your
choice; increase
properties of a choice
Pause ongoing activity
Lower Body 3 Dimensional Gestures
Static Gestures
34. Bent ankle Toes upward
Right toe forward Right toe backward
Increase properties of a
choice; select or confirm
a choice on left side; left
forward scrolling; pause
or stop ongoing activity
Pause ongoing activity;
increase properties of a
choice
Increase properties of a
choice; select or confirm
a choice on right side;
right forward scrolling
Decrease properties of a
choice; select or confirm
a choice on right side;
right backward scrolling
Lower Body 3 Dimensional Gestures
Static Gestures
35. Sitting Crossed legs (right) - I
Crossed legs (left) - I Crossed legs (right) - II
Start a system Pause ongoing activity;
activate favourite
choices
Pause ongoing activity;
activate favorite choices
Pause ongoing activity
Lower Body 3 Dimensional Gestures
Static Gestures
37. Full Body 3 Dimensional Gestures
Static Gestures
Stand – hands on waist Stand – hands on hips
Tired Huh
Pause ongoing activity;
start a system; activate
serious applications;
return to default
Pause ongoing activity;
stop ongoing activity
Dislike a choice; provide
alternative choice
Dislike a choice; provide
alternative choice;
delete a choice; remove
choice from favourite
38. Hands open & bend
left/right
Hit
A step towards left/
right
Bend forward
Obstruct moving objects
Delete a choice; stop
ongoing activity; hit an
object with a racket (e.g.
Hitting a tennis ball)
View previous/next set
of contents
Activate a choice; fast
forward; move a choice
forward
Full Body 3 Dimensional Gestures
Static Gestures
39. Bend left Bend right
Fly (left) Fly (right)
Select or confirm a
choice on left side;
horizontal scroll on left
Select or confirm a
choice on right side;
horizontal scroll on right
Select or confirm a
choice on left side;
horizontal scroll on left
Select or confirm a
choice on right side;
horizontal scroll on right
Full Body 3 Dimensional Gestures
Static Gestures
40. Squat Sitting on toes
Activate a choice;
activate favourite
choices
Start a system; activate
favourite choices
Namaste
Start a system; activate
a choice
Full Body 3 Dimensional Gestures
Static Gestures
41. Embedded Interaction Lab (EILab) Team
Denny George, Mannu Amrit, Minal Jain and Keyur Sorathia
A special thanks to Shreya Raina.
Special mention:
Moupiya Ukil and Amlan Abhinav
