Slides from a class by Greg Borenstein presented at NYU ITP summer camp 2011

1. Intro to the Kinect:
Gestural Interfaces
Greg Borenstein
@atduskgreg
http://ideasfordozens.com

2. About Me
ITP Resident
Kinect Book for OʼReilly
Special Effects

3. About You
Processing experience?
Understand 3D?
Worked with the Kinect?
On Windows?

4. The Plan
What is the Kinect?
A stupid example of a gestural interface
The ingredients: joint position and 3D math
What makes a good gestural interface?
A better example of a gestural interface
Hands-on

9. IR Projector

10. Image courtesy of futurepicture.org

11. IR Projector

12. IR Camera
IR Projector

13. R GB Camera
IR Camera
IR Projector

14. RGB Image Depth Image

15. Skeleton Data

16. $2000

17. $2000 $3000

18. Nov. 4 - Nov. 10

19. openkinect.org

20. Processing.org

21. Dan Shiffman
NYU ITP photo by Jeff Howard

23. openni.org

24. Simple OpenNI
code.google.com/p/simple-openni

25. Something Stupid

26. Something Stupid
Control Emacs with Your Beard w/ Devin
Chalmers at Open Source Bridge
code here: https://github.com/qwzybug/osb-kinect

27. DEMO

28. How does this work?
Measure distance between joints
Trigger actions using Robot

29. Get Position of Joints
kinect.getJointPositionSkeleton()
joint.dist()

30. DEMO

31. Measuring things in 3D
Orientation of coordinate system
Control the size and position of an image

32. DEMO

33. What makes a good
gestural interface?

34. Kinect Abnormal Motion Assessment System
motionassessment.com
Involuntary Motion Disorders like Chorea van
Sydenham, Tardive Dyskinesia, and Parkinsonʼs

35. Kinect Abnormal Motion Assessment System
motionassessment.com
Involuntary Motion Disorders like Chorea van
Sydenham, Tardive Dyskinesia, and Parkinsonʼs

36. Kinect Abnormal Motion Assessment System
motionassessment.com
Won the National Health 2.0 Developer
Challenge. Maybe improve treatment.

37. What do you want to make?

38. Making Things See:
Hacking Computer Vision with the Microsoft
Kinect, Processing, and Arduino
Beta “Real Soon Now” from OʼReilly

39. Thanks!
Greg Borenstein
@atduskgreg
http://gregborenstein.com
greg.borenstein@gmail.com