Blue Eyes technology aims to give computers human-like perceptual and sensory abilities by using cameras and microphones to identify user actions and emotions. It analyzes information to determine a user's physical, emotional, or informational state. Technologies like emotion mouse, eye tracking, and speech recognition are used. Blue Eyes applications could help reduce human error in control rooms and vehicles by continuously monitoring conscious brain involvement. The technology has benefits like preventing dangerous incidents and minimizing consequences. Future developments may enable ordinary devices to respond when users look at them.
2. WHAT IS BLUE EYES
TECHNOLOGY?
• Aims at creating computational machines that
have perceptual and sensory ability.
• The basic idea behind this technology is to give
the computer the human power.
• Due to this the machine can understand what a
user wants, where he is looking at and even
realize his physical or emotional states.
• Use camera and microphone to identify user
actions and emotions.
3. Motivation for blue eyes
• Human error - a frequent reason of
catastrophes and ecological disasters
– weariness
– Oversight
– Mental illness
• Monitoring of conscious
brain involvement (automation in
long driving)
4. The term BLUE EYES
• BLUE in the term stands for Bluetooth,
which enables reliable wireless
communication
• EYES , because the eye movement
enables us to obtain a lot of interesting
and important information.
5. How can we make computers
“see”and“feel” ?
Blue eyes uses sensing
technology to identify a user’s
actions and to extract key
information.
Information is then analyzed to
determine the user’s physical,
emotional, or informational state.
6. What is blue eyes not?
• Neither predicts nor interferes with
operator’s thoughts
• Cannot force directly the operator to
work
7. TECHNOLGIES USED
• Emotion Mouse
• Manual And Gaze Input Cascaded
(MAGIC)
• Artificial Intelligent Speech Recognition
• Simple User Interest Tracker (SUITOR)
8. Touch recognition
• Hardware: - mouse
– Heart rate
– Temperature : thermocouple
– Galvanic skin response (gsr): digital
multimeter
– General somatic activity (gsa): movement of
computer mouse
• Emotions:
Anger, fear, sadness, disgust, joy, surprise
9. Eye tracking
• Hardware: - cmos camera, jazz
multisensor
– Eye movement
– Eye position (gaze)
– Level of blood oxygenation acceleration
– Ambient light intensity
10. Speech recognition
• Scanned input words are matched against
internally stored known words
• Slight variations: statistical techniques for
matching process
11. System overview
Data Acquisition Unit Central System Unit
Atmel 89C52 Connection Visualization
microcontroller Bluetooth Bluetooth Manager Module
Jazz Data
Data Analysis
Multisensor Logger
Bluetooth technology provides means for
creating a Personal Area Network linking the
operators and the central system.
12. applications
• Generic control rooms
– Power station
– Flight control centers
– Operating theatres
• Common application
– A simpler system version for drivers
13. Case study: professional drivers
• Human factor in accidents : 92%
• Vehicle defects :
} 8%
• Road defects :
14. Analogy between hci and dvi
HARDWARES AND Human Computer Driver Vehicle
ESSENTIALS Interface Interface
Continuous attention towards Monitor screen Road, signal
…… is required
conscious brain involvement Yes required Yes required
monitoring
Oversight and weariness yes yes
For touch recognition Mouse, keyboard Steering, brake,
accelerator
Eye tracking towards Screen Signal, other vehicles
15. BLUE EYES ENABLED DEVICES
POD
Technology used in
cars
PONG
A Robot
16. Blue Eyes - benefits
• Prevention from dangerous incidents
• Minimization of
– ecological consequences
– financial loss
– a threat to a human life
18. CONCLUSION
• Provide more delicate and user friendly
facilities in computing devices
• Gap between the electronic and physical
world is reduced
• The computers can be run using implicit
commands instead of the explicit
commands
• Future applications of blue eye technology
is limitless