2. ABSTRACT
Gesture Vocalizer is a large scale multi-microcontroller
based system.
Designed to facilitate the communication among the
dumb, deaf and blind communities and their
communication with the normal people.
This system can be dynamically reconfigured to work
as a “smart device”.
5. DATA GLOVE
BEND SENSOR
data glove is equipped with five bend sensors
each of the bend sensor is fixed on each finger of the
hand glove
Used for the monitoring and sensing of static
movements of the fingers of the hand.
The bend sensor is made by using 555 timer IC in
astable mode along with a photo transistor.
The output of the bend sensor is a square wave.
7. TILT SENSOR
Accelerometer in the Gesture Vocalizer system is used
as a tilt sensor.
Two ADXL103 accelerometer checks the tilting of the
hand.
The accelerometer has an analog output which varies
from 1.5 volts to 3.5 volts.
The output of the accelerometer is provided to third
module
TECHNICAL ISSUE
8. REMEDY
Amplification and Attenuation Circuitry
This additional circuitry increases the range
of the accelerometer from 2 volts range to
5volts range
9. TILT DETECTION
The basic function of this module is to detect the
tilting of the hand and sending some binary data
against meaningful gestures, to the bend detection
module.
A dual channel ADC can be used to convert the
outputs of two accelerometers in to digital form.
Gesture Vocalizer system is a dual axis system, which
can detect the tilt of the hand in two axes.
Microcontroller receives the data of the two ADC’s one
by one, and saves them, for the further use.
10. Contd…….
The microcontroller checks whether the data received
from the ADC’s is some meaningful data, or useless
one.
The microcontroller compares the values received
from the ADC’s with the predefined values
The next step of the microcontroller is to send eight
bit binary data to the main “bend detection” module.
The microcontroller checks the output of the first
bend sensor, calculates its pulse width, saves its
output, and then moves towards the next bend sensor
one by one.
11. GESTURE DETECTION
Followed by BEND DETECTION
In this module one microcontroller is used and three
ports of this microcontroller are in use.
The microcontroller checks the output of the first
bend sensor, calculates its pulse width, saves its
output, and then moves towards the next bend sensor
one by one.
12. Contd……
Even a little bend of the finger is detected at this stage of the system.
Now the bending of each finger is quantized into ten levels. At any stage, the
finger must be at one of these levels, and it can easily be determined how much
the finger is bended.
next step is to combine the movement of each finger and name it a particular
gesture of the hand.
In the next step the system checks the data, which was sent by tilt detection
module at port one of the microcontroller.
The gesture detection module assigns a different 8bit code to each gesture.
If the gesture is meaningful the system sends an eight bit data to the speech
synthesis module.
13. SPEECH SYNTHESIS
This module of the system is consisted of a microcontroller (AT89C51), a
SP0256 (speech synthesizer) IC, amplifier circuitry and a speaker.
The function of this module is to produce voice against the respective
gesture.
The microcontroller receives the eight bit data from the “bend detection”
module.
Comparing this data with the predefined values the microcontroller comes
to know that which gesture does the hand make.
The last step of the system is to give voice to the each defined gesture. For
this purpose a speech synthesizer IC, SPO256 is used.
14. LCD DISPLAY
to translate the gestures, which are made by the hand, into some
text form. The text is display on LCD.
Gesture Detection module sends signal to the speech synthesis
module, the same signal is sent to the LCD display module.
The LCD display module is consisted of a microcontroller and an
LCD.
The LCD display module checks each signal, and compares it
with the already stored values.
On the basis of this comparison the microcontroller takes the
decision what should be displayed, having taken the decision the
microcontroller send an eight bit address to the LCD, this eight
bit address, tells the LCD, what should be displayed
16. CONCLUSION
This system is useful for dumb, deaf and blind people to
communicate with one another and with the normal
people.
The dumb people use their standard sign language which is
not easily understandable by common people and blind
people cannot see their gestures.
This system converts the sign language into voice which is
easily understandable by blind and normal people. The
sign language is translated into some text form, to facilitate
the deaf people as well. This text is display on LCD.
17. FUTURE ENHANCEMENTS
Designing of wireless transceiver system for “Microcontroller and Sensors
Based Gesture Vocalizer”.
Perfection in monitoring and sensing of the dynamic movements involved
in “Microcontroller and Sensors Based Gesture Vocalizer”.
Designing of a whole jacket, which would be capable of vocalizing the
gestures and movements of animals.
Virtual reality application e.g., replacing the conventional input devices
like joy sticks in videogames with the data glove.
The Robot control system to regulate machine activity at remote sensitive
sites.
18. REFERENCES
Sushmita Mitra and Tinku Acharya,”Gesture
Recognition: A Survey”, IEEE TRANSACTIONS ON
SYSTEMS, MAN, AND CYBERNETICS.
Juan P. Wachs, Helman Stern and Yael Edan, “Cluster
Labeling and Parameter Estimation for the Automated
Setup of a Hand-Gesture Recognition System”, IEEE
TRANSACTIONS ON SYSTEMS, MAN, AND
CYBERNETICS—SYSTEMS AND HUMANS
