TALKING HANDS

When a baby gives a flying kiss!

Humans have an ability to twist and turn their tongue so that the sounds come out in the form of combination of sounds that we refer as music. If we go a little further, these twists and turns can be made more complex to utter letters, words and sentences which give birth to what we term as language, a way to interact and understand the thoughts and emotions between two people. Of course the ears also play their role in make sense of what sounds they hear.

Deaf and Dumb are the ones who cannot interact in the way that most of us do. According to WHO there are 63 million people who cannot speak or listen. Why would someone want to talk if they don't understand what they talk? A kannada speaking person won't be interested to talk to French speaking person, well for some time they would try to interact but they will feel uncomfortable when they see that it's taking more time to really understand. The same goes with the deaf and dumb people. They can interact with the people in the world only if the other person knows their language, the sign language.

Talking hands is a project to design and develop a device that will help the Deaf and Dumb interact with other person. The device will have a camera, an ML model deployed on a embedded chip, a speaker, a microphone and a display. The camera will feed the ML model with hand signals which the ML model will decode and convert it into audio (preferred language by the user) and the microphone will get the audio from the person who is trying to talk with the dead and dumb and convert it to hand signs on the display which the dead and dumb can see and understand.

Talking hands project will enable the deaf and dumb interact with the world and will help them to do much more than they use to.