Hand sign language translator

Abstract

Sometimes we see two persons communicating using sign language in the streets, but we do not know what they are referring to as we do not know the sign language.

This project is the development of a Human-computer Interaction (HCI) system, “Let‟s Talk”, to help both the hearing-impaired people and normal people learn the American Sign Language (ASL) through an animated 3D model. In order to help the young hearing-impaired children learn the ASL, an application will also be specially developed to let the children discover the basic ASL through an interesting approach.

The software platform used in this project for programming and interfacing is Visual Basic 6.0. Pictures and graphics are incorporated into the Graphical User Interface (GUI) to make the system more appealing. The 3D animated model, Sydney, is created using Poser 7, a 3D rendering and animation creation tool developed by Smith Micro Software. The speech input section of the system was developed using the speech recognition software, Dragon NaturallySpeaking 11, whereby users can input using speech to generate the corresponding animated ASL videos.

After determining the basic structure and layout of the application, a big amount of time was spent on familiarizing the 3D animation software Poser 7 and GUI platform Visual Basic 6.0. The development of the database was done and list for a “Quiz” section for users to test their knowledge was finalized. Another section, “Child‟s Play”, was conceptualized and research was done to determine what basic ASLs are suitable for teaching hearing-impaired children.

This software helps to bridge the communication gap between the hearing-impaired people and the rest of the world. Parents of hearing-impaired children can make use of this software to learn the ASL themselves and teach their children at the same time using the “Child‟s Play” application, making it a good bonding activity between them.

“Let‟s Talk” can prove to a useful ASL learning tool for hearing-impaired people, normal people, hearing-impaired children and their parents.