Sign language recognition – teach machine to talk to deaf people

Abstract

With the advancement of technologies, people have been able to utilize various technologies and equipment to improve the standard of living. These improvements include transport, comfort, wealth and communications. Over the years, the means of communication has become arguably one of the most developed technologies in this age. With the introduction of internet, social media and phones, communications have been convenient and easy. Despite this, face-to-face verbal communication remains to be the primary mode of communication for most of the population. It is the most preferred and direct way of communicating over short distances. However, we cannot neglect the deaf-mutes, who are unable to communication well verbally. For them, their primary mode of communication is by using hand signs or sign language. The problem is that people who have not learnt sign language before will most likely have difficulties in understanding what the deaf-mutes are trying to convey. Hence, it is only logical that we should try to make use of the current technology, to enhance and improve their primary mode of communication such that they could be easier understood by others. The aim of this project is to create a program which is able to recognise simple signs and gestures which are translated into words. By using this program, people are able to understand the signs made by the deaf-mutes even though they do not understand sign language. Similarly, people are able to use this program to communicate back with the deaf-mutes with gestures. This will allow an effective way of communication between the mass population and the deaf-mutes. This project can be implemented in various locations such as airport, shopping malls and schools, where the deaf-mutes can ask for directions or help from others with the usage of this program. Thus, the machine is being used as an interpreter, as though the machine was taught to talk to deaf people. Therefore, this is a very meaningful project which will be able to help ease the deaf-mutes in communication with others effectively.