Sign2Sign: developing an accessible learning application for sign language (A)

Abstract

The number of Deaf and hard-of-hearing people ranging from new-born to elderly is increasing every day. Without being able to converse in sign language, many people including family and friends of a deaf person, might be having a communication gap with the deaf person.

This project aims to develop an accessible and effective sign language learning platform to help families and friends of a Deaf person to close the communication gap by learning sign language. The platform has a complete learning cycle for users to learn words, how to use them in sentences, and use these sentences to create conversations. The platform also involves the use of interactive 3D avatar to demonstrate the sign language and Sign Recognition AI to give users signing feedback in real-time.

This three-student’s team project was shortlisted as one of the World Finalist in the Microsoft Imagine Cup 2022 Competition and won as the 1st Winner for Asia-Pacific region in Lifestyle Category.