Abstract

In this paper, an innovative technique for communicating with people who have vocal and hearing impairments is presented. It discusses a more effective technique for speech-to-sign translation and sign recognition. Millions of individuals all over the world have hearing impairments. Deaf people never have the opportunity that hearing people do, whether it be to play computer games, communicate, go to seminars, or participate in video meetings. Since everyone cannot understand sign language, communication is the main difficulty they encounter while interacting with regular people. The primary objective of this paper is to develop a translating system composed of multiple modules that can translate English audio to English text. The structured grammar representation obtained after the parsing of the English text is then subjected to the Indian Sign Language grammar rules.