Advancing Communication Equity for the Deaf Community through AI Sign Language Recognition and Direct Video Calling Services.

The goal of the project is to advance equitable communication for the 2 million+ Deaf people within the United States by providing innovative, native-language solutions that improve accessibility, independence, and inclusion using artificial intelligence (AI) sign language recognition and Direct Video Calling solutions. The objectives are: (1) Expand adoption of Direct Video Calling, enabling native sign language users to directly communicate with businesses and government entities; (2) conduct research to identify critical signs and expressions to optimize the AI sign language recognition engine; and (3) increase awareness among stakeholders about the unique needs of the Deaf community and the value of direct sign language communication in place of outdated services such as English-based chats, TTY, and third party interpretation that create barriers. The project aims to enhance accessibility, achieving over 97% satisfaction rates among users and a 42% reduction in call times, contributing to one-call resolution and greater independence. Outcomes also include data-driven improvements, such as identification of high-priority signs and use cases to refine AI technology, enabling equitable communication across key sectors. The project also aims for broader adoption, with increased engagement from businesses and agencies in implementing inclusive communication strategies. The products are: (1) A scalable Direct Video Calling platform tailored for seamless native-language communication; (2) an enhanced AI sign language recognition engine; and (3) research publication(s) on impactful sign language datasets for AI applications in diverse industries.