Hearing Companion: Handheld Portable Sound Identification and Critical Alerting Functionality for People Who Are Deaf or Have Hearing Loss

Based on previous research, this project develops and demonstrates the HearingCompanionwhich: (1) automatically recognizes specific sounds in the environment on a pocket-sized device; and(2) alerts the user on their mobile device via vibration, images, and captions that identify these recognizedsounds. This efficient, wearable system utilizes existing and developing technology, improvingthe ability of a person who is deaf to function more naturally in a work or school environment. Phase IIproject goals include: (1) enhance the Hearing Companion device and application; (2) expand thenumber of mobile communication devices supported; (3) perform an extended usability evaluation ofthe device in a range of activities in vocational, public, and daily living scenarios; and (4) prepare fortransition into commercialization. The portable handheld system significantly enhances the user¿s senseof safety, security, and independence by providing a means of sound recognition heretofore unavailableto these individuals. Moreover, the personal devices provide a convenient and powerful tool formobile information and communication.