Loading...

Using augmented reality and automatic speech recognition techniques to help deaf and hard of hearing people

Mirzaei, M. R ; Sharif University of Technology | 2012

610 Viewed
  1. Type of Document: Article
  2. DOI: 10.1145/2331714.2331720
  3. Publisher: 2012
  4. Abstract:
  5. Recently, many researches show Augmented Reality (AR) and Automatic Speech Recognition (ASR) can help people with disabilities. In this paper we implement an innovative system for helping deaf people by combining AR, ASR, and AVSR technologies. This system can instantly take narrator's speech and converts it into readable text and shows it directly on AR display. We show that our system's accuracy becomes over 85 percent on average, by using different ASR engines near using an AVSR engine in different noisy environments. We also show in a survey that more than 90 percent of deaf people on average need such system as assistant in portable devices, near using only text or only sign-language for communications
  6. Keywords:
  7. Automatic speech recognition ; AR display ; Audio visual speech recognition ; Automatic speech recognition ; Deaf people ; Innovative systems ; Noisy environment ; People with disabilities ; Portable device ; Audition ; Augmented reality ; Communication ; Innovation ; Speech recognition ; Virtual reality ; Handicapped persons
  8. Source: ACM International Conference Proceeding Series ; 2012 ; 9781450312431 (ISBN)
  9. URL: http://dl.acm.org/citation.cfm?doid=2331714.2331720