Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired

Seongjae Lee, Sunmee Kang, Hanseok Ko, Jongseong Yoon, Minseok Keum

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

A novel approach for assisting effective bidirectional communication of intentions between people of normal hearing and hearing-impaired is presented in this paper. In particular, we demonstrate the intelligent hearing assistive utility by incorporating a speech-to-text interface such that the intended speaker's speech is directionally contained by means of a multichannel acoustic beamformer. Clear understanding of the normal hearing person's speech can reduce the burden on the hearing impaired in terms of required explicit response under context sensitive dialogue scenarios. Hence, hearing impaired friendlier interface device perceiving the utterances of normal hearing person is highly desirable. The proposed interface is a portable device with directional sound selection capability that performs speech-to-text task of normal hearing person's speech in diverse dialogue contexts. The relevant experimental results have confirmed that the proposed interface design is a feasible approach for realizing an effective and efficient intelligent agent, as it reduces the amount of work required from hearing impaired user who is interacting with the normal hearing people.

Original languageEnglish
Title of host publication2013 IEEE International Conference on Consumer Electronics, ICCE 2013
Pages360-361
Number of pages2
DOIs
Publication statusPublished - 2013
Event2013 IEEE International Conference on Consumer Electronics, ICCE 2013 - Las Vegas, NV, United States
Duration: 2013 Jan 112013 Jan 14

Publication series

NameDigest of Technical Papers - IEEE International Conference on Consumer Electronics
ISSN (Print)0747-668X

Other

Other2013 IEEE International Conference on Consumer Electronics, ICCE 2013
CountryUnited States
CityLas Vegas, NV
Period13/1/1113/1/14

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired'. Together they form a unique fingerprint.

  • Cite this

    Lee, S., Kang, S., Ko, H., Yoon, J., & Keum, M. (2013). Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired. In 2013 IEEE International Conference on Consumer Electronics, ICCE 2013 (pp. 360-361). [6486929] (Digest of Technical Papers - IEEE International Conference on Consumer Electronics). https://doi.org/10.1109/ICCE.2013.6486929