Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired

Seongjae Lee, Sunmee Kang, Hanseok Ko, Jongseong Yoon, Minseok Keum

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

A novel approach for assisting effective bidirectional communication of intentions between people of normal hearing and hearing-impaired is presented in this paper. In particular, we demonstrate the intelligent hearing assistive utility by incorporating a speech-to-text interface such that the intended speaker's speech is directionally contained by means of a multichannel acoustic beamformer. Clear understanding of the normal hearing person's speech can reduce the burden on the hearing impaired in terms of required explicit response under context sensitive dialogue scenarios. Hence, hearing impaired friendlier interface device perceiving the utterances of normal hearing person is highly desirable. The proposed interface is a portable device with directional sound selection capability that performs speech-to-text task of normal hearing person's speech in diverse dialogue contexts. The relevant experimental results have confirmed that the proposed interface design is a feasible approach for realizing an effective and efficient intelligent agent, as it reduces the amount of work required from hearing impaired user who is interacting with the normal hearing people.

Original languageEnglish
Title of host publicationDigest of Technical Papers - IEEE International Conference on Consumer Electronics
Pages360-361
Number of pages2
DOIs
Publication statusPublished - 2013 Apr 24
Event2013 IEEE International Conference on Consumer Electronics, ICCE 2013 - Las Vegas, NV, United States
Duration: 2013 Jan 112013 Jan 14

Other

Other2013 IEEE International Conference on Consumer Electronics, ICCE 2013
CountryUnited States
CityLas Vegas, NV
Period13/1/1113/1/14

Fingerprint

Audition
Beamforming
Intelligent agents
Acoustics
Acoustic waves
Communication

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Industrial and Manufacturing Engineering

Cite this

Lee, S., Kang, S., Ko, H., Yoon, J., & Keum, M. (2013). Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired. In Digest of Technical Papers - IEEE International Conference on Consumer Electronics (pp. 360-361). [6486929] https://doi.org/10.1109/ICCE.2013.6486929

Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired. / Lee, Seongjae; Kang, Sunmee; Ko, Hanseok; Yoon, Jongseong; Keum, Minseok.

Digest of Technical Papers - IEEE International Conference on Consumer Electronics. 2013. p. 360-361 6486929.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, S, Kang, S, Ko, H, Yoon, J & Keum, M 2013, Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired. in Digest of Technical Papers - IEEE International Conference on Consumer Electronics., 6486929, pp. 360-361, 2013 IEEE International Conference on Consumer Electronics, ICCE 2013, Las Vegas, NV, United States, 13/1/11. https://doi.org/10.1109/ICCE.2013.6486929
Lee S, Kang S, Ko H, Yoon J, Keum M. Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired. In Digest of Technical Papers - IEEE International Conference on Consumer Electronics. 2013. p. 360-361. 6486929 https://doi.org/10.1109/ICCE.2013.6486929
Lee, Seongjae ; Kang, Sunmee ; Ko, Hanseok ; Yoon, Jongseong ; Keum, Minseok. / Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired. Digest of Technical Papers - IEEE International Conference on Consumer Electronics. 2013. pp. 360-361
@inproceedings{86ddaad93042443791efe9045904fc54,
title = "Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired",
abstract = "A novel approach for assisting effective bidirectional communication of intentions between people of normal hearing and hearing-impaired is presented in this paper. In particular, we demonstrate the intelligent hearing assistive utility by incorporating a speech-to-text interface such that the intended speaker's speech is directionally contained by means of a multichannel acoustic beamformer. Clear understanding of the normal hearing person's speech can reduce the burden on the hearing impaired in terms of required explicit response under context sensitive dialogue scenarios. Hence, hearing impaired friendlier interface device perceiving the utterances of normal hearing person is highly desirable. The proposed interface is a portable device with directional sound selection capability that performs speech-to-text task of normal hearing person's speech in diverse dialogue contexts. The relevant experimental results have confirmed that the proposed interface design is a feasible approach for realizing an effective and efficient intelligent agent, as it reduces the amount of work required from hearing impaired user who is interacting with the normal hearing people.",
author = "Seongjae Lee and Sunmee Kang and Hanseok Ko and Jongseong Yoon and Minseok Keum",
year = "2013",
month = "4",
day = "24",
doi = "10.1109/ICCE.2013.6486929",
language = "English",
isbn = "9781467313612",
pages = "360--361",
booktitle = "Digest of Technical Papers - IEEE International Conference on Consumer Electronics",

}

TY - GEN

T1 - Dialogue enabling speech-to-text user assistive agent with auditory perceptual beamforming for hearing-impaired

AU - Lee, Seongjae

AU - Kang, Sunmee

AU - Ko, Hanseok

AU - Yoon, Jongseong

AU - Keum, Minseok

PY - 2013/4/24

Y1 - 2013/4/24

N2 - A novel approach for assisting effective bidirectional communication of intentions between people of normal hearing and hearing-impaired is presented in this paper. In particular, we demonstrate the intelligent hearing assistive utility by incorporating a speech-to-text interface such that the intended speaker's speech is directionally contained by means of a multichannel acoustic beamformer. Clear understanding of the normal hearing person's speech can reduce the burden on the hearing impaired in terms of required explicit response under context sensitive dialogue scenarios. Hence, hearing impaired friendlier interface device perceiving the utterances of normal hearing person is highly desirable. The proposed interface is a portable device with directional sound selection capability that performs speech-to-text task of normal hearing person's speech in diverse dialogue contexts. The relevant experimental results have confirmed that the proposed interface design is a feasible approach for realizing an effective and efficient intelligent agent, as it reduces the amount of work required from hearing impaired user who is interacting with the normal hearing people.

AB - A novel approach for assisting effective bidirectional communication of intentions between people of normal hearing and hearing-impaired is presented in this paper. In particular, we demonstrate the intelligent hearing assistive utility by incorporating a speech-to-text interface such that the intended speaker's speech is directionally contained by means of a multichannel acoustic beamformer. Clear understanding of the normal hearing person's speech can reduce the burden on the hearing impaired in terms of required explicit response under context sensitive dialogue scenarios. Hence, hearing impaired friendlier interface device perceiving the utterances of normal hearing person is highly desirable. The proposed interface is a portable device with directional sound selection capability that performs speech-to-text task of normal hearing person's speech in diverse dialogue contexts. The relevant experimental results have confirmed that the proposed interface design is a feasible approach for realizing an effective and efficient intelligent agent, as it reduces the amount of work required from hearing impaired user who is interacting with the normal hearing people.

UR - http://www.scopus.com/inward/record.url?scp=84876351646&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876351646&partnerID=8YFLogxK

U2 - 10.1109/ICCE.2013.6486929

DO - 10.1109/ICCE.2013.6486929

M3 - Conference contribution

SN - 9781467313612

SP - 360

EP - 361

BT - Digest of Technical Papers - IEEE International Conference on Consumer Electronics

ER -