Human localization based on the fusion of vision and sound system

Sung Wan Kim, Ji Yong Lee, Doik Kim, Bum Jae You, Nakju Doh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, a method for accurate human localization using a sequential fusion of sound and vision is proposed. Although the sound localization alone works well in most cases, there are situations such as noisy environment and small inter-microphone distance, which may produce wrong or poor results. A vision system also has deficiency, such as limited visual field. To solve these problems we propose a method that combines sound localization and vision in real time. Particularly, a robot finds rough location of the speaker via sound source localization, and then using vision to increase the accuracy of the location. Experimental results show that the proposed method is more accurate and reliable than the results of pure sound localization.

Original languageEnglish
Title of host publicationURAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence
Pages495-498
Number of pages4
DOIs
Publication statusPublished - 2011 Dec 1
Event2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence, URAI 2011 - Incheon, Korea, Republic of
Duration: 2011 Nov 232011 Nov 26

Other

Other2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence, URAI 2011
CountryKorea, Republic of
CityIncheon
Period11/11/2311/11/26

Fingerprint

Fusion reactions
Acoustic waves
Microphones
Robots

Keywords

  • Face Detection
  • Fusion
  • Human Localization
  • Sound Localization

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications

Cite this

Kim, S. W., Lee, J. Y., Kim, D., You, B. J., & Doh, N. (2011). Human localization based on the fusion of vision and sound system. In URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (pp. 495-498). [6145870] https://doi.org/10.1109/URAI.2011.6145870

Human localization based on the fusion of vision and sound system. / Kim, Sung Wan; Lee, Ji Yong; Kim, Doik; You, Bum Jae; Doh, Nakju.

URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence. 2011. p. 495-498 6145870.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, SW, Lee, JY, Kim, D, You, BJ & Doh, N 2011, Human localization based on the fusion of vision and sound system. in URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence., 6145870, pp. 495-498, 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence, URAI 2011, Incheon, Korea, Republic of, 11/11/23. https://doi.org/10.1109/URAI.2011.6145870
Kim SW, Lee JY, Kim D, You BJ, Doh N. Human localization based on the fusion of vision and sound system. In URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence. 2011. p. 495-498. 6145870 https://doi.org/10.1109/URAI.2011.6145870
Kim, Sung Wan ; Lee, Ji Yong ; Kim, Doik ; You, Bum Jae ; Doh, Nakju. / Human localization based on the fusion of vision and sound system. URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence. 2011. pp. 495-498
@inproceedings{89a7474b8d634fb3b6d3a927017989df,
title = "Human localization based on the fusion of vision and sound system",
abstract = "In this paper, a method for accurate human localization using a sequential fusion of sound and vision is proposed. Although the sound localization alone works well in most cases, there are situations such as noisy environment and small inter-microphone distance, which may produce wrong or poor results. A vision system also has deficiency, such as limited visual field. To solve these problems we propose a method that combines sound localization and vision in real time. Particularly, a robot finds rough location of the speaker via sound source localization, and then using vision to increase the accuracy of the location. Experimental results show that the proposed method is more accurate and reliable than the results of pure sound localization.",
keywords = "Face Detection, Fusion, Human Localization, Sound Localization",
author = "Kim, {Sung Wan} and Lee, {Ji Yong} and Doik Kim and You, {Bum Jae} and Nakju Doh",
year = "2011",
month = "12",
day = "1",
doi = "10.1109/URAI.2011.6145870",
language = "English",
isbn = "9781457707223",
pages = "495--498",
booktitle = "URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence",

}

TY - GEN

T1 - Human localization based on the fusion of vision and sound system

AU - Kim, Sung Wan

AU - Lee, Ji Yong

AU - Kim, Doik

AU - You, Bum Jae

AU - Doh, Nakju

PY - 2011/12/1

Y1 - 2011/12/1

N2 - In this paper, a method for accurate human localization using a sequential fusion of sound and vision is proposed. Although the sound localization alone works well in most cases, there are situations such as noisy environment and small inter-microphone distance, which may produce wrong or poor results. A vision system also has deficiency, such as limited visual field. To solve these problems we propose a method that combines sound localization and vision in real time. Particularly, a robot finds rough location of the speaker via sound source localization, and then using vision to increase the accuracy of the location. Experimental results show that the proposed method is more accurate and reliable than the results of pure sound localization.

AB - In this paper, a method for accurate human localization using a sequential fusion of sound and vision is proposed. Although the sound localization alone works well in most cases, there are situations such as noisy environment and small inter-microphone distance, which may produce wrong or poor results. A vision system also has deficiency, such as limited visual field. To solve these problems we propose a method that combines sound localization and vision in real time. Particularly, a robot finds rough location of the speaker via sound source localization, and then using vision to increase the accuracy of the location. Experimental results show that the proposed method is more accurate and reliable than the results of pure sound localization.

KW - Face Detection

KW - Fusion

KW - Human Localization

KW - Sound Localization

UR - http://www.scopus.com/inward/record.url?scp=84863175798&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863175798&partnerID=8YFLogxK

U2 - 10.1109/URAI.2011.6145870

DO - 10.1109/URAI.2011.6145870

M3 - Conference contribution

SN - 9781457707223

SP - 495

EP - 498

BT - URAI 2011 - 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence

ER -