A new approach for Korean word spacing incorporating confidence value of user's input

Seung Wook Lee, Hae-Chang Rim, So Young Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

One of the problems of automatic word spacers is that the spacer mis-corrects the correctly spaced user's input. In this paper, we propose a new approach of estimating the confidence of user's input and incorporating the confidence value into the spacer for Korean word spacing. The confidence is defined as the probability that the input space is correct and is calculated by maximum likelihood estimation in the training data. The experimental results showed that the proposed method is more reliable than the previous method especially when the user's input is correct, and that the performance can be much improved when the confidence value is more precisely estimated.

Original languageEnglish
Title of host publicationProceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology
Pages92-97
Number of pages6
DOIs
Publication statusPublished - 2007 Dec 1
Event6th International Conference on Advanced Language Processing and Web Information Technology, ALPIT 2007 - Luoyang, Henan, China
Duration: 2007 Aug 222007 Aug 24

Other

Other6th International Conference on Advanced Language Processing and Web Information Technology, ALPIT 2007
CountryChina
CityLuoyang, Henan
Period07/8/2207/8/24

Fingerprint

Maximum likelihood estimation

ASJC Scopus subject areas

  • Computer Science(all)
  • Information Systems

Cite this

Lee, S. W., Rim, H-C., & Park, S. Y. (2007). A new approach for Korean word spacing incorporating confidence value of user's input. In Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology (pp. 92-97). [4460621] https://doi.org/10.1109/ALPIT.2007.94

A new approach for Korean word spacing incorporating confidence value of user's input. / Lee, Seung Wook; Rim, Hae-Chang; Park, So Young.

Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology. 2007. p. 92-97 4460621.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, SW, Rim, H-C & Park, SY 2007, A new approach for Korean word spacing incorporating confidence value of user's input. in Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology., 4460621, pp. 92-97, 6th International Conference on Advanced Language Processing and Web Information Technology, ALPIT 2007, Luoyang, Henan, China, 07/8/22. https://doi.org/10.1109/ALPIT.2007.94
Lee SW, Rim H-C, Park SY. A new approach for Korean word spacing incorporating confidence value of user's input. In Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology. 2007. p. 92-97. 4460621 https://doi.org/10.1109/ALPIT.2007.94
Lee, Seung Wook ; Rim, Hae-Chang ; Park, So Young. / A new approach for Korean word spacing incorporating confidence value of user's input. Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology. 2007. pp. 92-97
@inproceedings{a475f539ba204e2784de5e53652b64ba,
title = "A new approach for Korean word spacing incorporating confidence value of user's input",
abstract = "One of the problems of automatic word spacers is that the spacer mis-corrects the correctly spaced user's input. In this paper, we propose a new approach of estimating the confidence of user's input and incorporating the confidence value into the spacer for Korean word spacing. The confidence is defined as the probability that the input space is correct and is calculated by maximum likelihood estimation in the training data. The experimental results showed that the proposed method is more reliable than the previous method especially when the user's input is correct, and that the performance can be much improved when the confidence value is more precisely estimated.",
author = "Lee, {Seung Wook} and Hae-Chang Rim and Park, {So Young}",
year = "2007",
month = "12",
day = "1",
doi = "10.1109/ALPIT.2007.94",
language = "English",
isbn = "0769529305",
pages = "92--97",
booktitle = "Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology",

}

TY - GEN

T1 - A new approach for Korean word spacing incorporating confidence value of user's input

AU - Lee, Seung Wook

AU - Rim, Hae-Chang

AU - Park, So Young

PY - 2007/12/1

Y1 - 2007/12/1

N2 - One of the problems of automatic word spacers is that the spacer mis-corrects the correctly spaced user's input. In this paper, we propose a new approach of estimating the confidence of user's input and incorporating the confidence value into the spacer for Korean word spacing. The confidence is defined as the probability that the input space is correct and is calculated by maximum likelihood estimation in the training data. The experimental results showed that the proposed method is more reliable than the previous method especially when the user's input is correct, and that the performance can be much improved when the confidence value is more precisely estimated.

AB - One of the problems of automatic word spacers is that the spacer mis-corrects the correctly spaced user's input. In this paper, we propose a new approach of estimating the confidence of user's input and incorporating the confidence value into the spacer for Korean word spacing. The confidence is defined as the probability that the input space is correct and is calculated by maximum likelihood estimation in the training data. The experimental results showed that the proposed method is more reliable than the previous method especially when the user's input is correct, and that the performance can be much improved when the confidence value is more precisely estimated.

UR - http://www.scopus.com/inward/record.url?scp=50049120310&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=50049120310&partnerID=8YFLogxK

U2 - 10.1109/ALPIT.2007.94

DO - 10.1109/ALPIT.2007.94

M3 - Conference contribution

AN - SCOPUS:50049120310

SN - 0769529305

SN - 9780769529301

SP - 92

EP - 97

BT - Proceedings - ALPIT 2007 6th International Conference on Advanced Language Processing and Web Information Technology

ER -