One of the most prominent problems in computer processing of the Chinese language is
identification of the words in a sentence. Since there are no blanks to mark word boundaries …

There is no blank to mark word boundaries in Chinese text. As a result, identifying words is
difficult, because of segmentation ambiguities and occurrences of unknown words …

Since written Chinese has no space to delimit words, segmenting Chinese texts becomes an
essential task. During this task, the problem of unknown word occurs. It is impossible to …

This paper presents a mechanism of new word identification in Chinese text where
probabilities are used to filter candidate character strings and to assign POS to the selected …

A sentence in Chinese is written as a string of characters without separation between words.
Before linguistic analyses on a text, it has to be first segmented into a sequence of words …

Statistical methods for extracting Chinese unknown words usually suffer a problem that
superfluous character strings with strong statistical associations are extracted as well. To …

Abstract “Word” is difficult to define in the languages that do not exhibit explicit word
boundary, such as Thai. Traditional methods on defining words for this kind of languages …

An unsupervised iterative approach for extracting a new lexicon (or unknown words) from a
Chinese text corpus is proposed in this paper. Instead of using a non-iterative segmentation …

Chinese sentences are composed with string of characters without blanks to mark words.
However the basic unit for sentence parsing and understanding is word. Therefore the first …

Word Identification has been an important and active issue in Chinese Natural Language
Processing. In this paper, a new mechanism, based on the concept of sublanguage, is …