We present a novel new word extraction method from Japanese texts based on expected
word frequencies. First, we compute expected word frequencies from Japanese texts using a …

We present a self-organized method to build a stochastic Japanese word segmenter from a
small number of basic words and a large amount of unsegmented training text. It consists of …

An unsupervised iterative approach for extracting a new lexicon (or unknown words) from a
Chinese text corpus is proposed in this paper. Instead of using a non-iterative segmentation …

Abstract In English written text, words are separated by spaces, but in written Chinese text,
there are no such separators between words.(See Figure 1.) Thus, effective information …

Not all languages, eg Chinese, have delimiters for words. To extract words from a sentence
in these languages, we usually rely on a dictionary for known words. For unknown words …

A Word is the smallest unit for text analysis, and the premise behind most text-mining
algorithms is that the words in given documents can be perfectly recognized. However, the …

This paper presents a mechanism of new word identification in Chinese text where
probabilities are used to filter candidate character strings and to assign POS to the selected …

There is no blank to mark word boundaries in Chinese text. As a result, identifying words is
difficult, because of segmentation ambiguities and occurrences of unknown words …

Term extraction is an important problem in natural language processing. In this paper, we
propose a language independent statistical corpusbased term extraction algorithm. In …

A Word is the smallest unit for text analysis, and the premise behind most text-mining
algorithms is that the words in given documents can be perfectly recognized. However, the …