Language identification (" LI") is the problem of determining the natural language that a
document or part thereof is written in. Automatic LI has been extensively researched for over …

Abstract Language identification is the task of identifying the language a given document is
written in. This paper describes a detailed examination of what models perform best under …

We show that transductive (cross-domain) learning is an important consideration in building
a general-purpose language identification system, and develop a feature selection method …

Abstract Language identification is the task of automatically detecting the language (s)
present in a document based on the content of the document. In this work, we address the …

We present an evaluation of “off-theshelf” language identification systems as applied to
microblog messages from Twitter. A key challenge is the lack of an adequate corpus of …

The task of identifying the language in which a given document (ranging from a sentence to
thousands of pages) is written has been relatively well studied over several decades …

This paper describes the preliminary results of an efficient language classifier using an ad-
hoc Cumulative Frequency Addition of N-grams. The new classification technique is simpler …

There is an increasing need to deal with multi-lingual documents today. If we could segment
multi-lingual documents language-wise, it would be very useful both for exploration of …

The classification accuracy of text-based language identification depends on several factors,
including the size of the text fragment to be identified, the amount of training data available …

Identifying the language of an unknown text is not a new problem but what is new is the task
of identifying close languages. Malay and Indonesian as many other language€ are very …