This paper proposes a new algorithm that simultaneously identifies the coding system and
language of a code string fetched from the Internet, especially World-Wide Web. The …

This paper describes the preliminary results of an efficient language classifier using an ad-
hoc Cumulative Frequency Addition of N-grams. The new classification technique is simpler …

There is an increasing need to deal with multi-lingual documents today. If we could segment
multi-lingual documents language-wise, it would be very useful both for exploration of …

Identifying the language of an unknown text is not a new problem but what is new is the task
of identifying close languages. Malay and Indonesian as many other language€ are very …

Suchmaschinen im WWW indexieren und durchsuchen Dokumente in großer
Geschwindigkeit. Trotz der quantitativ beeindruckenden Ergebnisse lässt dieQualität der …

To determine how close two language models (eg, n-grams models) are, we can use
several distance measures. If we can represent the models as distributions, then the …

Text on the Web is available in numerous languages and encodings, often not according to
any standards. The number of multilingual documents on the Web is also increasing. The …

In this paper, we reconsider the problem of language identification of multilingual
documents. Automated language identification algorithms have been improving steadily …

In this article, we address the problem of categorization according to language by presenting
a method based on natural properties of language which allow us to categorize any kind of …

In this paper, we present the method we have designed and implemented for identifying lists
and sentences in PDF documents while participating to FinSBD-2 Financial Document …