An overview on machine translation evaluation

L Han - arXiv preprint arXiv:2202.11027, 2022 - arxiv.org
Since the 1950s, machine translation (MT) has become one of the important tasks of AI and
development, and has experienced several different periods and stages of development …

Predicting Perfect Quality Segments in MT Output with Fine-Tuned OpenAI LLM: Is it possible to capture editing distance patterns from historical data?

S Gladkoff, G Erofeev, L Han, G Nenadic - arXiv preprint arXiv:2308.00158, 2023 - arxiv.org
Translation Quality Estimation (TQE) is an important step before deploying the output
translation into usage. TQE is also critical in assessing machine translation (MT) and human …

Lig system for word level qe task at wmt14

NQ Luong, L Besacier, B Lecouteux - Workshop on machine …, 2014 - inria.hal.science
This paper describes our Word-level QE system for WMT 2014 shared task on Spanish-
English pair. Compared to WMT 2013, this year's task is different due to the lack of SMT …

Towards accurate predictors of word quality for machine translation: Lessons learned on french–english and english–spanish systems

NQ Luong, L Besacier, B Lecouteux - Data & Knowledge Engineering, 2015 - Elsevier
This paper proposes some ideas to build effective estimators, which predict the quality of
words in a Machine Translation (MT) output. We propose a number of novel features of …

[PDF][PDF] An open-source toolkit for word-level confidence estimation in machine translation

C Servan, NT Le, NQ Luong, B Lecouteux… - Proceedings of the …, 2015 - aclanthology.org
Recently, a growing need of Confidence Estimation (CE) for Statistical Machine Translation
(SMT) systems in Computer Aided Translation (CAT), was observed. However, most of the …

Translation quality estimation using only bilingual corpora

L Liu, A Fujita, M Utiyama, A Finch… - IEEE/ACM Transactions …, 2017 - ieeexplore.ieee.org
In computer-aided translation scenarios, quality estimation of machine translation
hypotheses plays a critical role. Existing methods for word-level translation quality …

A methodology to measure the diachronic language distance between three languages based on perplexity

JR Pichel, P Gamallo, I Alegria… - Journal of Quantitative …, 2021 - Taylor & Francis
The aim of this paper is to apply a corpus-based methodology, based on the measure of
perplexity, to automatically calculate the cross-lingual language distance between historical …

LEPOR: An Augmented Machine Translation Evaluation Metric

L Han - arXiv preprint arXiv:1703.08748, 2017 - arxiv.org
Machine translation (MT) was developed as one of the hottest research topics in the natural
language processing (NLP) literature. One important issue in MT is that how to evaluate the …

Unsupervised quality estimation model for english to german translation and its application in extensive supervised evaluation

ALF Han, DF Wong, LS Chao, L He… - The Scientific World …, 2014 - Wiley Online Library
With the rapid development of machine translation (MT), the MT evaluation becomes very
important to timely tell us whether the MT system makes any progress. The conventional MT …

Revisit automatic error detection for wrong and missing translation–a supervised approach

W Lei, W Xu, A Aw, Y Xiang… - Proceedings of the 2019 …, 2019 - aclanthology.org
While achieving great fluency, current machine translation (MT) techniques are bottle-
necked by adequacy issues. To have a closer study of these issues and accelerate model …