Translation quality assessment: A brief survey on manual and automatic methods

L Han, GJF Jones, AF Smeaton - arXiv preprint arXiv:2105.03311, 2021 - arxiv.org
To facilitate effective translation modeling and translation studies, one of the crucial
questions to address is how to assess translation quality. From the perspectives of accuracy …

An overview on machine translation evaluation

L Han - arXiv preprint arXiv:2202.11027, 2022 - arxiv.org
Since the 1950s, machine translation (MT) has become one of the important tasks of AI and
development, and has experienced several different periods and stages of development …

A taxonomy and study of critical errors in machine translation

K Al Sharou, L Specia - … of the 23rd annual conference of the …, 2022 - aclanthology.org
Not all machine mistranslations are equal. For example, mistranslating a date or time in an
appointment, mistranslating the number or currency in a contract, or hallucinating profanity …

Measuring uncertainty in translation quality evaluation (TQE)

S Gladkoff, I Sorokina, L Han, A Alekseeva - arXiv preprint arXiv …, 2021 - arxiv.org
From both human translators (HT) and machine translation (MT) researchers' point of view,
translation quality evaluation (TQE) is an essential task. Translation service providers (TSPs) …

HOPE: A task-oriented and human-centric evaluation framework using professional post-editing towards more effective MT evaluation

S Gladkoff, L Han - arXiv preprint arXiv:2112.13833, 2021 - arxiv.org
Traditional automatic evaluation metrics for machine translation have been widely criticized
by linguists due to their low accuracy, lack of transparency, focus on language mechanics …

Topic modelling of swedish newspaper articles about coronavirus: a case study using latent dirichlet allocation method

B Griciūtė, L Han, G Nenadic - 2023 IEEE 11th International …, 2023 - ieeexplore.ieee.org
Topic Modelling (TM) is a natural language processing (NLP) method for discovering topics
in a collection of documents. Being an unsupervised method, it is a valuable tool when trying …

Chinese character decomposition for neural MT with multi-word expressions

L Han, GJF Jones, AF Smeaton, P Bolzoni - arXiv preprint arXiv …, 2021 - arxiv.org
Chinese character decomposition has been used as a feature to enhance Machine
Translation (MT) models, combining radicals into character and word level models. Recent …

CantonMT: Cantonese-English neural machine translation looking into evaluations

KY Hong, L Han, RT Batista-Navarro… - Proceedings of the 16th …, 2024 - aclanthology.org
Cantonese-English is a low-resource language pair for machine translation (MT) studies,
despite the vast amount of English content publicly available online and the large amount of …

Student's t-Distribution: On Measuring the Inter-Rater Reliability When the Observations are Scarce

S Gladkoff, L Han, G Nenadic - arXiv preprint arXiv:2303.04526, 2023 - arxiv.org
In natural language processing (NLP) we always rely on human judgement as the golden
quality evaluation method. However, there has been an ongoing debate on how to better …

CantonMT: Investigating Back-Translation and Model-Switch Mechanisms for Cantonese-English Neural Machine Translation

K Yin Hong, L Han, R Batista-Navarro… - ACM Transactions on …, 2024 - dl.acm.org
This paper investigates the development and evaluation of machine translation models from
Cantonese to English (and backward), where we propose a novel approach to tackle low …