While machine translation (MT) systems are achieving increasingly strong performance on benchmarks, they often produce translations with errors and anomalies. Understanding …
We report the results of the WMT 2024 shared task on Quality Estimation, in which the challenge is to predict the quality of the output of neural machine translation systems at the …
Large language models (LLMs) have achieved remarkable success across various NLP tasks, yet their focus has predominantly been on English due to English-centric pre-training …
Q Lu, L Ding, K Zhang, J Zhang, D Tao - arXiv preprint arXiv:2409.14335, 2024 - arxiv.org
Large Language Models (LLMs) have shown significant potential as judges for Machine Translation (MT) quality assessment, providing both scores and fine-grained feedback …
Annually, at the Conference of Machine Translation (WMT), the Metrics Shared Task organizers conduct the meta-evaluation of Machine Translation (MT) metrics, ranking them …
L Krause, SB Santamaria, JC Kalo - Proceedings of the Ninth …, 2024 - aclanthology.org
In this paper, we present our approach to the WMT24-Chat Task, addressing the challenge of translating chat conversations. Chat conversations are characterised by their informal …
Extremely low-resource (XLR) languages lack substantial corpora for training NLP models, motivating the use of all available resources such as dictionaries and grammar books …
An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model …
Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better …