A survey on evaluation metrics for machine translation

S Lee, J Lee, H Moon, C Park, J Seo, S Eo, S Koo… - Mathematics, 2023 - mdpi.com
… in machine translation (MT). The translation quality of neural network-based MT transcends
… Then, the semantic frame is aligned using maximum weighted bipartite matching based on …

Machine translation evaluation: unveiling the role of dense sentence vector embedding for morphologically rich language

S Tripathi, V Kansal - International Journal of Pattern Recognition …, 2020 - World Scientific
automated machine translation (MT) systems to translate text from source language to target
language. As existing systems for MT … nd the maximum matching based on Synonym match …

Beyond BLEU: training neural machine translation with semantic similarity

J Wieting, T Berg-Kirkpatrick, K Gimpel… - arXiv preprint arXiv …, 2019 - arxiv.org
… In this paper we propose SIMILE, a simple alternative to matching-based metrics like BLEU
for use in discriminative NMT training. As a new reward, we introduce a measure of semantic …

Towards a better integration of fuzzy matches in neural machine translation through data augmentation

A Tezcan, B Bulté, B Vanroy - Informatics, 2021 - mdpi.com
… Recent advances in machine translation (MT), most notably … semantically) unrelated sentences
than matching based on E D , … speaking, fuzzy matching based on BPE performed slightly …

[图书][B] Quality estimation for machine translation

L Specia, C Scarton, GH Paetzold - 2022 - books.google.com
… the system outputs against one or more reference outputs using string matching-based
evaluation … in terms of number of users is Machine Translation (MT). There are various online …

Writing in two languages: Neural machine translation as an assistive bilingual writing tool

J Xu - 2022 - theses.hal.science
Machine translation (MT) tools, which translate texts written in … in MT, especially the tangible
progress in neural machine … judgments than word-level matching-based metrics. Rei et al. (…

[PDF][PDF] Rethinking the evaluation of neural machine translation

J Yan, C Wu, F Meng, J Zhou - arXiv preprint arXiv:2106.15217, 2021 - academia.edu
… On the one hand, given any matching-based translation quality function Q, the empty
output should always rank to the last of YCR. On the other hand, ym is the mode of model …

Enabling Human-Centered Machine Translation Using Concept-Based Large Language Model Prompting and Translation Memory

M Qian, C Kong - International Conference on Human-Computer …, 2024 - Springer
… as machine translation tool in various studies and evaluations [1, 2]. Unlike traditional machine
translation (MT) tools such as Google Translate, … enables segment matching based on …

Low-resource neural machine translation: A case study of Cantonese

EKY Liu - Proceedings of the Ninth Workshop on NLP for Similar …, 2022 - aclanthology.org
… Although we used manual analysis along with SacreBLEU, having a non-matching based
… is that our Transformer MT systems performed worse than the BiLSTM systems in terms of …

Automatic classification of human translation and machine translation: A study from the perspective of lexical diversity

Y Fu, MJ Nederhof - arXiv preprint arXiv:2105.04616, 2021 - arxiv.org
machine translation and human translation be given more attention in machine translation
… into account when an n-gram matching based metric like BLEU is used for MT evaluation. …