An overview on machine translation evaluation
L Han - arXiv preprint arXiv:2202.11027, 2022 - arxiv.org
Since the 1950s, machine translation (MT) has become one of the important tasks of AI and
development, and has experienced several different periods and stages of development …
development, and has experienced several different periods and stages of development …
Medtem2. 0: Prompt-based temporal classification of treatment events from discharge summaries
Discharge summaries are comprehensive medical records that encompass vital information
about a patient's hospital stay. A crucial aspect of discharge summaries is the temporal …
about a patient's hospital stay. A crucial aspect of discharge summaries is the temporal …
HOPE: A task-oriented and human-centric evaluation framework using professional post-editing towards more effective MT evaluation
S Gladkoff, L Han - arXiv preprint arXiv:2112.13833, 2021 - arxiv.org
Traditional automatic evaluation metrics for machine translation have been widely criticized
by linguists due to their low accuracy, lack of transparency, focus on language mechanics …
by linguists due to their low accuracy, lack of transparency, focus on language mechanics …
Investigating massive multilingual pre-trained machine translation models for clinical domain via transfer learning
Massively multilingual pre-trained language models (MMPLMs) are developed in recent
years demonstrating superpowers and the pre-knowledge they acquire for downstream …
years demonstrating superpowers and the pre-knowledge they acquire for downstream …
Topic modelling of swedish newspaper articles about coronavirus: a case study using latent dirichlet allocation method
Topic Modelling (TM) is a natural language processing (NLP) method for discovering topics
in a collection of documents. Being an unsupervised method, it is a valuable tool when trying …
in a collection of documents. Being an unsupervised method, it is a valuable tool when trying …
Toward more effective human evaluation for machine translation
Improvements in text generation technologies such as machine translation have
necessitated more costly and time-consuming human evaluation procedures to ensure an …
necessitated more costly and time-consuming human evaluation procedures to ensure an …
cushLEPOR: customising hLEPOR metric using optuna for higher agreement with human judgments or pre-trained language model LaBSE
Human evaluation has always been expensive while researchers struggle to trust the
automatic metrics. To address this, we propose to customise traditional metrics by taking …
automatic metrics. To address this, we propose to customise traditional metrics by taking …
Student's t-Distribution: On Measuring the Inter-Rater Reliability When the Observations are Scarce
In natural language processing (NLP) we always rely on human judgement as the golden
quality evaluation method. However, there has been an ongoing debate on how to better …
quality evaluation method. However, there has been an ongoing debate on how to better …
A Comparative Study on Automatic Coding of Medical Letters with Explainability
This study aims to explore the implementation of Natural Language Processing (NLP) and
machine learning (ML) techniques to automate the coding of medical letters with visualised …
machine learning (ML) techniques to automate the coding of medical letters with visualised …
Readability metrics for machine translation in Dutch: Google vs. Azure & IBM
C van Toledo, M Schraagen, F van Dijk, M Brinkhuis… - Applied Sciences, 2023 - mdpi.com
This paper introduces a novel method to predict when a Google translation is better than
other machine translations (MT) in Dutch. Instead of considering fidelity, this approach …
other machine translations (MT) in Dutch. Instead of considering fidelity, this approach …