Analysis methods in neural language processing: A survey

Y Belinkov, J Glass - … of the Association for Computational Linguistics, 2019 - direct.mit.edu
The field of natural language processing has seen impressive progress in recent years, with
neural network models replacing many of the traditional systems. A plethora of new models …

Improving the reliability of deep neural networks in NLP: A review

B Alshemali, J Kalita - Knowledge-Based Systems, 2020 - Elsevier
Deep learning models have achieved great success in solving a variety of natural language
processing (NLP) problems. An ever-growing body of research, however, illustrates the …

Synthetic and natural noise both break neural machine translation

Y Belinkov, Y Bisk - arXiv preprint arXiv:1711.02173, 2017 - arxiv.org
Character-based neural machine translation (NMT) models alleviate out-of-vocabulary
issues, learn morphology, and move us closer to completely end-to-end translation systems …

Waffling around for performance: Visual classification with random words and broad concepts

K Roth, JM Kim, A Koepke, O Vinyals… - Proceedings of the …, 2023 - openaccess.thecvf.com
The visual classification performance of vision-language models such as CLIP has been
shown to benefit from additional semantic knowledge from large language models (LLMs) …

Evaluating the robustness of neural language models to input perturbations

M Moradi, M Samwald - arXiv preprint arXiv:2108.12237, 2021 - arxiv.org
High-performance neural language models have obtained state-of-the-art results on a wide
range of Natural Language Processing (NLP) tasks. However, results for common …

Automatic testing and improvement of machine translation

Z Sun, JM Zhang, M Harman, M Papadakis… - Proceedings of the ACM …, 2020 - dl.acm.org
This paper presents TransRepair, a fully automatic approach for testing and repairing the
consistency of machine translation systems. TransRepair combines mutation with …

Improving machine translation systems via isotopic replacement

Z Sun, JM Zhang, Y Xiong, M Harman… - Proceedings of the 44th …, 2022 - dl.acm.org
Machine translation plays an essential role in people's daily international communication.
However, machine translation systems are far from perfect. To tackle this problem …

Training on synthetic noise improves robustness to natural noise in machine translation

V Karpukhin, O Levy, J Eisenstein… - Proceedings of the 5th …, 2019 - aclanthology.org
Contemporary machine translation systems achieve greater coverage by applying subword
models such as BPE and character-level CNNs, but these methods are highly sensitive to …

Don't take the premise for granted: Mitigating artifacts in natural language inference

Y Belinkov, A Poliak, SM Shieber, B Van Durme… - arXiv preprint arXiv …, 2019 - arxiv.org
Natural Language Inference (NLI) datasets often contain hypothesis-only biases---artifacts
that allow models to achieve non-trivial performance without learning whether a premise …

Findings of the first shared task on machine translation robustness

X Li, P Michel, A Anastasopoulos, Y Belinkov… - arXiv preprint arXiv …, 2019 - arxiv.org
We share the findings of the first shared task on improving robustness of Machine
Translation (MT). The task provides a testbed representing challenges facing MT models …