Neural machine translation: A review

F Stahlberg - Journal of Artificial Intelligence Research, 2020 - jair.org
The field of machine translation (MT), the automatic translation of written text from one
natural language into another, has experienced a major paradigm shift in recent years …

[HTML][HTML] Progress in neural NLP: modeling, learning, and reasoning

M Zhou, N Duan, S Liu, HY Shum - Engineering, 2020 - Elsevier
Natural language processing (NLP) is a subfield of artificial intelligence that focuses on
enabling computers to understand and process human languages. In the last five years, we …

Domain adaptation and multi-domain adaptation for neural machine translation: A survey

D Saunders - Journal of Artificial Intelligence Research, 2022 - jair.org
The development of deep learning techniques has allowed Neural Machine Translation
(NMT) models to become extremely powerful, given sufficient training data and training time …

Distilling knowledge learned in BERT for text generation

YC Chen, Z Gan, Y Cheng, J Liu, J Liu - arXiv preprint arXiv:1911.03829, 2019 - arxiv.org
Large-scale pre-trained language model such as BERT has achieved great success in
language understanding tasks. However, it remains an open question how to utilize BERT …

[HTML][HTML] Neural machine translation: A review of methods, resources, and tools

Z Tan, S Wang, Z Yang, G Chen, X Huang, M Sun… - AI Open, 2020 - Elsevier
Abstract Machine translation (MT) is an important sub-field of natural language processing
that aims to translate natural languages using computers. In recent years, end-to-end neural …

Handwritten mathematical expression recognition with bidirectionally trained transformer

W Zhao, L Gao, Z Yan, S Peng, L Du… - Document analysis and …, 2021 - Springer
Encoder-decoder models have made great progress on handwritten mathematical
expression recognition recently. However, it is still a challenge for existing methods to …

Transformer: A general framework from machine translation to others

Y Zhao, J Zhang, C Zong - Machine Intelligence Research, 2023 - Springer
Abstract Machine translation is an important and challenging task that aims at automatically
translating natural language sentences from one language into another. Recently …

Neural machine translation: Challenges, progress and future

J Zhang, C Zong - Science China Technological Sciences, 2020 - Springer
Abstract Machine translation (MT) is a technique that leverages computers to translate
human languages automatically. Nowadays, neural machine translation (NMT) which …

Meet in the middle: A new pre-training paradigm

A Nguyen, N Karampatziakis… - Advances in Neural …, 2024 - proceedings.neurips.cc
Most language models (LMs) are trained and applied in an autoregressive left-to-right
fashion, predicting the next token from the preceding ones. However, this ignores that the full …

Regularizing end-to-end speech translation with triangular decomposition agreement

Y Du, Z Zhang, W Wang, B Chen, J Xie… - Proceedings of the AAAI …, 2022 - ojs.aaai.org
End-to-end speech-to-text translation (E2E-ST) is becoming increasingly popular due to the
potential of its less error propagation, lower latency, and fewer parameters. Given the triplet …