Neural machine translation: A review

F Stahlberg - Journal of Artificial Intelligence Research, 2020 - jair.org
The field of machine translation (MT), the automatic translation of written text from one
natural language into another, has experienced a major paradigm shift in recent years …

Transformer: A general framework from machine translation to others

Y Zhao, J Zhang, C Zong - Machine Intelligence Research, 2023 - Springer
Abstract Machine translation is an important and challenging task that aims at automatically
translating natural language sentences from one language into another. Recently …

Molecular transformer: a model for uncertainty-calibrated chemical reaction prediction

P Schwaller, T Laino, T Gaudin, P Bolgar… - ACS central …, 2019 - ACS Publications
Organic synthesis is one of the key stumbling blocks in medicinal chemistry. A necessary yet
unsolved step in planning synthesis is solving the forward problem: Given reactants and …

Lift yourself up: Retrieval-augmented text generation with self-memory

X Cheng, D Luo, X Chen, L Liu… - Advances in Neural …, 2024 - proceedings.neurips.cc
With direct access to human-written reference as memory, retrieval-augmented generation
has achieved much progress in a wide range of text generation tasks. Since better memory …

Domain adaptation and multi-domain adaptation for neural machine translation: A survey

D Saunders - Journal of Artificial Intelligence Research, 2022 - jair.org
The development of deep learning techniques has allowed Neural Machine Translation
(NMT) models to become extremely powerful, given sufficient training data and training time …

Deep model fusion: A survey

W Li, Y Peng, M Zhang, L Ding, H Hu… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep model fusion/merging is an emerging technique that merges the parameters or
predictions of multiple deep learning models into a single one. It combines the abilities of …

Synchronous bidirectional neural machine translation

L Zhou, J Zhang, C Zong - Transactions of the Association for …, 2019 - direct.mit.edu
Existing approaches to neural machine translation (NMT) generate the target language
sequence token-by-token from left to right. However, this kind of unidirectional decoding …

Discriminative reranking for neural machine translation

A Lee, M Auli, MA Ranzato - … of the 59th Annual Meeting of the …, 2021 - aclanthology.org
Reranking models enable the integration of rich features to select a better output hypothesis
within an n-best list or lattice. These models have a long history in NLP, and we revisit …

Softcorrect: Error correction with soft detection for automatic speech recognition

Y Leng, X Tan, W Liu, K Song, R Wang, XY Li… - Proceedings of the …, 2023 - ojs.aaai.org
Error correction in automatic speech recognition (ASR) aims to correct those incorrect words
in sentences generated by ASR models. Since recent ASR models usually have low word …

Transcormer: Transformer for sentence scoring with sliding language modeling

K Song, Y Leng, X Tan, Y Zou… - Advances in Neural …, 2022 - proceedings.neurips.cc
Sentence scoring aims at measuring the likelihood score of a sentence and is widely used in
many natural language processing scenarios, like reranking, which is to select the best …