A survey on non-autoregressive generation for neural machine translation and beyond

Y Xiao, L Wu, J Guo, J Li, M Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Non-autoregressive (NAR) generation, which is first proposed in neural machine translation
(NMT) to speed up inference, has attracted much attention in both machine learning and …

Glancing transformer for non-autoregressive neural machine translation

L Qian, H Zhou, Y Bao, M Wang, L Qiu… - arXiv preprint arXiv …, 2020 - arxiv.org
Recent work on non-autoregressive neural machine translation (NAT) aims at improving the
efficiency by parallel decoding without sacrificing the quality. However, existing NAT …

Fully non-autoregressive neural machine translation: Tricks of the trade

J Gu, X Kong - arXiv preprint arXiv:2012.15833, 2020 - arxiv.org
Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously
predict tokens with single forward of neural networks, which significantly reduces the …

Non-autoregressive machine translation with latent alignments

C Saharia, W Chan, S Saxena, M Norouzi - arXiv preprint arXiv …, 2020 - arxiv.org
This paper presents two strong methods, CTC and Imputer, for non-autoregressive machine
translation that model latent alignments with dynamic programming. We revisit CTC for …

Order-agnostic cross entropy for non-autoregressive machine translation

C Du, Z Tu, J Jiang - International conference on machine …, 2021 - proceedings.mlr.press
We propose a new training objective named order-agnostic cross entropy (OaXE) for fully
non-autoregressive translation (NAT) models. OaXE improves the standard cross-entropy …

A survey of non-autoregressive neural machine translation

F Li, J Chen, X Zhang - Electronics, 2023 - mdpi.com
Non-autoregressive neural machine translation (NAMT) has received increasing attention
recently in virtue of its promising acceleration paradigm for fast decoding. However, these …

Guiding non-autoregressive neural machine translation decoding with reordering information

Q Ran, Y Lin, P Li, J Zhou - Proceedings of the AAAI Conference on …, 2021 - ojs.aaai.org
Non-autoregressive neural machine translation (NAT) generates each target word in parallel
and has achieved promising inference acceleration. However, existing NAT models still …

AligNART: Non-autoregressive neural machine translation by jointly learning to estimate alignment and translate

J Song, S Kim, S Yoon - arXiv preprint arXiv:2109.06481, 2021 - arxiv.org
Non-autoregressive neural machine translation (NART) models suffer from the multi-
modality problem which causes translation inconsistency such as token repetition. Most …

Vigdet: Knowledge informed neural temporal point process for coordination detection on social media

Y Zhang, K Sharma, Y Liu - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Recent years have witnessed an increasing use of coordinated accounts on social media,
operated by misinformation campaigns to influence public opinion and manipulate social …

On the learning of non-autoregressive transformers

F Huang, T Tao, H Zhou, L Li… - … Conference on Machine …, 2022 - proceedings.mlr.press
Non-autoregressive Transformer (NAT) is a family of text generation models, which aims to
reduce the decoding latency by predicting the whole sentences in parallel. However, such …