Non-autoregressive machine translation with probabilistic context-free grammar

S Gui, C Shao, Z Ma, Y Chen… - Advances in Neural …, 2024 - proceedings.neurips.cc
Non-autoregressive Transformer (NAT) significantly accelerates the inference of neural
machine translation. However, conventional NAT models suffer from limited expression …

Non-autoregressive streaming transformer for simultaneous translation

Z Ma, S Zhang, S Guo, C Shao, M Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Simultaneous machine translation (SiMT) models are trained to strike a balance between
latency and translation quality. However, training these models to achieve high quality while …

Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?

Q Fang, S Zhang, Z Ma, M Zhang, Y Feng - arXiv preprint arXiv …, 2024 - arxiv.org
Recently proposed two-pass direct speech-to-speech translation (S2ST) models decompose
the task into speech-to-text translation (S2TT) and text-to-speech (TTS) within an end-to-end …

CTC-based Non-autoregressive Textless Speech-to-Speech Translation

Q Fang, Z Ma, Y Zhou, M Zhang, Y Feng - arXiv preprint arXiv:2406.07330, 2024 - arxiv.org
Direct speech-to-speech translation (S2ST) has achieved impressive translation quality, but
it often faces the challenge of slow decoding due to the considerable length of speech …

DiffNorm: Self-Supervised Normalization for Non-autoregressive Speech-to-speech Translation

W Tan, J Zhang, L Shen, D Khashabi… - arXiv preprint arXiv …, 2024 - arxiv.org
Non-autoregressive Transformers (NATs) are recently applied in direct speech-to-speech
translation systems, which convert speech across different languages without intermediate …

Automatic Speech-to-Speech Translation of Educational Videos Using SeamlessM4T and Its Use for Future VR Applications

LRS Gris, D Fernandes… - 2024 IEEE Conference …, 2024 - ieeexplore.ieee.org
Automatic Speech-to-Speech Translation (S2ST) is crucial for VR, providing immersive
experiences and global accessibility. For this task, cascade pipelines are often used, but it …