Natural tts synthesis by conditioning wavenet on mel spectrogram predictions

J Shen, R Pang, RJ Weiss, M Schuster… - … on acoustics, speech …, 2018 - ieeexplore.ieee.org
2018 IEEE international conference on acoustics, speech and signal …, 2018ieeexplore.ieee.org
This paper describes Tacotron 2, a neural network architecture for speech synthesis directly
from text. The system is composed of a recurrent sequence-to-sequence feature prediction
network that maps character embeddings to mel-scale spectrograms, followed by a modified
WaveNet model acting as a vocoder to synthesize time-domain waveforms from those
spectrograms. Our model achieves a mean opinion score (MOS) of 4.53 comparable to a
MOS of 4.58 for professionally recorded speech. To validate our design choices, we present …
This paper describes Tacotron 2, a neural network architecture for speech synthesis directly from text. The system is composed of a recurrent sequence-to-sequence feature prediction network that maps character embeddings to mel-scale spectrograms, followed by a modified WaveNet model acting as a vocoder to synthesize time-domain waveforms from those spectrograms. Our model achieves a mean opinion score (MOS) of 4.53 comparable to a MOS of 4.58 for professionally recorded speech. To validate our design choices, we present ablation studies of key components of our system and evaluate the impact of using mel spectrograms as the conditioning input to WaveNet instead of linguistic, duration, and F0 features. We further show that using this compact acoustic intermediate representation allows for a significant reduction in the size of the WaveNet architecture.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果