Style transfer for co-speech gesture animation: A multi-speaker conditional-mixture approach

C Ahuja, DW Lee, YI Nakano, LP Morency - Computer Vision–ECCV 2020 …, 2020 - Springer
How can we teach robots or virtual assistants to gesture naturally? Can we go further and
adapt the gesturing style to follow a specific speaker? Gestures that are naturally timed with …

Text-free image-to-speech synthesis using learned segmental units

WN Hsu, D Harwath, C Song, J Glass - arXiv preprint arXiv:2012.15454, 2020 - arxiv.org
In this paper we present the first model for directly synthesizing fluent, natural-sounding
spoken audio captions for images that does not require natural language text as an …

Data efficient voice cloning from noisy samples with domain adversarial training

J Cong, S Yang, L Xie, G Yu, G Wan - arXiv preprint arXiv:2008.04265, 2020 - arxiv.org
Data efficient voice cloning aims at synthesizing target speaker's voice with only a few
enrollment samples at hand. To this end, speaker adaptation and speaker encoding are two …

Denoising-and-dereverberation hierarchical neural vocoder for statistical parametric speech synthesis

Y Ai, ZH Ling, WL Wu, A Li - IEEE/ACM Transactions on Audio …, 2022 - ieeexplore.ieee.org
This paper presents a denoising and dereverberation hierarchical neural vocoder (DNR-
HiNet) to convert noisy and reverberant acoustic features into clean speech waveforms. The …

Adversarial feature learning and unsupervised clustering based speech synthesis for found data with acoustic and textual noise

S Yang, Y Wang, L Xie - IEEE Signal Processing Letters, 2020 - ieeexplore.ieee.org
Attention-based sequence-to-sequence (seq2seq) speech synthesis has achieved
extraordinary performance. But a studio-quality corpus with manual transcription is …

[PDF][PDF] Communication Beyond Words: Grounding Visual Body Motion with Language

C Ahuja - 2022 - lti.cs.cmu.edu
Communication is essential in sharing knowledge and ideas. It encourages collaboration
and teamwork, an important step towards inducing positive change in human societies. It is …