In this paper, we study articulatory synthesis, a speech synthesis method using human vocal
tract information that offers a way to develop efficient, generalizable and interpretable …

Advancements in generative artificial intelligence have made it easier to manipulate auditory
and visual elements, highlighting the critical need for robust audio–visual deepfake …

Within speech processing, articulatory-to-acoustic mapping (AAM) methods can apply
ultrasound tongue imaging (UTI) as an input.(Micro) convex transducers are mostly used …

We devise an articulatory representation-based text-to-speech (TTS) model, ArtSpeech, an
explainable and effective network for human-like speech synthesis, by revisiting the sound …

Silent speech interfaces (SSIs) have emerged as innovative non-acoustic communication
methods, and our previous study demonstrated the significant potential of three-axis …

Previous speech synthesis models from articulatory movements recorded using real-time
MRI (rtMRI) only predicted vocal tract shape parameters and required additional pitch …

Articulatory-to-acoustic mapping seeks to reconstruct speech from a recording of the
articulatory movements, for example, an ultrasound video. Just like speech signals, these …

This paper presents a data-driven model of intelligibility which is intended to be used in an
optimization-based model of speech production. The BiLSTM-based model is trained as a …

Thanks to the latest deep learning algorithms, silent speech interfaces (SSI) are now able to
synthesize intelligible speech from articulatory movement data under certain conditions …

In environments characterised by noise or the absence of audio signals, visual cues, notably
facial and lip movements, serve as valuable substitutes for missing or corrupted speech …