We live in a world where there are countless interactions with computer systems in every-
day situations. In the most ideal case, this interaction feels as familiar and as natural as the …

People naturally move their heads when they speak, and our study shows that this rhythmic
head motion conveys linguistic information. Three-dimensional head and face motion and …

This paper examines the degrees of correlation among vocal-tract and facial movement data
and the speech acoustics. Multilinear techniques are applied to support the claims that facial …

We have made significant progress in automatic speech recognition ASR for well-defined
applications like dictation and medium vocabulary transaction processing tasks in relatively …

Facial motion during speech is a direct consequence of vocal-tract motion which also
shapes the acoustics of speech. This fact suggests that speech acoustics can be used to …

Virtual Humans are becoming more and more popular and used in many applications such
as the entertainment industry (in both film and games) and medical applications. This …

Visual and auditory modalities are two of the most commonly used media in interactions
between humans. The authors describe a system to continuously monitor the user's voice …

In this chapter we address the audiovisual integration of information for speech. We first
summarize the spatial and temporal features of normal speech communication and the …

This thesis presents work in the area of computer animated talking heads. A system for
multimodal speech synthesis has been developed, capable of generating audiovisual …

This paper presents technical refinements and extensions of our system for correlating
audible and visible components of speech behavior and subsequently using those …