In this paper, we describe a user study evaluating the usability of an augmented reality (AR)
multimodal interface (MMI). We have developed an AR MMI that combines free-hand …

In this paper we describe a Wizard of Oz (WOz) user study of an Augmented Reality (AR)
interface that uses multimodal input (MMI) with natural hand interaction and speech …

New technologies, such as multi-touch tables, increasingly provide shareable interfaces
where multiple people can simultaneously interact, enabling co-located groups to …

True multi-user, multimodal interaction over a digital table lets co-located people
simultaneously gesture and speak commands to control an application. We explore this …

To realize the potential of multi-touch tables, interaction designers need to create
meaningful applications for them in real-world contexts. One convenient shortcut towards …

Current virtual environment (VEs) input techniques often overlook speech as a useful control
modality. Speech could improve interaction in multimodal VEs by enabling users to address …

Co-located collaborators often work over physical tabletops using combinations of
expressive hand gestures and verbal utterances. This paper provides the first observations …

The use of multiple modes of user input to interact with computers and devices is an active
area of human computer interaction research. With the advent of more powerful perceptual …

While digital tables can be used with existing applications, they are typically limited by the
one user per computer assumption of current operating systems. In this paper, we explore …

The performance of current speech recognition algorithms is well below that of human
speech recognition, with high number of misrecognized words in quiet environments and …