Human communication is naturally multimodal, and substantial focus has examined the
semantic correspondences in speech–gesture and text–image relationships. However …

Brands, both human and corporate, are increasingly communicating with their consumers
using emojis. The current work examines if and how these pictographs shape online brand …

This textbook provides the first foundational introduction to the practice of analysing
multimodality, covering the full breadth of media and situations in which multimodality needs …

Context Due to the unique characteristics of comics as a visual storytelling medium that
embraces a wide range of genres and aesthetic styles; comic recognition (CR) presents …

Text and image are used together in an increasingly flexible fashion and many disciplines
and areas of study are now attempting to understand how these combinations work. This …

In this chapter, a corpus of 100 instances of a specific type of meme, image macro (the one
typically made up of one top and one bottom stretch of text and a picture in-between), is …

Emojis are ideograms that are becoming ubiquitous in digital communication. However, no
research has yet investigated how humans process semantic and pragmatic content of …

Multimodal literacy is a term that originates in social semiotics, and refers to the study of
language that combines two or more modes of meaning. The related term, multimodality …

The current state of the art in multimodality appears to be reaching a consensus concerning
several central methods and perspectives that need to be applied in its study. This offers an …

Many authors of comics have metaphorically compared their writing process to that of
language. Jack 'King'Kirby, one of the most influential artists of mainstream American …