Multilingual multimodality: A taxonomical survey of datasets, techniques, challenges and opportunities

KR Chandu, A Geramifard - arXiv preprint arXiv:2210.16960, 2022 - arxiv.org
Contextualizing language technologies beyond a single language kindled embracing
multiple modalities and languages. Individually, each of these directions undoubtedly …

Solving the interface problem without translation: The same format thesis

G Ferretti, SZ Caiani - Pacific Philosophical Quarterly, 2019 - Wiley Online Library
In this article, we propose a new account concerning the interlock between intentions and
motor representations (henceforth: MRs), showing that the interface problem is not as deep …

Fatality killed the cat or: BabelPic, a multimodal dataset for non-concrete concepts

A Calabrese, M Bevilacqua, R Navigli - Proceedings of the 58th …, 2020 - iris.uniroma1.it
Thanks to the wealth of high-quality annotated images available in popular repositories such
as ImageNet, multimodal language-vision research is in full bloom. However, events …

CNAMD Corpus: A Chinese Natural Audiovisual Multimodal Database of Conversations for Social Interactive Agents

J Wu, S Chen, W Xiang, L Sun, H Zhang… - … Journal of Human …, 2024 - Taylor & Francis
Impressive progress has been made in developing companion Socially Interactive Agents
(SIAs) that provide companionship and reduce loneliness. However, recent works focus on …

How are gestures used by politicians? A multimodal co-gesture analysis

D Trotta, R Guarasci - IJCoL. Italian Journal of …, 2021 - journals.openedition.org
Gestures are an inseparable part of the language system (McNeill 2005; Kendon 2004), they
are semantically co-expressive with speech serving different semantic functions to …

Adding gesture, posture and facial displays to the polimodal corpus of political interviews

D Trotta, A Palmero Aprosio, S Tonelli… - Proceedings of the 12th …, 2020 - cris.fbk.eu
This paper introduces a multimodal corpus in the political domain, which on top of
transcribed face-to-face interviews presents the annotation of facial displays, hand gestures …

[PDF][PDF] Identification of Multiword Expressions: Comparing the Performance of a Conditional Random Fields Model on Corpora of Written and Spoken Italian.

I Manfredi, L Gregori - CLiC-it, 2023 - ceur-ws.org
This paper describes an experiment that compares the performance of a Conditional
Random Fields model on identification of Multiword expressions in corpora of spoken and …

[PDF][PDF] LABLITA-SUITE. Risorse per l'acquisizione dell'italiano L2

M Moneglia - Kwartalnik Neofilologiczny, 2019 - bibliotekanauki.pl
LABLITA-Suite. Resources for the acquisition of Italian as a second language–LABLITA-
suite provides technology-enhanced learning resources for the acquisition of Italian L2 …

[PDF][PDF] One event, many representations. Mapping action concepts through visual features.

A Panunzi, L Gregori, AA Ravelli - Proceedings of the Eleventh …, 2018 - aclanthology.org
This paper faces the problem of unifying the representation of actions and events in different
semantic resources. The proposed solution exploits the IMAGACT visual component (video …

Italian Multimodal Corpus: Verbal and Non-Verbal Communication in Political Domain

D Trotta - 2023 - elea.unisa.it
-Speaker gestures are semantically co-expressive with speech and serve different pragmatic
functions to accompany oral modality. Therefore, gestures are an inseparable part of the …