Grounding Conversational Robots on Vision Through Dense Captioning and Large Language Models

L Grassi, Z Hong, CT Recchiuto… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
This work explores a novel approach to empowering robots with visual perception
capabilities using textual descriptions. Our approach involves the integration of GPT-4 with …

Sustainable cloud services for verbal interaction with embodied agents

L Grassi, CT Recchiuto, A Sgorbissa - Intelligent Service Robotics, 2023 - Springer
This article presents the design and the implementation of a cloud system for knowledge-
based autonomous interaction devised for Social Robots and other conversational agents …

Social Robotics and Intercultural Pedagogy

J Joy, A Bartolini, M Milella, A Sgorbissa… - … on Control and …, 2024 - ieeexplore.ieee.org
Culturally Sustaining Pedagogy has emerged in recent years as a fundamental theoretical
approach to incorporating children's different languages, cultures, and identities into the …

Enhancing LLM-Based Human-Robot Interaction with Nuances for Diversity Awareness

L Grassi, CT Recchiuto, A Sgorbissa - arXiv preprint arXiv:2406.17531, 2024 - arxiv.org
This paper presents a system for diversity-aware autonomous conversation leveraging the
capabilities of large language models (LLMs). The system adapts to diverse populations and …

Imitation of human motion achieves natural head movements for humanoid robots in an active-speaker detection task

B Ding, M Kirtay, G Spigler - arXiv preprint arXiv:2407.11915, 2024 - arxiv.org
Head movements are crucial for social human-human interaction. They can transmit
important cues (eg, joint attention, speaker detection) that cannot be achieved with verbal …