Findings of the second WMT shared task on sign language translation (WMT-SLT23)

M Müller, M Alikhani, E Avramidis, R Bowden… - Proceedings of the …, 2023 - hal.science
This paper presents the results of the Second WMT Shared Task on Sign Language
Translation (WMT-SLT23) 1. This shared task is concerned with automatic translation …

A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation

L Liu, L Gao, W Lei, F Ma, X Lin, J Wang - arXiv preprint arXiv:2308.08849, 2023 - arxiv.org
Body language (BL) refers to the non-verbal communication expressed through physical
movements, gestures, facial expressions, and postures. It is a form of communication that …

Sign2Pose: A Pose-Based Approach for Gloss Prediction Using a Transformer Model

J Eunice, Y Sei, DJ Hemanth - Sensors, 2023 - mdpi.com
Word-level sign language recognition (WSLR) is the backbone for continuous sign language
recognition (CSLR) that infers glosses from sign videos. Finding the relevant gloss from the …

You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification

A Addlesee, A Eshghi - Frontiers in Dementia, 2024 - frontiersin.org
In spontaneous conversation, speakers seldom have a full plan of what they are going to say
in advance: they need to conceptualise and plan incrementally as they articulate each word …

Techniques for Generating Sign Language a Comprehensive Review

PP Waghmare - Journal of The Institution of Engineers (India): Series B, 2024 - Springer
Sign verbal is an important communication medium regarding the community of Deaf and
Hard of Hearing, and advances in sign language generation techniques have helped to …

Unsupervised Sign Language Translation and Generation

Z Guo, Z He, W Jiao, X Wang, R Wang, K Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Motivated by the success of unsupervised neural machine translation (UNMT), we introduce
an unsupervised sign language translation and generation network (USLNet), which learns …

T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text

A Yin, H Li, K Shen, S Tang, Y Zhuang - arXiv preprint arXiv:2406.07119, 2024 - arxiv.org
In this work, we propose a two-stage sign language production (SLP) paradigm that first
encodes sign language sequences into discrete codes and then autoregressively generates …

[PDF][PDF] CCL24-Eval 任务10 系统报告: 结合LLM 与ThreeJS 的手语数字人系统

杨阳, 张颖, 黄锴宇, 徐金安 - 2024 - openreview.net
摘要手语翻译系统作为一种重要的辅助技术, 为听障人士提供了与他人沟通的有效途径. 然而,
传统手语翻译系统在准确性和自然性方面存在局限. 本文提出了一种结合大语言模型(LLM) …

[PDF][PDF] ISABEL: An Inclusive and Collaborative Task-Oriented Dialogue System

A Sicilia, Y Asano, K Atwell, Q Cheng… - Alexa Prize …, 2023 - assets.amazon.science
In the rapidly evolving landscape of multimodal interactive technologies, a critical gap
persists in their utility and reach across diverse user populations. These technologies, while …

[PDF][PDF] Practical Tools from Domain Adaptation for Designing Inclusive, Equitable, and Robust Generative AI

A Sicilia, M Alikhani - Proceedings of the 13th International Joint …, 2023 - aclanthology.org
Generative language technologies have become integral to everyday communication,
shaping social interactions and informing critical decision-making processes in areas such …