Large language models and games: A survey and roadmap

R Gallotta, G Todd, M Zammit, S Earle, A Liapis… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent years have seen an explosive increase in research on large language models
(LLMs), and accompanying public engagement on the topic. While starting as a niche area …

Embedding large language models into extended reality: Opportunities and challenges for inclusion, engagement, and privacy

E Bozkir, S Özdel, KHC Lau, M Wang, H Gao… - Proceedings of the 6th …, 2024 - dl.acm.org
Advances in artificial intelligence and human-computer interaction will likely lead to
extended reality (XR) becoming pervasive. While XR can provide users with interactive …

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

N Numan, S Rajaram, BT Kumaravel… - Proceedings of the 37th …, 2024 - dl.acm.org
There is increased interest in using generative AI to create 3D spaces for Virtual Reality (VR)
applications. However, today's models produce artificial environments, falling short of …

How people prompt generative ai to create interactive vr scenes

S Aghel Manesh, T Zhang, Y Onishi, K Hara… - Proceedings of the …, 2024 - dl.acm.org
Generative AI tools can provide people with the ability to create virtual environments and
scenes with natural language prompts. Yet, how people will formulate such prompts is …

What's the Game, then? Opportunities and Challenges for Runtime Behavior Generation

N Jennings, H Wang, I Li, J Smith… - Proceedings of the 37th …, 2024 - dl.acm.org
Procedural content generation (PCG), the process of algorithmically creating game
components instead of manually, has been a common tool of game development for …

SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMs

W Qian, C Gao, A Sathya, R Suzuki… - Proceedings of the 37th …, 2024 - dl.acm.org
This paper introduces text-to-shape-display, a novel approach to generating dynamic shape
changes in pin-based shape displays through natural language commands. By leveraging …

DreamCodeVR: Towards Democratizing Behavior Design in Virtual Reality with Speech-Driven Programming

D Giunchi, N Numan, E Gatti… - 2024 IEEE Conference …, 2024 - ieeexplore.ieee.org
Virtual Reality (VR) has revolutionized how we interact with digital worlds. However,
programming for VR remains a complex and challenging task, requiring specialized skills …

How Secure Are Large Language Models (LLMs) for Navigation in Urban Environments?

C Wen, J Liang, S Yuan, H Huang, Y Fang - arXiv preprint arXiv …, 2024 - arxiv.org
In the field of robotics and automation, navigation systems based on Large Language
Models (LLMs) have recently shown impressive performance. However, the security aspects …

When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models

X Ma, Y Bhalgat, B Smart, S Chen, X Li, J Ding… - arXiv preprint arXiv …, 2024 - arxiv.org
As large language models (LLMs) evolve, their integration with 3D spatial data (3D-LLMs)
has seen rapid progress, offering unprecedented capabilities for understanding and …

Wrapped in Anansi's Web: Unweaving the Impacts of Generative-AI Personalization and VR Immersion in Oral Storytelling

KHC Lau, B Yun, S Saruba, E Bozkir… - arXiv preprint arXiv …, 2024 - arxiv.org
Oral traditions, vital to cultural identity, are losing relevance among youth due to the
dominance of modern media. This study addresses the revitalization of these traditions by …