Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension
Embodied perception is essential for intelligent vehicles and robots, enabling more natural
interaction and task execution. However, these advancements currently embrace vision …
interaction and task execution. However, these advancements currently embrace vision …
Transcrib3D: 3D Referring Expression Resolution through Large Language Models
If robots are to work effectively alongside people, they must be able to interpret natural
language references to objects in their 3D environment. Understanding 3D referring …
language references to objects in their 3D environment. Understanding 3D referring …
Transcribe3D: Grounding LLMs Using Transcribed Information for 3D Referential Reasoning with Self-Corrected Finetuning
If robots are to work effectively alongside people, they must be able to interpret natural
language references to objects in their 3D environment. Understanding 3D referring …
language references to objects in their 3D environment. Understanding 3D referring …
3d-stmn: Dependency-driven superpoint-text matching network for end-to-end 3d referring expression segmentation
In 3D Referring Expression Segmentation (3D-RES), the earlier approach adopts a two-
stage paradigm, extracting segmentation proposals and then matching them with referring …
stage paradigm, extracting segmentation proposals and then matching them with referring …
Spatiality-guided transformer for 3d dense captioning on point clouds
Dense captioning in 3D point clouds is an emerging vision-and-language task involving
object-level 3D scene understanding. Apart from coarse semantic class prediction and …
object-level 3D scene understanding. Apart from coarse semantic class prediction and …
Reason3D: Searching and Reasoning 3D Segmentation via Large Language Model
Recent advancements in multimodal large language models (LLMs) have shown their
potential in various domains, especially concept reasoning. Despite these developments …
potential in various domains, especially concept reasoning. Despite these developments …
Language-guided 3d object detection in point cloud for autonomous driving
This paper addresses the problem of 3D referring expression comprehension (REC) in
autonomous driving scenario, which aims to ground a natural language to the targeted …
autonomous driving scenario, which aims to ground a natural language to the targeted …
MiniGPT-3D: Efficiently Aligning 3D Point Clouds with Large Language Models using 2D Priors
Large 2D vision-language models (2D-LLMs) have gained significant attention by bridging
Large Language Models (LLMs) with images using a simple projector. Inspired by their …
Large Language Models (LLMs) with images using a simple projector. Inspired by their …
Vote2cap-detr++: Decoupling localization and describing for end-to-end 3d dense captioning
3D dense captioning requires a model to translate its understanding of an input 3D scene
into several captions associated with different object regions. Existing methods adopt a …
into several captions associated with different object regions. Existing methods adopt a …
ARKitSceneRefer: Text-based Localization of Small Objects in Diverse Real-World 3D Indoor Scenes
Abstract 3D referring expression comprehension is a task to ground text representations
onto objects in 3D scenes. It is a crucial task for indoor household robots or augmented …
onto objects in 3D scenes. It is a crucial task for indoor household robots or augmented …