Contextual modeling for 3d dense captioning on point clouds

Y Zhong, L Xu, J Luo, L Ma - arXiv preprint arXiv:2210.03925, 2022 - arxiv.org
3D dense captioning, as an emerging vision-language task, aims to identify and locate each
object from a set of point clouds and generate a distinctive natural language sentence for …

Spatiality-guided transformer for 3d dense captioning on point clouds

H Wang, C Zhang, J Yu, W Cai - arXiv preprint arXiv:2204.10688, 2022 - arxiv.org
Dense captioning in 3D point clouds is an emerging vision-and-language task involving
object-level 3D scene understanding. Apart from coarse semantic class prediction and …

More: Multi-order relation mining for dense captioning in 3d scenes

Y Jiao, S Chen, Z Jie, J Chen, L Ma… - European Conference on …, 2022 - Springer
Abstract 3D dense captioning is a recently-proposed novel task, where point clouds contain
more geometric information than the 2D counterpart. However, it is also more challenging …

A comprehensive survey of 3d dense captioning: Localizing and describing objects in 3d scenes

T Yu, X Lin, S Wang, W Sheng… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Three-Dimensional (3D) dense captioning is an emerging vision-language bridging task that
aims to generate multiple detailed and accurate descriptions for 3D scenes. It presents …

RPCS v2. 0: Object-detection-based recurrent point cloud selection method for 3D dense captioning

S Hayashi, Z Zhang, J Zhou - Neurocomputing, 2024 - Elsevier
Abstract 3D dense captioning is the process of generating natural language descriptions for
objects in a 3D scene, represented as RGB-D scans or point clouds. Three problems …

3djcg: A unified framework for joint dense captioning and visual grounding on 3d point clouds

D Cai, L Zhao, J Zhang, L Sheng… - Proceedings of the …, 2022 - openaccess.thecvf.com
Observing that the 3D captioning task and the 3D grounding task contain both shared and
complementary information in nature, in this work, we propose a unified framework to jointly …

X-trans2cap: Cross-modal knowledge transfer using transformer for 3d dense captioning

Z Yuan, X Yan, Y Liao, Y Guo, G Li… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract 3D dense captioning aims to describe individual objects by natural language in 3D
scenes, where 3D scenes are usually represented as RGB-D scans or point clouds …

TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenes

B Jin, Y Zheng, P Li, W Li, Y Zheng, S Hu, X Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
3D dense captioning stands as a cornerstone in achieving a comprehensive understanding
of 3D scenes through natural language. It has recently witnessed remarkable achievements …

Complete 3d relationships extraction modality alignment network for 3d dense captioning

A Mao, Z Yang, W Chen, R Yi… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
3D dense captioning aims to semantically describe each object detected in a 3D scene,
which plays a significant role in 3D scene understanding. Previous works lack a complete …

View selection for 3d captioning via diffusion ranking

T Luo, J Johnson, H Lee - arXiv preprint arXiv:2404.07984, 2024 - arxiv.org
Scalable annotation approaches are crucial for constructing extensive 3D-text datasets,
facilitating a broader range of applications. However, existing methods sometimes lead to …