[PDF][PDF] UniT3D: A Unified Transformer for 3D Dense Captioning and Visual Grounding Supplementary Material

DZ Chen, R Hu, X Chen, M Nießner, AX Chang - openaccess.thecvf.com
In this supplementary material, we provide detailed dense captioning results on the
ScanRefer dataset in Sec. 1. To showcase the effectiveness of the proposed pre-training …

End-to-end 3d dense captioning with vote2cap-detr

S Chen, H Zhu, X Chen, Y Lei… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract 3D dense captioning aims to generate multiple captions localized with their
associated object regions. Existing methods follow a sophisticated" detect-then-describe" …

X-trans2cap: Cross-modal knowledge transfer using transformer for 3d dense captioning

Z Yuan, X Yan, Y Liao, Y Guo, G Li… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract 3D dense captioning aims to describe individual objects by natural language in 3D
scenes, where 3D scenes are usually represented as RGB-D scans or point clouds …

Complete 3d relationships extraction modality alignment network for 3d dense captioning

A Mao, Z Yang, W Chen, R Yi… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
3D dense captioning aims to semantically describe each object detected in a 3D scene,
which plays a significant role in 3D scene understanding. Previous works lack a complete …

Spatiality-guided transformer for 3d dense captioning on point clouds

H Wang, C Zhang, J Yu, W Cai - arXiv preprint arXiv:2204.10688, 2022 - arxiv.org
Dense captioning in 3D point clouds is an emerging vision-and-language task involving
object-level 3D scene understanding. Apart from coarse semantic class prediction and …

Vote2cap-detr++: Decoupling localization and describing for end-to-end 3d dense captioning

S Chen, H Zhu, M Li, X Chen, P Guo… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
3D dense captioning requires a model to translate its understanding of an input 3D scene
into several captions associated with different object regions. Existing methods adopt a …

Rethinking 3D Dense Caption and Visual Grounding in A Unified Framework through Prompt-based Localization

Y Luo, H Lin, X Zheng, Y Jiang, F Chao, J Hu… - arXiv preprint arXiv …, 2024 - arxiv.org
3D Visual Grounding (3DVG) and 3D Dense Captioning (3DDC) are two crucial tasks in
various 3D applications, which require both shared and complementary information in …

More: Multi-order relation mining for dense captioning in 3d scenes

Y Jiao, S Chen, Z Jie, J Chen, L Ma… - European Conference on …, 2022 - Springer
Abstract 3D dense captioning is a recently-proposed novel task, where point clouds contain
more geometric information than the 2D counterpart. However, it is also more challenging …

[PDF][PDF] Supplementary Material for D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding

In this supplementary material, we provide results on the ReferIt3D dataset in Sec. 1. To
showcase the effectiveness of our speaker-listener architecture, we provide additional …

[PDF][PDF] Dense Captioning for 3D Scenes with SparseConv

A Khakhlyuk, A Singh - anurag14.github.io
There has been a lot of previous work in the area of cross-modal scene understanding,
especially for the tasks of image captioning [32] and the related task of dense captioning …