Detecting any human-object interaction relationship: Universal hoi detector with spatial prompt learning on foundation models

Y Cao, Q Tang, X Su, S Chen, S You… - Advances in Neural …, 2023 - proceedings.neurips.cc
Human-object interaction (HOI) detection aims to comprehend the intricate relationships
between humans and objects, predicting triplets, and serving as the foundation for …

Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness

G Wang, Y Guo, Z Xu… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Human-Object Interaction (HOI) Detection constitutes an important aspect of human-
centric scene understanding which requires precise object detection and interaction …

Disentangled Pre-training for Human-Object Interaction Detection

Z Li, X Li, C Ding, X Xu - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Detecting human-object interaction (HOI) has long been limited by the amount of supervised
data available. Recent approaches address this issue by pre-training according to pseudo …

Open-World Human-Object Interaction Detection via Multi-modal Prompts

J Yang, B Li, A Zeng, L Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
In this paper we develop MP-HOI a powerful Multi-modal Prompt-based HOI detector
designed to leverage both textual descriptions for open-set generalization and visual …

Exploring Self-and Cross-Triplet Correlations for Human-Object Interaction Detection

W Jiang, W Ren, J Tian, L Qu, Z Wang… - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Human-Object Interaction (HOI) detection plays a vital role in scene understanding, which
aims to predict the HOI triplet in the form of< human, object, action>. Existing methods mainly …

Discovering Syntactic Interaction Clues for Human-Object Interaction Detection

J Luo, W Ren, W Jiang, X Chen… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Recently Vision-Language Model (VLM) has greatly advanced the Human-Object
Interaction (HOI) detection. The existing VLM-based HOI detectors typically adopt a hand …

Person in Place: Generating Associative Skeleton-Guidance Maps for Human-Object Interaction Image Editing

CH Yang, CH Kang, K Kong, H Oh… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently there were remarkable advances in image editing tasks in various ways.
Nevertheless existing image editing models are not designed for Human-Object Interaction …

QLDT: adaptive Query Learning for HOI Detection via vision-language knowledge Transfer

X Wang, Y Gao, W Yu, C Wu, M Chen, H Ma, Z Chen - Applied Intelligence, 2024 - Springer
Human-object interaction detection can be mainly categorized into two core problems,
namely human-object association detection and interaction understanding. Firstly, for …

Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detection

T Lei, S Yin, Y Liu - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Open-vocabulary human-object interaction (HOI) detection which is concerned with the
problem of detecting novel HOIs guided by natural language is crucial for understanding …

Diffnas: Bootstrapping diffusion models by prompting for better architectures

W Li, X Su, S You, F Wang, C Qian… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Diffusion models have recently exhibited remarkable performance on synthetic data. After a
diffusion path is selected, a base model, such as UNet, operates as a denoising …