Human-Object Interaction Detection
132 papers with code • 6 benchmarks • 22 datasets
Human-Object Interaction (HOI) detection is a task of identifying "a set of interactions" in an image, which involves the i) localization of the subject (i.e., humans) and target (i.e., objects) of interaction, and ii) the classification of the interaction labels.
Benchmarks
These leaderboards are used to track progress in Human-Object Interaction Detection
Libraries
Use these libraries to find Human-Object Interaction Detection models and implementations
HICO-DET
V-COCO
FineGym
HICO
RICH
BEHAVE
MECCANO
Watch-n-Patch
Most implemented papers
RLIPv2: Fast Scaling of Relational Language-Image Pre-training
jacobyuan7/rlipv2
•
•
ICCV 2023
In this paper, we propose RLIPv2, a fast converging model that enables the scaling of relational pre-training to large-scale pseudo-labelled scene graph data.
Contextual Action Recognition with R*CNN
gkioxari/RstarCNN
•
•
ICCV 2015
In this work, we exploit the simple observation that actions are accompanied by contextual cues to build a strong action recognition system.
Detecting and Recognizing Human-Object Interactions
facebookresearch/detectron
•
•
CVPR 2018
Our hypothesis is that the appearance of a person -- their pose, clothing, action -- is a powerful cue for localizing the objects they are interacting with.
VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutions
ASMIftekhar/VSGNet
•
•
CVPR 2020
Comprehensive visual understanding requires detection frameworks that can effectively learn and utilize object interactions while analyzing objects individually.
PaStaNet: Toward Human Activity Knowledge Engine
DirtyHarryLYL/HAKE
•
•
CVPR 2020
In light of this, we propose a new path: infer human part states first and then reason out the activities based on part-level semantics.
Polysemy Deciphering Network for Robust Human-Object Interaction Detection
To address this issue, in this paper, we propose a novel Polysemy Deciphering Network (PD-Net) that decodes the visual polysemy of verbs for HOI detection in three distinct ways.
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction Detection
yeliudev/ConsNet
•
•
We consider the problem of Human-Object Interaction (HOI) Detection, which aims to locate and recognize HOI instances in the form of <human, action, object> in images.
HOI Analysis: Integrating and Decomposing Human-Object Interaction
DirtyHarryLYL/HAKE-Action-Torch
•
•
NeurIPS 2020
Meanwhile, isolated human and object can also be integrated into coherent HOI again.
Spatially Conditioned Graphs for Detecting Human-Object Interactions
fredzzhang/spatially-conditioned-graphs
•
•
ICCV 2021
We address the problem of detecting human-object interactions in images using graphical neural networks.
Affordance Transfer Learning for Human-Object Interaction Detection
The proposed method can thus be used to 1) improve the performance of HOI detection, especially for the HOIs with unseen objects; and 2) infer the affordances of novel objects.
