Instances as queries

Y Fang, S Yang, X Wang, Y Li, C Fang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present QueryInst, a new perspective for instance segmentation. QueryInst is a multi-
stage end-to-end system that treats instances of interest as learnable queries, enabling …

Gen-vlkt: Simplify association and enhance interaction understanding for hoi detection

Y Liao, A Zhang, M Lu, Y Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract The task of Human-Object Interaction (HOI) detection could be divided into two core
problems, ie, human-object association and interaction understanding. In this paper, we …

Mining the benefits of two-stage and one-stage hoi detection

A Zhang, Y Liao, S Liu, M Lu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Two-stage methods have dominated Human-Object Interaction~(HOI) detection for several
years. Recently, one-stage HOI detection methods have become popular. In this paper, we …

Human object interaction detection: Design and survey

M Antoun, D Asmar - Image and Vision Computing, 2023 - Elsevier
Abstract Human-Object Interaction (HOI) detection is the process of estimating the
interaction between a human and an object in an image. The first attempts at HOI involved …

Sgtr: End-to-end scene graph generation with transformer

R Li, S Zhang, X He - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
Abstract Scene Graph Generation (SGG) remains a challenging visual understanding task
due to its compositional property. Most previous works adopt a bottom-up two-stage or a …

Relational context learning for human-object interaction detection

S Kim, D Jung, M Cho - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Recent state-of-the-art methods for HOI detection typically build on transformer architectures
with two decoder branches, one for human-object pair detection and the other for interaction …

Rlip: Relational language-image pre-training for human-object interaction detection

H Yuan, J Jiang, S Albanie, T Feng… - Advances in …, 2022 - proceedings.neurips.cc
Abstract The task of Human-Object Interaction (HOI) detection targets fine-grained visual
parsing of humans interacting with their environment, enabling a broad range of …

Efficient two-stage detection of human-object interactions with a novel unary-pairwise transformer

FZ Zhang, D Campbell, S Gould - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Recent developments in transformer models for visual data have led to significant
improvements in recognition and detection tasks. In particular, using learnable queries in …

Exploring structure-aware transformer over interaction proposals for human-object interaction detection

Y Zhang, Y Pan, T Yao, R Huang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Recent high-performing Human-Object Interaction (HOI) detection techniques have
been highly influenced by Transformer-based object detector (ie, DETR). Nevertheless, most …

Exploring predicate visual context in detecting of human-object interactions

FZ Zhang, Y Yuan, D Campbell… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recently, the DETR framework has emerged as the dominant approach for human--object
interaction (HOI) research. In particular, two-stage transformer-based HOI detectors are …