Search Results for author: Xinpeng Liu

Found 18 papers, 11 papers with code

Homogeneous Dynamics Space for Heterogeneous Humans

no code implementations9 Dec 2024 Xinpeng Liu, Junxuan Liang, Chenshuo Zhang, Zixuan Cai, Cewu Lu, Yong-Lu Li

We identify a major obstacle to this as the heterogeneity of existing human motion understanding efforts.

Human Dynamics

Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models

no code implementations6 Dec 2024 Zehao Wang, Xinpeng Liu, Xiaoqian Wu, Yudonglin Zhang, Zhou Fang, Yifan Fang, Junfu Pu, Cewu Lu, Yong-Lu Li

In this paper, to the best of our knowledge, we are the $\textbf{first}$ to investigate the $\textbf{verb hallucination}$ phenomenon of MLLMs from various perspectives.

Hallucination Optical Character Recognition (OCR) +1

TreeFormer: Single-view Plant Skeleton Estimation via Tree-constrained Graph Generation

1 code implementation25 Nov 2024 Xinpeng Liu, Hiroaki Santo, Yosuke Toda, Fumio Okura

While recent graph generation methods successfully infer thin structures from images, it is challenging to constrain the output graph strictly to a tree structure.

Graph Generation

ImDy: Human Inverse Dynamics from Imitated Observations

no code implementations23 Oct 2024 Xinpeng Liu, Junxuan Liang, Zili Lin, Haowen Hou, Yong-Lu Li, Cewu Lu

In light of this, we devise an efficient data collection pipeline with state-of-the-art motion imitation algorithms and physics simulators, resulting in a large-scale human inverse dynamics benchmark as Imitated Dynamics (ImDy).

Primitive-based 3D Human-Object Interaction Modelling and Programming

no code implementations17 Dec 2023 SiQi Liu, Yong-Lu Li, Zhou Fang, Xinpeng Liu, Yang You, Cewu Lu

To explore an effective embedding of HAOI for the machine, we build a new benchmark on 3D HAOI consisting of primitives together with their images and propose a task requiring machines to recover 3D HAOI using primitives from images.

3D Reconstruction Human-Object Interaction Detection +2

Revisit Human-Scene Interaction via Space Occupancy

no code implementations5 Dec 2023 Xinpeng Liu, Haowen Hou, Yanchao Yang, Yong-Lu Li, Cewu Lu

High-quality data with simultaneously captured human and 3D environments is hard to acquire, resulting in limited data diversity and complexity.

Bridging the Gap between Human Motion and Action Semantics via Kinematic Phrases

no code implementations6 Oct 2023 Xinpeng Liu, Yong-Lu Li, Ailing Zeng, Zizheng Zhou, Yang You, Cewu Lu

Motion understanding aims to establish a reliable mapping between motion and action semantics, while it is a challenging many-to-many problem.

Motion Generation

From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding

no code implementations CVPR 2024 Yong-Lu Li, Xiaoqian Wu, Xinpeng Liu, Zehao Wang, Yiming Dou, Yikun Ji, Junyi Zhang, Yixing Li, Jingru Tan, Xudong Lu, Cewu Lu

By aligning the classes of previous datasets to our semantic space, we gather (image/video/skeleton/MoCap) datasets into a unified database in a unified label system, i. e., bridging "isolated islands" into a "Pangea".

Action Understanding Transfer Learning

Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection

1 code implementation28 Jul 2022 Xiaoqian Wu, Yong-Lu Li, Xinpeng Liu, Junyi Zhang, Yuzhe Wu, Cewu Lu

Though significant progress has been made, interactiveness learning remains a challenging problem in HOI detection: existing methods usually generate redundant negative H-O pair proposals and fail to effectively extract interactive pairs.

Human-Object Interaction Detection

Highlighting Object Category Immunity for the Generalization of Human-Object Interaction Detection

1 code implementation19 Feb 2022 Xinpeng Liu, Yong-Lu Li, Cewu Lu

To achieve OC-immunity, we propose an OC-immune network that decouples the inputs from OC, extracts OC-immune representations, and leverages uncertainty quantification to generalize to unseen objects.

Human-Object Interaction Detection Object +1

HAKE: A Knowledge Engine Foundation for Human Activity Understanding

3 code implementations14 Feb 2022 Yong-Lu Li, Xinpeng Liu, Xiaoqian Wu, Yizhuo Li, Zuoyu Qiu, Liang Xu, Yue Xu, Hao-Shu Fang, Cewu Lu

Human activity understanding is of widespread interest in artificial intelligence and spans diverse applications like health care and behavior analysis.

Action Recognition Human-Object Interaction Detection +2

HAKE: Human Activity Knowledge Engine

4 code implementations13 Apr 2019 Yong-Lu Li, Liang Xu, Xinpeng Liu, Xijie Huang, Yue Xu, Mingyang Chen, Ze Ma, Shiyi Wang, Hao-Shu Fang, Cewu Lu

To address these and promote the activity understanding, we build a large-scale Human Activity Knowledge Engine (HAKE) based on the human body part states.

Ranked #2 on Human-Object Interaction Detection on HICO (using extra training data)

Action Detection Human-Object Interaction Detection +1

Cannot find the paper you are looking for? You can Submit a new open access paper.