Search Results for author: Tao Pu

Found 10 papers, 8 papers with code

Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation

1 code implementation23 Sep 2023 Tao Pu, Tianshui Chen, Hefeng Wu, Yongyi Lu, Liang Lin

In this work, we propose a spatial-temporal knowledge-embedded transformer (STKET) that incorporates the prior spatial-temporal knowledge into the multi-head cross-attention mechanism to learn more representative relationship representations.

Graph Generation Object +2

Dual-Perspective Semantic-Aware Representation Blending for Multi-Label Image Recognition with Partial Labels

1 code implementation26 May 2022 Tao Pu, Tianshui Chen, Hefeng Wu, Yukai Shi, Zhijing Yang, Liang Lin

Specifically, an instance-perspective representation blending (IPRB) module is designed to blend the representations of the known labels in an image with the representations of the corresponding unknown labels in another image to complement these unknown labels.

Image Classification Multi-label Image Recognition with Partial Labels

Heterogeneous Semantic Transfer for Multi-label Recognition with Partial Labels

1 code implementation23 May 2022 Tianshui Chen, Tao Pu, Lingbo Liu, Yukai Shi, Zhijing Yang, Liang Lin

Multi-label image recognition with partial labels (MLR-PL), in which some labels are known while others are unknown for each image, may greatly reduce the cost of annotation and thus facilitate large-scale MLR.

Multi-label Image Recognition with Partial Labels

Semantic Representation and Dependency Learning for Multi-Label Image Recognition

no code implementations8 Apr 2022 Tao Pu, Mingzhan Sun, Hefeng Wu, Tianshui Chen, Ling Tian, Liang Lin

We also design an object erasing (OE) module to implicitly learn semantic dependency among categories by erasing semantic-aware regions to regularize the network training.

Object object-detection +1

Semantic-Aware Representation Blending for Multi-Label Image Recognition with Partial Labels

1 code implementation4 Mar 2022 Tao Pu, Tianshui Chen, Hefeng Wu, Liang Lin

However, these algorithms depend on sufficient multi-label annotations to train the models, leading to poor performance especially with low known label proportion.

Multi-label Image Recognition with Partial Labels

Structured Semantic Transfer for Multi-Label Recognition with Partial Labels

1 code implementation21 Dec 2021 Tianshui Chen, Tao Pu, Hefeng Wu, Yuan Xie, Liang Lin

To reduce the annotation cost, we propose a structured semantic transfer (SST) framework that enables training multi-label recognition models with partial labels, i. e., merely some labels are known while other labels are missing (also called unknown labels) per image.

Multi-label Image Recognition with Partial Labels

AU-Expression Knowledge Constrained Representation Learning for Facial Expression Recognition

1 code implementation29 Dec 2020 Tao Pu, Tianshui Chen, Yuan Xie, Hefeng Wu, Liang Lin

In this work, we explore the correlations among the action units and facial expressions, and devise an AU-Expression Knowledge Constrained Representation Learning (AUE-CRL) framework to learn the AU representations without AU annotations and adaptively use representations to facilitate facial expression recognition.

Facial Expression Recognition Facial Expression Recognition (FER) +1

Adversarial Graph Representation Adaptation for Cross-Domain Facial Expression Recognition

1 code implementation3 Aug 2020 Yuan Xie, Tianshui Chen, Tao Pu, Hefeng Wu, Liang Lin

However, most of these works focus on holistic feature adaptation, and they ignore local features that are more transferable across different datasets.

Cross-Domain Facial Expression Recognition Facial Expression Recognition (FER)

Cannot find the paper you are looking for? You can Submit a new open access paper.