Technique Report of CVPR 2024 PBDL Challenges

no code implementations • 15 Jun 2024 • Ying Fu, Yu Li, ShaoDi You, Boxin Shi, Linwei Chen, Yunhao Zou, Zichun Wang, Yichen Li, Yuze Han, Yingkai Zhang, Jianan Wang, Qinglin Liu, Wei Yu, Xiaoqian Lv, Jianing Li, Shengping Zhang, Xiangyang Ji, Yuanpei Chen, Yuhan Zhang, Weihang Peng, Liwen Zhang, Zhe Xu, Dingyong Gou, Cong Li, Senyan Xu, Yunkang Zhang, Siyuan Jiang, Xiaoqiang Lu, Licheng Jiao, Fang Liu, Xu Liu, Lingling Li, Wenping Ma, Shuyuan Yang, Haiyang Xie, Jian Zhao, Shihua Huang, Peng Cheng, Xi Shen, Zheng Wang, Shuai An, Caizhi Zhu, Xuelong Li, Tao Zhang, Liang Li, Yu Liu, Chenggang Yan, Gengchen Zhang, Linyan Jiang, Bingyi Song, Zhuoyu An, Haibo Lei, Qing Luo, Jie Song, YuAn Liu, Haoyuan Zhang, Lingfeng Wang, Wei Chen, Aling Luo, Cheng Li, Jun Cao, Shu Chen, Zifei Dou, Xinyu Liu, Jing Zhang, Kexin Zhang, Yuting Yang, Xuejian Gou, Qinliang Wang, Yang Liu, Shizhan Zhao, Yanzhao Zhang, Libo Yan, Yuwei Guo, Guoxin Li, Qiong Gao, Chenyue Che, Long Sun, Xiang Chen, Hao Li, Jinshan Pan, Chuanlong Xie, Hongming Chen, Mingrui Li, Tianchen Deng, Jingwei Huang, Yufeng Li, Fei Wan, Bingxin Xu, Jian Cheng, Hongzhe Liu, Cheng Xu, Yuxiang Zou, Weiguo Pan, Songyin Dai, Sen Jia, Junpei Zhang, Puhua Chen, Qihang Li

The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies.

Deep Learning

Hybrid CNN-Transformer Model For Facial Affect Recognition In the ABAW4 Challenge

no code implementations • 20 Jul 2022 • Lingfeng Wang, Haocheng Li, Chunyin Liu

This paper describes our submission to the fourth Affective Behavior Analysis (ABAW) competition.

Multi-Task Learning

Multi-modal Multi-label Facial Action Unit Detection with Transformer

no code implementations • 24 Mar 2022 • Lingfeng Wang, Shisen Wang, Jin Qi

Facial Action Coding System is an important approach of facial expression analysis. This paper describes our submission to the third Affective Behavior Analysis (ABAW) 2022 competition.

Action Unit Detection Facial Action Unit Detection

TR-MISR: Multiimage Super-Resolution Based on Feature Fusion With Transformers

1 code implementation • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2022 • Tai An, Xin Zhang, Chunlei Huo, Bin Xue, Lingfeng Wang, Chunhong Pan

In addition, TR-MISR adopts an additional learnable embedding vector that fuses these vectors to restore the details to the greatest extent. TR-MISR has successfully applied the transformer to MISR tasks for the first time, notably reducing the difficulty of training the transformer by ignoring the spatial relations of image patches.

Decoder Multi-Frame Super-Resolution

A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysis

1 code implementation • 9 Jul 2021 • Lingfeng Wang, Shisen Wang, Jin Qi, Kenji Suzuki

To tackle this problem, this paper presents a semi-supervised model with a mean teacher framework to leverage additional unlabeled data.

Guiding the Flowing of Semantics: Interpretable Video Captioning via POS Tag

no code implementations • IJCNLP 2019 • Xinyu Xiao, Lingfeng Wang, Bin Fan, Shinming Xiang, Chunhong Pan

To address these problems, we propose an Adaptive Semantic Guidance Network (ASGN), which instantiates the whole video semantics to different POS-aware semantics with the supervision of part of speech (POS) tag.

POS TAG +1

Deep Discriminative Clustering Analysis

no code implementations • 5 May 2019 • Jianlong Chang, Yiwen Guo, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, Chunhong Pan

Traditional clustering methods often perform clustering with low-level indiscriminative representations and ignore relationships between patterns, resulting in slight achievements in the era of deep learning.

Clustering

Structure-Aware Convolutional Neural Networks

1 code implementation • NeurIPS 2018 • Jianlong Chang, Jie Gu, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, Chunhong Pan

Convolutional neural networks (CNNs) are inherently subject to invariable filters that can only aggregate local inputs with the same topological structures.

Action Recognition Activity Detection +5

Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network

1 code implementation • 30 Jul 2018 • Yongcheng Liu, Bin Fan, Lingfeng Wang, Jun Bai, Shiming Xiang, Chunhong Pan

Specifically, for confusing manmade objects, ScasNet improves the labeling coherence with sequential global-to-local contexts aggregation.

Deep Adaptive Image Clustering

1 code implementation • ICCV 2017 • Jianlong Chang, Lingfeng Wang, Gaofeng Meng, Shiming Xiang, Chunhong Pan

The main challenge is that the ground-truth similarities are unknown in image clustering.

Clustering Image Clustering