Search Results for author: Jinhui Tang

Found 92 papers, 45 papers with code

Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localization

no code implementations12 Sep 2024 Ling Xing, Hongyu Qu, Rui Yan, Xiangbo Shu, Jinhui Tang

ii) To better aggregate such audio and visual features, we further customize Cross-modal Dynamic Perception layer (CDP) in cross-modal feature pyramid to understand local temporal patterns of audio-visual events by imposing local consistency within multimodal features in a data-driven manner.

cross-modal alignment

IMAGDressing-v1: Customizable Virtual Dressing

1 code implementation17 Jul 2024 Fei Shen, Xin Jiang, Xin He, Hu Ye, Cong Wang, Xiaoyu Du, Zechao Li, Jinhui Tang

Latest advances have achieved realistic virtual try-on (VTON) through localized garment inpainting using latent diffusion models, significantly enhancing consumers' online shopping experience.

Denoising Image Generation +1

A Recover-then-Discriminate Framework for Robust Anomaly Detection

no code implementations7 Jun 2024 Peng Xing, Dong Zhang, Jinhui Tang, Zechao Li

Specifically, by Case-1, we found that the main reasons detrimental to current AD methods is that the inputs to the recovery model contain a large number of detailed features to be recovered, which leads to the normal/abnormal area has-not/has been recovered into its original state.

Anomaly Detection

DVF: Advancing Robust and Accurate Fine-Grained Image Retrieval with Retrieval Guidelines

no code implementations24 Apr 2024 Xin Jiang, Hao Tang, Rui Yan, Jinhui Tang, Zechao Li

This paper presents a meticulous analysis leading to the proposal of practical guidelines to identify subcategory-specific discrepancies and generate discriminative features to design effective FGIR models.

Image Retrieval Retrieval

Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object Segmentation

1 code implementation21 Apr 2024 Gensheng Pei, Yazhou Yao, Jianbo Jiao, Wenguan Wang, Liqiang Nie, Jinhui Tang

To achieve this objective, we present a unified self-supervised approach to learn visual representations of static-dynamic feature similarity.

Semantic Segmentation Video Object Segmentation +1

The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Report

3 code implementations16 Apr 2024 Bin Ren, Nancy Mehta, Radu Timofte, Hongyuan Yu, Cheng Wan, Yuxin Hong, Bingnan Han, Zhuoyuan Wu, Yajun Zou, Yuqing Liu, Jizhe Li, Keji He, Chao Fan, Heng Zhang, Xiaolin Zhang, Xuanwu Yin, Kunlong Zuo, Bohao Liao, Peizhe Xia, Long Peng, Zhibo Du, Xin Di, Wangkai Li, Yang Wang, Wei Zhai, Renjing Pei, Jiaming Guo, Songcen Xu, Yang Cao, ZhengJun Zha, Yan Wang, Yi Liu, Qing Wang, Gang Zhang, Liou Zhang, Shijie Zhao, Long Sun, Jinshan Pan, Jiangxin Dong, Jinhui Tang, Xin Liu, Min Yan, Menghan Zhou, Yiqiang Yan, Yixuan Liu, Wensong Chan, Dehua Tang, Dong Zhou, Li Wang, Lu Tian, Barsoum Emad, Bohan Jia, Junbo Qiao, Yunshuai Zhou, Yun Zhang, Wei Li, Shaohui Lin, Shenglong Zhou, Binbin Chen, Jincheng Liao, Suiyi Zhao, Zhao Zhang, Bo wang, Yan Luo, Yanyan Wei, Feng Li, Mingshen Wang, Yawei Li, Jinhan Guan, Dehua Hu, Jiawei Yu, Qisheng Xu, Tao Sun, Long Lan, Kele Xu, Xin Lin, Jingtong Yue, Lehan Yang, Shiyi Du, Lu Qi, Chao Ren, Zeyu Han, YuHan Wang, Chaolin Chen, Haobo Li, Mingjun Zheng, Zhongbao Yang, Lianhong Song, Xingzhuo Yan, Minghan Fu, Jingyi Zhang, Baiang Li, Qi Zhu, Xiaogang Xu, Dan Guo, Chunle Guo, Jiadi Chen, Huanhuan Long, Chunjiang Duanmu, Xiaoyan Lei, Jie Liu, Weilin Jia, Weifeng Cao, Wenlong Zhang, Yanyu Mao, Ruilong Guo, Nihao Zhang, Qian Wang, Manoj Pandey, Maksym Chernozhukov, Giang Le, Shuli Cheng, Hongyuan Wang, Ziyan Wei, Qingting Tang, Liejun Wang, Yongming Li, Yanhui Guo, Hao Xu, Akram Khatami-Rizi, Ahmad Mahmoudi-Aznaveh, Chih-Chung Hsu, Chia-Ming Lee, Yi-Shiuan Chou, Amogh Joshi, Nikhil Akalwadi, Sampada Malagi, Palani Yashaswini, Chaitra Desai, Ramesh Ashok Tabib, Ujwala Patil, Uma Mudenagudi

In sub-track 1, the practical runtime performance of the submissions was evaluated, and the corresponding score was used to determine the ranking.

Image Super-Resolution

ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorization

1 code implementation9 Apr 2024 Yixin Yang, Jiangxin Dong, Jinhui Tang, Jinshan Pan

To explore this property for better spatial and temporal feature utilization, we develop a local attention module to aggregate the features from adjacent frames in a spatial-temporal neighborhood.

Colorization

Collaborative Feedback Discriminative Propagation for Video Super-Resolution

1 code implementation6 Apr 2024 Hao Li, Xiang Chen, Jiangxin Dong, Jinhui Tang, Jinshan Pan

However, inaccurate alignment usually leads to aligned features with significant artifacts, which will be accumulated during propagation and thus affect video restoration.

Video Reconstruction Video Restoration +1

Unleashing Network Potentials for Semantic Scene Completion

1 code implementation CVPR 2024 Fengyun Wang, Qianru Sun, Dong Zhang, Jinhui Tang

Semantic scene completion (SSC) aims to predict complete 3D voxel occupancy and semantics from a single-view RGB-D image, and recent SSC methods commonly adopt multi-modal inputs.

Spatial Structure Constraints for Weakly Supervised Semantic Segmentation

1 code implementation20 Jan 2024 Tao Chen, Yazhou Yao, Xingguo Huang, Zechao Li, Liqiang Nie, Jinhui Tang

In this paper, we propose spatial structure constraints (SSC) for weakly supervised semantic segmentation to alleviate the unwanted object over-activation of attention expansion.

Object Object Localization +2

MGNet: Learning Correspondences via Multiple Graphs

no code implementations10 Jan 2024 Luanyuan Dai, Xiaoyu Du, Hanwang Zhang, Jinhui Tang

To obtain information integrating implicit and explicit local graphs, we construct local graphs from implicit and explicit aspects and combine them effectively, which is used to build a global graph.

Context Disentangling and Prototype Inheriting for Robust Visual Grounding

1 code implementation19 Dec 2023 Wei Tang, Liang Li, Xuejing Liu, Lu Jin, Jinhui Tang, Zechao Li

In this paper, we propose a novel framework with context disentangling and prototype inheriting for robust visual grounding to handle both scenes.

Visual Grounding

W-HMR: Monocular Human Mesh Recovery in World Space with Weak-Supervised Calibration

1 code implementation29 Nov 2023 Wei Yao, Hongwen Zhang, Yunlian Sun, Yebin Liu, Jinhui Tang

Our contributions include a novel weak-supervised camera calibration technique, an effective orientation correction module, and a decoupling strategy that significantly improves the generalizability and accuracy of human motion recovery in both camera and world coordinates.

 Ranked #1 on 3D Human Pose Estimation on SPEC-MTP (using extra training data)

3D Human Pose Estimation Camera Calibration +2

Multi-view Information Integration and Propagation for Occluded Person Re-identification

1 code implementation7 Nov 2023 Neng Dong, Shuanglin Yan, Hao Tang, Jinhui Tang, Liyan Zhang

Moreover, as multiple images with the same identity are not accessible in the testing stage, we devise an Information Propagation (IP) mechanism to distill knowledge from the comprehensive representation to that of a single occluded image.

Occluded Person Re-Identification

Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification

no code implementations17 Oct 2023 Shuanglin Yan, Neng Dong, Jun Liu, Liyan Zhang, Jinhui Tang

Since the support set is unavailable during inference, we propose to distill the knowledge learned by the "richer" model into a lightweight model for inference with a single image/text as input.

Image Retrieval Image-text matching +2

Towards Unified Deep Image Deraining: A Survey and A New Benchmark

no code implementations5 Oct 2023 Xiang Chen, Jinshan Pan, Jiangxin Dong, Jinhui Tang

In this paper, we provide a comprehensive review of existing image deraining method and provide a unify evaluation setting to evaluate the performance of image deraining methods.

Rain Removal

M$^3$Net: Multi-view Encoding, Matching, and Fusion for Few-shot Fine-grained Action Recognition

no code implementations6 Aug 2023 Hao Tang, Jun Liu, Shuanglin Yan, Rui Yan, Zechao Li, Jinhui Tang

Due to the scarcity of manually annotated data required for fine-grained video understanding, few-shot fine-grained (FS-FG) action recognition has gained significant attention, with the aim of classifying novel fine-grained action categories with only a few labeled instances.

Decision Making Fine-grained Action Recognition +1

Erasing, Transforming, and Noising Defense Network for Occluded Person Re-Identification

1 code implementation14 Jul 2023 Neng Dong, Liyan Zhang, Shuanglin Yan, Hao Tang, Jinhui Tang

Occlusion perturbation presents a significant challenge in person re-identification (re-ID), and existing methods that rely on external visual cues require additional computational resources and only consider the issue of missing information caused by occlusion.

Adversarial Defense Occluded Person Re-Identification

Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation

1 code implementation9 May 2023 Tao Chen, Yazhou Yao, Jinhui Tang

Weakly supervised semantic segmentation (WSSS) models relying on class activation maps (CAMs) have achieved desirable performance comparing to the non-CAMs-based counterparts.

Denoising Image Generation +2

VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset

1 code implementation17 Apr 2023 Sihan Chen, Xingjian He, Longteng Guo, Xinxin Zhu, Weining Wang, Jinhui Tang, Jing Liu

Different from widely-studied vision-language pretraining models, VALOR jointly models relationships of vision, audio and language in an end-to-end manner.

 Ranked #1 on Video Captioning on VATEX (using extra training data)

Audio captioning Audio-Video Question Answering (AVQA) +17

Semantic Scene Completion with Cleaner Self

1 code implementation CVPR 2023 Fengyun Wang, Dong Zhang, Hanwang Zhang, Jinhui Tang, Qianru Sun

SSC is a well-known ill-posed problem as the prediction model has to "imagine" what is behind the visible surface, which is usually represented by Truncated Signed Distance Function (TSDF).

Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution

1 code implementation ICCV 2023 Long Sun, Jiangxin Dong, Jinhui Tang, Jinshan Pan

Although numerous solutions have been proposed for image super-resolution, they are usually incompatible with low-power devices with many computational and memory constraints.

Image Super-Resolution

Triplet Contrastive Representation Learning for Unsupervised Vehicle Re-identification

1 code implementation23 Jan 2023 Fei Shen, Xiaoyu Du, Liyan Zhang, Xiangbo Shu, Jinhui Tang

To address this problem, in this paper, we propose a simple Triplet Contrastive Representation Learning (TCRL) framework which leverages cluster features to bridge the part features and global features for unsupervised vehicle re-identification.

Contrastive Learning Representation Learning +3

ISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection

1 code implementation IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY 2023 Cairong Zhao, Chutian Wang, Guosheng Hu, Haonan Chen, Chun Liu, Jinhui Tang

To address these two challenges, in this paper, we propose an Interpretable Spatial-Temporal Video Transformer (ISTVT), which consists of a novel decomposed spatial-temporal self-attention and a self-subtract mechanism to capture spatial artifacts and temporal inconsistency for robust Deepfake detection.

DeepFake Detection Face Swapping

Deep Discriminative Spatial and Temporal Network for Efficient Video Deblurring

1 code implementation CVPR 2023 Jinshan Pan, Boming Xu, Jiangxin Dong, Jianjun Ge, Jinhui Tang

In contrast to existing methods that directly align adjacent frames without discrimination, we develop a deep discriminative spatial and temporal network to facilitate the spatial and temporal feature exploration for better video deblurring.

Deblurring Video Deblurring

Multi-Scale Residual Low-Pass Filter Network for Image Deblurring

no code implementations ICCV 2023 Jiangxin Dong, Jinshan Pan, Zhongbao Yang, Jinhui Tang

We present a simple and effective Multi-scale Residual Low-Pass Filter Network (MRLPFNet) that jointly explores the image details and main structures for image deblurring.

Deblurring Decoder +1

BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization

no code implementations5 Dec 2022 Yixin Yang, Zhongzheng Peng, Xiaoyu Du, Zhulin Tao, Jinhui Tang, Jinshan Pan

To overcome this problem, we further develop a mixed expert block to extract semantic information for modeling the object boundaries of frames so that the semantic image prior can better guide the colorization process for better performance.

Colorization Semantic correspondence

CLIP-Driven Fine-grained Text-Image Person Re-identification

1 code implementation19 Oct 2022 Shuanglin Yan, Neng Dong, Liyan Zhang, Jinhui Tang

Secondly, cross-grained feature refinement (CFR) and fine-grained correspondence discovery (FCD) modules are proposed to establish the cross-grained and fine-grained interactions between modalities, which can filter out non-modality-shared image patches/words and mine cross-modal correspondences from coarse to fine.

cross-modal alignment Person Re-Identification +2

ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly Detection

no code implementations19 Oct 2022 Peng Xing, Hao Tang, Jinhui Tang, Zechao Li

However, existing KDAD methods suffer from two main limitations: 1) the student network can effortlessly replicate the teacher network's representations, and 2) the features of the teacher network serve solely as a ``reference standard" and are not fully leveraged.

Anomaly Detection Anomaly Localization +1

Centralized Feature Pyramid for Object Detection

1 code implementation5 Oct 2022 Yu Quan, Dong Zhang, Liyan Zhang, Jinhui Tang

To address this problem, in this paper, we propose a Centralized Feature Pyramid (CFP) for object detection, which is based on a globally explicit centralized feature regulation.

Object object-detection +1

Boosting Few-shot Fine-grained Recognition with Background Suppression and Foreground Alignment

1 code implementation4 Oct 2022 Zican Zha, Hao Tang, Yunlian Sun, Jinhui Tang

To address this challenging task, we propose a two-stage background suppression and foreground alignment framework, which is composed of a background activation suppression (BAS) module, a foreground object alignment (FOA) module, and a local-to-local (L2L) similarity metric.

Few-Shot Learning

Accurate and Efficient Stereo Matching via Attention Concatenation Volume

3 code implementations23 Sep 2022 Gangwei Xu, Yun Wang, Junda Cheng, Jinhui Tang, Xin Yang

In this paper, we present a novel cost volume construction method, named attention concatenation volume (ACV), which generates attention weights from correlation clues to suppress redundant information and enhance matching-related information in the concatenation volume.

Stereo Matching

Understanding the Tricks of Deep Learning in Medical Image Segmentation: Challenges and Future Directions

1 code implementation21 Sep 2022 Dong Zhang, Yi Lin, Hao Chen, Zhuotao Tian, Xin Yang, Jinhui Tang, Kwang Ting Cheng

Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg).

Data Augmentation Domain Adaptation +3

Graph Reasoning Transformer for Image Parsing

no code implementations20 Sep 2022 Dong Zhang, Jinhui Tang, Kwang-Ting Cheng

In this paper, we propose a novel Graph Reasoning Transformer (GReaT) for image parsing to enable image patches to interact following a relation reasoning pattern.

Relation

Image-Specific Information Suppression and Implicit Local Alignment for Text-based Person Search

no code implementations30 Aug 2022 Shuanglin Yan, Hao Tang, Liyan Zhang, Jinhui Tang

Moreover, existing methods seldom consider the information inequality problem between modalities caused by image-specific information.

Person Search Text based Person Search

ShuffleMixer: An Efficient ConvNet for Image Super-Resolution

1 code implementation30 May 2022 Long Sun, Jinshan Pan, Jinhui Tang

We propose a simple and effective approach, ShuffleMixer, for lightweight image super-resolution that explores large convolution and channel split-shuffle operation.

Image Super-Resolution

PNP: Robust Learning From Noisy Labels by Probabilistic Noise Prediction

no code implementations CVPR 2022 Zeren Sun, Fumin Shen, Dan Huang, Qiong Wang, Xiangbo Shu, Yazhou Yao, Jinhui Tang

Label noise has been a practical challenge in deep learning due to the strong capability of deep neural networks in fitting all training data.

sub-region localized hashing for fine-grained image retrieval

no code implementations IEEE Transactions on Image Processing 2021 Xinguang Xiang, YaJie Zhang, Lu Jin, Zechao Li, Jinhui Tang

Specifically, to localize diverse local regions, a sub-region localization module is developed to learn discriminative local features by locating the peaks of non-overlap sub-regions in the feature map.

Image Retrieval Retrieval

Video-Text Pre-training with Learned Regions

1 code implementation2 Dec 2021 Rui Yan, Mike Zheng Shou, Yixiao Ge, Alex Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang

Video-Text pre-training aims at learning transferable representations from large-scale video-text pairs via aligning the semantics between visual and textual information.

Representation Learning Text Retrieval +1

Fine-Grained Image Analysis with Deep Learning: A Survey

no code implementations11 Nov 2021 Xiu-Shen Wei, Yi-Zhe Song, Oisin Mac Aodha, Jianxin Wu, Yuxin Peng, Jinhui Tang, Jian Yang, Serge Belongie

Fine-grained image analysis (FGIA) is a longstanding and fundamental problem in computer vision and pattern recognition, and underpins a diverse set of real-world applications.

Deep Learning Fine-Grained Image Recognition +3

Improving OCR-Based Image Captioning by Incorporating Geometrical Relationship

no code implementations CVPR 2021 Jing Wang, Jinhui Tang, Mingkun Yang, Xiang Bai, Jiebo Luo

Under the guidance of the geometrical relationship between OCR tokens, our LSTM-R capitalizes on a newly-devised relation-aware pointer network to select OCR tokens from the scene text for OCR-based image captioning.

Image Captioning Optical Character Recognition (OCR) +1

CTNet: Context-based Tandem Network for Semantic Segmentation

1 code implementation20 Apr 2021 Zechao Li, Yanpeng Sun, Jinhui Tang

Specifically, the Spatial Contextual Module (SCM) is leveraged to uncover the spatial contextual dependency between pixels by exploring the correlation between pixels and categories.

Segmentation Semantic Segmentation

Interactive Fusion of Multi-level Features for Compositional Activity Recognition

1 code implementation10 Dec 2020 Rui Yan, Lingxi Xie, Xiangbo Shu, Jinhui Tang

To understand a complex action, multiple sources of information, including appearance, positional, and semantic features, need to be integrated.

Action Recognition

Feature Pyramid Transformer

1 code implementation ECCV 2020 Dong Zhang, Hanwang Zhang, Jinhui Tang, Meng Wang, Xiansheng Hua, Qianru Sun

Yet, the non-local spatial interactions are not across scales, and thus they fail to capture the non-local contexts of objects (or parts) residing in different scales.

Instance Segmentation object-detection +3

Social Adaptive Module for Weakly-supervised Group Activity Recognition

no code implementations ECCV 2020 Rui Yan, Lingxi Xie, Jinhui Tang, Xiangbo Shu, Qi Tian

This paper presents a new task named weakly-supervised group activity recognition (GAR) which differs from conventional GAR tasks in that only video-level labels are available, yet the important persons within each frame are not provided even in the training data.

Group Activity Recognition

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection

7 code implementations NeurIPS 2020 Xiang Li, Wenhai Wang, Lijun Wu, Shuo Chen, Xiaolin Hu, Jun Li, Jinhui Tang, Jian Yang

Specifically, we merge the quality estimation into the class prediction vector to form a joint representation of localization quality and classification, and use a vector to represent arbitrary distribution of box locations.

Dense Object Detection General Classification

Cascaded Deep Video Deblurring Using Temporal Sharpness Prior

1 code implementation CVPR 2020 Jinshan Pan, Haoran Bai, Jinhui Tang

The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps.

Deblurring Optical Flow Estimation +1

Deep Blind Video Super-resolution

2 code implementations ICCV 2021 Jinshan Pan, Songsheng Cheng, Jiawei Zhang, Jinhui Tang

Existing video super-resolution (SR) algorithms usually assume that the blur kernels in the degradation process are known and do not model the blur kernels in the restoration.

Image Deconvolution Image Restoration +2

Adaptive Context Network for Scene Parsing

no code implementations ICCV 2019 Jun Fu, Jing Liu, Yuhang Wang, Yong Li, Yongjun Bao, Jinhui Tang, Hanqing Lu

Recent works attempt to improve scene parsing performance by exploring different levels of contexts, and typically train a well-designed convolutional network to exploit useful contexts across all pixels equally.

Scene Parsing Semantic Segmentation

Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction

no code implementations29 Sep 2019 Xiangbo Shu, Liyan Zhang, Guo-Jun Qi, Wei Liu, Jinhui Tang

To this end, we propose a novel Skeleton-joint Co-attention Recurrent Neural Networks (SC-RNN) to capture the spatial coherence among joints, and the temporal evolution among skeletons simultaneously on a skeleton-joint co-attention feature map in spatiotemporal space.

Human motion prediction motion prediction

Image Formation Model Guided Deep Image Super-Resolution

1 code implementation18 Aug 2019 Jinshan Pan, Yang Liu, Deqing Sun, Jimmy Ren, Ming-Ming Cheng, Jian Yang, Jinhui Tang

We present a simple and effective image super-resolution algorithm that imposes an image formation constraint on the deep neural networks via pixel substitution.

Image Super-Resolution

Aligning Linguistic Words and Visual Semantic Units for Image Captioning

1 code implementation6 Aug 2019 Longteng Guo, Jing Liu, Jinhui Tang, Jiangwei Li, Wei Luo, Hanqing Lu

Image captioning attempts to generate a sentence composed of several linguistic words, which are used to describe objects, attributes, and interactions in an image, denoted as visual semantic units in this paper.

Attribute Image Captioning +2

Convolutional Auto-encoding of Sentence Topics for Image Paragraph Generation

no code implementations1 Aug 2019 Jing Wang, Yingwei Pan, Ting Yao, Jinhui Tang, Tao Mei

A valid question is how to encapsulate such gists/topics that are worthy of mention from an image, and then describe the image from one topic to another but holistically with a coherent structure.

Descriptive Image Paragraph Captioning +2

Modeling Embedding Dimension Correlations via Convolutional Neural Collaborative Filtering

1 code implementation26 Jun 2019 Xiaoyu Du, Xiangnan He, Fajie Yuan, Jinhui Tang, Zhiguang Qin, Tat-Seng Chua

In this work, we emphasize on modeling the correlations among embedding dimensions in neural networks to pursue higher effectiveness for CF.

Collaborative Filtering Recommendation Systems

Joint Label Prediction based Semi-Supervised Adaptive Concept Factorization for Robust Data Representation

no code implementations25 May 2019 Zhao Zhang, Yan Zhang, Guangcan Liu, Jinhui Tang, Shuicheng Yan, Meng Wang

To enrich prior knowledge to enhance the discrimination, RS2ACF clearly uses class information of labeled data and more importantly propagates it to unlabeled data by jointly learning an explicit label indicator for unlabeled data.

Deep Semantic Multimodal Hashing Network for Scalable Image-Text and Video-Text Retrievals

no code implementations9 Jan 2019 Lu Jin, Zechao Li, Jinhui Tang

In this article, we propose a novel deep semantic multimodal hashing network (DSMHN) for scalable image-text and video-text retrieval.

Cross-Modal Retrieval Deep Hashing +4

Fast Matrix Factorization with Non-Uniform Weights on Missing Data

1 code implementation11 Nov 2018 Xiangnan He, Jinhui Tang, Xiaoyu Du, Richang Hong, Tongwei Ren, Tat-Seng Chua

This poses an imbalanced learning problem, since the scale of missing entries is usually much larger than that of observed entries, but they cannot be ignored due to the valuable negative signal.

Hierarchical Long Short-Term Concurrent Memory for Human Interaction Recognition

no code implementations1 Nov 2018 Xiangbo Shu, Jinhui Tang, Guo-Jun Qi, Wei Liu, Jian Yang

In a Co-LSTM unit, each sub-memory unit stores individual motion information, while this Co-LSTM unit selectively integrates and stores inter-related motion information between multiple interacting persons from multiple sub-memory units via the cell gate and co-memory cell, respectively.

Action Recognition Human Interaction Recognition +1

Adversarial Training Towards Robust Multimedia Recommender System

1 code implementation19 Sep 2018 Jinhui Tang, Xiaoyu Du, Xiangnan He, Fajie Yuan, Qi Tian, Tat-Seng Chua

To this end, we propose a novel solution named Adversarial Multimedia Recommendation (AMR), which can lead to a more robust multimedia recommender model by using adversarial learning.

Information Retrieval Multimedia

Outer Product-based Neural Collaborative Filtering

1 code implementation12 Aug 2018 Xiangnan He, Xiaoyu Du, Xiang Wang, Feng Tian, Jinhui Tang, Tat-Seng Chua

In this work, we contribute a new multi-layer neural network architecture named ONCF to perform collaborative filtering.

Collaborative Filtering Multi-Domain Recommender Systems +1

Physics-Based Generative Adversarial Models for Image Restoration and Beyond

no code implementations2 Aug 2018 Jinshan Pan, Jiangxin Dong, Yang Liu, Jiawei Zhang, Jimmy Ren, Jinhui Tang, Yu-Wing Tai, Ming-Hsuan Yang

We present an algorithm to directly solve numerous image restoration problems (e. g., image deblurring, image dehazing, image deraining, etc.).

Deblurring Image Deblurring +3

Single Image Dehazing via Conditional Generative Adversarial Network

no code implementations CVPR 2018 Runde Li, Jinshan Pan, Zechao Li, Jinhui Tang

In contrast, we solve this problem based on a conditional generative adversarial network (cGAN), where the clear image is estimated by an end-to-end trainable neural network.

Decoder Generative Adversarial Network +2

Deep Ordinal Hashing with Spatial Attention

no code implementations7 May 2018 Lu Jin, Xiangbo Shu, Kai Li, Zechao Li, Guo-Jun Qi, Jinhui Tang

However, most existing deep hashing methods directly learn the hash functions by encoding the global semantic information, while ignoring the local spatial information of images.

Deep Hashing Image Retrieval

Social Anchor-Unit Graph Regularized Tensor Completion for Large-Scale Image Retagging

no code implementations12 Apr 2018 Jinhui Tang, Xiangbo Shu, Zechao Li, Yu-Gang Jiang, Qi Tian

Recent approaches simultaneously explore visual, user and tag information to improve the performance of image retagging by constructing and exploring an image-tag-user graph.

Graph Learning TAG

Hardware-Efficient Guided Image Filtering For Multi-Label Problem

no code implementations CVPR 2017 Longquan Dai, Mengke Yuan, Zechao Li, Xiaopeng Zhang, Jinhui Tang

In this paper we propose a hardware-efficient Guided Filter (HGF), which solves the efficiency problem of multichannel guided image filtering and yields competent results when applying it to multi-label problems with synthesized polynomial multichannel guidance.

Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification

no code implementations14 Jun 2017 Yu-Gang Jiang, Zuxuan Wu, Jinhui Tang, Zechao Li, xiangyang xue, Shih-Fu Chang

More specifically, we utilize three Convolutional Neural Networks (CNNs) operating on appearance, motion and audio signals to extract their corresponding features.

General Classification Video Classification

Personalized Age Progression with Bi-level Aging Dictionary Learning

no code implementations4 Jun 2017 Xiangbo Shu, Jinhui Tang, Zechao Li, Hanjiang Lai, Liyan Zhang, Shuicheng Yan

Basically, for each age group, we learn an aging dictionary to reveal its aging characteristics (e. g., wrinkles), where the dictionary bases corresponding to the same index yet from two neighboring aging dictionaries form a particular aging pattern cross these two age groups, and a linear combination of all these patterns expresses a particular personalized aging process.

Dictionary Learning Face Verification

Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition

no code implementations3 Jun 2017 Xiangbo Shu, Jinhui Tang, Guo-Jun Qi, Yan Song, Zechao Li, Liyan Zhang

To this end, we propose a novel Concurrence-Aware Long Short-Term Sub-Memories (Co-LSTSM) to model the long-term inter-related dynamics between two interacting people on the bounding boxes covering people.

Action Recognition Temporal Action Localization

Deep Learning Driven Visual Path Prediction from a Single Image

no code implementations27 Jan 2016 Siyu Huang, Xi Li, Zhongfei Zhang, Zhouzhou He, Fei Wu, Wei Liu, Jinhui Tang, Yueting Zhuang

The highly effective visual representation and deep context models ensure that our framework makes a deep semantic understanding of the scene and motion pattern, consequently improving the performance of the visual path prediction task.

Deep Learning

Human Parsing With Contextualized Convolutional Neural Network

no code implementations ICCV 2015 Xiaodan Liang, Chunyan Xu, Xiaohui Shen, Jianchao Yang, Si Liu, Jinhui Tang, Liang Lin, Shuicheng Yan

In this work, we address the human parsing task with a novel Contextualized Convolutional Neural Network (Co-CNN) architecture, which well integrates the cross-layer context, global image-level context, within-super-pixel context and cross-super-pixel neighborhood context into a unified network.

Human Parsing

Nonconvex Nonsmooth Low-Rank Minimization via Iteratively Reweighted Nuclear Norm

no code implementations23 Oct 2015 Canyi Lu, Jinhui Tang, Shuicheng Yan, Zhouchen Lin

The nuclear norm is widely used as a convex surrogate of the rank function in compressive sensing for low rank matrix recovery with its applications in image recovery and signal processing.

Compressive Sensing

Personalized Age Progression with Aging Dictionary

no code implementations ICCV 2015 Xiangbo Shu, Jinhui Tang, Hanjiang Lai, Luoqi Liu, Shuicheng Yan

Second, it is challenging or even impossible to collect faces of all age groups for a particular subject, yet much easier and more practical to get face pairs from neighboring age groups.

Dictionary Learning Face Verification

Sparse Composite Quantization

no code implementations CVPR 2015 Ting Zhang, Guo-Jun Qi, Jinhui Tang, Jingdong Wang

The benefit is that the distance evaluation between the query and the dictionary element (a sparse vector) is accelerated using the efficient sparse vector operation, and thus the cost of distance table computation is reduced a lot.

Quantization Retrieval

Correntropy Induced L2 Graph for Robust Subspace Clustering

no code implementations18 Jan 2015 Canyi Lu, Jinhui Tang, Min Lin, Liang Lin, Shuicheng Yan, Zhouchen Lin

In this paper, we study the robust subspace clustering problem, which aims to cluster the given possibly noisy data points into their underlying subspaces.

Clustering graph construction

Constructing a Non-Negative Low Rank and Sparse Graph with Data-Adaptive Features

no code implementations3 Sep 2014 Liansheng Zhuang, Shenghua Gao, Jinhui Tang, Jingjing Wang, Zhouchen Lin, Yi Ma

This paper aims at constructing a good graph for discovering intrinsic data structures in a semi-supervised learning setting.

graph construction

Generalized Nonconvex Nonsmooth Low-Rank Minimization

no code implementations CVPR 2014 Canyi Lu, Jinhui Tang, Shuicheng Yan, Zhouchen Lin

We observe that all the existing nonconvex penalty functions are concave and monotonically increasing on $[0,\infty)$.

Weakly-Supervised Dual Clustering for Image Semantic Segmentation

no code implementations CVPR 2013 Yang Liu, Jing Liu, Zechao Li, Jinhui Tang, Hanqing Lu

In this paper, we propose a novel Weakly-Supervised Dual Clustering (WSDC) approach for image semantic segmentation with image-level labels, i. e., collaboratively performing image segmentation and tag alignment with those regions.

Clustering Image Segmentation +4

Cannot find the paper you are looking for? You can Submit a new open access paper.