Search Results for author: Liqing Zhang

Found 63 papers, 38 papers with code

Towards Automatic Curation of Antibiotic Resistance Genes via Statement Extraction from Scientific Papers: A Benchmark Dataset and Models

1 code implementation BioNLP (ACL) 2022 Sidhant Chandak, Liqing Zhang, Connor Brown, Lifu Huang

Antibiotic resistance has become a growing worldwide concern as new resistance mechanisms are emerging and spreading globally, and thus detecting and collecting the cause – Antibiotic Resistance Genes (ARGs), have been more critical than ever.

WeditGAN: Few-shot Image Generation via Latent Space Relocation

no code implementations11 May 2023 Yuxuan Duan, Li Niu, Yan Hong, Liqing Zhang

In few-shot image generation, directly training GAN models on just a handful of images faces the risk of overfitting.

Image Generation

Image Cropping With Spatial-Aware Feature and Rank Consistency

no code implementations CVPR 2023 Chao Wang, Li Niu, Bo Zhang, Liqing Zhang

To address the first issue, we propose spatial-aware feature to encode the spatial relationship between candidate crops and aesthetic elements, by feeding the concatenation of crop mask and selectively aggregated feature maps to a light-weighted encoder.

Image Cropping

Weak-shot Semantic Segmentation via Dual Similarity Transfer

1 code implementation5 Oct 2022 Junjie Chen, Li Niu, Siyuan Zhou, Jianlou Si, Chen Qian, Liqing Zhang

Proposal segmentation allows proposal-pixel similarity transfer from base classes to novel classes, which enables the mask learning of novel classes.

Semantic Segmentation Semantic Similarity +1

Inharmonious Region Localization with Auxiliary Style Feature

no code implementations5 Oct 2022 Penghao Wu, Li Niu, Liqing Zhang

Based on the extracted style features, we also propose a novel style voting module to guide the localization of inharmonious region.

Inharmonious Region Localization via Recurrent Self-Reasoning

no code implementations5 Oct 2022 Penghao Wu, Li Niu, Jing Liang, Liqing Zhang

Synthetic images created by image editing operations are prevalent, but the color or illumination inconsistency between the manipulated region and background may make it unrealistic.

Image Harmonization

Learning Object Placement via Dual-path Graph Completion

1 code implementation23 Jul 2022 Siyuan Zhou, Liu Liu, Li Niu, Liqing Zhang

Object placement aims to place a foreground object over a background image with a suitable location and size.

Human-centric Image Cropping with Partition-aware and Content-preserving Features

1 code implementation21 Jul 2022 Bo Zhang, Li Niu, Xing Zhao, Liqing Zhang

Image cropping aims to find visually appealing crops in an image, which is an important yet challenging task.

Image Cropping

DeltaGAN: Towards Diverse Few-shot Image Generation with Sample-Specific Delta

1 code implementation21 Jul 2022 Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang

In this work, we propose a novel Delta Generative Adversarial Network (DeltaGAN), which consists of a reconstruction subnetwork and a generation subnetwork.

Image Generation

Spatial Transformation for Image Composition via Correspondence Learning

no code implementations6 Jul 2022 Bo Zhang, Yue Liu, Kaixin Lu, Li Niu, Liqing Zhang

Instead, we propose a novel correspondence learning network (CorrelNet) to model the correspondence between foreground and background using cross-attention maps, based on which we can predict the target coordinate that each source coordinate of foreground should be mapped to on the background.

Virtual Try-on

Deep Video Harmonization with Color Mapping Consistency

1 code implementation2 May 2022 Xinyuan Lu, Shengyuan Huang, Li Niu, Wenyan Cong, Liqing Zhang

Video harmonization aims to adjust the foreground of a composite video to make it compatible with the background.

Video Harmonization

XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding

1 code implementation CVPR 2022 Zhangxuan Gu, Changhua Meng, Ke Wang, Jun Lan, Weiqiang Wang, Ming Gu, Liqing Zhang

Recently, various multimodal networks for Visually-Rich Document Understanding(VRDU) have been proposed, showing the promotion of transformers by integrating visual and layout information with the text embeddings.

Optical Character Recognition (OCR)

Dual-Path Image Inpainting With Auxiliary GAN Inversion

no code implementations CVPR 2022 Wentao Wang, Li Niu, Jianfu Zhang, Xue Yang, Liqing Zhang

Different from feed-forward methods, they seek for a closest latent code to the corrupted image and feed it to a pretrained generator.

Image Inpainting

Mixed Supervised Object Detection by Transferring Mask Prior and Semantic Similarity

1 code implementation NeurIPS 2021 Yan Liu, Zhijie Zhang, Li Niu, Junjie Chen, Liqing Zhang

Specifically, the ability of using mask prior to help detect objects is learned from base categories and transferred to novel categories.

object-detection Object Detection +2

Weak-shot Semantic Segmentation by Transferring Semantic Affinity and Boundary

no code implementations4 Oct 2021 Siyuan Zhou, Li Niu, Jianlou Si, Chen Qian, Liqing Zhang

As a result, we find that pixel-level annotation of base categories can facilitate affinity learning and propagation, leading to higher-quality CAMs of novel categories.

Weakly supervised Semantic Segmentation Weakly-Supervised Semantic Segmentation

Defending Graph Neural Networks via Tensor-Based Robust Graph Aggregation

no code implementations29 Sep 2021 Jianfu Zhang, Yan Hong, Dawei Cheng, Liqing Zhang, Qibin Zhao

In this paper, we propose a tensor-based framework for GNNs to learn robust graphs from adversarial graphs by aggregating predefined robust graphs to enhance the robustness of GNNs via tensor approximation.

HYouTube: Video Harmonization Dataset

1 code implementation18 Sep 2021 Xinyuan Lu, Shengyuan Huang, Li Niu, Wenyan Cong, Liqing Zhang

In this work, we construct a new video harmonization dataset HYouTube by adjusting the foreground of real videos to create synthetic composite videos.

Video Harmonization

Visible Watermark Removal via Self-calibrated Localization and Background Refinement

1 code implementation8 Aug 2021 Jing Liang, Li Niu, Fengjun Guo, Teng Long, Liqing Zhang

In the refinement stage, we integrate multi-level features to improve the texture quality of watermarked area.

Multi-Task Learning

Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer

1 code implementation3 Aug 2021 Yifan Xu, Zhijie Zhang, Mengdan Zhang, Kekai Sheng, Ke Li, WeiMing Dong, Liqing Zhang, Changsheng Xu, Xing Sun

Vision transformers (ViTs) have recently received explosive popularity, but the huge computational cost is still a severe issue.

Image Classification

OPA: Object Placement Assessment Dataset

2 code implementations5 Jul 2021 Liu Liu, Zhenchen Liu, Bo Zhang, Jiangtong Li, Li Niu, Qingyang Liu, Liqing Zhang

Image composition aims to generate realistic composite image by inserting an object from one image into another background image, where the placement (e. g., location, size, occlusion) of inserted object may be unreasonable, which would significantly degrade the quality of the composite image.

Making Images Real Again: A Comprehensive Survey on Deep Image Composition

1 code implementation28 Jun 2021 Li Niu, Wenyan Cong, Liu Liu, Yan Hong, Bo Zhang, Jing Liang, Liqing Zhang

We also point out the limitations of existing methods in each sub-task and the problem of the whole image composition task.

Image Harmonization

End-to-End Video Object Detection with Spatial-Temporal Transformers

1 code implementation23 May 2021 Lu He, Qianyu Zhou, Xiangtai Li, Li Niu, Guangliang Cheng, Xiao Li, Wenxuan Liu, Yunhai Tong, Lizhuang Ma, Liqing Zhang

Recently, DETR and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors.

object-detection Optical Flow Estimation +1

Shadow Generation for Composite Image in Real-world Scenes

1 code implementation21 Apr 2021 Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang

In this work, we focus on generating plausible shadow for the foreground object in the composite image.

Inharmonious Region Localization

3 code implementations19 Apr 2021 Jing Liang, Li Niu, Liqing Zhang

The advance of image editing techniques allows users to create artistic works, but the manipulated regions may be incompatible with the background.

Image Harmonization

Image Composition Assessment with Saliency-augmented Multi-pattern Pooling

1 code implementation7 Apr 2021 Bo Zhang, Li Niu, Liqing Zhang

Image composition assessment is crucial in aesthetic assessment, which aims to assess the overall composition quality of a given image.

Aesthetics Quality Assessment

Deep Image Harmonization by Bridging the Reality Gap

1 code implementation31 Mar 2021 Junyan Cao, Wenyan Cong, Li Niu, Jianfu Zhang, Liqing Zhang

Image harmonization has been significantly advanced with large-scale harmonization dataset.

Image Harmonization Transfer Learning

Parallel Multi-Resolution Fusion Network for Image Inpainting

no code implementations ICCV 2021 Wentao Wang, Jianfu Zhang, Li Niu, Haoyu Ling, Xue Yang, Liqing Zhang

Conventional deep image inpainting methods are based on auto-encoder architecture, in which the spatial details of images will be lost in the down-sampling process, leading to the degradation of generated results.

Image Inpainting

Disentangled Information Bottleneck

1 code implementation14 Dec 2020 Ziqi Pan, Li Niu, Jianfu Zhang, Liqing Zhang

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that balances the compression and prediction terms.

Adversarial Attack Out-of-Distribution Detection

From Pixel to Patch: Synthesize Context-aware Features for Zero-shot Semantic Segmentation

1 code implementation25 Sep 2020 Zhangxuan Gu, Siyuan Zhou, Li Niu, Zihan Zhao, Liqing Zhang

Thus, we focus on zero-shot semantic segmentation, which aims to segment unseen objects with only category-level semantic representations provided for unseen categories.

Image Classification Semantic Segmentation +1

Graph Neural Network for Fraud Detection via Spatial-Temporal Attention

1 code implementation TKDE 2020 Dawei Cheng, Xiaoyang Wang, Ying Zhang, Liqing Zhang

But manually generating features needs domain knowledge and may lay behind the modus operandi of fraud, which means we need to automatically focus on the most relevant fraudulent behavior patterns in the online detection system.

Fraud Detection

Weak-shot Fine-grained Classification via Similarity Transfer

1 code implementation NeurIPS 2021 Junjie Chen, Li Niu, Liu Liu, Liqing Zhang

In this setting, we propose a method called SimTrans to transfer pairwise semantic similarity from base categories to novel categories.

Classification General Classification +2

BargainNet: Background-Guided Domain Translation for Image Harmonization

2 code implementations19 Sep 2020 Wenyan Cong, Li Niu, Jianfu Zhang, Jing Liang, Liqing Zhang

Therefore, we propose an image harmonization network with a novel domain code extractor and well-tailored triplet losses, which could capture the background domain information to guide the foreground harmonization.

Image Harmonization Translation

DeltaGAN: Towards Diverse Few-shot Image Generation with Sample-Specific Delta

1 code implementation18 Sep 2020 Yan Hong, Li Niu, Jianfu Zhang, Jing Liang, Liqing Zhang

In this work, we propose a novel Delta Generative Adversarial Network (DeltaGAN), which consists of a reconstruction subnetwork and a generation subnetwork.

Image Generation

Context-aware Feature Generation for Zero-shot Semantic Segmentation

2 code implementations16 Aug 2020 Zhangxuan Gu, Siyuan Zhou, Li Niu, Zihan Zhao, Liqing Zhang

In this paper, we propose a novel context-aware feature generation method for zero-shot segmentation named CaGNet.

Semantic Segmentation Word Embeddings +1

F2GAN: Fusing-and-Filling GAN for Few-shot Image Generation

1 code implementation5 Aug 2020 Yan Hong, Li Niu, Jianfu Zhang, Weijie Zhao, Chen Fu, Liqing Zhang

In this paper, we propose a Fusing-and-Filling Generative Adversarial Network (F2GAN) to generate realistic and diverse images for a new category with only a few images.

Image Generation

Spatio-Temporal Attention-Based Neural Network for Credit Card Fraud Detection

1 code implementation AAAI 2020 Dawei Cheng, Sheng Xiang, Chencheng Shang, Yiyi Zhang, Fangzhou Yang, Liqing Zhang

But manually generating features needs domain knowledge and may lay behind the modus operandi of fraud, which means we need to automatically focus on the most relevant patterns in fraudulent behavior.

Fraud Detection

Beyond without Forgetting: Multi-Task Learning for Classification with Disjoint Datasets

no code implementations15 Mar 2020 Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang

To address these issues, we propose our MTL with Selective Augmentation (MTL-SA) method to select the training samples in unlabeled datasets with confident pseudo labels and close data distribution to the labeled dataset.

General Classification Multi-Task Learning

MatchingGAN: Matching-based Few-shot Image Generation

1 code implementation7 Mar 2020 Yan Hong, Li Niu, Jianfu Zhang, Liqing Zhang

Matching generator can match random vectors with a few conditional images from the same category and generate new images for this category based on the fused features.

Image Generation

Exploiting Motion Information from Unlabeled Videos for Static Image Action Recognition

no code implementations1 Dec 2019 Yiyi Zhang, Li Niu, Ziqi Pan, Meichao Luo, Jianfu Zhang, Dawei Cheng, Liqing Zhang

Specifically, the VRE module includes a proxy task which imposes pseudo motion label constraint and temporal coherence constraint on unlabeled videos, while the MRA module could predict the motion information of a static action image by exploiting unlabeled videos.

Action Recognition Self-Supervised Learning

Zero-Shot Sketch-Based Image Retrieval with Structure-aware Asymmetric Disentanglement

no code implementations29 Nov 2019 Jiangtong Li, Zhixin Ling, Li Niu, Liqing Zhang

The goal of Sketch-Based Image Retrieval (SBIR) is using free-hand sketches to retrieve images of the same category from a natural image gallery.

Disentanglement Retrieval +2

DoveNet: Deep Image Harmonization via Domain Verification

1 code implementation CVPR 2020 Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu, Zhixin Ling, Weiyuan Li, Liqing Zhang

Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image.

Image Harmonization

Image Cropping with Composition and Saliency Aware Aesthetic Score Map

no code implementations24 Nov 2019 Yi Tu, Li Niu, Weijie Zhao, Dawei Cheng, Liqing Zhang

Aesthetic image cropping is a practical but challenging task which aims at finding the best crops with the highest aesthetic quality in an image.

Image Cropping

A Proposal-based Approach for Activity Image-to-Video Retrieval

no code implementations24 Nov 2019 Ruicong Xu, Li Niu, Jianfu Zhang, Liqing Zhang

Activity image-to-video retrieval task aims to retrieve videos containing the similar activity as the query image, which is a challenging task because videos generally have many background segments irrelevant to the activity.

Cross-Modal Retrieval Retrieval +1

Image Harmonization Dataset iHarmony4: HCOCO, HAdobe5k, HFlickr, and Hday2night

1 code implementation28 Aug 2019 Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu, Zhixin Ling, Weiyuan Li, Liqing Zhang

Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image.

Image Harmonization

Learning from Web Data with Self-Organizing Memory Module

no code implementations CVPR 2020 Yi Tu, Li Niu, Junjie Chen, Dawei Cheng, Liqing Zhang

However, crawled web images usually have two types of noises, label noise and background noise, which induce extra difficulties in utilizing them effectively.

Image Classification

Hard Pixel Mining for Depth Privileged Semantic Segmentation

1 code implementation27 Jun 2019 Zhangxuan Gu, Li Niu, Haohua Zhao, Liqing Zhang

Specifically, we propose a novel Loss Weight Module, which outputs a loss weight map by employing two depth-related measurements of hard pixels: Depth Prediction Error and Depthaware Segmentation Error.

Depth Estimation Depth Prediction +1

Multi-shot Pedestrian Re-identification via Sequential Decision Making

no code implementations CVPR 2018 Jianfu Zhang, Naiyan Wang, Liqing Zhang

In contrary to existing works that aggregate single frames features by time series model such as recurrent neural network, in this paper, we propose an interpretable reinforcement learning based approach to this problem.

Decision Making Time Series Analysis

Rectifier Neural Network with a Dual-Pathway Architecture for Image Denoising

no code implementations10 Sep 2016 Keting Zhang, Liqing Zhang

Recently deep neural networks based on tanh activation function have shown their impressive power in image denoising.

Image Denoising

Tensor Ring Decomposition

1 code implementation17 Jun 2016 Qibin Zhao, Guoxu Zhou, Shengli Xie, Liqing Zhang, Andrzej Cichocki

In this paper, we introduce a fundamental tensor decomposition model to represent a large dimensional tensor by a circular multilinear products over a sequence of low dimensional cores, which can be graphically interpreted as a cyclic interconnection of 3rd-order tensors, and thus termed as tensor ring (TR) decomposition.

Tensor Decomposition Tensor Networks

Object Proposal by Multi-Branch Hierarchical Segmentation

no code implementations CVPR 2015 Chaoyang Wang, Long Zhao, Shuang Liang, Liqing Zhang, Jinyuan Jia, Yichen Wei

Hierarchical segmentation based object proposal methods have become an important step in modern object detection paradigm.

object-detection Object Detection

Bayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion

1 code implementation10 May 2015 Qibin Zhao, Liqing Zhang, Andrzej Cichocki

Tucker decomposition is the cornerstone of modern machine learning on tensorial data analysis, which have attracted considerable attention for multiway feature extraction, compressive sensing, and tensor completion.

Compressive Sensing Dimensionality Reduction +1

Bayesian Robust Tensor Factorization for Incomplete Multiway Data

no code implementations9 Oct 2014 Qibin Zhao, Guoxu Zhou, Liqing Zhang, Andrzej Cichocki, Shun-ichi Amari

We propose a generative model for robust tensor factorization in the presence of both missing data and outliers.

Model Selection Variational Inference

Feature Learning from Incomplete EEG with Denoising Autoencoder

no code implementations3 Oct 2014 Junhua Li, Zbigniew Struzik, Liqing Zhang, Andrzej Cichocki

An alternative pathway for the human brain to communicate with the outside world is by means of a brain computer interface (BCI).

Denoising Electroencephalogram (EEG)

Bayesian CP Factorization of Incomplete Tensors with Automatic Rank Determination

1 code implementation25 Jan 2014 Qibin Zhao, Liqing Zhang, Andrzej Cichocki

CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors.

Bayesian Inference Image Inpainting

Spatial-Spectral Boosting Analysis for Stroke Patients' Motor Imagery EEG in Rehabilitation Training

no code implementations23 Oct 2013 Hao Zhang, Liqing Zhang

Current studies about motor imagery based rehabilitation training systems for stroke subjects lack an appropriate analytic method, which can achieve a considerable classification accuracy, at the same time detects gradual changes of imagery patterns during rehabilitation process and disinters potential mechanisms about motor function recovery.

Electroencephalogram (EEG)

Higher-Order Partial Least Squares (HOPLS): A Generalized Multi-Linear Regression Method

1 code implementation5 Jul 2012 Qibin Zhao, Cesar F. Caiafa, Danilo P. Mandic, Zenas C. Chao, Yasuo Nagasaka, Naotaka Fujii, Liqing Zhang, Andrzej Cichocki

A new generalized multilinear regression model, termed the Higher-Order Partial Least Squares (HOPLS), is introduced with the aim to predict a tensor (multiway array) $\tensor{Y}$ from a tensor $\tensor{X}$ through projecting the data onto the latent space and performing regression on the corresponding latent variables.


Dynamic visual attention: searching for coding length increments

no code implementations NeurIPS 2008 Xiaodi Hou, Liqing Zhang

A visual attention system should respond placidly when common stimuli are presented, while at the same time keep alert to anomalous visual inputs.

Cannot find the paper you are looking for? You can Submit a new open access paper.