Search Results for author: He Zhang

Found 56 papers, 16 papers with code

A Survey on Fairness-aware Recommender Systems

no code implementations1 Jun 2023 Di Jin, Luzhi Wang, He Zhang, Yizhen Zheng, Weiping Ding, Feng Xia, Shirui Pan

As information filtering services, recommender systems have extremely enriched our daily life by providing personalized suggestions and facilitating people in decision-making, which makes them vital and indispensable to human society in the information era.

Decision Making Fairness +1

Photoswap: Personalized Subject Swapping in Images

no code implementations29 May 2023 Jing Gu, Yilin Wang, Nanxuan Zhao, Tsu-Jui Fu, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, HyunJoon Jung, Xin Eric Wang

In an era where images and visual content dominate our digital landscape, the ability to manipulate and personalize these images has become a necessity.

LightPainter: Interactive Portrait Relighting with Freehand Scribble

no code implementations CVPR 2023 Yiqun Mei, He Zhang, Xuaner Zhang, Jianming Zhang, Zhixin Shu, Yilin Wang, Zijun Wei, Shi Yan, HyunJoon Jung, Vishal M. Patel

Recent portrait relighting methods have achieved realistic results of portrait lighting effects given a desired lighting representation such as an environment map.

From Wide to Deep: Dimension Lifting Network for Parameter-efficient Knowledge Graph Embedding

no code implementations22 Mar 2023 Borui Cai, Yong Xiang, Longxiang Gao, Di wu, He Zhang, Jiong Jin, Tom Luan

Specifically, we view the concatenation of all entity representations as an embedding layer, and then conventional KGE methods that adopt high-dimensional entity representations equal to enlarging the width of the embedding layer to gain expressiveness.

Knowledge Distillation Knowledge Graph Embedding +1

Semi-supervised Parametric Real-world Image Harmonization

no code implementations CVPR 2023 Ke Wang, Michaël Gharbi, He Zhang, Zhihao Xia, Eli Shechtman

Learning-based image harmonization techniques are usually trained to undo synthetic random global transformations applied to a masked foreground in a single ground truth photo.

Image Harmonization

PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositing

no code implementations CVPR 2023 Yichen Sheng, Jianming Zhang, Julien Philip, Yannick Hold-Geoffroy, Xin Sun, He Zhang, Lu Ling, Bedrich Benes

To compensate for the lack of geometry in 2D Image compositing, recent deep learning-based approaches introduced a pixel height representation to generate soft shadows and reflections.

On the Interaction between Node Fairness and Edge Privacy in Graph Neural Networks

no code implementations30 Jan 2023 He Zhang, Xingliang Yuan, Quoc Viet Hung Nguyen, Shirui Pan

Existing studies have respectively explored the fairness and privacy of GNNs and exhibited that both fairness and privacy are at the cost of GNN performance.


How Far are We from Robust Long Abstractive Summarization?

1 code implementation30 Oct 2022 Huan Yee Koh, Jiaxin Ju, He Zhang, Ming Liu, Shirui Pan

For long document abstractive models, we show that the constant strive for state-of-the-art ROUGE results can lead us to generate more relevant summaries but not factual ones.

Abstractive Text Summarization

LinearCoFold and LinearCoPartition: Linear-Time Algorithms for Secondary Structure Prediction of Interacting RNA molecules

no code implementations26 Oct 2022 He Zhang, Sizhen Li, Liang Zhang, David H. Mathews, Liang Huang

Vienna RNAcofold, which reduces the problem into the classical single sequence folding by concatenating two strands, scales in cubic time against the combined sequence length, and is slow for long sequences.

Anti-Delay Kalman Filter Fusion Algorithm for Vehicle-borne Sensor Network with Finite-Time Convergence

no code implementations20 Sep 2022 Hang Yu, Keren Dai, Haojie Li, Yao Zou, Xiang Ma, Shaojie Ma, He Zhang

Intelligent vehicles in autonomous driving and obstacle avoidance, the precise relative state of vehicles put forward a higher demand.

Autonomous Driving

Controllable Shadow Generation Using Pixel Height Maps

no code implementations12 Jul 2022 Yichen Sheng, Yifan Liu, Jianming Zhang, Wei Yin, A. Cengiz Oztireli, He Zhang, Zhe Lin, Eli Shechtman, Bedrich Benes

It can be used to calculate hard shadows in a 2D image based on the projective geometry, providing precise control of the shadows' direction and shape.

LinearAlifold: Linear-Time Consensus Structure Prediction for RNA Alignments

1 code implementation29 Jun 2022 Liang Zhang, Sizhen Li, He Zhang, David H. Mathews, Liang Huang

We present LinearAlifold, an efficient algorithm for folding aligned RNA homologs that scales linearly with both the sequence length and the number of sequences, based on our recent work LinearFold that folds a single RNA in linear time.

A Flexible Diffusion Model

no code implementations17 Jun 2022 Weitao Du, Tao Yang, He Zhang, Yuanqi Du

Despite the empirical success of the hand-crafted fixed forward SDEs, a great quantity of proper forward SDEs remain unexplored.

Trustworthy Graph Neural Networks: Aspects, Methods and Trends

no code implementations16 May 2022 He Zhang, Bang Wu, Xingliang Yuan, Shirui Pan, Hanghang Tong, Jian Pei

Graph neural networks (GNNs) have emerged as a series of competent graph learning methods for diverse real-world scenarios, ranging from daily applications like recommendation systems and question answering to cutting-edge technologies such as drug discovery in life sciences and n-body simulation in astrophysics.

Drug Discovery Edge-computing +4

Rethinking Portrait Matting with Privacy Preserving

1 code implementation31 Mar 2022 Sihan Ma, Jizhizi Li, Jing Zhang, He Zhang, DaCheng Tao

P3M-10k consists of 10, 421 high resolution face-blurred portrait images along with high-quality alpha mattes, which enables us to systematically evaluate both trimap-free and trimap-based matting methods and obtain some useful findings about model generalization ability under the privacy preserving training (PPT) setting.

Domain Generalization Image Matting +1

Interactive Portrait Harmonization

no code implementations15 Mar 2022 Jeya Maria Jose Valanarasu, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Jose Echevarria, Yinglan Ma, Zijun Wei, Kalyan Sunkavalli, Vishal M. Patel

To enable flexible interaction between user and harmonization, we introduce interactive harmonization, a new setting where the harmonization is performed with respect to a selected \emph{region} in the reference image instead of the entire background.

Image Harmonization

Projective Ranking-based GNN Evasion Attacks

no code implementations25 Feb 2022 He Zhang, Xingliang Yuan, Chuan Zhou, Shirui Pan

By projecting the strategy, our method dramatically minimizes the cost of learning a new attack strategy when the attack budget changes.

Temporal Knowledge Graph Completion: A Survey

no code implementations16 Jan 2022 Borui Cai, Yong Xiang, Longxiang Gao, He Zhang, Yunfeng Li, JianXin Li

KGC methods assume a knowledge graph is static, but that may lead to inaccurate prediction results because many facts in the knowledge graphs change over time.

Temporal Knowledge Graph Completion

Lite Vision Transformer with Enhanced Self-Attention

1 code implementation CVPR 2022 Chenglin Yang, Yilin Wang, Jianming Zhang, He Zhang, Zijun Wei, Zhe Lin, Alan Yuille

We propose Lite Vision Transformer (LVT), a novel light-weight transformer network with two enhanced self-attention mechanisms to improve the model performances for mobile deployment.

Panoptic Segmentation

HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars

no code implementations19 Dec 2021 Tao Hu, Tao Yu, Zerong Zheng, He Zhang, Yebin Liu, Matthias Zwicker

To handle complicated motions (e. g., self-occlusions), we then leverage the encoded information on the UV manifold to construct a 3D volumetric representation based on a dynamic pose-conditioned neural radiance field.

Neural Rendering

Co-evolution Transformer for Protein Contact Prediction

1 code implementation NeurIPS 2021 He Zhang, Fusong Ju, Jianwei Zhu, Liang He, Bin Shao, Nanning Zheng, Tie-Yan Liu

These methods generally derive coevolutionary features by aggregating the learned residue representations from individual sequences with equal weights, which is inconsistent with the premise that residue co-evolutions are a reflection of collective covariation patterns of numerous homologous proteins.

Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model

no code implementations29 Oct 2021 Liang He, Shizhuo Zhang, Lijun Wu, Huanhuan Xia, Fusong Ju, He Zhang, Siyuan Liu, Yingce Xia, Jianwei Zhu, Pan Deng, Bin Shao, Tao Qin, Tie-Yan Liu

The key problem in the protein sequence representation learning is to capture the co-evolutionary information reflected by the inter-residue co-variation in the sequences.

Language Modelling Multiple Sequence Alignment +1

SE(3) Equivariant Graph Neural Networks with Complete Local Frames

1 code implementation26 Oct 2021 Weitao Du, He Zhang, Yuanqi Du, Qi Meng, Wei Chen, Bin Shao, Tie-Yan Liu

In this paper, we propose a framework to construct SE(3) equivariant graph neural networks that can approximate the geometric quantities efficiently.

Fine Grained Human Evaluation for English-to-Chinese Machine Translation: A Case Study on Scientific Text

no code implementations13 Sep 2021 Ming Liu, He Zhang, Guanhao Wu

Recent research suggests that neural machine translation (MT) in the news domain has reached human-level performance, but for other professional domains, it is far below the level.

Machine Translation NMT +1

SSH: A Self-Supervised Framework for Image Harmonization

1 code implementation ICCV 2021 Yifan Jiang, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Kalyan Sunkavalli, Simon Chen, Sohrab Amirghodsi, Sarah Kong, Zhangyang Wang

Image harmonization aims to improve the quality of image compositing by matching the "appearance" (\eg, color tone, brightness and contrast) between foreground and background images.

Benchmarking Data Augmentation +1

Federated Learning Meets Natural Language Processing: A Survey

no code implementations27 Jul 2021 Ming Liu, Stella Ho, Mengqi Wang, Longxiang Gao, Yuan Jin, He Zhang

Recent Natural Language Processing techniques rely on deep learning and large pre-trained language models.

Federated Learning

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering

no code implementations CVPR 2022 Ruizhi Shao, Hongwen Zhang, He Zhang, Mingjia Chen, YanPei Cao, Tao Yu, Yebin Liu

We introduce DoubleField, a novel framework combining the merits of both surface field and radiance field for high-fidelity human reconstruction and rendering.

Transfer Learning

Error Bounds of the Invariant Statistics in Machine Learning of Ergodic Itô Diffusions

no code implementations21 May 2021 He Zhang, John Harlim, Xiantao Li

We find that sufficient conditions for such a linear dependence result are through learning algorithms that produce a uniformly Lipschitz and consistent estimator in the hypothesis space that retains certain characteristics of the drift coefficients, such as the usual linear growth condition that guarantees the existence of solutions of the underlying SDEs.

BIG-bench Machine Learning regression

A Driving Behavior Recognition Model with Bi-LSTM and Multi-Scale CNN

no code implementations1 Mar 2021 He Zhang, Zhixiong Nan, Tao Yang, Yifan Liu, Nanning Zheng

In autonomous driving, perceiving the driving behaviors of surrounding agents is important for the ego-vehicle to make a reasonable decision.

Autonomous Driving

Meticulous Object Segmentation

1 code implementation13 Dec 2020 Chenglin Yang, Yilin Wang, Jianming Zhang, He Zhang, Zhe Lin, Alan Yuille

To evaluate segmentation quality near object boundaries, we propose the Meticulosity Quality (MQ) score considering both the mask coverage and boundary precision.

Image Segmentation Semantic Segmentation

Mask Guided Matting via Progressive Refinement Network

1 code implementation CVPR 2021 Qihang Yu, Jianming Zhang, He Zhang, Yilin Wang, Zhe Lin, Ning Xu, Yutong Bai, Alan Yuille

We propose Mask Guided (MG) Matting, a robust matting framework that takes a general coarse mask as guidance.

Image Matting

A Backward SDE Method for Uncertainty Quantification in Deep Learning

no code implementations28 Nov 2020 Richard Archibald, Feng Bao, Yanzhao Cao, He Zhang

We develop a probabilistic machine learning method, which formulates a class of stochastic neural networks by a stochastic optimal control problem.

BIG-bench Machine Learning

Deep Image Compositing

no code implementations4 Nov 2020 He Zhang, Jianming Zhang, Federico Perazzi, Zhe Lin, Vishal M. Patel

In this paper, we propose a new method which can automatically generate high-quality image compositing without any user input.

Image Matting

Synergy between Machine/Deep Learning and Software Engineering: How Far Are We?

no code implementations12 Aug 2020 Simin Wang, LiGuo Huang, Jidong Ge, Tengfei Zhang, Haitao Feng, Ming Li, He Zhang, Vincent Ng

To improve the applicability and generalizability of research results, we analyzed what ingredients in a study would facilitate an understanding of why a ML/DL technique was selected for a specific SE problem.

SummPip: Unsupervised Multi-Document Summarization with Sentence Graph Compression

1 code implementation17 Jul 2020 Jinming Zhao, Ming Liu, Longxiang Gao, Yuan Jin, Lan Du, He Zhao, He Zhang, Gholamreza Haffari

Obtaining training data for multi-document summarization (MDS) is time consuming and resource-intensive, so recent neural models can only be trained for limited domains.

Document Summarization Multi-Document Summarization

Algorithm for Optimized mRNA Design Improves Stability and Immunogenicity

1 code implementation21 Apr 2020 He Zhang, Liang Zhang, Ang Lin, Congcong Xu, Ziyu Li, Kaibo Liu, Boxiang Liu, Xiaopin Ma, Fanfan Zhao, Weiguo Yao, Hangwen Li, David H. Mathews, Yujian Zhang, Liang Huang

Messenger RNA (mRNA) vaccines are being used for COVID-19, but still suffer from the critical issue of mRNA instability and degradation, which is a major obstacle in the storage, distribution, and efficacy of the vaccine.

FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazing

no code implementations20 Jan 2020 Yu Dong, Yihao Liu, He Zhang, Shifeng Chen, Yu Qiao

With the proposed Fusion-discriminator which takes frequency information as additional priors, our model can generator more natural and realistic dehazed images with less color distortion and fewer artifacts.

Image Dehazing Single Image Dehazing

Dual affine moment invariants

no code implementations19 Nov 2019 You Hao, Hanlin Mo, Qi Li, He Zhang, Hua Li

In this paper, we propose a general framework to derive moment invariants under DAT for objects in M-dimensional space with N channels, which can be called dual-affine moment invariants (DAMI).

Deep Adversarial Learning in Intrusion Detection: A Data Augmentation Enhanced Framework

no code implementations23 Jan 2019 He Zhang, Xingrui Yu, Peng Ren, Chunbo Luo, Geyong Min

The novelty of the proposed framework focuses on incorporating deep adversarial learning with statistical learning and exploiting learning based data augmentation.

Data Augmentation Network Intrusion Detection

Synthesis of High-Quality Visible Faces from Polarimetric Thermal Faces using Generative Adversarial Networks

no code implementations12 Dec 2018 He Zhang, Benjamin S. Riggan, Shuowen Hu, Nathaniel J. Short, Vishal M. Patel

Previous approaches utilize either a two-step procedure (visible feature estimation and visible image reconstruction) or an input-level fusion technique, where different Stokes images are concatenated and used as a multi-channel input to synthesize the visible image given the corresponding polarimetric signatures.

Face Generation Face Verification +1

Differential and integral invariants under Mobius transformation

no code implementations30 Aug 2018 He Zhang, Hanlin Mo, You Hao, Qi Li, Hua Li

According to the Liouville Theorem, an important part of the conformal transformation is the Mobius transformation, so we focus on Mobius transformation and propose two differential expressions that are invariable under 2-D and 3-D Mobius transformation respectively.

Pushing the Limits of Unconstrained Face Detection: a Challenge Dataset and Baseline Results

no code implementations26 Apr 2018 Hajime Nada, Vishwanath A. Sindagi, He Zhang, Vishal M. Patel

In this work, we identify the next set of challenges that requires attention from the research community and collect a new dataset of face images that involve these issues such as weather-based degradations, motion blur, focus blur and several others.

Face Detection Robust Face Recognition

Densely Connected Pyramid Dehazing Network

1 code implementation CVPR 2018 He Zhang, Vishal M. Patel

We propose a new end-to-end single image dehazing method, called Densely Connected Pyramid Dehazing Network (DCPDN), which can jointly learn the transmission map, atmospheric light and dehazing all together.

Image Dehazing Single Image Dehazing

Density-aware Single Image De-raining using a Multi-stream Dense Network

1 code implementation CVPR 2018 He Zhang, Vishal M. Patel

In addition, an ablation study is performed to demonstrate the improvements obtained by different modules in the proposed method.

Density Estimation Single Image Deraining

Fast and Efficient Calculations of Structural Invariants of Chirality

no code implementations20 Oct 2017 He Zhang, Hanlin Mo, You Hao, Shirui Li, Hua Li

And the five chiral invariants have four characteristics:(1) They play an important role in the detection of symmetry, especially in the treatment of 'false zero' problem.

Symmetry Detection

Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces

no code implementations8 Aug 2017 He Zhang, Vishal M. Patel, Benjamin S. Riggan, Shuowen Hu

Previous approaches utilize a two-step procedure (visible feature estimation and visible image reconstruction) to synthesize the visible image given the corresponding polarimetric thermal image.

Face Generation Face Recognition +2

SAR Image Despeckling Using a Convolutional Neural Network

3 code implementations2 Jun 2017 Puyang Wang, He Zhang, Vishal M. Patel

Synthetic Aperture Radar (SAR) images are often contaminated by a multiplicative noise known as speckle.

Sar Image Despeckling

Sparse Representation-based Open Set Recognition

1 code implementation6 May 2017 He Zhang, Vishal M. Patel

We propose a generalized Sparse Representation- based Classification (SRC) algorithm for open set recognition where not all classes presented during testing are known during training.

Classification General Classification +3

Image De-raining Using a Conditional Generative Adversarial Network

7 code implementations21 Jan 2017 He Zhang, Vishwanath Sindagi, Vishal M. Patel

Hence, it is important to solve the problem of single image de-raining/de-snowing.

Rain Removal

Towards Evidence-Based Ontology for Supporting Systematic Literature Review

no code implementations22 Sep 2016 Yueming Sun, Ye Yang, He Zhang, Wen Zhang, Qing Wang

[Conclusions]: The approach of using ontology could effectively and efficiently support the conducting of systematic literature review.

Cannot find the paper you are looking for? You can Submit a new open access paper.