Search Results for author: Jie Cao

Found 51 papers, 17 papers with code

Recent Progress of Face Image Synthesis

no code implementations15 Jun 2017 Zhihe Lu, Zhihang Li, Jie Cao, Ran He, Zhenan Sun

Face synthesis has been a fascinating yet challenging problem in computer vision and machine learning.

Face Generation Face Recognition

An Effective Training Method For Deep Convolutional Neural Network

no code implementations31 Jul 2017 Yang Jiang, Zeyang Dou, Qun Hao, Jie Cao, Kun Gao, Xi Chen

In this paper, we propose the nonlinearity generation method to speed up and stabilize the training of deep convolutional neural networks.

Object Recognition

Load Balanced GANs for Multi-view Face Image Synthesis

no code implementations21 Feb 2018 Jie Cao, Yibo Hu, Bing Yu, Ran He, Zhenan Sun

Multi-view face synthesis from a single image is an ill-posed problem and often suffers from serious appearance distortion.

Face Generation

Learning a High Fidelity Pose Invariant Model for High-resolution Face Frontalization

no code implementations NeurIPS 2018 Jie Cao, Yibo Hu, Hongwen Zhang, Ran He, Zhenan Sun

We decompose the prerequisite of warping into dense correspondence field estimation and facial texture map recovering, which are both well addressed by deep networks.

Dictionary Learning Face Recognition +2

Geometry-Aware Face Completion and Editing

no code implementations9 Sep 2018 Linsen Song, Jie Cao, Linxiao Song, Yibo Hu, Ran He

Extensive experimental results qualitatively and quantitatively demonstrate that our network is able to generate visually pleasing face completion results and edit face attributes as well.

Facial Inpainting

Location-Centered House Price Prediction: A Multi-Task Learning Approach

no code implementations7 Jan 2019 Guangliang Gao, Zhifeng Bao, Jie Cao, A. K. Qin, Timos Sellis, Fellow, IEEE, Zhiang Wu

Regarding the choice of prediction model, we observe that a variety of approaches either consider the entire house data for modeling, or split the entire data and model each partition independently.

Multi-Task Learning

Cross-spectral Face Completion for NIR-VIS Heterogeneous Face Recognition

no code implementations10 Feb 2019 Ran He, Jie Cao, Lingxiao Song, Zhenan Sun, Tieniu Tan

This paper models high resolution heterogeneous face synthesis as a complementary combination of two components, a texture inpainting component and pose correction component.

Face Generation Face Recognition +3

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

no code implementations14 Apr 2019 Jie Cao, Huaibo Huang, Yi Li, Jingtuo Liu, Ran He, Zhenan Sun

In this work, we present a novel training framework for GANs, namely biphasic learning, to achieve image-to-image translation in multiple visual domains at $1024^2$ resolution.

Image-to-Image Translation Mutual Information Estimation +2

Accurate Human Gesture Sensing With Coarse-Grained RF Signatures

no code implementations IEEE Access ( Volume: 7 ) 2019 Hongyu Sun, Zheng Lu, Chin-Ling Chen, Jie Cao, Zhenjiang Tan

RF-based gesture sensing and recognition has increasingly attracted intense academic and industrial interest due to its various device-free applications in daily life, such as elder monitoring, mobile games.

RF-based Gesture Recognition

Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes

1 code implementation ACL 2019 Jie Cao, Michael Tanana, Zac E. Imel, Eric Poitras, David C. Atkins, Vivek Srikumar

Specifically, we address the problem of providing real-time guidance to therapists with a dialogue observer that (1) categorizes therapist and client MI behavioral codes and, (2) forecasts codes for upcoming utterances to help guide the conversation and potentially alert the therapist.

PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer

1 code implementation CVPR 2020 Wentao Jiang, Si Liu, Chen Gao, Jie Cao, Ran He, Jiashi Feng, Shuicheng Yan

In this paper, we address the makeup transfer task, which aims to transfer the makeup from a reference image to a source image.

Amazon at MRP 2019: Parsing Meaning Representations with Lexical and Phrasal Anchoring

no code implementations CONLL 2019 Jie Cao, Yi Zhang, Adel Youssef, Vivek Srikumar

This paper describes the system submission of our team Amazon to the shared task on Cross Framework Meaning Representation Parsing (MRP) at the 2019 Conference for Computational Language Learning (CoNLL).

Learning 3D Human Shape and Pose from Dense Body Parts

1 code implementation31 Dec 2019 Hongwen Zhang, Jie Cao, Guo Lu, Wanli Ouyang, Zhenan Sun

Reconstructing 3D human shape and pose from monocular images is challenging despite the promising results achieved by the most recent learning-based methods.

Ranked #76 on 3D Human Pose Estimation on 3DPW (MPJPE metric)

3D human pose and shape estimation 3D Human Reconstruction +3

Informative Sample Mining Network for Multi-Domain Image-to-Image Translation

no code implementations ECCV 2020 Jie Cao, Huaibo Huang, Yi Li, Ran He, Zhenan Sun

The performance of multi-domain image-to-image translation has been significantly improved by recent progress in deep generative models.

Image-to-Image Translation Informativeness +1

Augmented Parallel-Pyramid Net for Attention Guided Pose-Estimation

no code implementations17 Mar 2020 Luanxuan Hou, Jie Cao, Yuan Zhao, Haifeng Shen, Yiping Meng, Ran He, Jieping Ye

At last, we proposed a differentiable auto data augmentation method to further improve estimation accuracy.

Data Augmentation Pose Estimation

OSLNet: Deep Small-Sample Classification with an Orthogonal Softmax Layer

1 code implementation20 Apr 2020 Xiaoxu Li, Dongliang Chang, Zhanyu Ma, Zheng-Hua Tan, Jing-Hao Xue, Jie Cao, Jingyi Yu, Jun Guo

A deep neural network of multiple nonlinear layers forms a large function space, which can easily lead to overfitting when it encounters small-sample data.

Classification General Classification

ReMarNet: Conjoint Relation and Margin Learning for Small-Sample Image Classification

1 code implementation27 Jun 2020 Xiaoxu Li, Liyun Yu, Xiaochen Yang, Zhanyu Ma, Jing-Hao Xue, Jie Cao, Jun Guo

Despite achieving state-of-the-art performance, deep learning methods generally require a large amount of labeled data during training and may suffer from overfitting when the sample size is small.

Classification General Classification +3

BSNet: Bi-Similarity Network for Few-shot Fine-grained Image Classification

1 code implementation29 Nov 2020 Xiaoxu Li, Jijie Wu, Zhuo Sun, Zhanyu Ma, Jie Cao, Jing-Hao Xue

Motivated by this, we propose a so-called \textit{Bi-Similarity Network} (\textit{BSNet}) that consists of a single embedding module and a bi-similarity module of two similarity measures.

Few-Shot Learning Fine-Grained Image Classification +1

ReMix: Towards Image-to-Image Translation with Limited Data

1 code implementation CVPR 2021 Jie Cao, Luanxuan Hou, Ming-Hsuan Yang, Ran He, Zhenan Sun

We interpolate training samples at the feature level and propose a novel content loss based on the perceptual relations among samples.

Data Augmentation Image-to-Image Translation +1

Database Workload Characterization with Query Plan Encoders

3 code implementations26 May 2021 Debjyoti Paul, Jie Cao, Feifei Li, Vivek Srikumar

To address this workload characterization problem, we propose our query plan encoders that learn essential features and their correlations from query plans.

Representation Learning Transfer Learning

A Comparative Study on Schema-Guided Dialogue State Tracking

no code implementations NAACL 2021 Jie Cao, Yi Zhang

In this paper, we conduct in-depth comparative studies to understand the use of natural language description for schema in dialog state tracking.

dialog state tracking Dialogue State Tracking +1

FaceInpainter: High Fidelity Face Adaptation to Heterogeneous Domains

no code implementations CVPR 2021 Jia Li, Zhaoyang Li, Jie Cao, Xingguang Song, Ran He

In this work, we propose a novel two-stage framework named FaceInpainter to implement controllable Identity-Guided Face Inpainting (IGFI) under heterogeneous domains.

Attribute Facial Inpainting +1

Optimization of retina-like illumination patterns in ghost imaging

no code implementations2 Aug 2021 Jie Cao, Dong Zhou, Ying-Qiang Zhang, Huan Cui, Fang-Hua Zhang, Qun Hao

This proposed method is verified by simulations and experiments compared with conventional GI, retina-like GI and GI using patterns optimized by principal component analysis.

Compressive Sensing

Complementary Fourier single-pixel imaging

no code implementations2 Aug 2021 Dong Zhou, Jie Cao, Huan Cui, Qun Hao, Bing-Kun Chen, Kai Lin

The complementary nature of Fourier patterns based on a four-step phase-shift algorithm is combined with the complementary nature of a digital micromirror device.

Improving Subgraph Recognition with Variational Graph Information Bottleneck

1 code implementation CVPR 2022 Junchi Yu, Jie Cao, Ran He

Subgraph recognition aims at discovering a compressed substructure of a graph that is most informative to the graph property.

Graph Classification

Styleverse: Towards Identity Stylization across Heterogeneous Domains

no code implementations2 Mar 2022 Jia Li, Jie Cao, Junxian Duan, Ran He

We propose a new challenging task namely IDentity Stylization (IDS) across heterogeneous domains.

Style Transfer

Window Filtering Algorithm for Pulsed Light Coherent Combining of Low Repetition Frequency

no code implementations3 Mar 2022 Jiali Zhang, Jie Cao, Qun Hao, Yang Cheng, Liquan Dong, Bin Han, Xuesheng Liu

The multi-dithering method has been well verified in phase locking of polarization coherent combination experiment.

Point Cloud Semantic Segmentation using Multi Scale Sparse Convolution Neural Network

no code implementations3 May 2022 Yunzheng Su, Lei Jiang, Jie Cao

In recent years, with the development of computing resources and LiDAR, point cloud semantic segmentation has attracted many researchers.

feature selection Point Cloud Segmentation +2

Temporally and Spatially variant-resolution illumination patterns in computational ghost imaging

no code implementations5 May 2022 Dong Zhou, Jie Cao, Huan Cui, Li-Xing Lin, Haoyu Zhang, Yingqiang Zhang, Qun Hao

For the same number of measurements, the method using temporally variable-resolution illumination patterns has better imaging quality than CGI, but it is less robust to noise.

"Understanding Robustness Lottery": A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches

no code implementations16 Jun 2022 Zhimin Li, Shusen Liu, Xin Yu, Kailkhura Bhavya, Jie Cao, Diffenderfer James Daniel, Peer-Timo Bremer, Valerio Pascucci

We decomposed and evaluated a set of critical geometric concepts from the common adopted classification loss, and used them to design a visualization system to compare and highlight the impact of pruning on model performance and feature representation.

Network Pruning

Modeling the Social Influence of COVID-19 via Personalized Propagation with Deep Learning

no code implementations26 Jul 2022 Yufei Liu, Jie Cao, Dechang Pi

The resulting algorithm combines the personalized propagation of a neural prediction model with the approximate personalized propagation of a neural prediction model from page rank analysis.

Marketing Recommendation Systems

DeepGen: Diverse Search Ad Generation and Real-Time Customization

no code implementations6 Aug 2022 Konstantin Golobokov, Junyi Chai, Victor Ye Dong, Mandy Gu, Bingyu Chi, Jie Cao, Yulan Yan, Yi Liu

In addition, our system creates a customized ad in real-time in response to the user's search query, therefore highlighting different aspects of the same product based on what the user is looking for.

Text Generation

OTSeq2Set: An Optimal Transport Enhanced Sequence-to-Set Model for Extreme Multi-label Text Classification

1 code implementation26 Oct 2022 Jie Cao, Yin Zhang

However, such models can't predict a relatively complete and variable-length label subset for each document, because they select positive labels relevant to the document by a fixed threshold or take top k labels in descending order of scores.

Multi Label Text Classification Multi-Label Text Classification +1

ScoreMix: A Scalable Augmentation Strategy for Training GANs with Limited Data

no code implementations27 Oct 2022 Jie Cao, Mandi Luo, Junchi Yu, Ming-Hsuan Yang, Ran He

Then, we optimize the augmented samples by minimizing the norms of the data scores, i. e., the gradients of the log-density functions.

Data Augmentation Image Generation

Vision Transformer with Super Token Sampling

1 code implementation CVPR 2023 Huaibo Huang, Xiaoqiang Zhou, Jie Cao, Ran He, Tieniu Tan

STA decomposes vanilla global attention into multiplications of a sparse association map and a low-dimensional attention, leading to high efficiency in capturing global dependencies.

Semantic Segmentation Superpixels

Rega-Net:Retina Gabor Attention for Deep Convolutional Neural Networks

no code implementations23 Nov 2022 Chun Bao, Jie Cao, Yaqian Ning, Yang Cheng, Qun Hao

Extensive research works demonstrate that the attention mechanism in convolutional neural networks (CNNs) effectively improves accuracy.

object-detection Object Detection

Bi-directional Feature Reconstruction Network for Fine-Grained Few-Shot Image Classification

1 code implementation30 Nov 2022 Jijie Wu, Dongliang Chang, Aneeshan Sain, Xiaoxu Li, Zhanyu Ma, Jie Cao, Jun Guo, Yi-Zhe Song

Conventional few-shot learning methods however cannot be naively adopted for this fine-grained setting -- a quick pilot study reveals that they in fact push for the opposite (i. e., lower inter-class variations and higher intra-class variations).

Few-Shot Image Classification Few-Shot Learning +2

Dependency Dialogue Acts -- Annotation Scheme and Case Study

no code implementations25 Feb 2023 Jon Z. Cai, Brendan King, Margaret Perkoff, Shiran Dudy, Jie Cao, Marie Grace, Natalia Wojarnik, Ananya Ganesh, James H. Martin, Martha Palmer, Marilyn Walker, Jeffrey Flanigan

DDA combines and adapts features from existing dialogue annotation frameworks, and emphasizes the multi-relational response structure of dialogues in addition to the dialogue acts and rhetorical relations.

MODIFY: Model-driven Face Stylization without Style Images

1 code implementation17 Mar 2023 Yuhe Ding, Jian Liang, Jie Cao, Aihua Zheng, Ran He

Briefly, MODIFY first trains a generative model in the target domain and then translates a source input to the target domain via the provided style model.

Translation

AUTO: Adaptive Outlier Optimization for Online Test-Time OOD Detection

1 code implementation22 Mar 2023 Puning Yang, Jian Liang, Jie Cao, Ran He

Out-of-distribution (OOD) detection is a crucial aspect of deploying machine learning models in open-world applications.

Out of Distribution (OOD) Detection

Boosting Fast and High-Quality Speech Synthesis with Linear Diffusion

no code implementations9 Jun 2023 Haogeng Liu, Tao Wang, Jie Cao, Ran He, JianHua Tao

When decreasing the number of sampling steps (i. e., the number of line segments used to fit the path), the ease of fitting straight lines compared to curves allows us to generate higher quality samples from a random noise with fewer iterations.

Denoising Speech Synthesis

Semi-Offline Reinforcement Learning for Optimized Text Generation

1 code implementation16 Jun 2023 Changyu Chen, Xiting Wang, Yiqiao Jin, Victor Ye Dong, Li Dong, Jie Cao, Yi Liu, Rui Yan

In reinforcement learning (RL), there are two major settings for interacting with the environment: online and offline.

Offline RL reinforcement-learning +2

Flexible uniform-sampling foveated Fourier single-pixel imaging

no code implementations5 Nov 2023 Huan Cui, Jie Cao, Qun Hao, Haoyu Zhang, Chang Zhou

At a sampling ratio of 0. 0084 referring to HR FSI with 1024*768 pixels, experimentally, by UFFSI with 255*341 cells of 89% reduction in data redundancy, the ROI has a significantly better imaging quality to meet imaging needs.

Improved Dense Nested Attention Network Based on Transformer for Infrared Small Target Detection

1 code implementation15 Nov 2023 Chun Bao, Jie Cao, Yaqian Ning, Tianhua Zhao, Zhijun Li, Zechen Wang, Li Zhang, Qun Hao

To address this issue, we propose a novel method for detecting infrared small targets called improved dense nested attention network (IDNANet), which is based on the transformer architecture.

Exploring Straighter Trajectories of Flow Matching with Diffusion Guidance

no code implementations28 Nov 2023 Siyu Xing, Jie Cao, Huaibo Huang, Xiao-Yu Zhang, Ran He

First, we propose a coupling strategy to straighten trajectories, creating couplings between image and noise samples under diffusion model guidance.

Goal-Oriented Communication, Estimation, and Control over Bidirectional Wireless Links

no code implementations26 Dec 2023 Jie Cao, Ernest Kurniawan, Amnart Boonkajay, Nikolaos Pappas, Sumei Sun, Petar Popovski

This status information, such as dynamic plant state and Markov Process-based context information, is then received/estimated by the controller for remote control.

Scheduling

Band-Attention Modulated RetNet for Face Forgery Detection

no code implementations9 Apr 2024 Zhida Zhang, Jie Cao, Wenkui Yang, Qihang Fan, Kai Zhou, Ran He

The transformer networks are extensively utilized in face forgery detection due to their scalability across large datasets. Despite their success, transformers face challenges in balancing the capture of global context, which is crucial for unveiling forgery clues, with computational complexity. To mitigate this issue, we introduce Band-Attention modulated RetNet (BAR-Net), a lightweight network designed to efficiently process extensive visual contexts while avoiding catastrophic forgetting. Our approach empowers the target token to perceive global information by assigning differential attention levels to tokens at varying distances.

An Augmented Benchmark Dataset for Geometric Question Answering through Dual Parallel Text Encoding

no code implementations COLING 2022 Jie Cao, Jing Xiao

The lack of high-quality datasets and efficient neural geometric solvers impedes the development of automatic geometric problems solving.

Data Augmentation Math +1

Cannot find the paper you are looking for? You can Submit a new open access paper.