Search Results for author: Jin Liu

Found 65 papers, 19 papers with code

Modeling Hierarchical Syntax Structure with Triplet Position for Source Code Summarization

no code implementations ACL 2022 Juncai Guo, Jin Liu, Yao Wan, Li Li, Pingyi Zhou

In this paper, we propose CODESCRIBE to model the hierarchical syntax structure of code by introducing a novel triplet position for code summarization.

Code Summarization Position +1

Latent Schr{ö}dinger Bridge Diffusion Model for Generative Learning

no code implementations20 Apr 2024 Yuling Jiao, Lican Kang, Huazhen Lin, Jin Liu, Heng Zuo

Our theoretical analysis encompasses the establishment of end-to-end error analysis for learning distributions via the latent Schr{\"o}dinger bridge diffusion model.

Model Will Tell: Training Membership Inference for Diffusion Models

no code implementations13 Mar 2024 Xiaomeng Fu, Xi Wang, Qiao Li, Jin Liu, Jiao Dai, Jizhong Han

In this paper, we explore a novel perspective for the TMI task by leveraging the intrinsic generative priors within the diffusion model.

Binary Classification

Region-Aware Exposure Consistency Network for Mixed Exposure Correction

1 code implementation28 Feb 2024 Jin Liu, Huiyuan Fu, Chuanming Wang, Huadong Ma

Exposure correction aims to enhance images suffering from improper exposure to achieve satisfactory visual effects.

Learning Exposure Correction in Dynamic Scenes

no code implementations27 Feb 2024 Jin Liu, Bo wang, Chuanming Wang, Huiyuan Fu, Huadong Ma

While image exposure correction is a popular topic, the video counterpart is less explored in the literature.

Video Enhancement

Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting

1 code implementation3 Dec 2023 Jin Liu, Huaibo Huang, Chao Jin, Ran He

Face stylization refers to the transformation of a face into a specific portrait style.

Image Reconstruction

A Hybrid Frame Structure Design of OTFS for Multi-tasks Communications

no code implementations21 Nov 2023 Pu Yuan, Jin Liu, Dajie Jiang, Fei Qin

Orthogonal time frequency space (OTFS) is a promising waveform in high mobility scenarios for it fully exploits the time-frequency diversity using a discrete Fourier transform (DFT) based two dimensional spreading.

OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions

no code implementations28 Sep 2023 Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai, Cai Yu, Jiao Dai, Jizhong Han

Other works construct one-to-one mapping between audio signal and head motion sequences, introducing ambiguity correspondences into the mapping since people can behave differently in head motions when speaking the same content.

Talking Head Generation Video Generation

MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Model

no code implementations31 Aug 2023 Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai, Cai Yu, Jiao Dai, Jizhong Han

Responsive listening head generation is an important task that aims to model face-to-face communication scenarios by generating a listener head video given a speaker video and a listener head image.

Denoising

Faster Stochastic Variance Reduction Methods for Compositional MiniMax Optimization

no code implementations18 Aug 2023 Jin Liu, Xiaokang Pan, Junwen Duan, Hongdong Li, Youqi Li, Zhe Qu

All the proposed complexities indicate that our proposed methods can match lower bounds to existing minimax optimizations, without requiring a large batch size in each iteration.

Stochastic Optimization

"Generate" the Future of Work through AI: Empirical Evidence from Online Labor Markets

no code implementations9 Aug 2023 Jin Liu, Xingchen Xu, Yongjun Li, Yong Tan

With the advent of general-purpose Generative AI, the interest in discerning its impact on the labor market escalates.

Mobile Supply: The Last Piece of Jigsaw of Recommender System

no code implementations7 Aug 2023 Zhenhao Jiang, Biao Zeng, Hao Feng, Jin Liu, Jie Zhang, Jia Jia, Ning Hu

In order to address the problem of pagination trigger mechanism, we propose a completely new module in the pipeline of recommender system named Mobile Supply.

Recommendation Systems Re-Ranking

ESMC: Entire Space Multi-Task Model for Post-Click Conversion Rate via Parameter Constraint

no code implementations18 Jul 2023 Zhenhao Jiang, Biao Zeng, Hao Feng, Jin Liu, Jicong Fan, Jie Zhang, Jia Jia, Ning Hu, Xingyu Chen, Xuguang Lan

We propose a novel Entire Space Multi-Task Model for Post-Click Conversion Rate via Parameter Constraint (ESMC) and two alternatives: Entire Space Multi-Task Model with Siamese Network (ESMS) and Entire Space Multi-Task Model in Global Domain (ESMG) to address the PSC issue.

Decision Making Recommendation Systems +1

Asymmetric Patch Sampling for Contrastive Learning

1 code implementation5 Jun 2023 Chengchao Shen, Jianzhong Chen, Shu Wang, Hulin Kuang, Jin Liu, Jianxin Wang

Asymmetric appearance between positive pair effectively reduces the risk of representation degradation in contrastive learning.

Contrastive Learning Instance Segmentation +3

Adaptive Graph Convolutional Subspace Clustering

1 code implementation CVPR 2023 Lai Wei, Zhengwei Chen, Jun Yin, Changming Zhu, Rigui Zhou, Jin Liu

Spectral-type subspace clustering algorithms have shown excellent performance in many subspace clustering applications.

Clustering

FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions

no code implementations31 Mar 2023 Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai, Cai Yu, Jiao Dai, Jizhong Han

Specifically, the head pose prediction module is designed to generate head pose sequences from the source face and driving audio.

Pose Prediction Talking Head Generation +1

Joint embedding in Hierarchical distance and semantic representation learning for link prediction

no code implementations28 Mar 2023 Jin Liu, Jianye Chen, Chongfeng Fan, Fengyu Zhou

Existing well-known models deal with this task by mainly focusing on representing knowledge graph triplets in the distance space or semantic space.

Knowledge Graph Embedding Link Prediction +1

RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation

1 code implementation22 Mar 2023 Fengji Zhang, Bei Chen, Yue Zhang, Jacky Keung, Jin Liu, Daoguang Zan, Yi Mao, Jian-Guang Lou, Weizhu Chen

The task of repository-level code completion is to continue writing the unfinished code based on a broader context of the repository.

Code Completion Language Modelling +1

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

no code implementations3 Mar 2023 Junbin Mao, Jin Liu, Hanhe Lin, Hulin Kuang, Shirui Pan, Yi Pan

To effectively offset the negative impact between modalities in the process of multi-modal integration and extract heterogeneous information from graphs, we propose a novel method called MMKGL (Multi-modal Multi-Kernel Graph Learning).

Disease Prediction Graph Embedding +1

OPT: One-shot Pose-Controllable Talking Head Generation

no code implementations16 Feb 2023 Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai, Cai Yu, Jiao Dai, Jizhong Han

To solve the identity mismatch problem and achieve high-quality free pose control, we present One-shot Pose-controllable Talking head generation network (OPT).

Disentanglement Talking Head Generation

Diverse Title Generation for Stack Overflow Posts with Multiple Sampling Enhanced Transformer

1 code implementation24 Aug 2022 Fengji Zhang, Jin Liu, Yao Wan, Xiao Yu, Xiao Liu, Jacky Keung

Stack Overflow is one of the most popular programming communities where developers can seek help for their encountered problems.

Semantic decomposition Network with Contrastive and Structural Constraints for Dental Plaque Segmentation

no code implementations12 Aug 2022 Jian Shi, Baoli Sun, Xinchen Ye, Zhihui Wang, Xiaolong Luo, Jin Liu, Heli Gao, Haojie Li

Therefore, we propose a semantic decomposition network (SDNet) that introduces two single-task branches to separately address the segmentation of teeth and dental plaque and designs additional constraints to learn category-specific features for each branch, thus facilitating the semantic decomposition and improving the performance of dental plaque segmentation.

Segmentation

A Frequency-aware Software Cache for Large Recommendation System Embeddings

1 code implementation8 Aug 2022 Jiarui Fang, Geng Zhang, Jiatong Han, Shenggui Li, Zhengda Bian, Yongbin Li, Jin Liu, Yang You

Deep learning recommendation models (DLRMs) have been widely applied in Internet companies.

Syntax Controlled Knowledge Graph-to-Text Generation with Order and Semantic Consistency

1 code implementation Findings (NAACL) 2022 Jin Liu, Chongfeng Fan, Fengyu Zhou, Huijuan Xu

Knowledge graph-to-text (KG-to-text) generation aims to generate easy-to-understand sentences from the KG, and at the same time, maintains semantic consistency between generated sentences and the KG.

KG-to-Text Generation POS +2

CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training

no code implementations Findings (NAACL) 2022 Xin Wang, Yasheng Wang, Yao Wan, Jiawei Wang, Pingyi Zhou, Li Li, Hao Wu, Jin Liu

Specifically, we first extract multiple code views using compiler tools, and learn the complementary information among them under a contrastive learning framework.

Contrastive Learning Defect Detection +2

MRI-based Multi-task Decoupling Learning for Alzheimer's Disease Detection and MMSE Score Prediction: A Multi-site Validation

1 code implementation2 Apr 2022 Xu Tian, Jin Liu, Hulin Kuang, Yu Sheng, Jianxin Wang, the Alzheimer's Disease Neuroimaging Initiative

First, a multi-task learning network is proposed to implement AD detection and MMSE score prediction, which exploits feature correlation by adding three multi-task interaction layers between the backbones of the two tasks.

Alzheimer's Disease Detection Feature Correlation +2

Compilable Neural Code Generation with Compiler Feedback

no code implementations Findings (ACL) 2022 Xin Wang, Yasheng Wang, Yao Wan, Fei Mi, Yitong Li, Pingyi Zhou, Jin Liu, Hao Wu, Xin Jiang, Qun Liu

Automatically generating compilable programs with (or without) natural language descriptions has always been a touchstone problem for computational linguistics and automated software engineering.

Code Completion Code Generation +3

Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation

no code implementations COLING 2022 Yihe Wang, Yitong Li, Yasheng Wang, Fei Mi, Pingyi Zhou, Xin Wang, Jin Liu, Xin Jiang, Qun Liu

Experiments over publicly available datasets demonstrate that our method can help models generate better responses, even such training data are usually impressed as low-quality data.

Dialogue Generation Retrieval

ARSC-Net: Adventitious Respiratory Sound Classification Network Using Parallel Paths with Channel-Spatial Attention

no code implementations IEEE International Conference on Bioinformatics and Biomedicine 2022 Lei Xu, Jianhong Cheng, Jin Liu, Hulin Kuang, Fan Wu, Jianxin Wang

The two types of features are entered into the parallel encoders paths with residual attention for extracting feature representation, and then fused into a channel-spatial attention module to adaptively focus on the important features between channel and spatial part for the classification task.

Ranked #9 on Audio Classification on ICBHI Respiratory Sound Database (using extra training data)

Audio Classification Sound Classification

Rational Polynomial Camera Model Warping for Deep Learning Based Satellite Multi-View Stereo Matching

1 code implementation ICCV 2021 Jian Gao, Jin Liu, Shunping Ji

Based on the RPC warping, we propose the deep learning based satellite MVS (SatMVS) framework for large-scale and wide depth range Earth surface reconstruction.

Stereo Matching Surface Reconstruction

SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation

no code implementations10 Aug 2021 Xin Wang, Yasheng Wang, Fei Mi, Pingyi Zhou, Yao Wan, Xiao Liu, Li Li, Hao Wu, Jin Liu, Xin Jiang

Code representation learning, which aims to encode the semantics of source code into distributed vectors, plays an important role in recent deep-learning-based models for code intelligence.

Clone Detection Code Search +5

Effectiveness of Artificial Intelligence in Stock Market Prediction based on Machine Learning

1 code implementation30 Jun 2021 Sohrab Mokhtari, Kang K. Yen, Jin Liu

This paper tries to address the problem of stock market prediction leveraging artificial intelligence (AI) strategies.

BIG-bench Machine Learning Stock Market Prediction

Hierarchical Neighbor Propagation With Bidirectional Graph Attention Network for Relation Prediction

no code implementations IEEE/ACM Transactions on Audio, Speech, and Language Processing 2021 Zhiwen Xie, Runjie Zhu, Jin Liu, Guangyou Zhou, and Jimmy Xiangji Huang

Abstract—The graph attention network (GAT) [1] has started to become a mainstream neural network architecture since 2018, yielding remarkable performance gains in various natural language processing (NLP) tasks.

Graph Attention Relation

LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

no code implementations7 Apr 2021 Jin Liu, Peng Chen, Tao Liang, Zhaoxing Li, Cai Yu, Shuqiao Zou, Jiao Dai, Jizhong Han

Face reenactment is a challenging task, as it is difficult to maintain accurate expression, pose and identity simultaneously.

Face Reenactment

DeepMI: Deep Multi-lead ECG Fusion for Identifying Myocardial Infarction and its Occurrence-time

no code implementations31 Mar 2021 Girmaw Abebe Tadesse, Hamza Javed, Yong liu, Jin Liu, Jiyan Chen, Komminist Weldemariam, Tingting Zhu

We propose an end-to-end deep learning approach, DeepMI, to classify MI from normal cases as well as identifying the time-occurrence of MI (defined as acute, recent and old), using a collection of fusion strategies on 12 ECG leads at data-, feature-, and decision-level.

Transfer Learning

Toward Understanding Supervised Representation Learning with RKHS and GAN

no code implementations1 Jan 2021 Xu Liao, Jin Liu, Tianwen Wen, Yuling Jiao, Jian Huang

At the population level, we formulate the ideal representation learning task as that of finding a nonlinear map that minimizes the sum of losses characterizing conditional independence (with RKHS) and disentanglement (with GAN).

Disentanglement Image Classification

Sufficient and Disentangled Representation Learning

no code implementations1 Jan 2021 Jian Huang, Yuling Jiao, Xu Liao, Jin Liu, Zhou Yu

We provide strong statistical guarantees for the learned representation by establishing an upper bound on the excess error of the objective function and show that it reaches the nonparametric minimax rate under mild conditions.

Disentanglement

Multi-grained Trajectory Graph Convolutional Networks for Habit-unrelated Human Motion Prediction

no code implementations23 Dec 2020 Jin Liu, Jianqin Yin

A multi-grained trajectory graph convolutional networks based and lightweight framework is proposed for habit-unrelated human motion prediction.

Computational Efficiency Human motion prediction +1

Quantum simulation of a three-mode optomechanical system based on the Fredkin-type interaction

no code implementations17 Dec 2020 Jin Liu, Yue-Hui Zhou, Jian Huang, Jin-Feng Huang, Jie-Qiao Liao

The realization of multimode optomechanical interactions in the single-photon strong-coupling regime is a desired task in cavity optomechanics, but it remains a challenge in realistic physical systems.

Quantum Physics

Generative Learning With Euler Particle Transport

no code implementations11 Dec 2020 Yuan Gao, Jian Huang, Yuling Jiao, Jin Liu, Xiliang Lu, Zhijian Yang

The key task in training is the estimation of the density ratios or differences that determine the residual maps.

A Contextual Alignment Enhanced Cross Graph Attention Network for Cross-lingual Entity Alignment

no code implementations COLING 2020 Zhiwen Xie, Runjie Zhu, Kunsong Zhao, Jin Liu, Guangyou Zhou, Jimmy Xiangji Huang

In this paper, we propose a novel Contextual Alignment Enhanced Cross Graph Attention Network (CAECGAT) for the task of cross-lingual entity alignment, which is able to jointly learn the embeddings in different KGs by propagating cross-KG information through pre-aligned seed alignments.

Entity Alignment Graph Attention

ReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for Knowledge Graph Embedding

no code implementations ACL 2020 Zhiwen Xie, Guangyou Zhou, Jin Liu, Jimmy Xiangji Huang

In this paper, we take the benefits of ConvE and KBGAT together and propose a Relation-aware Inception network with joint local-global structural information for knowledge graph Embedding (ReInceptionE).

Knowledge Graph Embedding Relation

Deep Dimension Reduction for Supervised Representation Learning

1 code implementation10 Jun 2020 Jian Huang, Yuling Jiao, Xu Liao, Jin Liu, Zhou Yu

We propose a deep dimension reduction approach to learning representations with these characteristics.

Dimensionality Reduction Disentanglement

A Novel Recurrent Encoder-Decoder Structure for Large-Scale Multi-view Stereo Reconstruction from An Open Aerial Dataset

1 code implementation CVPR 2020 Jin Liu, Shunping Ji

In this paper, we present a synthetic aerial dataset, called the WHU dataset, we created for MVS tasks, which, to our knowledge, is the first large-scale multi-view aerial dataset.

Surface Reconstruction

Learning Implicit Generative Models with Theoretical Guarantees

no code implementations7 Feb 2020 Yuan Gao, Jian Huang, Yuling Jiao, Jin Liu

We then solve the McKean-Vlasov equation numerically using the forward Euler iteration, where the forward Euler map depends on the density ratio (density difference) between the distribution at current iteration and the underlying target distribution.

On Newton Screening

no code implementations27 Jan 2020 Jian Huang, Yuling Jiao, Lican Kang, Jin Liu, Yanyan Liu, Xiliang Lu, Yuanyuan Yang

Based on this KKT system, a built-in working set with a relatively small size is first determined using the sum of primal and dual variables generated from the previous iteration, then the primal variable is updated by solving a least-squares problem on the working set and the dual variable updated based on a closed-form expression.

Sparse Learning

A Support Detection and Root Finding Approach for Learning High-dimensional Generalized Linear Models

no code implementations16 Jan 2020 Jian Huang, Yuling Jiao, Lican Kang, Jin Liu, Yanyan Liu, Xiliang Lu

Feature selection is important for modeling high-dimensional data, where the number of variables can be much larger than the sample size.

feature selection

TrajectoryNet: a new spatio-temporal feature learning network for human motion prediction

no code implementations15 Oct 2019 Xiaoli Liu, Jianqin Yin, Jin Liu, Pengxiang Ding, Jun Liu, Huaping Liu

And the global temporal co-occurrence features represent the co-occurrence relationship that different subsequences in a complex motion sequence are appeared simultaneously, which can be obtained automatically with our proposed TrajectoryNet by reorganizing the temporal information as the depth dimension of the input tensor.

Human motion prediction motion prediction +1

Wasserstein-Wasserstein Auto-Encoders

no code implementations25 Feb 2019 Shunkang Zhang, Yuan Gao, Yuling Jiao, Jin Liu, Yang Wang, Can Yang

To address the challenges in learning deep generative models (e. g., the blurriness of variational auto-encoder and the instability of training generative adversarial networks, we propose a novel deep generative model, named Wasserstein-Wasserstein auto-encoders (WWAE).

BOLT-SSI: A Statistical Approach to Screening Interaction Effects for Ultra-High Dimensional Data

1 code implementation10 Feb 2019 Min Zhou, Mingwei Dai, Yuan YAO, Jin Liu, Can Yang, Heng Peng

In this paper, we first propose a simple method for sure screening interactions (SSI).

Methodology

6D Object Pose Estimation without PnP

no code implementations5 Feb 2019 Jin Liu, Sheng He

On this basis, a special layer, Collinear Equation Layer, is added next to region layer to output the 2D projections of the 3D bounding boxs corners.

6D Pose Estimation using RGB Object +1

6D Object Pose Estimation Based on 2D Bounding Box

no code implementations27 Jan 2019 Jin Liu, Sheng He

Our system trains a novel convolutional neural network to regress the unit quaternion, which represents the 3D rotation, from the partial image inside the bounding box returned by 2D detection systems.

6D Pose Estimation using RGB Object +1

BIVAS: A scalable Bayesian method for bi-level variable selection with applications

1 code implementation28 Mar 2018 Mingxuan Cai, Mingwei Dai, Jingsi Ming, Heng Peng, Jin Liu, Can Yang

To address this problem, we consider variational inference for bi-level variable selection (BIVAS).

Applications

A novel total variation model based on kernel functions and its application

no code implementations19 Nov 2017 Zhizheng Liang, Lei Zhang, Jin Liu, Yong Zhou

In this novel model, we first map each pixel value of an image into a Hilbert space by using a nonlinear map, and then define a coupled image of an original image in order to construct a kernel function.

Saliency Pattern Detection by Ranking Structured Trees

1 code implementation ICCV 2017 Lei Zhu, Haibin Ling, Jin Wu, Huiping Deng, Jin Liu

We show that the linear combination of structured labels can well model the saliency distribution in local regions.

object-detection RGB Salient Object Detection +2

What Makes it Difficult to Understand a Scientific Literature?

no code implementations4 Dec 2015 Mengyun Cao, Jiao Tian, Dezhi Cheng, Jin Liu, Xiaoping Sun

Through such analysis, we summarized some characteristics and problems which are reflected by people with different levels of knowledge on the comprehension of difficult science and technology literature, which can be modeled in semantic link network.

Reading Comprehension

Multi-ary Pulse Amplitude Modulated Signal Processing Using Bistable Stochastic Resonance

no code implementations International Conference on Noise and Fluctuations (ICNF) 2015 Jin Liu, Zan Li, Rui Gao, Jun Bai, Linlin Liang

On this basis, the mechanism of the BSR system response to MPAM signal inputs is elucidated, and a corresponding decoding scheme is proposed.

An adaptive Simulated Annealing-based satellite observation scheduling method combined with a dynamic task clustering strategy

no code implementations14 Jan 2014 Guohua Wu, Huilin Wang, Haifeng Li, Witold Pedrycz, Dishan Qiu, Manhao Ma, Jin Liu

In this study, we present an adaptive Simulated Annealing based scheduling algorithm aggregated with a dynamic task clustering strategy (or ASA-DTC for short) for satellite observation scheduling problems (SOSPs).

Clustering Scheduling

A Unified Primal Dual Active Set Algorithm for Nonconvex Sparse Recovery

no code implementations4 Oct 2013 Jian Huang, Yuling Jiao, Bangti Jin, Jin Liu, Xiliang Lu, Can Yang

In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations.

Cannot find the paper you are looking for? You can Submit a new open access paper.