Search Results for author: Kun Li

Found 71 papers, 24 papers with code

High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videos

no code implementations2 Nov 2023 Xiongzheng Li, Jinsong Zhang, Yu-Kun Lai, Jingyu Yang, Kun Li

To alleviate the ambiguity estimating 3D garments from monocular videos, we design a multi-hypothesis deformation module that learns spatial representations of multiple plausible deformations.

Garment Reconstruction

Towards Grouping in Large Scenes with Occlusion-aware Spatio-temporal Transformers

no code implementations30 Oct 2023 Jinsong Zhang, Lingfeng Gu, Yu-Kun Lai, Xueyang Wang, Kun Li

To explore the potential spatio-temporal relationship, we propose spatio-temporal transformers to simultaneously extract trajectory information and fuse inter-person features in a hierarchical manner.

CT-GAT: Cross-Task Generative Adversarial Attack based on Transferability

1 code implementation22 Oct 2023 Minxuan Lv, Chengwei Dai, Kun Li, Wei Zhou, Songlin Hu

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks.

Adversarial Attack

MeaeQ: Mount Model Extraction Attacks with Efficient Queries

1 code implementation21 Oct 2023 Chengwei Dai, Minxuan Lv, Kun Li, Wei Zhou

We study model extraction attacks in natural language processing (NLP) where attackers aim to steal victim models by repeatedly querying the open Application Programming Interfaces (APIs).

Active Learning Model extraction

Transformer-based Multimodal Change Detection with Multitask Consistency Constraints

1 code implementation13 Oct 2023 BiYuan Liu, HuaiXin Chen, Kun Li, Michael Ying Yang

We observe that the current change detection methods struggle with the multitask conflicts between semantic and height change detection tasks.

Change Detection

A New Transformation Approach for Uplift Modeling with Binary Outcome

no code implementations9 Oct 2023 Kun Li, Jiang Tian, Xiaojia Xiang

The main drawback of these approaches is that in general it does not use the information in the treatment indicator beyond the construction of the transformed outcome and usually is not efficient.


Dual-Path Temporal Map Optimization for Make-up Temporal Video Grounding

no code implementations12 Sep 2023 Jiaxiu Li, Kun Li, Jia Li, Guoliang Chen, Dan Guo, Meng Wang

Compared with the general video grounding task, MTVG focuses on meticulous actions and changes on the face.

text similarity Video Grounding

Exploiting Diverse Feature for Multimodal Sentiment Analysis

no code implementations25 Aug 2023 Jia Li, Wei Qian, Kun Li, Qi Li, Dan Guo, Meng Wang

Specifically, we achieve the results of 0. 8492 and 0. 8439 for MuSe-Personalisation in terms of arousal and valence CCC.

Multimodal Sentiment Analysis

Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos

no code implementations15 Aug 2023 Wei Qian, Dan Guo, Kun Li, Xilan Tian, Meng Wang

Specifically, the proposed Dual-TL uses a Spatial TokenLearner (S-TL) to explore associations in different facial ROIs, which promises the rPPG prediction far away from noisy ROI disturbances.

ViGT: Proposal-free Video Grounding with Learnable Token in Transformer

no code implementations11 Aug 2023 Kun Li, Dan Guo, Meng Wang

First, we employed a sharing feature encoder to project both video and query into a joint feature space before performing cross-modal co-attention (i. e., video-to-query attention and query-to-video attention) to highlight discriminative features in each modality.

regression Video Grounding

Data Augmentation for Human Behavior Analysis in Multi-Person Conversations

no code implementations3 Aug 2023 Kun Li, Dan Guo, Guoliang Chen, Feiyang Liu, Meng Wang

In this paper, we present the solution of our team HFUT-VUT for the MultiMediate Grand Challenge 2023 at ACM Multimedia 2023.

FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving

1 code implementation2 Aug 2023 Tengju Ye, Wei Jing, Chunyong Hu, Shikun Huang, Lingping Gao, Fangzhen Li, Jingke Wang, Ke Guo, Wencong Xiao, Weibo Mao, Hang Zheng, Kun Li, Junbo Chen, Kaicheng Yu

Building a multi-modality multi-task neural network toward accurate and robust performance is a de-facto standard in perception task of autonomous driving.

Autonomous Driving

Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classification

1 code implementation20 Jul 2023 Kun Li, Dan Guo, Guoliang Chen, Xinge Peng, Meng Wang

In this paper, we briefly introduce the solution of our team HFUT-VUT for the Micros-gesture Classification in the MiGA challenge at IJCAI 2023.

Action Classification Classification +1

Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfer

1 code implementation ICCV 2023 Wing-Yin Yu, Lai-Man Po, Ray C. C. Cheung, Yuzhi Zhao, Yu Xue, Kun Li

To address these issues, we propose a novel Deformable Motion Modulation (DMM) that utilizes geometric kernel offset with adaptive weight modulation to simultaneously perform feature alignment and style transfer.

motion prediction Pose Transfer +2

ATWM: Defense against adversarial malware based on adversarial training

no code implementations11 Jul 2023 Kun Li, Fan Zhang, Wei Guo

In order to defend against malware attacks, researchers have proposed many Windows malware detection models based on deep learning.

Adversarial Defense Malware Detection

CMDFusion: Bidirectional Fusion Network with Cross-modality Knowledge Distillation for LIDAR Semantic Segmentation

1 code implementation9 Jul 2023 Jun Cen, Shiwei Zhang, Yixuan Pei, Kun Li, Hang Zheng, Maochun Luo, Yingya Zhang, Qifeng Chen

In this way, RGB images are not required during inference anymore since the 2D knowledge branch provides 2D information according to the 3D LIDAR input.

Autonomous Vehicles Knowledge Distillation +2

Interactive Image Segmentation with Cross-Modality Vision Transformers

1 code implementation5 Jul 2023 Kun Li, George Vosselman, Michael Ying Yang

Interactive image segmentation aims to segment the target from the background with the manual guidance, which takes as input multimodal data such as images, clicks, scribbles, and bounding boxes.

Image Segmentation Interactive Segmentation +2

Physics-Informed Ensemble Representation for Light-Field Image Super-Resolution

1 code implementation31 May 2023 Manchang Jin, Gaosheng Liu, Kunshu Hu, Xin Luo, Kun Li, Jingyu Yang

Recent learning-based approaches have achieved significant progress in light field (LF) image super-resolution (SR) by exploring convolution-based or transformer-based network structures.

Image Super-Resolution

FGAM:Fast Adversarial Malware Generation Method Based on Gradient Sign

no code implementations22 May 2023 Kun Li, Fan Zhang, Wei Guo

Adversarial attacks are to deceive the deep learning model by generating adversarial samples.

Malware Detection

SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting

no code implementations15 May 2023 Xiaoying Zhang, Baolin Peng, Kun Li, Jingyan Zhou, Helen Meng

Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research.

dialog state tracking

Standardized Benchmark Dataset for Localized Exposure to a Realistic Source at 10$-$90 GHz

1 code implementation3 May 2023 Ante Kapetanovic, Dragan Poljak, Kun Li

To address this issue, in this paper, the limited available data on the incident power density and resultant maximum temperature rise on the skin surface considering various steady-state exposure scenarios at 10$-$90 GHz have been statistically modeled.

HybridFusion: LiDAR and Vision Cross-Source Point Cloud Fusion

no code implementations10 Apr 2023 Yu Wang, Shuhui Bu, Lin Chen, Yifei Dong, Kun Li, Xuefeng Cao, Ke Li

First, the point cloud is divided into small patches, and a matching patch set is selected based on global descriptors and spatial distribution, which constitutes the coarse matching process.

Point Cloud Registration

Narrator: Towards Natural Control of Human-Scene Interaction Generation via Relationship Reasoning

no code implementations ICCV 2023 Haibiao Xuan, Xiongzheng Li, Jinsong Zhang, Hongwen Zhang, Yebin Liu, Kun Li

Also, we model global and local spatial relationships in a 3D scene and a textual description respectively based on the scene graph, and introduce a partlevel action mechanism to represent interactions as atomic body part states.

Angle-Constrained Formation Control under Directed Non-Triangulated Sensing Graphs (Extended Version)

no code implementations6 Mar 2023 Kun Li, Zhixi Shen, Gangshan Jing, Yongduan Song

Angle-constrained formation control has attracted much attention from control community due to the advantage that inter-edge angles are invariant under uniform translations, rotations, and scalings of the whole formation.

Causal Inference Based Single-branch Ensemble Trees For Uplift Modeling

no code implementations3 Feb 2023 Fanglan Zheng, Menghan Wang, Kun Li, Jiang Tian, Xiaojia Xiang

In this manuscript (ms), we propose causal inference based single-branch ensemble trees for uplift modeling, namely CIET.

Causal Inference

Crowd3D: Towards Hundreds of People Reconstruction from a Single Image

no code implementations CVPR 2023 Hao Wen, Jing Huang, Huili Cui, Haozhe Lin, Yukun Lai, Lu Fang, Kun Li

However, existing methods cannot deal with large scenes containing hundreds of people, which encounter the challenges of large number of people, large variations in human scale, and complex spatial distribution.

Fleet Rebalancing for Expanding Shared e-Mobility Systems: A Multi-agent Deep Reinforcement Learning Approach

1 code implementation11 Nov 2022 Man Luo, Bowen Du, Wenzhe Zhang, Tianyou Song, Kun Li, HongMing Zhu, Mark Birkin, Hongkai Wen

This is particularly challenging in the context of expanding systems, because i) the range of the EVs is limited while charging time is typically long, which constrain the viable rebalancing operations; and ii) the EV stations in the system are dynamically changing, i. e., the legitimate targets for rebalancing operations can vary over time.

Multi-agent Reinforcement Learning

ITSRN++: Stronger and Better Implicit Transformer Network for Continuous Screen Content Image Super-Resolution

no code implementations17 Oct 2022 Sheng Shen, Huanjing Yue, Jingyu Yang, Kun Li

Specifically, we propose a modulation based transformer as the upsampler, which modulates the pixel features in discrete space via a periodic nonlinear function to generate features for continuous pixels.

Image Super-Resolution

FOF: Learning Fourier Occupancy Field for Monocular Real-time Human Reconstruction

no code implementations5 Jun 2022 Qiao Feng, Yebin Liu, Yu-Kun Lai, Jingyu Yang, Kun Li

Based on FOF, we design the first 30+FPS high-fidelity real-time monocular human reconstruction framework.

HDhuman: High-quality Human Novel-view Rendering from Sparse Views

no code implementations20 Jan 2022 Tiansong Zhou, Jing Huang, Tao Yu, Ruizhi Shao, Kun Li

To this end, we propose HDhuman, which uses a human reconstruction network with a pixel-aligned spatial transformer and a rendering network with geometry-guided pixel-wise feature integration to achieve high-quality human reconstruction and rendering.

Neural Rendering Surface Reconstruction +1

Group Gated Fusion on Attention-based Bidirectional Alignment for Multimodal Emotion Recognition

1 code implementation17 Jan 2022 PengFei Liu, Kun Li, Helen Meng

Emotion recognition is a challenging and actively-studied research area that plays a critical role in emotion-aware human-computer interaction systems.

Multimodal Emotion Recognition

High-Fidelity Human Avatars From a Single RGB Camera

no code implementations CVPR 2022 Hao Zhao, Jinsong Zhang, Yu-Kun Lai, Zerong Zheng, Yingdi Xie, Yebin Liu, Kun Li

To cope with the complexity of textures and generate photo-realistic results, we propose a reference-based neural rendering network and exploit a bottom-up sharpening-guided fine-tuning strategy to obtain detailed textures.

Neural Rendering Vocal Bursts Intensity Prediction

Implicit Transformer Network for Screen Content Image Continuous Super-Resolution

1 code implementation NeurIPS 2021 Jingyu Yang, Sheng Shen, Huanjing Yue, Kun Li

Nowadays, there is an explosive growth of screen contents due to the wide application of screen sharing, remote cooperation, and online education.


Large-Scale Hyperspectral Image Clustering Using Contrastive Learning

1 code implementation15 Nov 2021 Yaoming Cai, Zijia Zhang, Yan Liu, Pedram Ghamisi, Kun Li, Xiaobo Liu, Zhihua Cai

Specifically, we exploit a symmetric twin neural network comprised of a projection head with a dimensionality of the cluster number to conduct dual contrastive learning from a spectral-spatial augmentation pool.

Clustering Contrastive Learning +2

LSTM-RPA: A Simple but Effective Long Sequence Prediction Algorithm for Music Popularity Prediction

1 code implementation27 Oct 2021 Kun Li, Meng Li, Yanling Li, Min Lin

The traditional trend prediction models can better predict the short trend than the long trend.

Real-Time Anchor-Free Single-Stage 3D Detection with IoU-Awareness

no code implementations29 Jul 2021 Runzhou Ge, Zhuangzhuang Ding, Yihan Hu, Wenxin Shao, Li Huang, Kun Li, Qiang Liu

Extended from our last year's award-winning model AFDet, we have made a handful of modifications to the base model, to improve the accuracy and at the same time to greatly reduce the latency.

Data Augmentation

Economic Recession Prediction Using Deep Neural Network

no code implementations21 Jul 2021 ZiHao Wang, Kun Li, Steve Q. Xia, Hongfu Liu

We investigate the effectiveness of different machine learning methodologies in predicting economic cycles.

BIG-bench Machine Learning

Out-of-Scope Domain and Intent Classification through Hierarchical Joint Modeling

1 code implementation30 Apr 2021 PengFei Liu, Kun Li, Helen Meng

User queries for a real-world dialog system may sometimes fall outside the scope of the system's capabilities, but appropriate system responses will enable smooth processing throughout the human-computer interaction.

Classification General Classification +3

Open Intent Discovery through Unsupervised Semantic Clustering and Dependency Parsing

1 code implementation25 Apr 2021 PengFei Liu, Youzhang Ning, King Keung Wu, Kun Li, Helen Meng

This paper presents an unsupervised two-stage approach to discover intents and generate meaningful intent labels automatically from a collection of unlabeled utterances in a domain.

Clustering Dependency Parsing +3

An Accurate and Efficient Large-scale Regression Method through Best Friend Clustering

no code implementations22 Apr 2021 Kun Li, Liang Yuan, Yunquan Zhang, Gongwei Chen

As the data size in Machine Learning fields grows exponentially, it is inevitable to accelerate the computation by utilizing the ever-growing large number of available cores provided by high-performance computing hardware.

Clustering regression

PISE: Person Image Synthesis and Editing with Decoupled GAN

1 code implementation CVPR 2021 Jinsong Zhang, Kun Li, Yu-Kun Lai, Jingyu Yang

The results of qualitative and quantitative experiments demonstrate the superiority of our model on human pose transfer.

Human Parsing Pose Transfer

Polycaprolactone/graphite nanoplates composite nanopapers

no code implementations25 Jan 2021 Kun Li, Daniele Battegazzore, Orietta Monticelli, Alberto Fina

Nanopapers based on graphene and related materials were recently proposed for application in heat spreader applications.

Materials Science

Human Pose Transfer by Adaptive Hierarchical Deformation

1 code implementation13 Dec 2020 Jinsong Zhang, Xingzi Liu, Kun Li

Existing methods cannot effectively utilize the input information, which often fail to preserve the style and shape of hair and clothes.

Pose Transfer Semantic Parsing +1

PoNA: Pose-guided Non-local Attention for Human Pose Transfer

1 code implementation13 Dec 2020 Kun Li, Jinsong Zhang, Yebin Liu, Yu-Kun Lai, Qionghai Dai

In each block, we propose a pose-guided non-local attention (PoNA) mechanism with a long-range dependency scheme to select more important regions of image features to transfer.

Person Re-Identification Pose Transfer

Constituency Lattice Encoding for Aspect Term Extraction

1 code implementation COLING 2020 Yunyi Yang, Kun Li, Xiaojun Quan, Weizhou Shen, Qinliang Su

One of the remaining challenges for aspect term extraction in sentiment analysis resides in the extraction of phrase-level aspect terms, which is non-trivial to determine the boundaries of such terms.

Aspect Term Extraction and Sentiment Classification Term Extraction

GPS-Net: Graph-based Photometric Stereo Network

no code implementations NeurIPS 2020 Zhuokun Yao, Kun Li, Ying Fu, Haofeng Hu, Boxin Shi

For all-pixel operation, we propose the Normal Regression Network to make efficient use of the intra-image spatial information for predicting a surface normal map with rich details.

Cross-MPI: Cross-scale Stereo for Image Super-Resolution using Multiplane Images

no code implementations CVPR 2021 Yuemei Zhou, Gaochang Wu, Ying Fu, Kun Li, Yebin Liu

Various combinations of cameras enrich computational photography, among which reference-based superresolution (RefSR) plays a critical role in multiscale imaging systems.

Image Super-Resolution

Unsupervised Pre-training for Biomedical Question Answering

no code implementations27 Sep 2020 Vaishnavi Kommaraju, Karthick Gunasekaran, Kun Li, Trapit Bansal, Andrew McCallum, Ivana Williams, Ana-Maria Istrate

We explore the suitability of unsupervised representation learning methods on biomedical text -- BioBERT, SciBERT, and BioSentVec -- for biomedical question answering.

Question Answering Representation Learning +1

A Vertical Federated Learning Method for Interpretable Scorecard and Its Application in Credit Scoring

no code implementations14 Sep 2020 Fanglan Zheng, Erihe, Kun Li, Jiang Tian, Xiaojia Xiang

With the success of big data and artificial intelligence in many fields, the applications of big data driven models are expected in financial risk management especially credit scoring and rating.

Federated Learning Management

Visual-speech Synthesis of Exaggerated Corrective Feedback

no code implementations12 Sep 2020 Yaohua Bu, Weijun Li, Tianyi Ma, Shengqi Chen, Jia Jia, Kun Li, Xiaobo Lu

To provide more discriminative feedback for the second language (L2) learners to better identify their mispronunciation, we propose a method for exaggerated visual-speech feedback in computer-assisted pronunciation training (CAPT).

Speech Synthesis

Adaptive 3D Face Reconstruction from a Single Image

no code implementations8 Jul 2020 Kun Li, Jing Yang, Nianhong Jiao, Jinsong Zhang, Yu-Kun Lai

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses.

3D Face Reconstruction Pose Estimation

A Federated F-score Based Ensemble Model for Automatic Rule Extraction

no code implementations7 Jul 2020 Kun Li, Fanglan Zheng, Jiang Tian, Xiaojia Xiang

In this manuscript, we propose a federated F-score based ensemble tree model for automatic rule extraction, namely Fed-FEARE.

Federated Learning Marketing

Conditional Augmentation for Aspect Term Extraction via Masked Sequence-to-Sequence Generation

no code implementations ACL 2020 Kun Li, Chengbo Chen, Xiaojun Quan, Qing Ling, Yan Song

In this paper, we formulate the data augmentation as a conditional generation task: generating a new sentence while preserving the original opinion targets and labels.

Data Augmentation Extract Aspect +2

Accurate 3D Localization for MAV Swarms by UWB and IMU Fusion

1 code implementation28 Jul 2018 Jiaxin Li, Yingcai Bi, Kun Li, Kangli Wang, Feng Lin, Ben M. Chen

Driven by applications like Micro Aerial Vehicles (MAVs), driver-less cars, etc, localization solution has become an active research topic in the past decade.


Meta Inverse Reinforcement Learning via Maximum Reward Sharing for Human Motion Analysis

no code implementations7 Oct 2017 Kun Li, Joel W. Burdick

Observing that each demonstrator has an inherent reward for each state and the task-specific behaviors mainly depend on a small number of key states, we propose a meta IRL algorithm that first models the reward function for each task as a distribution conditioned on a baseline reward function shared by all tasks and dependent only on the demonstrator, and then finds the most likely reward function in the distribution that explains the task-specific behaviors.

reinforcement-learning Reinforcement Learning (RL) +1

A Function Approximation Method for Model-based High-Dimensional Inverse Reinforcement Learning

no code implementations23 Aug 2017 Kun Li, Joel W. Burdick

This works handles the inverse reinforcement learning problem in high-dimensional state spaces, which relies on an efficient solution of model-based high-dimensional reinforcement learning problems.

reinforcement-learning Reinforcement Learning (RL) +1

Bellman Gradient Iteration for Inverse Reinforcement Learning

no code implementations24 Jul 2017 Kun Li, Yanan Sui, Joel W. Burdick

We introduce a strategy to flexibly handle different types of actions with two approximations of the Bellman Optimality Equation, and a Bellman Gradient Iteration method to compute the gradient of the Q-value with respect to the reward function.

reinforcement-learning Reinforcement Learning (RL) +1

Clinical Patient Tracking in the Presence of Transient and Permanent Occlusions via Geodesic Feature

no code implementations22 Jul 2017 Kun Li, Joel W. Burdick

This paper develops a method to use RGB-D cameras to track the motions of a human spinal cord injury patient undergoing spinal stimulation and physical rehabilitation.

Robust Non-Rigid Registration with Reweighted Position and Transformation Sparsity

no code implementations15 Mar 2017 Kun Li, Jingyu Yang, Yu-Kun Lai, Daoliang Guo

Non-rigid registration is challenging because it is ill-posed with high degrees of freedom and is thus sensitive to noise and outliers.

Inverse Reinforcement Learning with Multi-Relational Chains for Robot-Centered Smart Home

no code implementations16 Aug 2014 Kun Li, Max Q. -H. Meng

In a robot-centered smart home, the robot observes the home states with its own sensors, and then it can change certain object states according to an operator's commands for remote operations, or imitate the operator's behaviors in the house for autonomous operations.

reinforcement-learning Reinforcement Learning (RL)

Cannot find the paper you are looking for? You can Submit a new open access paper.