Search Results for author: Kai Wang

Found 78 papers, 25 papers with code

The Shape Part Slot Machine: Contact-based Reasoning for Generating 3D Shapes from Parts

no code implementations1 Dec 2021 Kai Wang, Paul Guerrero, Vladimir Kim, Siddhartha Chaudhuri, Minhyuk Sung, Daniel Ritchie

We present the Shape Part Slot Machine, a new method for assembling novel 3D shapes from existing parts by performing contact-based reasoning.

Incremental Meta-Learning via Episodic Replay Distillation for Few-Shot Image Recognition

no code implementations9 Nov 2021 Kai Wang, Xialei Liu, Andy Bagdanov, Luis Herranz, Shangling Jui, Joost Van de Weijer

We propose an approach to IML, which we call Episodic Replay Distillation (ERD), that mixes classes from the current task with class exemplars from previous tasks when sampling episodes for meta-learning.

Continual Learning Knowledge Distillation +1

MutFormer: A context-dependent transformer-based model to predict pathogenic missense mutations

1 code implementation27 Oct 2021 Theodore Jiang, Li Fang, Kai Wang

MutFormer and pre-computed variant scores are publicly available on GitHub at https://github. com/WGLab/mutformer.


HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined Classification

1 code implementation21 Oct 2021 Kai Wang, Xialei Liu, Luis Herranz, Joost Van de Weijer

To overcome forgetting in this benchmark, we propose Hierarchy-Consistency Verification (HCV) as an enhancement to existing continual learning methods.

Classification Continual Learning +1

RL4RS: A Real-World Benchmark for Reinforcement Learning based Recommender System

no code implementations18 Oct 2021 Kai Wang, Zhene Zou, Qilin Deng, Yue Shang, Minghao Zhao, Runze Wu, Xudong Shen, Tangjie Lyu, Changjie Fan

Reinforcement learning based recommender systems (RL-based RS) aims at learning a good policy from a batch of collected data, with casting sequential recommendation to multi-step decision-making tasks.

Combinatorial Optimization Decision Making +1

Feudal Reinforcement Learning by Reading Manuals

no code implementations13 Oct 2021 Kai Wang, Zhonghao Wang, Mo Yu, Humphrey Shi

The manager agent is a multi-hop plan generator dealing with high-level abstract information and generating a series of sub-goals in a backward manner.

Curriculum Learning

Align Yourself: Self-supervised Pre-training for Fine-grained Recognition via Saliency Alignment

no code implementations30 Jun 2021 Di wu, Siyuan Li, Zelin Zang, Kai Wang, Lei Shang, Baigui Sun, Hao Li, Stan Z. Li

In this paper, we first point out that current contrastive methods are prone to memorizing background/foreground texture and therefore have a limitation in localizing the foreground object.

Contrastive Learning Image Classification +1

Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Problems by Reinforcement Learning

no code implementations NeurIPS 2021 Kai Wang, Sanket Shah, Haipeng Chen, Andrew Perrault, Finale Doshi-Velez, Milind Tambe

In the predict-then-optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes decision quality when the optimization is subsequently solved.

Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Making by Reinforcement Learning

no code implementations NeurIPS 2021 Kai Wang, Sanket Shah, Haipeng Chen, Andrew Perrault, Finale Doshi-Velez, Milind Tambe

In the predict-then-optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes decision quality when the optimization is subsequently solved.

Decision Making

An Efficient Training Approach for Very Large Scale Face Recognition

1 code implementation21 May 2021 Kai Wang, Shuo Wang, Zhipeng Zhou, Xiaobo Wang, Xiaojiang Peng, Baigui Sun, Hao Li, Yang You

After that, to reduce the training time and hardware costs of the FC layer, we propose a Dynamic Class Pool (DCP) that stores the features from Gallery Net and calculates the inner product (logits) with positive samples (whose identities are in the DCP) in each mini-batch.

Face Recognition

ACAE-REMIND for Online Continual Learning with Compressed Feature Replay

no code implementations18 May 2021 Kai Wang, Luis Herranz, Joost Van de Weijer

Methods are typically allowed to use a limited buffer to store some of the images in the stream.

Continual Learning

Learning to Cluster Faces via Transformer

no code implementations23 Apr 2021 Jinxing Ye, Xioajiang Peng, Baigui Sun, Kai Wang, Xiuyu Sun, Hao Li, Hanqing Wu

In this paper, we repurpose the well-known Transformer and introduce a Face Transformer for supervised face clustering.

Face Clustering

Continual learning in cross-modal retrieval

no code implementations14 Apr 2021 Kai Wang, Luis Herranz, Joost Van de Weijer

We found that the indexing stage pays an important role and that simply avoiding reindexing the database with updated embedding networks can lead to significant gains.

Continual Learning Cross-Modal Retrieval +1

Personalized Bundle Recommendation in Online Games

no code implementations12 Apr 2021 Qilin Deng, Kai Wang, Minghao Zhao, Zhene Zou, Runze Wu, Jianrong Tao, Changjie Fan, Liang Chen

In business domains, \textit{bundling} is one of the most important marketing strategies to conduct product promotions, which is commonly used in online e-commerce and offline retailers.

Link Prediction Recommendation Systems

Reinforcement Learning with a Disentangled Universal Value Function for Item Recommendation

no code implementations7 Apr 2021 Kai Wang, Zhene Zou, Qilin Deng, Runze Wu, Jianrong Tao, Changjie Fan, Liang Chen, Peng Cui

As a part of the value function, free from the sparse and high-variance reward signals, a high-capacity reward-independent world model is trained to simulate complex environmental dynamics under a certain goal.

Model-based Reinforcement Learning Recommendation Systems

TSTNN: Two-stage Transformer based Neural Network for Speech Enhancement in the Time Domain

no code implementations18 Mar 2021 Kai Wang, Bengbeng He, Wei-Ping Zhu

In this paper, we propose a transformer-based architecture, called two-stage transformer neural network (TSTNN) for end-to-end speech denoising in the time domain.

Denoising Speech Denoising +1

On Implicit Attribute Localization for Generalized Zero-Shot Learning

no code implementations8 Mar 2021 Shiqi Yang, Kai Wang, Luis Herranz, Joost Van de Weijer

Zero-shot learning (ZSL) aims to discriminate images from unseen classes by exploiting relations to seen classes via their attribute-based descriptions.

Generalized Zero-Shot Learning

A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detection

no code implementations16 Feb 2021 Ning li, Tao Li, Chunyu Hu, Kai Wang, Hong Kang

In ophthalmology, early fundus screening is an economic and effective way to prevent blindness caused by ophthalmic diseases.

Applications of Deep Learning in Fundus Images: A Review

1 code implementation25 Jan 2021 Tao Li, Wang Bo, Chunyu Hu, Hong Kang, Hanruo Liu, Kai Wang, Huazhu Fu

The use of fundus images for the early screening of eye diseases is of great clinical importance.

Image Generation Lesion Segmentation

AU-Guided Unsupervised Domain Adaptive Facial Expression Recognition

no code implementations18 Dec 2020 Kai Wang, Yuxin Gu, Xiaojiang Peng, Panpan Zhang, Baigui Sun, Hao Li

The domain diversities including inconsistent annotation and varied image collection conditions inevitably exist among different facial expression recognition (FER) datasets, which pose an evident challenge for adapting the FER model trained on one dataset to another one.

Facial Expression Recognition

Takagi topological insulator with odd $\mathcal P\mathcal T$ pairs of corner states

no code implementations17 Dec 2020 Jia-Xiao Dai, Kai Wang, Shengyuan A. Yang, Y. X. Zhao

Particularly, the global Takagi's factorization can (cannot) be done on a $3$D ($2$D) sphere.

Mesoscale and Nanoscale Physics

Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learning

1 code implementation NeurIPS 2021 Muhan Zhang, Pan Li, Yinglong Xia, Kai Wang, Long Jin

When we want to learn a node set representation involving multiple nodes, a common practice in previous works is to directly aggregate the multiple node representations learned by a GNN into a joint representation of the node set.

Classification General Classification +5

Suppressing Mislabeled Data via Grouping and Self-Attention

1 code implementation ECCV 2020 Xiaojiang Peng, Kai Wang, Zhaoyang Zeng, Qing Li, Jianfei Yang, Yu Qiao

Specifically, this plug-and-play AFM first leverages a \textit{group-to-attend} module to construct groups and assign attention weights for group-wise samples, and then uses a \textit{mixup} module with the attention weights to interpolate massive noisy-suppressed samples.

Image Classification

MulDE: Multi-teacher Knowledge Distillation for Low-dimensional Knowledge Graph Embeddings

no code implementations14 Oct 2020 Kai Wang, Yu Liu, Qian Ma, Quan Z. Sheng

Link prediction based on knowledge graph embeddings (KGE) aims to predict new triples to automatically construct knowledge graphs (KGs).

Knowledge Distillation Knowledge Graph Completion +3

A Comprehensive Review for MRF and CRF Approaches in Pathology Image Analysis

no code implementations29 Sep 2020 Yixin Li, Chen Li, Xiaoyan Li, Kai Wang, Md Mamunur Rahaman, Changhao Sun, Hao Chen, Xinran Wu, Hong Zhang, Qian Wang

In this review, we present a comprehensive overview of pathology image analysis based on the markov random fields (MRFs) and conditional random fields (CRFs), which are two popular random field models.

Dual-Mandate Patrols: Multi-Armed Bandits for Green Security

1 code implementation14 Sep 2020 Lily Xu, Elizabeth Bondi, Fei Fang, Andrew Perrault, Kai Wang, Milind Tambe

Conservation efforts in green security domains to protect wildlife and forests are constrained by the limited availability of defenders (i. e., patrollers), who must patrol vast areas to protect from attackers (e. g., poachers or illegal loggers).

Multi-Armed Bandits

Measuring galaxy abundance and clustering at high redshift from incomplete spectroscopic data: Tests on mock catalogs and application to zCOSMOS

1 code implementation31 Aug 2020 Jiacheng Meng, Cheng Li, Houjun Mo, Yangyao Chen, Kai Wang

Using realistic mock catalogs we show that target selection and redshift incompleteness can lead to significantly biased results.

Astrophysics of Galaxies

CardioLearn: A Cloud Deep Learning Service for Cardiac Disease Detection from Electrocardiogram

1 code implementation4 Jul 2020 Shenda Hong, Zhaoji Fu, Rongbo Zhou, Jie Yu, Yongkui Li, Kai Wang, Guanlin Cheng

Electrocardiogram (ECG) is one of the most convenient and non-invasive tools for monitoring peoples' heart condition, which can use for diagnosing a wide range of heart diseases, including Cardiac Arrhythmia, Acute Coronary Syndrome, et al.

Low-Resource Generation of Multi-hop Reasoning Questions

no code implementations ACL 2020 Jianxing Yu, Wei Liu, Shuang Qiu, Qinliang Su, Kai Wang, Xiaojun Quan, Jian Yin

Specifically, we first build a multi-hop generation model and guide it to satisfy the logical rationality by the reasoning chain extracted from a given text.

Machine Reading Comprehension

Bookworm continual learning: beyond zero-shot learning and continual learning

1 code implementation26 Jun 2020 Kai Wang, Luis Herranz, Anjan Dutta, Joost Van de Weijer

We propose bookworm continual learning(BCL), a flexible setting where unseen classes can be inferred via a semantic model, and the visual model can be updated continually.

Continual Learning Zero-Shot Learning

Automatically Learning Compact Quality-aware Surrogates for Optimization Problems

1 code implementation NeurIPS 2020 Kai Wang, Bryan Wilder, Andrew Perrault, Milind Tambe

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values.

Portfolio Optimization

Simple and effective localized attribute representations for zero-shot learning

no code implementations10 Jun 2020 Shiqi Yang, Kai Wang, Luis Herranz, Joost Van de Weijer

Zero-shot learning (ZSL) aims to discriminate images from unseen classes by exploiting relations to seen classes via their semantic descriptions.

Fine-tuning Zero-Shot Learning

Multi-Domain Dialogue Acts and Response Co-Generation

1 code implementation ACL 2020 Kai Wang, Junfeng Tian, Rui Wang, Xiaojun Quan, Jianxing Yu

Unlike those pipeline approaches, our act generation module preserves the semantic structures of multi-domain dialogue acts and our response generation module dynamically attends to different acts as needed.

Task-Oriented Dialogue Systems

Semantic Drift Compensation for Class-Incremental Learning

1 code implementation CVPR 2020 Lu Yu, Bartłomiej Twardowski, Xialei Liu, Luis Herranz, Kai Wang, Yongmei Cheng, Shangling Jui, Joost Van de Weijer

The vast majority of methods have studied this scenario for classification networks, where for each new task the classification layer of the network must be augmented with additional weights to make room for the newly added classes.

class-incremental learning General Classification +1

Axis Learning for Orientated Objects Detection in Aerial Images

no code implementations Remote Sensing 2020 Zhifeng Xiao, Linjun Qian, Weiping Shao, Xiaowei Tan, Kai Wang

Arbitrary orientated objects are detected by predicting the axis of the object, which is the line connecting the head and tail of the object, and the width of the object is vertical to the axis.

Object Detection In Aerial Images One-stage Anchor-free Oriented Object Detection

Relating the structure of dark matter halos to their assembly and environment

2 code implementations11 Mar 2020 Yangyao Chen, H. J. Mo, Cheng Li, Huiyuan Wang, Xiaohu Yang, Youcai Zhang, Kai Wang

Using decision trees built with the random ensemble method, we find that the correlation between halo concentration and assembly history is tight: more than 60% of the variance in halo concentration can be explained by assembly history alone.

Astrophysics of Galaxies Cosmology and Nongalactic Astrophysics

Suppressing Uncertainties for Large-Scale Facial Expression Recognition

2 code implementations CVPR 2020 Kai Wang, Xiaojiang Peng, Jianfei Yang, Shijian Lu, Yu Qiao

Annotating a qualitative large-scale facial expression dataset is extremely difficult due to the uncertainties caused by ambiguous facial expressions, low-quality facial images, and the subjectiveness of annotators.

Facial Expression Recognition

PA-Cache: Evolving Learning-Based Popularity-Aware Content Caching in Edge Networks

no code implementations20 Feb 2020 Qilin Fan, Xiuhua Li, Jian Li, Qiang He, Kai Wang, Junhao Wen

Compared to the conventional content delivery networks, caches in edge networks with smaller sizes usually have to accommodate more bursty requests.

Decision Making

Aesthetic Quality Assessment for Group photograph

no code implementations4 Feb 2020 Yaoting Wang, Yongzhen Ke, Kai Wang, Cuijiao Zhang, Fan Qin

Image aesthetic quality assessment has got much attention in recent years, but not many works have been done on a specific genre of photos: Group photograph.

A Realistic Face-to-Face Conversation System based on Deep Neural Networks

no code implementations21 Aug 2019 Zezhou Chen, Zhaoxiang Liu, Huan Hu, Jinqiang Bai, Shiguo Lian, Fuyuan Shi, Kai Wang

Based on the models' output, the synthesizer uses the Pixel2Pixel model to generate realistic facial images.

CBOWRA: A Representation Learning Approach for Medication Anomaly Detection

no code implementations20 Aug 2019 Liang Zhao, Zhiyuan Ma, Yangming Zhou, Kai Wang, Shengping Liu, Ju Gao

Electronic health record is an important source for clinical researches and applications, and errors inevitably occur in the data, which could lead to severe damages to both patients and hospital services.

Anomaly Detection Representation Learning

Video synthesis of human upper body with realistic face

no code implementations19 Aug 2019 Zhaoxiang Liu, Huan Hu, Zipeng Wang, Kai Wang, Jinqiang Bai, Shiguo Lian

This paper presents a generative adversarial learning-based human upper body video synthesis approach to generate an upper body video of target person that is consistent with the body motion, face expression, and pose of the person in source video.

Deep Learning based Wearable Assistive System for Visually Impaired People

no code implementations9 Aug 2019 Yimin Lin, Kai Wang, Wanxin Yi, Shiguo Lian

In this paper, we propose a deep learning based assistive system to improve the environment perception experience of visually impaired (VI).

Coupled-Projection Residual Network for MRI Super-Resolution

no code implementations12 Jul 2019 Chun-Mei Feng, Kai Wang, Shijian Lu, Yong Xu, Heng Kong, Ling Shao

The deep sub-network learns from the residuals of the high-frequency image information, where multiple residual blocks are cascaded to magnify the MRI images at the last network layer.


Bootstrap Model Ensemble and Rank Loss for Engagement Intensity Regression

no code implementations8 Jul 2019 Kai Wang, Jianfei Yang, Da Guo, Kaipeng Zhang, Xiaojiang Peng, Yu Qiao

Based on our winner solution last year, we mainly explore head features and body features with a bootstrap strategy and two novel loss functions in this paper.

Frame attention networks for facial expression recognition in videos

1 code implementation29 Jun 2019 Debin Meng, Xiaojiang Peng, Kai Wang, Yu Qiao

The feature embedding module is a deep Convolutional Neural Network (CNN) which embeds face images into feature vectors.

Ranked #2 on Facial Expression Recognition on CK+ (Accuracy (7 emotion) metric)

Facial Expression Recognition

LSANet: Feature Learning on Point Sets by Local Spatial Aware Layer

1 code implementation14 May 2019 Lin-Zhuo Chen, Xuan-Yi Li, Deng-Ping Fan, Kai Wang, Shao-Ping Lu, Ming-Ming Cheng

We design a novel Local Spatial Aware (LSA) layer, which can learn to generate Spatial Distribution Weights (SDWs) hierarchically based on the spatial relationship in local region for spatial independent operations, to establish the relationship between these operations and spatial distribution, thus capturing the local geometric structure sensitively. We further propose the LSANet, which is based on LSA layer, aggregating the spatial information with associated features in each layer of the network better in network design. The experiments show that our LSANet can achieve on par or better performance than the state-of-the-art methods when evaluating on the challenging benchmark datasets.

Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition

1 code implementation10 May 2019 Kai Wang, Xiaojiang Peng, Jianfei Yang, Debin Meng, Yu Qiao

Extensive experiments show that our RAN and region biased loss largely improve the performance of FER with occlusion and variant pose.

Facial Expression Recognition

Towards More Realistic Human-Robot Conversation: A Seq2Seq-based Body Gesture Interaction System

no code implementations5 May 2019 Minjie Hua, Fuyuan Shi, Yibing Nan, Kai Wang, Hao Chen, Shiguo Lian

This paper presents a novel system that enables intelligent robots to exhibit realistic body gestures while communicating with humans.

Virtual-Blind-Road Following Based Wearable Navigation Device for Blind People

no code implementations30 Apr 2019 Jinqiang Bai, Shiguo Lian, Zhaoxiang Liu, Kai Wang, Dijun Liu

To help the blind people walk to the destination efficiently and safely in indoor environment, a novel wearable navigation device is presented in this paper.

Deep Learning Based Robot for Automatically Picking up Garbage on the Grass

no code implementations30 Apr 2019 Jinqiang Bai, Shiguo Lian, Zhaoxiang Liu, Kai Wang, Dijun Liu

In addition, with the ground segmentation using a deep neural network, a novel navigation strategy is proposed to guide the robot to move around.

Synthetic Data Generation and Adaption for Object Detection in Smart Vending Machines

no code implementations28 Apr 2019 Kai Wang, Fuyuan Shi, Wenqi Wang, Yibing Nan, Shiguo Lian

This paper presents an improved scheme for the generation and adaption of synthetic images for the training of deep Convolutional Neural Networks(CNNs) to perform the object detection task in smart vending machines.

Object Detection Synthetic Data Generation

A Survey on Face Data Augmentation

no code implementations26 Apr 2019 Xiang Wang, Kai Wang, Shiguo Lian

The quality and size of training set have great impact on the results of deep learning-based face related tasks.

Data Augmentation

Detecting Colorized Images via Convolutional Neural Networks: Toward High Accuracy and Good Generalization

no code implementations17 Feb 2019 Weize Quan, Dong-Ming Yan, Kai Wang, Xiaopeng Zhang, Denis Pellerin

First, we design and implement a base network, which can attain better performance in terms of classification accuracy and generalization (in most cases) compared with state-of-the-art methods.

Colorization General Classification

A Unified Framework for Mutual Improvement of SLAM and Semantic Segmentation

no code implementations25 Dec 2018 Kai Wang, Yimin Lin, Luowei Wang, Liming Han, Minjie Hua, Xiang Wang, Shiguo Lian, Bill Huang

This paper presents a novel framework for simultaneously implementing localization and segmentation, which are two of the most important vision-based tasks for robotics.

Semantic Segmentation

Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Models

no code implementations CVPR 2019 Daniel Ritchie, Kai Wang, Yu-an Lin

We present a new, fast and flexible pipeline for indoor scene synthesis that is based on deep convolutional generative models.

Indoor Scene Synthesis

Sub-GAN: An Unsupervised Generative Model via Subspaces

no code implementations ECCV 2018 Jie Liang, Jufeng Yang, Hsin-Ying Lee, Kai Wang, Ming-Hsuan Yang

The recent years have witnessed significant growth in constructing robust generative models to capture informative distributions of natural data.

LIUM-CVC Submissions for WMT18 Multimodal Translation Task

no code implementations WS 2018 Ozan Caglayan, Adrien Bardet, Fethi Bougares, Loïc Barrault, Kai Wang, Marc Masana, Luis Herranz, Joost Van de Weijer

This paper describes the multimodal Neural Machine Translation systems developed by LIUM and CVC for WMT18 Shared Task on Multimodal Translation.

Machine Translation Translation

Knowledge Graph Embedding with Entity Neighbors and Deep Memory Network

no code implementations11 Aug 2018 Kai Wang, Yu Liu, Xiujuan Xu, Dan Lin

Knowledge Graph Embedding (KGE) aims to represent entities and relations of knowledge graph in a low-dimensional continuous vector space.

Knowledge Graph Embedding

Deep Learning Analysis of Defect and Phase Evolution During Electron Beam Induced Transformations in WS2

no code implementations14 Mar 2018 Artem Maksov, Ondrej Dyck, Kai Wang, Kai Xiao, David B. Geohegan, Bobby G. Sumpter, Rama K. Vasudevan, Stephen Jesse, Sergei V. Kalinin, Maxim Ziatdinov

Understanding elementary mechanisms behind solid-state phase transformations and reactions is the key to optimizing desired functional properties of many technologically relevant materials.

Materials Science

BTS-DSN: Deeply Supervised Neural Network with Short Connections for Retinal Vessel Segmentation

1 code implementation11 Mar 2018 Song Guo, Kai Wang, Hong Kang, Yujun Zhang, Yingqi Gao, Tao Li

Results: The proposed BTS-DSN has been verified on DRIVE, STARE and CHASE_DB1 datasets, and showed competitive performance over other state-of-the-art methods.

Retinal Vessel Segmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.