Search Results for author: Cheng Wang

Found 118 papers, 43 papers with code

Image Captioning with Deep Bidirectional LSTMs

1 code implementation4 Apr 2016 Cheng Wang, Haojin Yang, Christian Bartz, Christoph Meinel

This work presents an end-to-end trainable deep bidirectional LSTM (Long-Short Term Memory) model for image captioning.

Caption Generation Data Augmentation +5

Partial Procedural Geometric Model Fitting for Point Clouds

1 code implementation17 Oct 2016 Zongliang Zhang, Jonathan Li, Yulan Guo, Yangbin Lin, Ming Cheng, Cheng Wang

However, most geometric model fitting methods are unable to fit an arbitrary geometric model (e. g. a surface with holes) to incomplete data, due to that the similarity metrics used in these methods are unable to measure the rigid partial similarity between arbitrary models.

RRA: Recurrent Residual Attention for Sequence Learning

1 code implementation12 Sep 2017 Cheng Wang

In this paper, we propose a recurrent neural network (RNN) with residual attention (RRA) to learn long-range dependencies from sequential data.

Sentiment Analysis

Traffic Sign Timely Visual Recognizability Evaluation Based on 3D Measurable Point Clouds

no code implementations10 Oct 2017 Shanxin Zhang, Cheng Wang, Zhuang Yang, Chenglu Wen, Jonathan Li, Chenhui Yang

Then, based on the VEM, we proposed the concept of the Visual Recognizability Field (VRF) to reflect the visual recognizability distribution in 3D space and established a Visual Recognizability Evaluation Model (VREM) to measure a traffic sign visual recognizability for a given viewpoint.

Point Cloud Segmentation

Unsupervised Domain Adaptive Re-Identification: Theory and Practice

3 code implementations30 Jul 2018 Liangchen Song, Cheng Wang, Lefei Zhang, Bo Du, Qian Zhang, Chang Huang, Xinggang Wang

We study the problem of unsupervised domain adaptive re-identification (re-ID) which is an active topic in computer vision but lacks a theoretical foundation.

General Classification Unsupervised Domain Adaptation

LRMM: Learning to Recommend with Missing Modalities

no code implementations EMNLP 2018 Cheng Wang, Mathias Niepert, Hui Li

More importantly, LRMM is more robust to previous methods in alleviating data-sparsity and the cold-start problem.

Recommendation Systems

Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-identification

no code implementations ECCV 2018 Cheng Wang, Qian Zhang, Chang Huang, Wenyu Liu, Xinggang Wang

We propose a novel deep network called Mancs that solves the person re-identification problem from the following aspects: fully utilizing the attention mechanism for the person misalignment problem and properly sampling for the ranking loss to obtain more stable person representation.

Person Re-Identification

RealPoint3D: Point Cloud Generation from a Single Image with Complex Background

1 code implementation8 Sep 2018 Yan Xia, Yang Zhang, Dingfu Zhou, Xinyu Huang, Cheng Wang, Ruigang Yang

Then, the image together with the retrieved shape model is fed into the proposed network to generate the fine-grained 3D point cloud.

3D Generation Point Cloud Generation

Geometric Multi-Model Fitting by Deep Reinforcement Learning

no code implementations22 Sep 2018 Zongliang Zhang, Hongbin Zeng, Jonathan Li, Yiping Chen, Chenhui Yang, Cheng Wang

This paper deals with the geometric multi-model fitting from noisy, unstructured point set data (e. g., laser scanned point clouds).

Decision Making reinforcement-learning +1

Layerwise Recurrent Autoencoder for General Real-world Traffic Flow Forecasting

no code implementations27 Sep 2018 Peize Zhao, Danfeng Cai, Shaokun Zhang, Feng Chen, Zhemin Zhang, Cheng Wang, Jonathan Li

To forecast the traffic flow across a wide area and overcome the mentioned challenges, we design and propose a promising forecasting model called Layerwise Recurrent Autoencoder (LRA), in which a three-layer stacked autoencoder (SAE) architecture is used to obtain temporal traffic correlations and a recurrent neural networks (RNNs) model for prediction.

Management

State-Regularized Recurrent Networks

no code implementations27 Sep 2018 Cheng Wang, Mathias Niepert

We aim to address both shortcomings with a class of recurrent networks that use a stochastic state transition mechanism between cell applications.

Memorization

An efficient ADMM algorithm for high dimensional precision matrix estimation via penalized quadratic loss

1 code implementation12 Nov 2018 Cheng Wang, Binyan Jiang

The estimation of high dimensional precision matrices has been a central topic in statistical learning.

Computation Methodology

NeuroTreeNet: A New Method to Explore Horizontal Expansion Network

no code implementations22 Nov 2018 Shenlong Lou, Yan Luo, Qiancong Fan, Feng Chen, Yiping Chen, Cheng Wang, Jonathan Li

It is widely recognized that the deeper networks or networks with more feature maps have better performance.

Super-Resolution

Towards Personalized Management of Type B Aortic Dissection Using STENT: a STandard cta database with annotation of the ENtire aorta and True-false lumen

no code implementations3 Jan 2019 Jianning Li, Long Cao, Yangyang Ge, Bowen Meng, Cheng Wang, Wei Guo

The database contains 274 CT angiography (CTA) scans from 274 unique TBAD patients and is split into a training set(254 cases including 210 preoperative and 44 postoperative scans ) and a test set(20 cases). Based on STENT, we develop a series of methods including automated TBAD segmentation and automated measurement of TBAD parameters that facilitate personalized and precise management of the disease.

Decision Making Management

Integrating and querying similar tables from PDF documents using deep learning

1 code implementation15 Jan 2019 Rahul Anand, Hye-Young Paik, Cheng Wang

Tabular data extraction from reports and other published data in PDF format is of interest for various data consolidation purposes such as analysing and aggregating financial reports of a company.

A Fast Iterative Algorithm for High-dimensional Differential Network

1 code implementation22 Jan 2019 Zhou Tang, Zhangsheng Yu, Cheng Wang

Differential network is an important tool to capture the changes of conditional correlations under two sample cases.

Computation

Penalized Interaction Estimation for Ultrahigh Dimensional Quadratic Regression

1 code implementation22 Jan 2019 Cheng Wang, Binyan Jiang, Liping Zhu

In this article we introduce a novel method which allows us to estimate the main effects and interactions separately.

Methodology

State-Regularized Recurrent Neural Networks

no code implementations25 Jan 2019 Cheng Wang, Mathias Niepert

We aim to address both shortcomings with a class of recurrent networks that use a stochastic state transition mechanism between cell applications.

Language Modelling Memorization +2

RecSys-DAN: Discriminative Adversarial Networks for Cross-Domain Recommender Systems

no code implementations26 Mar 2019 Cheng Wang, Mathias Niepert, Hui Li

Although various transfer learning methods have shown promising performance in this context, our proposed novel method RecSys-DAN focuses on alleviating the cross-domain and within-domain data sparsity and data imbalance and learns transferable latent representations for users, items and their interactions.

Domain Adaptation Recommendation Systems +2

Fast Regularity-Constrained Plane Reconstruction

no code implementations20 May 2019 Yangbin Lin, Jialian Li, Cheng Wang, Zhonggui Chen, Zongyue Wang, Jonathan Li

Man-made environments typically comprise planar structures that exhibit numerous geometric relationships, such as parallelism, coplanarity, and orthogonality.

RF-Net: An End-to-End Image Matching Network based on Receptive Field

1 code implementation CVPR 2019 Xuelun Shen, Cheng Wang, Xin Li, Zenglei Yu, Jonathan Li, Chenglu Wen, Ming Cheng, Zijian He

This paper proposes a new end-to-end trainable matching network based on receptive field, RF-Net, to compute sparse correspondence between images.

Keypoint Detection

Accelerating Mini-batch SARAH by Step Size Rules

no code implementations20 Jun 2019 Zhuang Yang, Zengping Chen, Cheng Wang

Motivated by this gap, we proposed a variant of the Barzilai-Borwein (BB) method, referred to as the Random Barzilai-Borwein (RBB) method, to calculate step size for SARAH in the mini-batch setting, thereby leading to a new SARAH method: MB-SARAH-RBB.

PointNLM: Point Nonlocal-Means for vegetation segmentation based on middle echo point clouds

no code implementations20 Jun 2019 Jonathan Li, Rongren Wu, Yiping Chen, Qing Zhu, Zhipeng Luo, Cheng Wang

Second, to accurately extract trees from all point clouds, we propose a 3D deep learning network, PointNLM, to semantically segment tree crowns.

Point Cloud Segmentation Segmentation +1

Toward better boundary preserved supervoxel segmentation for 3D point clouds

1 code implementation ISPRS Journal of Photogrammetry and Remote Sensing 2019 Yangbin Lin, Cheng Wang, Dawei Zhai, Wei Li, Jonathan Li

In this paper, we present a simple but effective supervoxel segmentation method for point clouds, which formalizes supervoxel segmentation as a subset selection problem.

Point Cloud Segmentation Segmentation

GMAN: A Graph Multi-Attention Network for Traffic Prediction

6 code implementations11 Nov 2019 Chuanpan Zheng, Xiaoliang Fan, Cheng Wang, Jianzhong Qi

Between the encoder and the decoder, a transform attention layer is applied to convert the encoded traffic features to generate the sequence representations of future time steps as the input of the decoder.

Image Dehazing Traffic Prediction

Point2Node: Correlation Learning of Dynamic-Node for Point Cloud Feature Modeling

no code implementations23 Dec 2019 Wenkai Han, Chenglu Wen, Cheng Wang, Xin Li, Qing Li

Point2Node can dynamically explore correlation among all graph nodes from different levels, and adaptively aggregate the learned features.

Review: deep learning on 3D point clouds

no code implementations17 Jan 2020 Saifullahi Aminu Bello, Shangshu Yu, Cheng Wang

Deep learning is now the most powerful tool for data processing in computer vision, becoming the most preferred technique for tasks such as classification, segmentation, and detection.

Autonomous Driving

DNN-aided Read-voltage Threshold Optimization for MLC Flash Memory with Finite Block Length

no code implementations11 Apr 2020 Cheng Wang, Kang Wei, Lingjun Kong, Long Shi, Zhen Mei, Jun Li, Kui Cai

The error correcting performance of multi-level-cell (MLC) NAND flash memory is closely related to the block length of error correcting codes (ECCs) and log-likelihood-ratios (LLRs) of the read-voltage thresholds.

TCTS: A Task-Consistent Two-Stage Framework for Person Search

no code implementations CVPR 2020 Cheng Wang, Bingpeng Ma, Hong Chang, Shiguang Shan, Xilin Chen

In the re-ID stage, we predict identity labels of detected bounding boxes, and use these examples to construct a more practical mixed train set for the DRA model.

Person Search Vocal Bursts Valence Prediction

VPC-Net: Completion of 3D Vehicles from MLS Point Clouds

1 code implementation8 Aug 2020 Yan Xia, Yusheng Xu, Cheng Wang, Uwe Stilla

Moreover, a new refiner module is also presented to preserve the vehicle details from inputs and refine the complete outputs with fine-grained information.

Autonomous Driving

Rotational dynamics of bottom-heavy rods in turbulence from experiments and numerical simulations

1 code implementation10 Dec 2020 Linfeng Jiang, Cheng Wang, Shuang Liu, Chao Sun, Enrico Calzavarini

We successfully perform the three-dimensional tracking in a turbulent fluid flow of small asymmetrical particles that are neutrally-buoyant and bottom-heavy, i. e., they have a non-homogeneous mass distribution along their symmetry axis.

Fluid Dynamics

Structure-preserving, energy stable numerical schemes for a liquid thin film coarsening model

no code implementations22 Dec 2020 Juan Zhang, Cheng Wang, Steven M. Wise, Zhengru Zhang

In the second order numerical scheme, the BDF temporal stencil is applied, and an alternate convex-concave decomposition is derived, so that the concave part corresponds to a quadratic energy.

Numerical Analysis Numerical Analysis 35A15 (Primary) 12-XX, 12-08 (Secondary) F.2.2; G.2

Efficient erbium-doped thin-film lithium niobate waveguide amplifiers

no code implementations18 Jan 2021 Zhaoxi Chen, Qing Xu, Ke Zhang, Wing-Han Wong, De-Long Zhang, Edwin Yue-Bun Pun, Cheng Wang

Lithium niobate on insulator (LNOI) is an emerging photonic platform with great promises for future optical communications, nonlinear optics and microwave photonics.

Optics Applied Physics

Random matrix description of dynamically backscattered coherent waves propagating in a wide-field-illuminated random medium

no code implementations16 Feb 2021 Peng Miao, Yifan Zhang, Cheng Wang, Shanbao Tong

We find that the dynamic speckle patterns can be utilized to decouple the singly and multiply backscattered components.

Optics Applied Physics

FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagery

no code implementations9 Mar 2021 Xian Sun, Peijin Wang, Zhiyuan Yan, Feng Xu, Ruiping Wang, Wenhui Diao, Jin Chen, Jihao Li, Yingchao Feng, Tao Xu, Martin Weinmann, Stefan Hinz, Cheng Wang, Kun fu

In this paper, we propose a novel benchmark dataset with more than 1 million instances and more than 15, 000 images for Fine-grAined object recognItion in high-Resolution remote sensing imagery which is named as FAIR1M.

Object object-detection +2

Neighbor Embedding Variational Autoencoder

no code implementations21 Mar 2021 Renfei Tu, Yang Liu, Yongzeng Xue, Cheng Wang, Maozu Guo

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i. e. the latent variational distributions collapse to the prior, especially when a strong decoder network is used.

A Detector-oblivious Multi-arm Network for Keypoint Matching

1 code implementation2 Apr 2021 Xuelun Shen, Cheng Wang, Xin Li, Qian Hu, Jingyi Zhang

This paper presents a matching network to establish point correspondence between images.

Handling Long-Tail Queries with Slice-Aware Conversational Systems

no code implementations26 Apr 2021 Cheng Wang, Sun Kim, Taiwoo Park, Sajal Choudhary, Sunghyun Park, Young-Bum Kim, Ruhi Sarikaya, Sungjin Lee

We have been witnessing the usefulness of conversational AI systems such as Siri and Alexa, directly impacting our daily lives.

DLA-Net: Learning Dual Local Attention Features for Semantic Segmentation of Large-Scale Building Facade Point Clouds

1 code implementation1 Jun 2021 Yanfei Su, Weiquan Liu, Zhimin Yuan, Ming Cheng, Zhihong Zhang, Xuelun Shen, Cheng Wang

As there is a lack of 3D point clouds datasets related to the fine-grained building facade, we construct the first large-scale building facade point clouds benchmark dataset for semantic segmentation.

3D Semantic Segmentation Point Cloud Segmentation +1

Learning Slice-Aware Representations with Mixture of Attentions

no code implementations Findings (ACL) 2021 Cheng Wang, Sungjin Lee, Sunghyun Park, Han Li, Young-Bum Kim, Ruhi Sarikaya

Real-world machine learning systems are achieving remarkable performance in terms of coarse-grained metrics like overall accuracy and F-1 score.

Natural Language Understanding

Monocular 3D Object Detection: An Extrinsic Parameter Free Approach

no code implementations CVPR 2021 Yunsong Zhou, Yuan He, Hongzi Zhu, Cheng Wang, Hongyang Li, Qinhong Jiang

Due to the lack of insight in industrial application, existing methods on open datasets neglect the camera pose information, which inevitably results in the detector being susceptible to camera extrinsic parameters.

Ranked #9 on Monocular 3D Object Detection on KITTI Cars Moderate (using extra training data)

Autonomous Driving Monocular 3D Object Detection +2

Stationary Multi-source AI-powered Real-time Tomography (SMART)

no code implementations27 Aug 2021 Weiwen Wu, Yaohui Tang, Tianling Lv, Chuang Niu, Cheng Wang, Yiyan Guo, Yunheng Chang, Ge Wang, Yan Xi

The reconstructed volumetric images convincingly demonstrate the merits of the SMART system using the AI-empowered interior tomography approach, enabling cardiac micro-CT with the unprecedented temporal resolution of 30ms, which is an order of magnitude higher than the state of the art.

Computed Tomography (CT)

Storage and Transmission Capacity Requirements of a Remote Solar Power Generation System

no code implementations13 Sep 2021 Yue Chen, Wei Wei, Cheng Wang, Miadreza Shafie-khah, João P. S. Catalão

Large solar power stations usually locate in remote areas and connect to the main grid via a long transmission line.

Oscillatory Fourier Neural Network: A Compact and Efficient Architecture for Sequential Processing

no code implementations14 Sep 2021 Bing Han, Cheng Wang, Kaushik Roy

To address these challenges, we propose a novel neuron model that has cosine activation with a time varying component for sequential processing.

Sentiment Analysis

ConTIG: Continuous Representation Learning on Temporal Interaction Graphs

no code implementations27 Sep 2021 Xu Yan, Xiaoliang Fan, Peizhen Yang, Zonghan Wu, Shirui Pan, Longbiao Chen, Yu Zang, Cheng Wang

Representation learning on temporal interaction graphs (TIG) is to model complex networks with the dynamic evolution of interactions arising in a broad spectrum of problems.

Dynamic Node Classification Link Prediction +1

Spatial-temporal V-Net for automatic segmentation and quantification of right ventricles in gated myocardial perfusion SPECT images

1 code implementation11 Oct 2021 Chen Zhao, Shi Shi, Zhuo He, Cheng Wang, Zhongqiang Zhao, Xinli Li, Yanli Zhou, Weihua Zhou

By integrating the spatial features from each cardiac frame of the gated MPS and the temporal features from the sequential cardiac frames of the gated MPS, we developed a Spatial-Temporal V-Net (ST-VNet) for automatic extraction of RV endocardial and epicardial contours.

Segmentation

Spatio-Temporal Joint Graph Convolutional Networks for Traffic Forecasting

no code implementations25 Nov 2021 Chuanpan Zheng, Xiaoliang Fan, Shirui Pan, Haibing Jin, Zhaopeng Peng, Zonghan Wu, Cheng Wang, Philip S. Yu

However, this approach failed to explicitly reflect the correlations between different nodes at different time steps, thus limiting the learning capability of graph neural networks.

Linear Discriminant Analysis with High-dimensional Mixed Variables

no code implementations14 Dec 2021 Binyan Jiang, Chenlei Leng, Cheng Wang, Zhongqing Yang, Xinyang Yu

Datasets containing both categorical and continuous variables are frequently encountered in many areas, and with the rapid development of modern measurement technologies, the dimensions of these variables can be very high.

LEMMA Vocal Bursts Intensity Prediction

Transformer Uncertainty Estimation with Hierarchical Stochastic Attention

1 code implementation27 Dec 2021 Jiahuan Pei, Cheng Wang, György Szarvas

In this work, we propose a novel way to enable transformers to have the capability of uncertainty estimation and, meanwhile, retain the original predictive performance.

Medical Diagnosis text-classification +1

C2-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System

1 code implementation4 Jan 2022 Yuanhang Zhou, Kun Zhou, Wayne Xin Zhao, Cheng Wang, Peng Jiang, He Hu

To implement this framework, we design both coarse-grained and fine-grained procedures for modeling user preference, where the former focuses on more general, coarse-grained semantic fusion and the latter focuses on more specific, fine-grained semantic fusion.

Contrastive Learning Recommendation Systems +2

A Unified Granular-ball Learning Model of Pawlak Rough Set and Neighborhood Rough Set

no code implementations10 Jan 2022 Shuyin Xia, Cheng Wang, Guoyin Wang, Weiping Ding, Xinbo Gao, JianHang Yu, Yujia Zhai, Zizhong Chen

The granular-ball rough set can simultaneously represent Pawlak rough sets, and the neighborhood rough set, so as to realize the unified representation of the two.

feature selection

Multi-Graph Fusion Networks for Urban Region Embedding

1 code implementation24 Jan 2022 Shangbin Wu, Xu Yan, Xiaoliang Fan, Shirui Pan, Shichao Zhu, Chuanpan Zheng, Ming Cheng, Cheng Wang

Human mobility data contains rich but abundant information, which yields to the comprehensive region embeddings for cross domain tasks.

Crime Prediction

Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks

no code implementations8 Mar 2022 Jibing Gong, Yao Wan, Ye Liu, Xuewen Li, Yi Zhao, Cheng Wang, YuTing Lin, Xiaohan Fang, Wenzheng Feng, Jingyi Zhang, Jie Tang

Despite the usefulness of this service, we consider that recommending courses to users directly may neglect their varying degrees of expertise.

Graph Attention reinforcement-learning +1

HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDAR

1 code implementation CVPR 2022 Yudi Dai, Yitai Lin, Chenglu Wen, Siqi Shen, Lan Xu, Jingyi Yu, Yuexin Ma, Cheng Wang

We propose Human-centered 4D Scene Capture (HSC4D) to accurately and efficiently create a dynamic digital world, containing large-scale indoor-outdoor scenes, diverse human motions, and rich interactions between humans and environments.

3D Human Pose Estimation Autonomous Driving

A Co-design view of Compute in-Memory with Non-Volatile Elements for Neural Networks

no code implementations3 Jun 2022 Wilfried Haensch, Anand Raghunathan, Kaushik Roy, Bhaswar Chakrabart, Charudatta M. Phatak, Cheng Wang, Supratik Guha

In the second part, we review what is knows about the different new non-volatile memory materials and devices suited for compute in-memory, and discuss the outlook and challenges.

Feature-aware Diversified Re-ranking with Disentangled Representations for Relevant Recommendation

no code implementations10 Jun 2022 Zihan Lin, Hui Wang, Jingshu Mao, Wayne Xin Zhao, Cheng Wang, Peng Jiang, Ji-Rong Wen

Relevant recommendation is a special recommendation scenario which provides relevant items when users express interests on one target item (e. g., click, like and purchase).

Disentanglement Re-Ranking

Verifiable Goal Recognition for Autonomous Driving with Occlusions

1 code implementation28 Jun 2022 Cillian Brewitt, Massimiliano Tamborski, Cheng Wang, Stefano V. Albrecht

Goal recognition (GR) involves inferring the goals of other vehicles, such as a certain junction exit, which can enable more accurate prediction of their future behaviour.

Autonomous Driving

KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification

no code implementations8 Oct 2022 Yong He, Cheng Wang, Shun Zhang, Nan Li, Zhaorong Li, Zhenyu Zeng

Herein, we develop a new model called KG-MTT-BERT (Knowledge Graph Enhanced Multi-Type Text BERT) by extending the BERT model for long and multi-type text with the integration of the medical knowledge graph.

Question Answering text-classification +1

HSurf-Net: Normal Estimation for 3D Point Clouds by Learning Hyper Surfaces

1 code implementation13 Oct 2022 Qing Li, Yu-Shen Liu, Jin-San Cheng, Cheng Wang, Yi Fang, Zhizhong Han

To address these issues, we introduce hyper surface fitting to implicitly learn hyper surfaces, which are represented by multi-layer perceptron (MLP) layers that take point features as input and output surface patterns in a high dimensional feature space.

Surface Normals Estimation

Deploying a Retrieval based Response Model for Task Oriented Dialogues

no code implementations25 Oct 2022 Lahari Poddar, György Szarvas, Cheng Wang, Jorge Balazs, Pavel Danchenko, Patrick Ernst

Task-oriented dialogue systems in industry settings need to have high conversational capability, be easily adaptable to changing situations and conform to business constraints.

Retrieval Task-Oriented Dialogue Systems

Exposing Surveillance Detection Routes via Reinforcement Learning, Attack Graphs, and Cyber Terrain

no code implementations6 Nov 2022 Lanxiao Huang, Tyler Cody, Christopher Redino, Abdul Rahman, Akshay Kakkar, Deepak Kushwaha, Cheng Wang, Ryan Clark, Daniel Radke, Peter Beling, Edward Bowen

Reinforcement learning (RL) operating on attack graphs leveraging cyber terrain principles are used to develop reward and state associated with determination of surveillance detection routes (SDR).

reinforcement-learning Reinforcement Learning (RL)

Transformation-Equivariant 3D Object Detection for Autonomous Driving

no code implementations22 Nov 2022 Hai Wu, Chenglu Wen, Wei Li, Xin Li, Ruigang Yang, Cheng Wang

However, it is difficult to apply such networks to 3D object detection in autonomous driving due to its large computation cost and slow reasoning speed.

3D Object Detection Autonomous Driving +3

FedGS: Federated Graph-based Sampling with Arbitrary Client Availability

1 code implementation25 Nov 2022 Zheng Wang, Xiaoliang Fan, Jianzhong Qi, Haibing Jin, Peizhen Yang, Siqi Shen, Cheng Wang

Second, constrained by the far-distance in data distribution of the sampled clients, we further minimize the variance of the numbers of times that the clients are sampled, to mitigate long-term bias.

Federated Learning

Few-Shot Specific Emitter Identification via Hybrid Data Augmentation and Deep Metric Learning

1 code implementation1 Dec 2022 Cheng Wang, Xue Fu, Yu Wang, Guan Gui, Haris Gacanin, Hikmet Sari, Fumiyuki Adachi

Specific emitter identification (SEI) is a potential physical layer authentication technology, which is one of the most critical complements of upper layer authentication.

Data Augmentation Metric Learning

State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions

no code implementations10 Dec 2022 Cheng Wang, Carolin Lawrence, Mathias Niepert

We aim to address both shortcomings with a class of recurrent networks that use a stochastic state transition mechanism between cell applications.

Memorization Object Recognition +1

CoIn: Contrastive Instance Feature Mining for Outdoor 3D Object Detection with Very Limited Annotations

1 code implementation ICCV 2023 Qiming Xia, Jinhao Deng, Chenglu Wen, Hai Wu, Shaoshuai Shi, Xin Li, Cheng Wang

Combining CoIn with an iterative training strategy, we propose a CoIn++ pipeline, which requires only 2% annotations in the KITTI dataset to achieve performance comparable to the fully supervised methods.

3D Object Detection Contrastive Learning +2

SGLoc: Scene Geometry Encoding for Outdoor LiDAR Localization

no code implementations CVPR 2023 Wen Li, Shangshu Yu, Cheng Wang, Guosheng Hu, Siqi Shen, Chenglu Wen

In this work, we propose a novel LiDAR localization framework, SGLoc, which decouples the pose estimation to point cloud correspondence regression and pose estimation via this correspondence.

Outdoor Localization Pose Estimation +1

INCREASE: Inductive Graph Representation Learning for Spatio-Temporal Kriging

2 code implementations6 Feb 2023 Chuanpan Zheng, Xiaoliang Fan, Cheng Wang, Jianzhong Qi, Chaochao Chen, Longbiao Chen

It aims to infer knowledge for (the things at) unobserved locations using the data from (the things at) observed locations during a given time period of interest.

Graph Representation Learning Relation

Causal Explanations for Sequential Decision-Making in Multi-Agent Systems

1 code implementation21 Feb 2023 Balint Gyevnar, Cheng Wang, Christopher G. Lucas, Shay B. Cohen, Stefano V. Albrecht

We present CEMA: Causal Explanations in Multi-Agent systems; a framework for creating causal natural language explanations of an agent's decisions in dynamic sequential multi-agent systems to build more trustworthy autonomous agents.

Autonomous Driving counterfactual +2

Interpreting Hidden Semantics in the Intermediate Layers of 3D Point Cloud Classification Neural Network

no code implementations12 Mar 2023 Weiquan Liu, Minghao Liu, Shijun Zheng, Cheng Wang

It delivers the class Relevance to the activated neurons in the intermediate layers in a back-propagation manner, and associates the activation of neurons with the input points to visualize the hidden semantics of each layer.

3D Point Cloud Classification Adversarial Attack +2

Adaptive Local Adversarial Attacks on 3D Point Clouds for Augmented Reality

no code implementations12 Mar 2023 Weiquan Liu, Shijun Zheng, Cheng Wang

Adversarial examples are beneficial to improve the robustness of the 3D neural network model and enhance the stability of the AR system.

Adversarial Attack

Ins-ATP: Deep Estimation of ATP for Organoid Based on High Throughput Microscopic Images

1 code implementation13 Mar 2023 Xuesheng Bian, Cheng Wang, Shuting Chen, Weiquan Liu, Sen Xu, Jinxin Zhu, Rugang Wang, Zexin Chen, Min Huang, Gang Li

Performing ATP bioluminescence causes cell lysis of organoids, so it is impossible to observe organoids' long-term viability changes after medication continually.

SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments

1 code implementation CVPR 2023 Yudi Dai, Yitai Lin, Xiping Lin, Chenglu Wen, Lan Xu, Hongwei Yi, Siqi Shen, Yuexin Ma, Cheng Wang

We present SLOPER4D, a novel scene-aware dataset collected in large urban environments to facilitate the research of global human pose estimation (GHPE) with human-scene interaction in the wild.

3D Human Pose Estimation Camera Calibration +1

Meta-Calibration Regularized Neural Networks

no code implementations27 Mar 2023 Cheng Wang, Jacek Golebiowski

Our experiments show that (a) learning sample-wise gamma at continuous space can effectively perform calibration; (b) SECE smoothly optimise gamma-net towards better robustness to binning schemes; (c) the combination of gamma-net and SECE achieve the best calibration performance across various calibration metrics and retain very competitive predictive performance as compared to multiple recently proposed methods on three datasets.

Meta-Learning

OpenInst: A Simple Query-Based Method for Open-World Instance Segmentation

no code implementations28 Mar 2023 Cheng Wang, Guoli Wang, Qian Zhang, Peng Guo, Wenyu Liu, Xinggang Wang

Fortunately, we have identified two observations that help us achieve the best of both worlds: 1) query-based methods demonstrate superiority over dense proposal-based methods in open-world instance segmentation, and 2) learning localization cues is sufficient for open world instance segmentation.

Autonomous Driving Open-World Instance Segmentation +2

CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions

no code implementations CVPR 2023 Ming Yan, Xin Wang, Yudi Dai, Siqi Shen, Chenglu Wen, Lan Xu, Yuexin Ma, Cheng Wang

The core of this dataset is a blending optimization process, which corrects for the pose as it drifts and is affected by the magnetic conditions.

Pose Prediction

Resilient-Economic Coordinated Robust Operation of Integrated Electric-Gas Systems

no code implementations28 Apr 2023 Ahmed Rabee Sayed, Cheng Wang, Tianshu Bi

Interactions between power and gas systems, which are both large and complex, have been gradually intensified during the last decades, predominantly due to the propagation of large fleet natural gas-fired power units (GPUs) and the technological developments of power-to-gas (P2G) facilities.

Decision Making Scheduling

SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depth

2 code implementations8 Jun 2023 Zelin Liu, Xinggang Wang, Cheng Wang, Wenyu Liu, Xiang Bai

By integrating the pseudo-depth method and the DCM strategy into the data association process, we propose a new tracker, called SparseTrack.

 Ranked #1 on Multi-Object Tracking on MOT20 (using extra training data)

Depth Estimation Multi-Object Tracking +1

Encoding Enhanced Complex CNN for Accurate and Highly Accelerated MRI

no code implementations21 Jun 2023 Zimeng Li, Sa Xiao, Cheng Wang, Haidong Li, Xiuchao Zhao, Caohui Duan, Qian Zhou, Qiuchen Rao, Yuan Fang, Junshuai Xie, Lei Shi, Fumin Guo, Chaohui Ye, Xin Zhou

Magnetic resonance imaging (MRI) using hyperpolarized noble gases provides a way to visualize the structure and function of human lung, but the long imaging time limits its broad research and clinical applications.

MRI Reconstruction

Calibration in Deep Learning: A Survey of the State-of-the-Art

no code implementations2 Aug 2023 Cheng Wang

There have been some recent advances in calibrating deep models.

Evaluation of STT-MRAM as a Scratchpad for Training in ML Accelerators

no code implementations3 Aug 2023 Sourjya Roy, Cheng Wang, Anand Raghunathan

We devised a cross-layer simulation framework to evaluate the effectiveness of STT-MRAM as a scratchpad replacing SRAM in a systolic-array-based DNN accelerator.

Teeth And Root Canals Segmentation Using ZXYFormer With Uncertainty Guidance And Weight Transfer

no code implementations14 Aug 2023 Shangxuan Li, Yu Du, Li Ye, Chichi Li, Yanshu Fang, Cheng Wang, Wu Zhou

In addition, there are weak edges at the tooth, between tooth and root canal, which makes it very difficult to segment such weak edges.

Segmentation

A global product of fine-scale urban building height based on spaceborne lidar

no code implementations22 Oct 2023 Xiao Ma, Guang Zheng, Chi Xu, L. Monika Moskal, Peng Gong, Qinghua Guo, Huabing Huang, Xuecao Li, Yong Pang, Cheng Wang, Huan Xie, Bailang Yu, Bo Zhao, Yuyu Zhou

Our results revealed that the estimated method of building height samples based on the GEDI data was effective with 0. 78 of Pearson's r and 3. 67 m of RMSE in comparison to the reference data.

RiskQ: Risk-sensitive Multi-Agent Reinforcement Learning Value Factorization

1 code implementation NeurIPS 2023 Siqi Shen, Chennan Ma, Chao Li, Weiquan Liu, Yongquan Fu, Songzhu Mei, Xinwang Liu, Cheng Wang

Multi-agent systems are characterized by environmental uncertainty, varying policies of agents, and partial observability, which result in significant risks.

Multi-agent Reinforcement Learning reinforcement-learning

Enhancing the Rationale-Input Alignment for Self-explaining Rationalization

no code implementations7 Dec 2023 Wei Liu, Haozhao Wang, Jun Wang, Zhiying Deng, Yuankai Zhang, Cheng Wang, Ruixuan Li

Rationalization empowers deep learning models with self-explaining capabilities through a cooperative game, where a generator selects a semantically consistent subset of the input as a rationale, and a subsequent predictor makes predictions based on the selected rationale.

SPEAL: Skeletal Prior Embedded Attention Learning for Cross-Source Point Cloud Registration

no code implementations14 Dec 2023 Kezheng Xiong, Maoji Zheng, Qingshan Xu, Chenglu Wen, Siqi Shen, Cheng Wang

To the best of our knowledge, our approach is the first to facilitate point cloud registration with skeletal geometric priors.

Benchmarking Point Cloud Registration

ZeroRF: Fast Sparse View 360° Reconstruction with Zero Pretraining

no code implementations14 Dec 2023 Ruoxi Shi, Xinyue Wei, Cheng Wang, Hao Su

We present ZeroRF, a novel per-scene optimization method addressing the challenge of sparse view 360{\deg} reconstruction in neural field representations.

Image Generation

End-to-End Crystal Structure Prediction from Powder X-Ray Diffraction

no code implementations8 Jan 2024 Qingsi Lai, Lin Yao, Zhifeng Gao, Siyuan Liu, Hongshuai Wang, Shuqi Lu, Di He, LiWei Wang, Cheng Wang, Guolin Ke

XtalNet represents a significant advance in CSP, enabling the prediction of complex structures from PXRD data without the need for external databases or manual intervention.

Contrastive Learning Retrieval

Sophisticated Behavioral Simulation: A Possible Solution to Problems of Organized Complexity

no code implementations18 Jan 2024 Cheng Wang, Chuwen Wang, Yu Zhao, Wang Zhang, Shirong Zeng, Ronghui Ning, Changjun Jiang

As a matter of facts, they act as the best tool to handle problems in complex systems where closed-form expressions are unavailable and the target distribution in the representation space is too complex to be fully represented by data-driven learning models, such as deep learning (DL) models.

Weather Forecasting

Discovering Command and Control (C2) Channels on Tor and Public Networks Using Reinforcement Learning

no code implementations14 Feb 2024 Cheng Wang, Christopher Redino, Abdul Rahman, Ryan Clark, Daniel Radke, Tyler Cody, Dhruv Nandakumar, Edward Bowen

Results on a typical network configuration show that the RL agent can automatically discover resilient C2 attack paths utilizing both Tor-based and conventional communication channels, while also bypassing network firewalls.

Reinforcement Learning (RL)

GIM: Learning Generalizable Image Matcher From Internet Videos

no code implementations16 Feb 2024 Xuelun Shen, Zhipeng Cai, Wei Yin, Matthias Müller, Zijun Li, Kaixuan Wang, Xiaozhi Chen, Cheng Wang

Given an architecture, GIM first trains it on standard domain-specific datasets and then combines it with complementary matching methods to create dense labels on nearby frames of novel videos.

Domain Generalization

G4G:A Generic Framework for High Fidelity Talking Face Generation with Fine-grained Intra-modal Alignment

no code implementations28 Feb 2024 Juan Zhang, Jiahao Chen, Cheng Wang, Zhiwang Yu, Tangquan Qi, Di wu

Despite numerous completed studies, achieving high fidelity talking face generation with highly synchronized lip movements corresponding to arbitrary audio remains a significant challenge in the field.

Talking Face Generation

Sunshine to Rainstorm: Cross-Weather Knowledge Distillation for Robust 3D Object Detection

no code implementations28 Feb 2024 Xun Huang, Hai Wu, Xin Li, Xiaoliang Fan, Chenglu Wen, Cheng Wang

LiDAR-based 3D object detection models have traditionally struggled under rainy conditions due to the degraded and noisy scanning signals.

Knowledge Distillation object-detection +1

Large Language Models Need Consultants for Reasoning: Becoming an Expert in a Complex Human System Through Behavior Simulation

1 code implementation27 Mar 2024 Chuwen Wang, Shirong Zeng, Cheng Wang

In the MEOW framework, simulated data are utilized to train an expert model concentrating ``experience'' about a specific task in each independent time of simulation.

Common Sense Reasoning World Knowledge

RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method

no code implementations28 Mar 2024 Ming Yan, Yan Zhang, Shuqiang Cai, Shuqi Fan, Xincheng Lin, Yudi Dai, Siqi Shen, Chenglu Wen, Lan Xu, Yuexin Ma, Cheng Wang

Comprehensive capturing of human motions requires both accurate captures of complex poses and precise localization of the human within scenes.

Real-time guidewire tracking and segmentation in intraoperative x-ray

no code implementations12 Apr 2024 Baochang Zhang, Mai Bui, Cheng Wang, Felix Bourier, Heribert Schunkert, Nassir Navab

For this purpose, real-time and accurate guidewire segmentation and tracking can enhance the visualization of guidewires and provide visual feedback for physicians during the intervention as well as for robot-assisted interventions.

FedPFT: Federated Proxy Fine-Tuning of Foundation Models

1 code implementation17 Apr 2024 Zhaopeng Peng, Xiaoliang Fan, Yufan Chen, Zheng Wang, Shirui Pan, Chenglu Wen, Ruisheng Zhang, Cheng Wang

Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs.

Cannot find the paper you are looking for? You can Submit a new open access paper.