Search Results for author: Yan Lu

Found 62 papers, 17 papers with code

A Comprehensive Review of Digital Twin -- Part 2: Roles of Uncertainty Quantification and Optimization, a Battery Digital Twin, and Perspectives

no code implementations27 Aug 2022 Adam Thelen, Xiaoge Zhang, Olga Fink, Yan Lu, Sayan Ghosh, Byeng D. Youn, Michael D. Todd, Sankaran Mahadevan, Chao Hu, Zhen Hu

This second paper presents a literature review of key enabling technologies of digital twins, with an emphasis on uncertainty quantification, optimization methods, open source datasets and tools, major findings, challenges, and future directions.

A Comprehensive Review of Digital Twin -- Part 1: Modeling and Twinning Enabling Technologies

no code implementations26 Aug 2022 Adam Thelen, Xiaoge Zhang, Olga Fink, Yan Lu, Sayan Ghosh, Byeng D. Youn, Michael D. Todd, Sankaran Mahadevan, Chao Hu, Zhen Hu

In part two of this review, the role of uncertainty quantification and optimization are discussed, a battery digital twin is demonstrated, and more perspectives on the future of digital twin are shared.

Neural Capture of Animatable 3D Human from Monocular Video

no code implementations18 Aug 2022 Gusi Te, Xiu Li, Xiao Li, Jinglu Wang, Wei Hu, Yan Lu

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views.

Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification

no code implementations1 Aug 2022 Xulin Li, Yan Lu, Bin Liu, Yating Liu, Guojun Yin, Qi Chu, Jinyang Huang, Feng Zhu, Rui Zhao, Nenghai Yu

But we find existing graph-based methods in the visible-infrared person re-identification task (VI-ReID) suffer from bad generalization because of two issues: 1) train-test modality balance gap, which is a property of VI-ReID task.

Person Re-Identification

Predictive Neural Speech Coding

no code implementations18 Jul 2022 Xue Jiang, Xiulian Peng, Huaying Xue, Yuan Zhang, Yan Lu

Neural audio/speech coding has shown its capability to deliver a high quality at much lower bitrates than traditional methods recently.


Neighbor Correspondence Matching for Flow-based Video Frame Synthesis

no code implementations14 Jul 2022 Zhaoyang Jia, Yan Lu, Houqiang Li

Since the current frame is not available in video frame synthesis, NCM is performed in a current-frame-agnostic fashion to establish multi-scale correspondences in the spatial-temporal neighborhoods of each pixel.

Video Compression Video Frame Interpolation

Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compression

1 code implementation13 Jul 2022 Jiahao Li, Bin Li, Yan Lu

Besides estimating the probability distribution, our entropy model also generates the quantization step at spatial-channel-wise.

Quantization Video Compression

Online Video Instance Segmentation via Robust Context Fusion

no code implementations12 Jul 2022 Xiang Li, Jinglu Wang, Xiaohao Xu, Bhiksha Raj, Yan Lu

We propose a robust context fusion network to tackle VIS in an online fashion, which predicts instance segmentation frame-by-frame with a few preceding frames.

Instance Segmentation Semantic Segmentation +1

Cross-Scale Vector Quantization for Scalable Neural Speech Coding

no code implementations7 Jul 2022 Xue Jiang, Xiulian Peng, Huaying Xue, Yuan Zhang, Yan Lu

In this paper, we introduce a cross-scale scalable vector quantization scheme (CSVQ), in which multi-scale features are encoded progressively with stepwise feature fusion and refinement.


Multi-Modal Multi-Correlation Learning for Audio-Visual Speech Separation

no code implementations4 Jul 2022 Xiaoyu Wang, Xiangyu Kong, Xiulian Peng, Yan Lu

In this paper we propose a multi-modal multi-correlation learning framework targeting at the task of audio-visual speech separation.

Contrastive Learning Speech Separation

Towards Robust Video Object Segmentation with Adaptive Object Calibration

1 code implementation2 Jul 2022 Xiaohao Xu, Jinglu Wang, Xiang Ming, Yan Lu

We consolidate this conditional mask calibration process in a progressive manner, where the object representations and proto-masks evolve to be discriminative iteratively.

Semantic Segmentation Semi-Supervised Video Object Segmentation +2

Visual Concepts Tokenization

no code implementations20 May 2022 Tao Yang, Yuwang Wang, Yan Lu, Nanning Zheng

We further propose a Concept Disentangling Loss to facilitate that different concept tokens represent independent visual concepts.

Representation Learning

Test-time Batch Normalization

no code implementations20 May 2022 Tao Yang, Shenglong Zhou, Yuwang Wang, Yan Lu, Nanning Zheng

Deep neural networks often suffer the data distribution shift between training and testing, and the batch statistics are observed to reflect the shift.

Domain Generalization

Deep Frequency Filtering for Domain Generalization

no code implementations23 Mar 2022 Shiqi Lin, Zhizheng Zhang, Zhipeng Huang, Yan Lu, Cuiling Lan, Peng Chu, Quanzeng You, Jiang Wang, Zicheng Liu, Amey Parulkar, Viraj Navkal, Zhibo Chen

Improving the generalization capability of Deep Neural Networks (DNNs) is critical for their practical uses, which has been a longstanding challenge.

Domain Generalization

Neural Compression-Based Feature Learning for Video Restoration

no code implementations CVPR 2022 Cong Huang, Jiahao Li, Bin Li, Dong Liu, Yan Lu

The temporal features usually contain various noisy and uncorrelated information, and they may interfere with the restoration of the current frame.

Denoising Quantization +3

Robust Nonparametric Distribution Forecast with Backtest-based Bootstrap and Adaptive Residual Selection

no code implementations16 Feb 2022 Longshaokan Wang, Lingda Wang, Mina Georgieva, Paulo Machado, Abinaya Ulagappa, Safwan Ahmed, Yan Lu, Arjun Bakshi, Farhad Ghassemi

Distribution forecast can quantify forecast uncertainty and provide various forecast scenarios with their corresponding estimated probabilities.

Mask-based Latent Reconstruction for Reinforcement Learning

no code implementations28 Jan 2022 Tao Yu, Zhizheng Zhang, Cuiling Lan, Yan Lu, Zhibo Chen

For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance.

reinforcement-learning Representation Learning

End-to-End Neural Speech Coding for Real-Time Communications

no code implementations24 Jan 2022 Xue Jiang, Xiulian Peng, Chengyu Zheng, Huaying Xue, Yuan Zhang, Yan Lu

Deep-learning based methods have shown their advantages in audio coding over traditional ones but limited attention has been paid on real-time communications (RTC).

Speech Enhancement

Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking

2 code implementations CVPR 2020 Jin Gao, Yan Lu, Xiaojuan Qi, Yutong Kou, Bing Li, Liang Li, Shan Yu, Weiming Hu

In this paper, we propose a simple yet effective recursive least-squares estimator-aided online learning approach for few-shot online adaptation without requiring offline training.

Continual Learning One-Shot Learning +2

Continuous Human Action Detection Based on Wearable Inertial Data

no code implementations11 Dec 2021 Xia Gong, Yan Lu, Haoran Wei

Human action detection is a hot topic, which is widely used in video surveillance, human machine interface, healthcare monitoring, gaming, dancing training and musical instrument teaching.

Action Detection Gesture Recognition

Reliable Propagation-Correction Modulation for Video Object Segmentation

1 code implementation6 Dec 2021 Xiaohao Xu, Jinglu Wang, Xiao Li, Yan Lu

We introduce two modulators, propagation and correction modulators, to separately perform channel-wise re-calibration on the target frame embeddings according to local temporal correlations and reliable references respectively.

Semantic Segmentation Semi-Supervised Video Object Segmentation +1

Hybrid Instance-aware Temporal Fusion for Online Video Instance Segmentation

no code implementations3 Dec 2021 Xiang Li, Jinglu Wang, Xiao Li, Yan Lu

Based on this representation, we introduce a cropping-free temporal fusion approach to model the temporal consistency between video frames.

Image Segmentation Instance Segmentation +2

Temporal Context Mining for Learned Video Compression

no code implementations27 Nov 2021 Xihua Sheng, Jiahao Li, Bin Li, Li Li, Dong Liu, Yan Lu

From the stored propagated features, we propose to learn multi-scale temporal contexts, and re-fill the learned temporal contexts into the modules of our compression scheme, including the contextual encoder-decoder, the frame generator, and the temporal context encoder.


Video Instance Segmentation by Instance Flow Assembly

no code implementations20 Oct 2021 Xiang Li, Jinglu Wang, Xiao Li, Yan Lu

Instance segmentation is a challenging task aiming at classifying and segmenting all object instances of specific classes.

Instance Segmentation Object Localization +2

Deep Contextual Video Compression

1 code implementation NeurIPS 2021 Jiahao Li, Bin Li, Yan Lu

In this paper, we propose a deep contextual video compression framework to enable a paradigm shift from predictive coding to conditional coding.

Video Compression

Cross-Stage Transformer for Video Learning

no code implementations29 Sep 2021 Yuanze Lin, Xun Guo, Yan Lu

By inserting the proposed cross-stage mechanism in existing spatial and temporal transformer blocks, we build a separable transformer network for video learning based on ViT structure, in which self-attentions and features are progressively aggregated from one block to the next.

Action Recognition

Uncertainty-Aware Deep Video Compression with Ensembles

no code implementations29 Sep 2021 Wufei Ma, Jiahao Li, Bin Li, Yan Lu

Deep learning-based video compression is a challenging task and many previous state-of-the-art learning-based video codecs use optical flows to exploit the temporal correlation between successive frames and then compress the residual error.

Video Compression

What Makes for Good Representations for Contrastive Learning

no code implementations29 Sep 2021 Haoqing Wang, Xun Guo, Zhi-Hong Deng, Yan Lu

Therefore, we assume the task-relevant information that is not shared between views can not be ignored and theoretically prove that the minimal sufficient representation in contrastive learning is not sufficient for the downstream tasks, which causes performance degradation.

Contrastive Learning Representation Learning

Self-Supervised Video Representation Learning with Meta-Contrastive Network

no code implementations ICCV 2021 Yuanze Lin, Xun Guo, Yan Lu

Our method contains two training stages based on model-agnostic meta learning (MAML), each of which consists of a contrastive branch and a meta branch.

Contrastive Learning Meta-Learning +4

Geometry Uncertainty Projection Network for Monocular 3D Object Detection

1 code implementation ICCV 2021 Yan Lu, Xinzhu Ma, Lei Yang, Tianzhu Zhang, Yating Liu, Qi Chu, Junjie Yan, Wanli Ouyang

In this paper, we propose a Geometry Uncertainty Projection Network (GUP Net) to tackle the error amplification problem at both inference and training stages.

Depth Estimation Monocular 3D Object Detection +1

SSAN: Separable Self-Attention Network for Video Representation Learning

no code implementations CVPR 2021 Xudong Guo, Xun Guo, Yan Lu

However, spatial correlations and temporal correlations represent different contextual information of scenes and temporal reasoning.

Action Recognition Representation Learning +1

MonoGRNet: A General Framework for Monocular 3D Object Detection

no code implementations18 Apr 2021 Zengyi Qin, Jinglu Wang, Yan Lu

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection.

2D object detection Depth Estimation +3

Phoneme-based Distribution Regularization for Speech Enhancement

no code implementations8 Apr 2021 Yajing Liu, Xiulian Peng, Zhiwei Xiong, Yan Lu

Specifically, we propose a phoneme-based distribution regularization (PbDr) for speech enhancement, which incorporates frame-wise phoneme information into speech enhancement network in a conditional manner.

Speech Enhancement

Custom Object Detection via Multi-Camera Self-Supervised Learning

no code implementations5 Feb 2021 Yan Lu, Yuanchao Shu

This paper proposes MCSSL, a self-supervised learning approach for building custom object detection models in multi-camera networks.

object-detection Object Detection +1

T-Net: Effective Permutation-Equivariant Network for Two-View Correspondence Learning

1 code implementation ICCV 2021 Zhen Zhong, Guobao Xiao, Linxin Zheng, Yan Lu, Jiayi Ma

We develop a conceptually simple, flexible, and effective framework (named T-Net) for two-view correspondence learning.

Interactive Speech and Noise Modeling for Speech Enhancement

no code implementations17 Dec 2020 Chengyu Zheng, Xiulian Peng, Yuan Zhang, Sriram Srinivasan, Yan Lu

In this paper, we propose a novel idea to model speech and noise simultaneously in a two-branch convolutional neural network, namely SN-Net.

Speaker Separation Speech Enhancement

Weakly Supervised 3D Object Detection from Point Clouds

1 code implementation28 Jul 2020 Zengyi Qin, Jinglu Wang, Yan Lu

A crucial task in scene understanding is 3D object detection, which aims to detect and localize the 3D bounding boxes of objects belonging to specific classes.

3D Object Detection Knowledge Distillation +2

Weakly-supervised Temporal Action Localization by Uncertainty Modeling

2 code implementations12 Jun 2020 Pilhyeon Lee, Jinglu Wang, Yan Lu, Hyeran Byun

Experimental results show that our uncertainty modeling is effective at alleviating the interference of background frames and brings a large performance gain without bells and whistles.

Action Classification Multiple Instance Learning +4

Scattering under Linear Non Self-Adjoint Operators: Case of in-Plane Elastic Waves

no code implementations6 Mar 2020 Amir Ashkan Mokhtari, Yan Lu, Qiyuan Zhou, Alireza V. Amirkhizi, Ankit Srivastava

In this paper, we consider the problem of the scattering of in-plane waves at an interface between a homogeneous medium and a metamaterial.

Applied Physics

Cross-modality Person re-identification with Shared-Specific Feature Transfer

no code implementations CVPR 2020 Yan Lu, Yue Wu, Bin Liu, Tianzhu Zhang, Baopu Li, Qi Chu, Nenghai Yu

In this paper, we tackle the above limitation by proposing a novel cross-modality shared-specific feature transfer algorithm (termed cm-SSFT) to explore the potential of both the modality-shared information and the modality-specific characteristics to boost the re-identification performance.

Cross-Modality Person Re-identification Person Re-Identification

Reinforcement learning for bandwidth estimation and congestion control in real-time communications

no code implementations4 Dec 2019 Joyce Fang, Martin Ellis, Bin Li, Siyao Liu, Yasaman Hosseinkashi, Michael Revow, Albert Sadovnikov, Ziyuan Liu, Peng Cheng, Sachin Ashok, David Zhao, Ross Cutler, Yan Lu, Johannes Gehrke

Bandwidth estimation and congestion control for real-time communications (i. e., audio and video conferencing) remains a difficult problem, despite many years of research.


Triangulation Learning Network: from Monocular to Stereo 3D Object Detection

1 code implementation CVPR 2019 Zengyi Qin, Jinglu Wang, Yan Lu

In this paper, we study the problem of 3D object detection from stereo images, in which the key challenge is how to effectively utilize stereo information.

3D Object Detection From Stereo Images object-detection

Relational Knowledge Distillation

3 code implementations CVPR 2019 Wonpyo Park, Dongju Kim, Yan Lu, Minsu Cho

Knowledge distillation aims at transferring knowledge acquired in one model (a teacher) to another model (a student) that is typically smaller.

Knowledge Distillation Metric Learning

Real-Time Anomaly Detection With HMOF Feature

no code implementations12 Dec 2018 Huihui Zhu, Bin Liu, Guojun Yin, Yan Lu, Weihai Li, Nenghai Yu

Most existing methods are computation consuming, which cannot satisfy the real-time requirement.

Anomaly Detection Optical Flow Estimation

Affinity Derivation and Graph Merge for Instance Segmentation

1 code implementation ECCV 2018 Yiding Liu, Siyu Yang, Bin Li, Wengang Zhou, Jizheng Xu, Houqiang Li, Yan Lu

We present an instance segmentation scheme based on pixel affinity information, which is the relationship of two pixels belonging to a same instance.

Instance Segmentation Semantic Segmentation

MonoGRNet: A Geometric Reasoning Network for Monocular 3D Object Localization

1 code implementation26 Nov 2018 Zengyi Qin, Jinglu Wang, Yan Lu

We propose MonoGRNet for the amodal 3D object detection from a monocular RGB image via geometric reasoning in both the observed 2D projection and the unobserved depth dimension.

2D object detection Depth Estimation +4

MVPNet: Multi-View Point Regression Networks for 3D Object Reconstruction from A Single Image

no code implementations23 Nov 2018 Jinglu Wang, Bo Sun, Yan Lu

In this paper, we address the problem of reconstructing an object's surface from a single image using generative networks.

3D Object Reconstruction From A Single Image

Weakly Supervised Bilinear Attention Network for Fine-Grained Visual Classification

no code implementations6 Aug 2018 Tao Hu, Jizheng Xu, Cong Huang, Honggang Qi, Qingming Huang, Yan Lu

Besides, we propose attention regularization and attention dropout to weakly supervise the generating process of attention maps.

Classification Fine-Grained Image Classification +1

Local Descriptors Optimized for Average Precision

no code implementations CVPR 2018 Kun He, Yan Lu, Stan Sclaroff

In this paper, we improve the learning of local feature descriptors by optimizing the performance of descriptor matching, which is a common stage that follows descriptor extraction in local feature based pipelines, and can be formulated as nearest neighbor retrieval.


Feature Selective Networks for Object Detection

no code implementations CVPR 2018 Yao Zhai, Jingjing Fu, Yan Lu, Houqiang Li

The RoI-based sub-region attention map and aspect ratio attention map are selectively pooled from the banks, and then used to refine the original RoI features for RoI classification.

object-detection Object Detection +1

Robust RGB-D Odometry Using Point and Line Features

no code implementations ICCV 2015 Yan Lu, Dezhen Song

To meet the challenges, we fuse point and line features to form a robust odometry algorithm.

Visual Odometry

Content adaptive screen image scaling

no code implementations21 Oct 2015 Yao Zhai, Qifei Wang, Yan Lu, Shipeng Li

This paper proposes an efficient content adaptive screen image scaling scheme for the real-time screen applications like remote desktop and screen sharing.

General Classification

Human Activity Recognition using Smartphone

no code implementations30 Jan 2014 Amin Rasekh, Chien-An Chen, Yan Lu

In this project, we design a robust activity recognition system based on a smartphone.

Active Learning Dimensionality Reduction +2

Cannot find the paper you are looking for? You can Submit a new open access paper.