Search Results for author: Feng Xu

Found 66 papers, 24 papers with code

Eyeglasses 3D shape reconstruction from a single face image

no code implementations ECCV 2020 Yating Wang, Quan Wang, Feng Xu

A complete 3D face reconstruction requires to explicitly model the eyeglasses on the face, which is less investigated in the literature.

3D Face Reconstruction 3D Reconstruction +2

GaussianHead: Impressive 3D Gaussian-based Head Avatars with Dynamic Hybrid Neural Field

no code implementations4 Dec 2023 Jie Wang, Xianyan Li, Jiucheng Xie, Feng Xu, Hao Gao

Using explicit "dynamic" tri-plane as an efficient container for parameterized head geometry, aligned well with factors in the underlying geometry and tri-plane, we obtain aligned canonical factors for the canonical gaussians.

Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

1 code implementation1 Sep 2023 Shaohua Pan, Qi Ma, Xinyu Yi, Weifeng Hu, Xiong Wang, Xingkang Zhou, Jijunnan Li, Feng Xu

We believe that the combination is complementary and able to solve the inherent difficulties of using one modality input, including occlusions, extreme lighting/texture, and out-of-view for visual mocap and global drifts for inertial mocap.

3D Human Pose Estimation

SAR-NeRF: Neural Radiance Fields for Synthetic Aperture Radar Multi-View Representation

no code implementations11 Jul 2023 Zhengxin Lei, Feng Xu, Jiangtao Wei, Feng Cai, Feng Wang, Ya-Qiu Jin

SAR images are highly sensitive to observation configurations, and they exhibit significant variations across different viewing angles, making it challenging to represent and learn their anisotropic features.

Few-Shot Learning Image Generation

Physics-assisted Deep Learning for FMCW Radar Quantitative Imaging of Two-dimension Target

no code implementations5 Jul 2023 Zhuoyang Liu, Huilin Xu, Feng Xu

Radar imaging is crucial in remote sensing and has many applications in detection and autonomous driving.

Autonomous Driving Denoising

Quantum-Enhanced Diamond Molecular Tension Microscopy for Quantifying Cellular Forces

no code implementations28 Jun 2023 Feng Xu, Shuxiang Zhang, Linjie Ma, Yong Hou, Jie Li, Andrej Denisenko, Zifu Li, Joachim Spatz, Jörg Wrachtrup, Qiang Wei, Zhiqin Chu

The constant interplay and information exchange between cells and their micro-environment are essential to their survival and ability to execute biological functions.

Conceptual Study and Performance Analysis of Tandem Dual-Antenna Spaceborne SAR Interferometry

no code implementations17 Jun 2023 Fengming Hu, Feng Xu, Xiaolan Qiu, Chibiao Ding, YaQiu Jin

In this article, a new concept of Tandem Dual-Antenna SAR Interferometry (TDA-InSAR) system for single-pass reliable 3D surface mapping using the asymptotic 3D PU is proposed.

3D Reconstruction

GFDC: A Granule Fusion Density-Based Clustering with Evidential Reasoning

no code implementations20 May 2023 Mingjie Cai, Zhishan Wu, Qingguo Li, Feng Xu, Jie zhou

Further, three novel granule fusion strategies are utilized to combine granules into stable cluster structures, helping to detect clusters with arbitrary shapes.


Breast Cancer Immunohistochemical Image Generation: a Benchmark Dataset and Challenge Review

1 code implementation5 May 2023 Chuang Zhu, ShengJie Liu, Zekuan Yu, Feng Xu, Arpit Aggarwal, Germán Corredor, Anant Madabhushi, Qixun Qu, Hongwei Fan, Fangda Li, Yueheng Li, Xianchao Guan, Yongbing Zhang, Vivek Kumar Singh, Farhan Akram, Md. Mostafa Kamal Sarker, Zhongyue Shi, Mulan Jin

For invasive breast cancer, immunohistochemical (IHC) techniques are often used to detect the expression level of human epidermal growth factor receptor-2 (HER2) in breast tissue to formulate a precise treatment plan.

Image Generation SSIM

EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors

no code implementations2 May 2023 Xinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik, Shaohua Pan, Christian Theobalt, Feng Xu

We integrate the two techniques together in EgoLocate, a system that simultaneously performs human motion capture (mocap), localization, and mapping in real time from sparse body-mounted sensors, including 6 inertial measurement units (IMUs) and a monocular phone camera.

Simultaneous Localization and Mapping

Hybrid RIS-Assisted MIMO Dual-Function Radar-Communication System

no code implementations28 Mar 2023 Zhuoyang Liu, Haiyang Zhang, Tianyao Huang, Feng Xu, Yonina C. Eldar

Dual-function radar-communication (DFRC) technology is emerging in next-generation wireless systems.

Learning a 3D Morphable Face Reflectance Model from Low-cost Data

1 code implementation CVPR 2023 Yuxuan Han, Zhibo Wang, Feng Xu

This paper proposes the first 3D morphable face reflectance model with spatially varying BRDF using only low-cost publicly-available data.

Face Model Inverse Rendering

How To Guide Your Learner: Imitation Learning with Active Adaptive Expert Involvement

1 code implementation3 Mar 2023 Xu-Hui Liu, Feng Xu, Xinyu Zhang, Tianyuan Liu, Shengyi Jiang, Ruifeng Chen, Zongzhang Zhang, Yang Yu

In this paper, we propose a novel active imitation learning framework based on a teacher-student interaction model, in which the teacher's goal is to identify the best teaching behavior and actively affect the student's learning process.

Atari Games Imitation Learning

EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points

no code implementations CVPR 2023 Chengwei Zheng, Wenbin Lin, Feng Xu

To achieve this, we propose a scene analysis method to detect and initialize key points by considering the dynamics in the scene, and a weighted key points strategy to model topologically varying dynamics by joint key points and weights optimization.

Novel View Synthesis

ShadowNeuS: Neural SDF Reconstruction by Shadow Ray Supervision

1 code implementation CVPR 2023 Jingwang Ling, Zhibo Wang, Feng Xu

By supervising shadow rays, we successfully reconstruct a neural SDF of the scene from single-view images under multiple lighting conditions.

Novel View Synthesis

A Tale of Two Cities: Data and Configuration Variances in Robust Deep Learning

no code implementations18 Nov 2022 Guanqin Zhang, Jiankun Sun, Feng Xu, H. M. N. Dilum Bandara, Shiping Chen, Yulei Sui, Tim Menzies

Deep neural networks (DNNs), are widely used in many industries such as image recognition, supply chain, medical diagnosis, and autonomous driving.

Autonomous Driving Medical Diagnosis

Physical Interaction: Reconstructing Hand-object Interactions with Physics

1 code implementation22 Sep 2022 Haoyu Hu, Xinyu Yi, Hao Zhang, Jun-Hai Yong, Feng Xu

Single view-based reconstruction of hand-object interaction is challenging due to the severe observation missing caused by occlusions.

Real-to-Sim: Predicting Residual Errors of Robotic Systems with Sparse Data using a Learning-based Unscented Kalman Filter

no code implementations7 Sep 2022 Alexander Schperberg, Yusuke Tanaka, Feng Xu, Marcel Menner, Dennis Hong

Achieving highly accurate dynamic or simulator models that are close to the real robot can facilitate model-based controls (e. g., model predictive control or linear-quadradic regulators), model-based trajectory planning (e. g., trajectory optimization), and decrease the amount of learning time necessary for reinforcement learning methods.

Trajectory Planning

Confidence Matters: Inspecting Backdoors in Deep Neural Networks via Distribution Transfer

no code implementations13 Aug 2022 Tong Wang, Yuan YAO, Feng Xu, Miao Xu, Shengwei An, Ting Wang

Existing defenses are mainly built upon the observation that the backdoor trigger is usually of small size or affects the activation of only a few neurons.

Backdoor Attack backdoor defense

The feasibility of Q-band millimeter wave on hand-gesture recognition for indoor FTTR scenario

no code implementations22 Jul 2022 Yuxuan Hu, Zhaoyang Xia, Yanbo Zhao, Feng Xu

The generalization for different scenarios and dif-ferent users is an urgent problem for millimeter wave gesture recognition for indoor fiber-to-the-room (FTTR) scenario.

Hand Gesture Recognition Hand-Gesture Recognition

Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

1 code implementation19 Jul 2022 Jingwang Ling, Zhibo Wang, Ming Lu, Quan Wang, Chen Qian, Feng Xu

Previous works on morphable models mostly focus on large-scale facial geometry but ignore facial details.

Self-Supervised Music-Motion Synchronization Learning for Music-Driven Conducting Motion Generation

1 code implementation Journal of Computer Science and Technology 2022 Fan Liu, Delong Chen, Ruizhi Zhou, Sai Yang, Feng Xu

Therefore, we propose a novel Music Motion Synchronized Generative Adversarial Network (M2S-GAN), which generates motions according to the automatically learned music representations.

Linear Leaky-Integrate-and-Fire Neuron Model Based Spiking Neural Networks and Its Mapping Relationship to Deep Neural Networks

no code implementations31 May 2022 Sijia Lu, Feng Xu

Spiking neural networks (SNNs) are brain-inspired machine learning algorithms with merits such as biological plausibility and unsupervised learning capability.

EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model

no code implementations30 May 2022 Xinya Ji, Hang Zhou, Kaisiyuan Wang, Qianyi Wu, Wayne Wu, Feng Xu, Xun Cao

Although significant progress has been made to audio-driven talking face generation, existing methods either neglect facial emotion or cannot be applied to arbitrary subjects.

Talking Face Generation

Detecting Topology Attacks against Graph Neural Networks

no code implementations21 Apr 2022 Senrong Xu, Yuan YAO, Liangyue Li, Wei Yang, Feng Xu, Hanghang Tong

In this work, we study the victim node detection problem under topology attacks against GNNs.

Node Classification

Portrait Eyeglasses and Shadow Removal by Leveraging 3D Synthetic Data

1 code implementation CVPR 2022 Junfeng Lyu, Zhibo Wang, Feng Xu

In this paper, we propose a novel framework to remove eyeglasses as well as their cast shadows from face images.

Face Verification Shadow Removal

OcclusionFusion: Occlusion-aware Motion Estimation for Real-time Dynamic 3D Reconstruction

1 code implementation CVPR 2022 Wenbin Lin, Chengwei Zheng, Jun-Hai Yong, Feng Xu

In our technique, the motion of visible regions is first estimated and combined with temporal information to infer the motion of the occluded regions through an LSTM-involved graph neural network.

3D Reconstruction Motion Estimation

Data-Driven Robust Control for Discrete Linear Time-Invariant Systems: A Descriptor System Approach

no code implementations14 Mar 2022 Jiabao He, Xuan Zhang, Feng Xu, Junbo Tan, Xueqian Wang

Given the recent surge of interest in data-driven control, this paper proposes a two-step method to study robust data-driven control for a parameter-unknown linear time-invariant (LTI) system that is affected by energy-bounded noises.

Data-Driven Controllability Analysis and Stabilization for Linear Descriptor Systems

no code implementations7 Dec 2021 Jiabao He, Xuan Zhang, Feng Xu, Junbo Tan, Xueqian Wang

For a parameter-unknown linear descriptor system, this paper proposes data-driven methods to testify the system's type and controllability and then to stabilize it.

Predicting Axillary Lymph Node Metastasis in Early Breast Cancer Using Deep Learning on Primary Tumor Biopsy Slides

1 code implementation4 Dec 2021 Feng Xu, Chuang Zhu, Wenqi Tang, Ying Wang, Yu Zhang, Jie Li, Hongchuan Jiang, Zhongyue Shi, Jun Liu, Mulan Jin

Conclusion: Our study provides a novel DL-based biomarker on primary tumor CNB slides to predict the metastatic status of ALN preoperatively for patients with EBC.

Multiple Instance Learning Specificity +1

Cross-modal Domain Adaptation for Cost-Efficient Visual Reinforcement Learning

1 code implementation NeurIPS 2021 Xiong-Hui Chen, Shengyi Jiang, Feng Xu, Zongzhang Zhang, Yang Yu

Experiments on MuJoCo and Hand Manipulation Suite tasks show that the agents deployed with our method achieve similar performance as it has in the source domain, while those deployed with previous methods designed for same-modal domain adaptation suffer a larger performance gap.

Domain Adaptation reinforcement-learning +1

Backdoor Attack through Frequency Domain

1 code implementation22 Nov 2021 Tong Wang, Yuan YAO, Feng Xu, Shengwei An, Hanghang Tong, Ting Wang

We also evaluate FTROJAN against state-of-the-art defenses as well as several adaptive defenses that are designed on the frequency domain.

Autonomous Driving Backdoor Attack

VirtualConductor: Music-driven Conducting Video Generation System

2 code implementations28 Jul 2021 Delong Chen, Fan Liu, Zewen Li, Feng Xu

In this demo, we present VirtualConductor, a system that can generate conducting video from any given music and a single user's image.

Pose Transfer Video Generation

TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors

1 code implementation10 May 2021 Xinyu Yi, Yuxiao Zhou, Feng Xu

For global translation estimation, we propose a supporting-foot-based method and an RNN-based method to robustly solve for the global translations with a confidence-based fusion technique.

Pose Estimation Translation

m6 A-related lncRNAs are potential biomarkers for predicting prognoses and immune responses in patients with LUAD

no code implementations molecular therapy nucleic acids 2021 Feng Xu, Xiaoling Huang, Yangyi Li, Yongsong Chen, and Ling Lin

This risk model based on the m6 A-based lncRNAs may be promising for the clinical prediction of prognoses and immunotherapeutic responses in LUAD patients.

Audio-Driven Emotional Video Portraits

1 code implementation CVPR 2021 Xinya Ji, Hang Zhou, Kaisiyuan Wang, Wayne Wu, Chen Change Loy, Xun Cao, Feng Xu

In this work, we present Emotional Video Portraits (EVP), a system for synthesizing high-quality video portraits with vivid emotional dynamics driven by audios.

Disentanglement Face Generation

Two-Dimensional DOA Estimation for L-shaped Nested Array via Tensor Modeling

no code implementations14 Apr 2021 Feng Xu, Sergiy A. Vorobyov

To develop such approach, a higher-order tensor is constructed, whose factor matrices contain the sources azimuth and elevation information.

Tensor Decomposition

Transmit Beamspace DDMA Based Automotive MIMO Radar

no code implementations25 Mar 2021 Feng Xu, Sergiy A. Vorobyov, Fawei Yang

The time division multiple access (TDMA) technique has been applied in automotive multiple-input multiple-output (MIMO) radar.

FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagery

no code implementations9 Mar 2021 Xian Sun, Peijin Wang, Zhiyuan Yan, Feng Xu, Ruiping Wang, Wenhui Diao, Jin Chen, Jihao Li, Yingchao Feng, Tao Xu, Martin Weinmann, Stefan Hinz, Cheng Wang, Kun fu

In this paper, we propose a novel benchmark dataset with more than 1 million instances and more than 15, 000 images for Fine-grAined object recognItion in high-Resolution remote sensing imagery which is named as FAIR1M.

object-detection Object Detection +1

DOA Estimation for Transmit Beamspace MIMO Radar via Tensor Decomposition with Vandermonde Factor Matrix

no code implementations29 Jan 2021 Feng Xu, Matthew W. Morency, Sergiy A. Vorobyov

A computationally efficient tensor decomposition method is proposed to decompose the Vandermonde factor matrices.

Information Theory Signal Processing Information Theory

Cross-Modal Domain Adaptation for Reinforcement Learning

1 code implementation1 Jan 2021 Xiong-Hui Chen, Shengyi Jiang, Feng Xu, Yang Yu

Domain adaptation is a promising direction for deploying RL agents in real-world applications, where vision-based robotics tasks constitute an important part.

Domain Adaptation reinforcement-learning +1

Monocular Real-time Full Body Capture with Inter-part Correlations

no code implementations CVPR 2021 Yuxiao Zhou, Marc Habermann, Ikhsanul Habibie, Ayush Tewari, Christian Theobalt, Feng Xu

We present the first method for real-time full body capture that estimates shape and motion of body and hands together with a dynamic 3D face model from a single color image.

3D Hand Pose Estimation Face Model

Joint DOD and DOA Estimation in Slow-Time MIMO Radar via PARAFAC Decomposition

no code implementations30 Jul 2020 Feng Xu, Sergiy A. Vorobyov, Xiaopeng Yang

We develop a new tensor model for slow-time multiple-input multiple output (MIMO) radar and apply it for joint direction-of-departure (DOD) and direction-of-arrival (DOA) estimation.

Deep Learning Meets SAR

no code implementations17 Jun 2020 Xiao Xiang Zhu, Sina Montazeri, Mohsin Ali, Yuansheng Hua, Yuanyuan Wang, Lichao Mou, Yilei Shi, Feng Xu, Richard Bamler

Deep learning in remote sensing has become an international hype, but it is mostly limited to the evaluation of optical data.

Deep Learning Based Single Sample Per Person Face Recognition: A Survey

no code implementations9 Jun 2020 Fan Liu, Delong Chen, Fei Wang, Zewen Li, Feng Xu

Face recognition under this situation is referred to as single sample face recognition and poses significant challenges to the effective training of deep models.

Domain Adaptation Face Recognition

Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data

2 code implementations CVPR 2020 Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu

We present a novel method for monocular hand shape and pose estimation at unprecedented runtime performance of 100fps and at state-of-the-art accuracy.

Pose Estimation

SQUIRL: Robust and Efficient Learning from Video Demonstration of Long-Horizon Robotic Manipulation Tasks

no code implementations10 Mar 2020 Bohan Wu, Feng Xu, Zhanpeng He, Abhi Gupta, Peter K. Allen

This paper aims to address this scalability challenge with a robust, sample-efficient, and general meta-IRL algorithm, SQUIRL, that performs a new but related long-horizon task robustly given only a single video demonstration.

reinforcement-learning Reinforcement Learning (RL) +1

Tell-the-difference: Fine-grained Visual Descriptor via a Discriminating Referee

no code implementations14 Oct 2019 Shuangjie Xu, Feng Xu, Yu Cheng, Pan Zhou

In this paper, we investigate a novel problem of telling the difference between image pairs in natural language.

Image Captioning

A Closed-form Solution to Universal Style Transfer

2 code implementations ICCV 2019 Ming Lu, Hao Zhao, Anbang Yao, Yurong Chen, Feng Xu, Li Zhang

Although plenty of methods have been proposed, a theoretical analysis of feature transform is still missing.

Style Transfer

DenseAttentionSeg: Segment Hands from Interacted Objects Using Depth Input

no code implementations29 Mar 2019 Zihao Bo, Hao Zhang, Junhai Yong, Feng Xu

We propose a real-time DNN-based technique to segment hand and object of interacting motions from depth inputs.

Hand Segmentation Segmentation

Reciprocal Translation between SAR and Optical Remote Sensing Images with Cascaded-Residual Adversarial Networks

no code implementations24 Jan 2019 Shilei Fu, Feng Xu, Ya-Qiu Jin

This paper attempts to develop machine intelligence that are trainable with large-volume co-registered SAR and optical images to translate SAR image to optical version for assisted SAR image interpretation.


Translating SAR to Optical Images for Assisted Interpretation

no code implementations8 Jan 2019 Shilei Fu, Feng Xu, Ya-Qiu Jin

This paper attempts to develop machine intelligence that are trainable with large-volume co-registered SAR and optical images to translate SAR image to optical version for assisted SAR interpretation.


Real-time Indoor Scene Reconstruction with RGBD and Inertia Input

no code implementations7 Dec 2018 Zunjie Zhu, Feng Xu

Experiments show that our patch deformation method improves the accuracy of feature tracking, and our 3D reconstruction outperforms the state-of-the-art solutions under fast camera motions.

3D Reconstruction 3D Scene Reconstruction +3

DDRNet: Depth Map Denoising and Refinement for Consumer Depth Cameras Using Cascaded CNNs

2 code implementations ECCV 2018 Shi Yan, Chenglei Wu, Lizhen Wang, Feng Xu, Liang An, Kaiwen Guo, Yebin Liu

Consumer depth sensors are more and more popular and come to our daily lives marked by its recent integration in the latest Iphone X.


Detecting Tiny Moving Vehicles in Satellite Videos

no code implementations5 Jul 2018 Wei Ao, Yanwei Fu, Feng Xu

Even worse, the noise signals also existed in the video frames, since the background of the video frame has the subpixel-level and uneven moving thanks to the motion of satellites.


Depth Assisted Full Resolution Network for Single Image-based View Synthesis

no code implementations17 Nov 2017 Xiaodong Cun, Feng Xu, Chi-Man Pun, Hao Gao

In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image.

Depth Estimation

Deep learning in remote sensing: a review

1 code implementation11 Oct 2017 Xiao Xiang Zhu, Devis Tuia, Lichao Mou, Gui-Song Xia, Liangpei Zhang, Feng Xu, Friedrich Fraundorfer

In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with.

BodyFusion: Real-Time Capture of Human Motion and Surface Geometry Using a Single Depth Camera

no code implementations ICCV 2017 Tao Yu, Kaiwen Guo, Feng Xu, Yuan Dong, Zhaoqi Su, Jianhui Zhao, Jianguo Li, Qionghai Dai, Yebin Liu

To reduce the ambiguities of the non-rigid deformation parameterization on the surface graph nodes, we take advantage of the internal articulated motion prior for human performance and contribute a skeleton-embedded surface fusion (SSF) method.

Surface Reconstruction

SAR Image Colorization: Converting Single-Polarization to Fully Polarimetric Using Deep Neural Networks

no code implementations22 Jul 2017 Qian Song, Feng Xu, Ya-Qiu Jin

Both qualitative and quantitative experiments with real fully polarimetric data are conducted to show the efficacy of the proposed method.

Colorization Image Colorization

Robust Non-Rigid Motion Tracking and Surface Reconstruction Using L0 Regularization

no code implementations ICCV 2015 Kaiwen Guo, Feng Xu, Yangang Wang, Yebin Liu, Qionghai Dai

We present a new motion tracking method to robustly reconstruct non-rigid geometries and motions from single view depth inputs captured by a consumer depth sensor.

Surface Reconstruction

Want a Good Answer? Ask a Good Question First!

no code implementations27 Nov 2013 Yuan Yao, Hanghang Tong, Tao Xie, Leman Akoglu, Feng Xu, Jian Lu

Community Question Answering (CQA) websites have become valuable repositories which host a massive volume of human knowledge.

Community Question Answering

Cannot find the paper you are looking for? You can Submit a new open access paper.