Search Results for author: Lu Fang

Found 31 papers, 7 papers with code

RobustFusion: Human Volumetric Capture with Data-driven Visual Cues using a RGBD Camera

no code implementations ECCV 2020 Zhuo Su, Lan Xu, Zerong Zheng, Tao Yu, Yebin Liu, Lu Fang

To enable robust tracking, we embrace both the initial model and the various visual cues into a novel performance capture scheme with hybrid motion optimization and semantic volumetric fusion, which can successfully capture challenging human motions under the monocular setting without pre-scanned detailed template and owns the reinitialization ability to recover from tracking failures and the disappear-reoccur scenarios.

RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream

no code implementations30 Apr 2021 Zhuo Su, Lan Xu, Dawei Zhong, Zhong Li, Fan Deng, Shuxue Quan, Lu Fang

To fill this gap, in this paper, we propose RobustFusion, a robust volumetric performance reconstruction system for human-object interaction scenarios using only a single RGBD sensor, which combines various data-driven visual and interaction cues to handle the complex interaction patterns and severe occlusions.

Human-Object Interaction Detection Human Parsing +2

Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network

1 code implementation14 Apr 2021 Gaochang Wu, Yebin Liu, Lu Fang, Tianyou Chai

In this paper, we revisit the classic LF rendering framework to address both challenges by incorporating it with advanced deep learning techniques.

Depth Estimation

Data-Uncertainty Guided Multi-Phase Learning for Semi-Supervised Object Detection

no code implementations CVPR 2021 Zhenyu Wang, YaLi Li, Ye Guo, Lu Fang, Shengjin Wang

In this paper, we delve into semi-supervised object detection where unlabeled images are leveraged to break through the upper bound of fully-supervised object detection models.

Object Detection Semi-Supervised Object Detection

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

1 code implementation24 Mar 2021 Gaochang Wu, Yebin Liu, Lu Fang, Qionghai Dai, Tianyou Chai

The main problem in direct reconstruction on the EPI involves an information asymmetry between the spatial and angular dimensions, where the detailed portion in the angular dimensions is damaged by undersampling.

LEAD: LiDAR Extender for Autonomous Driving

no code implementations16 Feb 2021 Jianing Zhang, Wei Li, Honggang Gou, Lu Fang, Ruigang Yang

In this paper, we propose LEAD, i. e., LiDAR Extender for Autonomous Driving, to extend the MEMS LiDAR by coupled image w. r. t both FoV and range.

Autonomous Driving Depth Completion +1

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

no code implementations26 Aug 2020 Tiankuang Zhou, Xing Lin, Jiamin Wu, Yitong Chen, Hao Xie, Yipeng Li, Jintao Fan, Huaqiang Wu, Lu Fang, Qionghai Dai

Here, we propose an optoelectronic reconfigurable computing paradigm by constructing a diffractive processing unit (DPU) that can efficiently support different neural networks and achieve a high model complexity with millions of neurons.

Spatial-Angular Attention Network for Light Field Reconstruction

1 code implementation5 Jul 2020 Gaochang Wu, Yingqian Wang, Yebin Liu, Lu Fang, Tianyou Chai

In this paper, we propose a spatial-angular attention network to perceive correspondences in the light field non-locally, and reconstruction high angular resolution light field in an end-to-end manner.

Zoom in to the details of human-centric videos

no code implementations27 May 2020 Guanghan Li, Yaping Zhao, Mengqi Ji, Xiaoyun Yuan, Lu Fang

Presenting high-resolution (HR) human appearance is always critical for the human-centric videos.

Pose Estimation Super-Resolution

SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsis

1 code implementation26 May 2020 Mengqi Ji, Jinzhi Zhang, Qionghai Dai, Lu Fang

Furthermore, the latter problem is handled via a multi-scale strategy that consequently refines the recovered geometry around the region with the repeating pattern.

MulayCap: Multi-layer Human Performance Capture Using A Monocular Video Camera

no code implementations13 Apr 2020 Zhaoqi Su, Weilin Wan, Tao Yu, Lingjie Liu, Lu Fang, Wenping Wang, Yebin Liu

We introduce MulayCap, a novel human performance capture method using a monocular video camera without the need for pre-scanning.

OccuSeg: Occupancy-aware 3D Instance Segmentation

no code implementations CVPR 2020 Lei Han, Tian Zheng, Lan Xu, Lu Fang

3D instance segmentation, with a variety of applications in robotics and augmented reality, is in large demands these days.

3D Instance Segmentation Multi-Task Learning +1

PANDA: A Gigapixel-level Human-centric Video Dataset

no code implementations CVPR 2020 Xueyang Wang, Xiya Zhang, Yinheng Zhu, Yuchen Guo, Xiaoyun Yuan, Liuyu Xiang, Zerun Wang, Guiguang Ding, David J. Brady, Qionghai Dai, Lu Fang

We believe PANDA will contribute to the community of artificial intelligence and praxeology by understanding human behaviors and interactions in large-scale real-world scenes.

Human Detection

SPI-Optimizer: an integral-Separated PI Controller for Stochastic Optimization

2 code implementations29 Dec 2018 Dan Wang, Mengqi Ji, Yong Wang, Haoqian Wang, Lu Fang

Inspired by the conditional integration idea in classical control society, we propose SPI-Optimizer, an integral-Separated PI controller based optimizer WITHOUT introducing extra hyperparameter.

Stochastic Optimization

RegNet: Learning the Optimization of Direct Image-to-Image Pose Registration

no code implementations26 Dec 2018 Lei Han, Mengqi Ji, Lu Fang, Matthias Nießner

Direct image-to-image alignment that relies on the optimization of photometric error metrics suffers from limited convergence range and sensitivity to lighting conditions.

HybridFusion: Real-Time Performance Capture Using a Single Depth Sensor and Sparse IMUs

no code implementations ECCV 2018 Zerong Zheng, Tao Yu, Hao Li, Kaiwen Guo, Qionghai Dai, Lu Fang, Yebin Liu

We propose a light-weight and highly robust real-time human performance capture method based on a single depth camera and sparse inertial measurement units (IMUs).

CrossNet: An End-to-end Reference-based Super Resolution Network using Cross-scale Warping

no code implementations ECCV 2018 Haitian Zheng, Mengqi Ji, Haoqian Wang, Yebin Liu, Lu Fang

The Reference-based Super-resolution (RefSR) super-resolves a low-resolution (LR) image given an external high-resolution (HR) reference image, where the reference image and LR image share similar viewpoint but with significant resolution gap x8.

Patch Matching Super-Resolution

Beyond SIFT using Binary features for Loop Closure Detection

no code implementations18 Sep 2017 Lei Han, Guyue Zhou, Lan Xu, Lu Fang

The proposed system originates from our previous work Multi-Index hashing for Loop closure Detection (MILD), which employs Multi-Index Hashing (MIH)~\cite{greene1994multi} for Approximate Nearest Neighbor (ANN) search of binary features.

Loop Closure Detection

SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis

3 code implementations ICCV 2017 Mengqi Ji, Juergen Gall, Haitian Zheng, Yebin Liu, Lu Fang

It takes a set of images and their corresponding camera parameters as input and directly infers the 3D model.

MILD: Multi-Index hashing for Loop closure Detection

no code implementations28 Feb 2017 Lei Han, Lu Fang

Loop Closure Detection (LCD) has been proved to be extremely useful in global consistent visual Simultaneously Localization and Mapping (SLAM) and appearance-based robot relocalization.

Loop Closure Detection

FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras

no code implementations29 Oct 2016 Lan Xu, Lu Fang, Wei Cheng, Kaiwen Guo, Guyue Zhou, Qionghai Dai, Yebin Liu

We propose a novel non-rigid surface registration method to track and fuse the depth of the three flying cameras for surface motion tracking of the moving target, and simultaneously calculate the pose of each flying camera.

Markerless Motion Capture Visual Odometry

Utilizing High-level Visual Feature for Indoor Shopping Mall Navigation

no code implementations6 Oct 2016 Ziwei Xu, Haitian Zheng, Minjian Pang, Yangchun Zhu, Xiongfei Su, Guyue Zhou, Lu Fang

Towards robust and convenient indoor shopping mall navigation, we propose a novel learning-based scheme to utilize the high-level visual information from the storefront images captured by personal devices of users.

Visual Navigation

Deep Learning for Surface Material Classification Using Haptic And Visual Information

no code implementations21 Dec 2015 Haitian Zheng, Lu Fang, Mengqi Ji, Matti Strese, Yigitcan Ozer, Eckehard Steinbach

When a user scratches a hand-held rigid tool across an object surface, an acceleration signal can be captured, which carries relevant information about the surface.

Classification General Classification +1

Learning High-level Prior with Convolutional Neural Networks for Semantic Segmentation

no code implementations22 Nov 2015 Haitian Zheng, Yebin Liu, Mengqi Ji, Feng Wu, Lu Fang

Finally, the optimization problem enables us to take advantage of state-of-the-art fully convolutional network structure for the implementation of the above encoders and decoder.

Semantic Segmentation

Separable Kernel for Image Deblurring

no code implementations CVPR 2014 Lu Fang, Haifeng Liu, Feng Wu, Xiaoyan Sun, Houqiang Li

In this paper, we deal with the image deblurring problem in a completely new perspective by proposing separable kernel to represent the inherent properties of the camera and scene system.

Deblurring

Cannot find the paper you are looking for? You can Submit a new open access paper.