Search Results for author: Lu Fang

Found 43 papers, 11 papers with code

RobustFusion: Human Volumetric Capture with Data-driven Visual Cues using a RGBD Camera

no code implementations ECCV 2020 Zhuo Su, Lan Xu, Zerong Zheng, Tao Yu, Yebin Liu, Lu Fang

To enable robust tracking, we embrace both the initial model and the various visual cues into a novel performance capture scheme with hybrid motion optimization and semantic volumetric fusion, which can successfully capture challenging human motions under the monocular setting without pre-scanned detailed template and owns the reinitialization ability to recover from tracking failures and the disappear-reoccur scenarios.

4D reconstruction

XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold

no code implementations28 Mar 2024 Guangyu Wang, Jinzhi Zhang, Fan Wang, Ruqi Huang, Lu Fang

We also introduce a novel dataset, namely GigaNVS, to benchmark cross-scale, high-resolution novel view synthesis of realworld large-scale scenes.

Neural Rendering Novel View Synthesis

Den-SOFT: Dense Space-Oriented Light Field DataseT for 6-DOF Immersive Experience

no code implementations15 Mar 2024 Xiaohang Yu, Zhengxian Yang, Shi Pan, Yuqi Han, Haoxiang Wang, Jun Zhang, Shi Yan, Borong Lin, Lei Yang, Tao Yu, Lu Fang

We have built a custom mobile multi-camera large-space dense light field capture system, which provides a series of high-quality and sufficiently dense light field images for various scenarios.

3D Reconstruction 3D Scene Reconstruction +1

OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning

1 code implementation20 Nov 2023 Haiyang Ying, Yixuan Yin, Jinzhi Zhang, Fan Wang, Tao Yu, Ruqi Huang, Lu Fang

Towards holistic understanding of 3D scenes, a general 3D segmentation method is needed that can segment diverse objects without restrictions on object quantity or categories, while also reflecting the inherent hierarchical structure.

Contrastive Learning Novel View Synthesis +1

PARF: Primitive-Aware Radiance Fusion for Indoor Scene Novel View Synthesis

no code implementations ICCV 2023 Haiyang Ying, Baowei Jiang, Jinzhi Zhang, Di Xu, Tao Yu, Qionghai Dai, Lu Fang

This paper proposes a method for fast scene radiance field reconstruction with strong novel view synthesis performance and convenient scene editing functionality.

Novel View Synthesis Semantic Parsing

ClickSeg: 3D Instance Segmentation with Click-Level Weak Annotations

no code implementations19 Jul 2023 Leyao Liu, Tao Kong, Minzhao Zhu, Jiashuo Fan, Lu Fang

Instead of directly using the model inference way, i. e., mean-shift clustering, to generate the pseudo labels, we propose to use k-means with fixed initial seeds: the annotated points.

3D Instance Segmentation Clustering +3

RealLiFe: Real-Time Light Field Reconstruction via Hierarchical Sparse Gradient Descent

no code implementations6 Jul 2023 Yijie Deng, Lei Han, Tianpeng Lin, Lin Li, Jinzhi Zhang, Lu Fang

Based on this insight, we introduce EffLiFe, a novel light field optimization method, which leverages the proposed Hierarchical Sparse Gradient Descent (HSGD) to produce high-quality light fields from sparse view images in real time.

Crowd3D: Towards Hundreds of People Reconstruction from a Single Image

no code implementations CVPR 2023 Hao Wen, Jing Huang, Huili Cui, Haozhe Lin, Yukun Lai, Lu Fang, Kun Li

However, existing methods cannot deal with large scenes containing hundreds of people, which encounter the challenges of large number of people, large variations in human scale, and complex spatial distribution.

RealGraph: A Multiview Dataset for 4D Real-world Context Graph Generation

no code implementations ICCV 2023 Haozhe Lin, Zequn Chen, Jinzhi Zhang, Bing Bai, Yu Wang, Ruqi Huang, Lu Fang

The CGG task capitalizes on the calibrated multiview videos of a dynamic scene, and targets at recovering semantic information (coordination, trajectories and relationships) of the presented objects in the form of spatio-temporal context graph in 4D space.

Graph Generation Scene Understanding

Geo-NI: Geometry-aware Neural Interpolation for Light Field Rendering

no code implementations20 Jun 2022 Gaochang Wu, Yuemei Zhou, Yebin Liu, Lu Fang, Tianyou Chai

In this paper, we present a Geometry-aware Neural Interpolation (Geo-NI) framework for light field rendering.

Novel View Synthesis

INS-Conv: Incremental Sparse Convolution for Online 3D Segmentation

no code implementations CVPR 2022 Leyao Liu, Tian Zheng, Yun-Jou Lin, Kai Ni, Lu Fang

Based on INS-Conv, an online joint 3D semantic and instance segmentation pipeline is proposed, reaching an inference speed of 15 FPS on GPU and 10 FPS on CPU.

Instance Segmentation RGB-D Reconstruction +2

RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream

no code implementations30 Apr 2021 Zhuo Su, Lan Xu, Dawei Zhong, Zhong Li, Fan Deng, Shuxue Quan, Lu Fang

To fill this gap, in this paper, we propose RobustFusion, a robust volumetric performance reconstruction system for human-object interaction scenarios using only a single RGBD sensor, which combines various data-driven visual and interaction cues to handle the complex interaction patterns and severe occlusions.

4D reconstruction Disentanglement +5

Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network

1 code implementation14 Apr 2021 Gaochang Wu, Yebin Liu, Lu Fang, Tianyou Chai

In this paper, we revisit the classic LF rendering framework to address both challenges by incorporating it with advanced deep learning techniques.

Depth Estimation

Data-Uncertainty Guided Multi-Phase Learning for Semi-Supervised Object Detection

no code implementations CVPR 2021 Zhenyu Wang, YaLi Li, Ye Guo, Lu Fang, Shengjin Wang

In this paper, we delve into semi-supervised object detection where unlabeled images are leveraged to break through the upper bound of fully-supervised object detection models.

Object object-detection +2

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

1 code implementation24 Mar 2021 Gaochang Wu, Yebin Liu, Lu Fang, Qionghai Dai, Tianyou Chai

The main problem in direct reconstruction on the EPI involves an information asymmetry between the spatial and angular dimensions, where the detailed portion in the angular dimensions is damaged by undersampling.

LEAD: LiDAR Extender for Autonomous Driving

no code implementations16 Feb 2021 Jianing Zhang, Wei Li, Honggang Gou, Lu Fang, Ruigang Yang

In this paper, we propose LEAD, i. e., LiDAR Extender for Autonomous Driving, to extend the MEMS LiDAR by coupled image w. r. t both FoV and range.

Autonomous Driving Depth Completion +1

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

no code implementations26 Aug 2020 Tiankuang Zhou, Xing Lin, Jiamin Wu, Yitong Chen, Hao Xie, Yipeng Li, Jintao Fan, Huaqiang Wu, Lu Fang, Qionghai Dai

Here, we propose an optoelectronic reconfigurable computing paradigm by constructing a diffractive processing unit (DPU) that can efficiently support different neural networks and achieve a high model complexity with millions of neurons.

Spatial-Angular Attention Network for Light Field Reconstruction

1 code implementation5 Jul 2020 Gaochang Wu, Yingqian Wang, Yebin Liu, Lu Fang, Tianyou Chai

In this paper, we propose a spatial-angular attention network to perceive correspondences in the light field non-locally, and reconstruction high angular resolution light field in an end-to-end manner.

Zoom in to the details of human-centric videos

no code implementations27 May 2020 Guanghan Li, Yaping Zhao, Mengqi Ji, Xiaoyun Yuan, Lu Fang

Presenting high-resolution (HR) human appearance is always critical for the human-centric videos.

Pose Estimation Super-Resolution

SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsis

1 code implementation26 May 2020 Mengqi Ji, Jinzhi Zhang, Qionghai Dai, Lu Fang

Furthermore, the latter problem is handled via a multi-scale strategy that consequently refines the recovered geometry around the region with the repeating pattern.


MulayCap: Multi-layer Human Performance Capture Using A Monocular Video Camera

no code implementations13 Apr 2020 Zhaoqi Su, Weilin Wan, Tao Yu, Lingjie Liu, Lu Fang, Wenping Wang, Yebin Liu

We introduce MulayCap, a novel human performance capture method using a monocular video camera without the need for pre-scanning.

OccuSeg: Occupancy-aware 3D Instance Segmentation

no code implementations CVPR 2020 Lei Han, Tian Zheng, Lan Xu, Lu Fang

3D instance segmentation, with a variety of applications in robotics and augmented reality, is in large demands these days.

3D Instance Segmentation Clustering +3

PANDA: A Gigapixel-level Human-centric Video Dataset

no code implementations CVPR 2020 Xueyang Wang, Xiya Zhang, Yinheng Zhu, Yuchen Guo, Xiaoyun Yuan, Liuyu Xiang, Zerun Wang, Guiguang Ding, David J. Brady, Qionghai Dai, Lu Fang

We believe PANDA will contribute to the community of artificial intelligence and praxeology by understanding human behaviors and interactions in large-scale real-world scenes.

4k Attribute +1

SPI-Optimizer: an integral-Separated PI Controller for Stochastic Optimization

2 code implementations29 Dec 2018 Dan Wang, Mengqi Ji, Yong Wang, Haoqian Wang, Lu Fang

Inspired by the conditional integration idea in classical control society, we propose SPI-Optimizer, an integral-Separated PI controller based optimizer WITHOUT introducing extra hyperparameter.

Stochastic Optimization

RegNet: Learning the Optimization of Direct Image-to-Image Pose Registration

1 code implementation26 Dec 2018 Lei Han, Mengqi Ji, Lu Fang, Matthias Nießner

Direct image-to-image alignment that relies on the optimization of photometric error metrics suffers from limited convergence range and sensitivity to lighting conditions.

HybridFusion: Real-Time Performance Capture Using a Single Depth Sensor and Sparse IMUs

no code implementations ECCV 2018 Zerong Zheng, Tao Yu, Hao Li, Kaiwen Guo, Qionghai Dai, Lu Fang, Yebin Liu

We propose a light-weight and highly robust real-time human performance capture method based on a single depth camera and sparse inertial measurement units (IMUs).

Surface Reconstruction

CrossNet: An End-to-end Reference-based Super Resolution Network using Cross-scale Warping

1 code implementation ECCV 2018 Haitian Zheng, Mengqi Ji, Haoqian Wang, Yebin Liu, Lu Fang

The Reference-based Super-resolution (RefSR) super-resolves a low-resolution (LR) image given an external high-resolution (HR) reference image, where the reference image and LR image share similar viewpoint but with significant resolution gap x8.

Patch Matching Reference-based Super-Resolution

Beyond SIFT using Binary features for Loop Closure Detection

no code implementations18 Sep 2017 Lei Han, Guyue Zhou, Lan Xu, Lu Fang

The proposed system originates from our previous work Multi-Index hashing for Loop closure Detection (MILD), which employs Multi-Index Hashing (MIH)~\cite{greene1994multi} for Approximate Nearest Neighbor (ANN) search of binary features.

Loop Closure Detection

SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis

3 code implementations ICCV 2017 Mengqi Ji, Juergen Gall, Haitian Zheng, Yebin Liu, Lu Fang

It takes a set of images and their corresponding camera parameters as input and directly infers the 3D model.

MILD: Multi-Index hashing for Loop closure Detection

no code implementations28 Feb 2017 Lei Han, Lu Fang

Loop Closure Detection (LCD) has been proved to be extremely useful in global consistent visual Simultaneously Localization and Mapping (SLAM) and appearance-based robot relocalization.

Loop Closure Detection

FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras

no code implementations29 Oct 2016 Lan Xu, Lu Fang, Wei Cheng, Kaiwen Guo, Guyue Zhou, Qionghai Dai, Yebin Liu

We propose a novel non-rigid surface registration method to track and fuse the depth of the three flying cameras for surface motion tracking of the moving target, and simultaneously calculate the pose of each flying camera.

Markerless Motion Capture Visual Odometry

Utilizing High-level Visual Feature for Indoor Shopping Mall Navigation

no code implementations6 Oct 2016 Ziwei Xu, Haitian Zheng, Minjian Pang, Yangchun Zhu, Xiongfei Su, Guyue Zhou, Lu Fang

Towards robust and convenient indoor shopping mall navigation, we propose a novel learning-based scheme to utilize the high-level visual information from the storefront images captured by personal devices of users.

Visual Navigation Vocal Bursts Intensity Prediction

Deep Learning for Surface Material Classification Using Haptic And Visual Information

no code implementations21 Dec 2015 Haitian Zheng, Lu Fang, Mengqi Ji, Matti Strese, Yigitcan Ozer, Eckehard Steinbach

When a user scratches a hand-held rigid tool across an object surface, an acceleration signal can be captured, which carries relevant information about the surface.

Classification General Classification +1

Learning High-level Prior with Convolutional Neural Networks for Semantic Segmentation

no code implementations22 Nov 2015 Haitian Zheng, Yebin Liu, Mengqi Ji, Feng Wu, Lu Fang

Finally, the optimization problem enables us to take advantage of state-of-the-art fully convolutional network structure for the implementation of the above encoders and decoder.

Image Segmentation Segmentation +2

Separable Kernel for Image Deblurring

no code implementations CVPR 2014 Lu Fang, Haifeng Liu, Feng Wu, Xiaoyan Sun, Houqiang Li

In this paper, we deal with the image deblurring problem in a completely new perspective by proposing separable kernel to represent the inherent properties of the camera and scene system.

Deblurring Image Deblurring

Cannot find the paper you are looking for? You can Submit a new open access paper.