Search Results for author: Qionghai Dai

Found 54 papers, 19 papers with code

An Event-Oriented Diffusion-Refinement Method for Sparse Events Completion

no code implementations6 Jan 2024 Bo Zhang, Yuqi Han, Jinli Suo, Qionghai Dai

Event cameras or dynamic vision sensors (DVS) record asynchronous response to brightness changes instead of conventional intensity frames, and feature ultra-high sensitivity at low bandwidth.

Lightweight High-Speed Photography Built on Coded Exposure and Implicit Neural Representation of Videos

1 code implementation22 Nov 2023 Zhihong Zhang, Runzhao Yang, Jinli Suo, Yuxiao Cheng, Qionghai Dai

In this work, by leveraging classical coded exposure imaging technique and emerging implicit neural representation for videos, we tactfully embed the motion direction cues into the blurry image during the imaging process and develop a novel self-recursive neural network to sequentially retrieve the latent video sequence from the blurry image utilizing the embedded motion direction cues.

PARF: Primitive-Aware Radiance Fusion for Indoor Scene Novel View Synthesis

no code implementations ICCV 2023 Haiyang Ying, Baowei Jiang, Jinzhi Zhang, Di Xu, Tao Yu, Qionghai Dai, Lu Fang

This paper proposes a method for fast scene radiance field reconstruction with strong novel view synthesis performance and convenient scene editing functionality.

Novel View Synthesis Semantic Parsing

ImmersiveNeRF: Hybrid Radiance Fields for Unbounded Immersive Light Field Reconstruction

no code implementations4 Sep 2023 Xiaohang Yu, Haoxiang Wang, Yuqi Han, Lei Yang, Tao Yu, Qionghai Dai

This paper proposes a hybrid radiance field representation for unbounded immersive light field reconstruction which supports high-quality rendering and aggressive view extrapolation.


SHoP: A Deep Learning Framework for Solving High-order Partial Differential Equations

1 code implementation17 May 2023 Tingxiong Xiao, Runzhao Yang, Yuxiao Cheng, Jinli Suo, Qionghai Dai

Solving partial differential equations (PDEs) has been a fundamental problem in computational science and of wide applications for both scientific and engineering research.

Super-NeRF: View-consistent Detail Generation for NeRF super-resolution

no code implementations26 Apr 2023 Yuqi Han, Tao Yu, Xiaohang Yu, Yuwang Wang, Qionghai Dai

Given multi-view low-resolution images, Super-NeRF constructs a consistency-controlling super-resolution module to generate view-consistent high-resolution details for NeRF.

Image Super-Resolution

Hi Sheldon! Creating Deep Personalized Characters from TV Shows

no code implementations9 Apr 2023 Meidai Xuanyuan, Yuwang Wang, Honglei Guo, Xiao Ma, Yuchen Guo, Tao Yu, Qionghai Dai

To support this novel task, we further collect a character centric multimodal dialogue dataset, named Deep Personalized Character Dataset (DPCD), from TV shows.

DarkVision: A Benchmark for Low-light Image/Video Perception

no code implementations16 Jan 2023 Bo Zhang, Yuchen Guo, Runzhao Yang, Zhihong Zhang, Jiayi Xie, Jinli Suo, Qionghai Dai

In this paper, we contribute the first multi-illuminance, multi-camera, and low-light dataset, named DarkVision, serving for both image enhancement and object detection.

Autonomous Driving Image Enhancement +5

EEG Opto-processor: epileptic seizure detection using diffractive photonic computing units

no code implementations9 Dec 2022 Tao Yan, Maoqi Zhang, Sen Wan, Kaifeng Shang, Haiou Zhang, Xun Cao, Xing Lin, Qionghai Dai

Here, we propose the EEG opto-processor based on diffractive photonic computing units (DPUs) to effectively process the extracranial and intracranial EEG signals and perform epileptic seizure detection.

Edge-computing EEG +2

TINC: Tree-structured Implicit Neural Compression

1 code implementation CVPR 2023 Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Jinli Suo, Qionghai Dai

In this paper, we propose a Tree-structured Implicit Neural Compression (TINC) to conduct compact representation for local regions and extract the shared features of these local representations in a hierarchical manner.

Data Compression

SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data

1 code implementation30 Sep 2022 Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Qianni Cao, Jinyuan Qu, Jinli Suo, Qionghai Dai

To address this issue, we firstly derive a mathematical explanation for INR's spectrum concentration property and an analytical insight on the design of INR based compressor.

Data Compression

Optical Neural Ordinary Differential Equations

no code implementations26 Sep 2022 Yun Zhao, Hang Chen, Min Lin, Haiou Zhang, Tao Yan, Xing Lin, Ruqi Huang, Qionghai Dai

Increasing the layer number of on-chip photonic neural networks (PNNs) is essential to improve its model performance.

Image Classification Trajectory Prediction

INFWIDE: Image and Feature Space Wiener Deconvolution Network for Non-blind Image Deblurring in Low-Light Conditions

1 code implementation17 Jul 2022 Zhihong Zhang, Yuxiao Cheng, Jinli Suo, Liheng Bian, Qionghai Dai

In terms of algorithm design, INFWIDE proposes a two-branch architecture, which explicitly removes noise and hallucinates saturated regions in the image space and suppresses ringing artifacts in the feature space, and integrates the two complementary outputs with a subtle multi-scale fusion network for high quality night photograph deblurring.

Blind Image Deblurring Image Deblurring

All-optical graph representation learning using integrated diffractive photonic computing units

no code implementations23 Apr 2022 Tao Yan, Rui Yang, Ziyang Zheng, Xing Lin, Hongkai Xiong, Qionghai Dai

Photonic neural networks perform brain-inspired computations using photons instead of electrons that can achieve substantially improved computing performance.

Graph Representation Learning

A Dual Sensor Computational Camera for High Quality Dark Videography

no code implementations11 Apr 2022 Yuxiao Cheng, Runzhao Yang, Zhihong Zhang, Jinli Suo, Qionghai Dai

In this paper, we propose to build a dual-sensor camera to additionally collect the photons in NIR wavelength, and make use of the correlation between RGB and near-infrared (NIR) spectrum to perform high-quality reconstruction from noisy dark video pairs.

Vocal Bursts Intensity Prediction

Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Vision

no code implementations18 Sep 2021 Jinli Suo, Weihang Zhang, Jin Gong, Xin Yuan, David J. Brady, Qionghai Dai

Signal capture stands in the forefront to perceive and understand the environment and thus imaging plays the pivotal role in mobile vision.

Decision Making Edge-computing

10-mega pixel snapshot compressive imaging with a hybrid coded aperture

1 code implementation30 Jun 2021 Zhihong Zhang, Chao Deng, Yang Liu, Xin Yuan, Jinli Suo, Qionghai Dai

Towards this end, snapshot compressive imaging (SCI) was proposed as a promising solution to improve the throughput of imaging systems by compressive sampling and computational reconstruction.

Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

1 code implementation ICCV 2021 Xiu Li, Jinli Suo, Weihang Zhang, Xin Yuan, Qionghai Dai

High quality imaging usually requires bulky and expensive lenses to compensate geometric and chromatic aberrations.

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

1 code implementation24 Mar 2021 Gaochang Wu, Yebin Liu, Lu Fang, Qionghai Dai, Tianyou Chai

The main problem in direct reconstruction on the EPI involves an information asymmetry between the spatial and angular dimensions, where the detailed portion in the angular dimensions is damaged by undersampling.

Plug-and-Play Algorithms for Video Snapshot Compressive Imaging

1 code implementation13 Jan 2021 Xin Yuan, Yang Liu, Jinli Suo, Frédo Durand, Qionghai Dai

On the other hand, applying SCI to large-scale problems (HD or UHD videos) in our daily life is still challenging and one of the bottlenecks lies in the reconstruction algorithm.

Demosaicking Denoising

PoNA: Pose-guided Non-local Attention for Human Pose Transfer

1 code implementation13 Dec 2020 Kun Li, Jinsong Zhang, Yebin Liu, Yu-Kun Lai, Qionghai Dai

In each block, we propose a pose-guided non-local attention (PoNA) mechanism with a long-range dependency scheme to select more important regions of image features to transfer.

Generative Adversarial Network Person Re-Identification +1

Deep Implicit Templates for 3D Shape Representation

1 code implementation CVPR 2021 Zerong Zheng, Tao Yu, Qionghai Dai, Yebin Liu

Deep implicit functions (DIFs), as a kind of 3D shape representation, are becoming more and more popular in the 3D vision community due to their compactness and strong representation power.

3D Shape Representation

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

no code implementations26 Aug 2020 Tiankuang Zhou, Xing Lin, Jiamin Wu, Yitong Chen, Hao Xie, Yipeng Li, Jintao Fan, Huaqiang Wu, Lu Fang, Qionghai Dai

Here, we propose an optoelectronic reconfigurable computing paradigm by constructing a diffractive processing unit (DPU) that can efficiently support different neural networks and achieve a high model complexity with millions of neurons.

PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstruction

1 code implementation8 Jul 2020 Zerong Zheng, Tao Yu, Yebin Liu, Qionghai Dai

To overcome the limitations of regular 3D representations, we propose Parametric Model-Conditioned Implicit Representation (PaMIR), which combines the parametric body model with the free-form deep implicit function.

3D Human Reconstruction Camera Calibration

SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsis

1 code implementation26 May 2020 Mengqi Ji, Jinzhi Zhang, Qionghai Dai, Lu Fang

Furthermore, the latter problem is handled via a multi-scale strategy that consequently refines the recovered geometry around the region with the repeating pattern.


Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging

3 code implementations CVPR 2020 Xin Yuan, Yang Liu, Jinli Suo, Qionghai Dai

Snapshot compressive imaging (SCI) aims to capture the high-dimensional (usually 3D) images using a 2D sensor (detector) in a single snapshot.


PANDA: A Gigapixel-level Human-centric Video Dataset

no code implementations CVPR 2020 Xueyang Wang, Xiya Zhang, Yinheng Zhu, Yuchen Guo, Xiaoyun Yuan, Liuyu Xiang, Zerun Wang, Guiguang Ding, David J. Brady, Qionghai Dai, Lu Fang

We believe PANDA will contribute to the community of artificial intelligence and praxeology by understanding human behaviors and interactions in large-scale real-world scenes.

Attribute Human Detection

Semi-Supervised Self-Growing Generative Adversarial Networks for Image Recognition

no code implementations11 Aug 2019 Haoqian Wang, Zhiwei Xu, Jun Xu, Wangpeng An, Lei Zhang, Qionghai Dai

There are two main problems in label inference: how to measure the confidence of the unlabeled data and how to generalize the classifier.

Attribute Generative Adversarial Network

SimulCap : Single-View Human Performance Capture with Cloth Simulation

no code implementations CVPR 2019 Tao Yu, Zerong Zheng, Yuan Zhong, Jianhui Zhao, Qionghai Dai, Gerard Pons-Moll, Yebin Liu

This paper proposes a new method for live free-viewpoint human performance capture with dynamic details (e. g., cloth wrinkles) using a single RGBD camera.

DeepHuman: 3D Human Reconstruction from a Single Image

1 code implementation ICCV 2019 Zerong Zheng, Tao Yu, Yixuan Wei, Qionghai Dai, Yebin Liu

We propose DeepHuman, an image-guided volume-to-volume translation CNN for 3D human reconstruction from a single RGB image.

3D Human Reconstruction Pose Estimation +1

Capture Dense: Markerless Motion Capture Meets Dense Pose Estimation

no code implementations5 Dec 2018 Xiu Li, Yebin Liu, Hanbyul Joo, Qionghai Dai, Yaser Sheikh

Specifically, we first introduce a novel markerless motion capture method that can take advantage of dense parsing capability provided by the dense pose detector.

Human Parsing Markerless Motion Capture +1

HybridFusion: Real-Time Performance Capture Using a Single Depth Sensor and Sparse IMUs

no code implementations ECCV 2018 Zerong Zheng, Tao Yu, Hao Li, Kaiwen Guo, Qionghai Dai, Lu Fang, Yebin Liu

We propose a light-weight and highly robust real-time human performance capture method based on a single depth camera and sparse inertial measurement units (IMUs).

Surface Reconstruction

Rank Minimization for Snapshot Compressive Imaging

3 code implementations20 Jul 2018 Yang Liu, Xin Yuan, Jinli Suo, David J. Brady, Qionghai Dai

We further investigate the special structure of the sampling process in SCI to tackle the computational workload and memory issues in SCI reconstruction.

A PID Controller Approach for Stochastic Optimization of Deep Networks

3 code implementations CVPR 2018 Wangpeng An, Haoqian Wang, Qingyun Sun, Jun Xu, Qionghai Dai, Lei Zhang

We first reveal the intrinsic connections between SGD-Momentum and PID based controller, then present the optimization algorithm which exploits the past, current, and change of gradients to update the network parameters.

Stochastic Optimization

Structured Illumination in Spatial-Orientational Hyperspace

1 code implementation14 Dec 2017 Karl Zhanghao, Xingye Chen, Wenhui Liu, Meiqi Li, Chunyan Shan, Xiao Wang, Kun Zhao, Amit Lai, Hao Xie, Qionghai Dai, Peng Xi

The dipole nature of chromophore is important for both super-resolution microscopy and imaging molecular structure, which is nevertheless neglected in most microscopies, even including structured illumination microscopy (SIM) with polarized excitations.


BodyFusion: Real-Time Capture of Human Motion and Surface Geometry Using a Single Depth Camera

no code implementations ICCV 2017 Tao Yu, Kaiwen Guo, Feng Xu, Yuan Dong, Zhaoqi Su, Jianhui Zhao, Jianguo Li, Qionghai Dai, Yebin Liu

To reduce the ambiguities of the non-rigid deformation parameterization on the surface graph nodes, we take advantage of the internal articulated motion prior for human performance and contribute a skeleton-embedded surface fusion (SSF) method.

Surface Reconstruction

Experimental comparison of single-pixel imaging algorithms

no code implementations11 Jul 2017 Liheng Bian, Jinli Suo, Qionghai Dai, Feng Chen

Various algorithms have been proposed for SPI reconstruction, including the linear correlation methods, the alternating projection method (AP), and the compressive sensing based methods.

Compressive Sensing

Light Field Reconstruction Using Deep Convolutional Network on EPI

no code implementations CVPR 2017 Gaochang Wu, Mandan Zhao, Liangyong Wang, Qionghai Dai, Tianyou Chai, Yebin Liu

In this paper, we take advantage of the clear texture structure of the epipolar plane image (EPI) in the light field data and model the problem of light field reconstruction from a sparse set of views as a CNN-based angular detail restoration on EPI.

FlyCap: Markerless Motion Capture Using Multiple Autonomous Flying Cameras

no code implementations29 Oct 2016 Lan Xu, Lu Fang, Wei Cheng, Kaiwen Guo, Guyue Zhou, Qionghai Dai, Yebin Liu

We propose a novel non-rigid surface registration method to track and fuse the depth of the three flying cameras for surface motion tracking of the moving target, and simultaneously calculate the pose of each flying camera.

Markerless Motion Capture Visual Odometry

Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient

no code implementations1 Mar 2016 Liheng Bian, Jinli Suo, Jaebum Chung, Xiaoze Ou, Changhuei Yang, Feng Chen, Qionghai Dai

Fourier ptychographic microscopy (FPM) is a novel computational coherent imaging technique for high space-bandwidth product imaging.


Fast and High Quality Highlight Removal from A Single Image

no code implementations1 Dec 2015 Dongsheng An, Jinli Suo, Xiangyang Ji, Haoqian Wang, Qionghai Dai

Specifically, this paper derives a normalized dichromatic model for the pixels with identical diffuse color: a unit circle equation of projection coefficients in two subspaces that are orthogonal to and parallel with the illumination, respectively.

Clustering highlight removal +1

Robust Non-Rigid Motion Tracking and Surface Reconstruction Using L0 Regularization

no code implementations ICCV 2015 Kaiwen Guo, Feng Xu, Yangang Wang, Yebin Liu, Qionghai Dai

We present a new motion tracking method to robustly reconstruct non-rigid geometries and motions from single view depth inputs captured by a consumer depth sensor.

Surface Reconstruction

Sampling-based Causal Inference in Cue Combination and its Neural Implementation

no code implementations3 Sep 2015 Zhaofei Yu, Feng Chen, Jianwu Dong, Qionghai Dai

Although the Bayesian causal inference model explains the problem of causal inference in cue combination successfully, how causal inference in cue combination could be implemented by neural circuits, is unclear.

Causal Inference

Scene-adaptive Coded Apertures Imaging

no code implementations19 Jun 2015 Xuehui Wang, Jinli Suo, Jingyi Yu, Yongdong Zhang, Qionghai Dai

Firstly, we capture the scene with a pinhole and analyze the scene content to determine primary edge orientations.

Light Field From Micro-Baseline Image Pair

no code implementations CVPR 2015 Zhoutong Zhang, Yebin Liu, Qionghai Dai

We first introduce a disparity assisted phase based synthesis (DAPS) strategy that can integrate disparity infor- mation into the phase term of a reference image to warp it to its close neighbor views.

Blind Optical Aberration Correction by Exploring Geometric and Visual Priors

no code implementations CVPR 2015 Tao Yue, Jinli Suo, Jue Wang, Xun Cao, Qionghai Dai

Furthermore, by investigating the visual artifacts of aberration degenerated images captured by consumer-level cameras, the non-uniform distribution of sharpness across color channels and the image lattice is exploited as visual priors, resulting in a novel strategy to utilize the guidance from the sharpest channel and local image regions to improve the overall performance and robustness.

Fourier Analysis on Transient Imaging with a Multifrequency Time-of-Flight Camera

no code implementations CVPR 2014 Jingyu Lin, Yebin Liu, Matthias B. Hullin, Qionghai Dai

A transient image is the optical impulse response of a scene which visualizes light propagation during an ultra-short time interval.

Multi-frame denoising of high speed optical coherence tomography data using inter-frame and intra-frame priors

no code implementations6 Dec 2013 Liheng Bian, Jinli Suo, Feng Chen, Qionghai Dai

Optical coherence tomography (OCT) is an important interferometric diagnostic technique which provides cross-sectional views of the subsurface microstructure of biological tissues.


Cannot find the paper you are looking for? You can Submit a new open access paper.