Search Results for author: Chunyu Lin

Found 40 papers, 22 papers with code

SGFormer: Spherical Geometry Transformer for 360 Depth Estimation

no code implementations23 Apr 2024 Junsong Zhang, Zisong Chen, Chunyu Lin, Lang Nie, Zhijie Shen, Junda Huang, Yao Zhao

Panoramic distortion poses a significant challenge in 360 depth estimation, particularly pronounced at the north and south poles.

Depth Estimation Position

Digging into contrastive learning for robust depth estimation with diffusion models

no code implementations15 Apr 2024 Jiyuan Wang, Chunyu Lin, Lang Nie, Kang Liao, Shuwei Shao, Yao Zhao

In this paper, we propose a novel robust depth estimation method called D4RD, featuring a custom contrastive learning mode tailored for diffusion models to mitigate performance degradation in complex environments.

Contrastive Learning Denoising +2

Eliminating Warping Shakes for Unsupervised Online Video Stitching

1 code implementation11 Mar 2024 Lang Nie, Chunyu Lin, Kang Liao, Yun Zhang, Shuaicheng Liu, Yao Zhao

In this paper, we retarget video stitching to an emerging issue, named warping shake, when extending image stitching to video stitching.

Image Stitching Video Stabilization

Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond

1 code implementation24 Jan 2024 Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao

To break this bottleneck, we propose the coupled thin-plate spline model (CoupledTPS), which iteratively couples multiple TPS with limited control points into a more flexible and powerful transformation.

360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception

no code implementations26 Dec 2023 Zhijie Shen, Chunyu Lin, Junsong Zhang, Lang Nie, Kang Liao, Yao Zhao

Existing panoramic layout estimation solutions tend to recover room boundaries from a vertically compressed sequence, yielding imprecise results as the compression process often muddles the semantics between various planes.

Disentanglement

WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditions

1 code implementation9 Oct 2023 Jiyuan Wang, Chunyu Lin, Lang Nie, Shujun Huang, Yao Zhao, Xing Pan, Rui Ai

In this paper, we propose WeatherDepth, a self-supervised robust depth estimation model with curriculum contrastive learning, to tackle performance degradation in complex weather conditions.

Contrastive Learning Depth Estimation +2

GAFlow: Incorporating Gaussian Attention into Optical Flow

1 code implementation ICCV 2023 Ao Luo, Fan Yang, Xin Li, Lang Nie, Chunyu Lin, Haoqiang Fan, Shuaicheng Liu

Moreover, for reliable motion analysis, we provide a new Gaussian-Guided Attention Module (GGAM) which not only inherits properties from Gaussian distribution to instinctively revolve around the neighbor fields of each point but also is empowered to put the emphasis on contextually related regions during matching.

Optical Flow Estimation Representation Learning

Deep Learning for Camera Calibration and Beyond: A Survey

1 code implementation19 Mar 2023 Kang Liao, Lang Nie, Shujuan Huang, Chunyu Lin, Jing Zhang, Yao Zhao, Moncef Gabbouj, DaCheng Tao

In this paper, we provide a comprehensive survey of learning-based camera calibration techniques, by analyzing their strengths and limitations.

Camera Calibration

SigVIC: Spatial Importance Guided Variable-Rate Image Compression

no code implementations16 Mar 2023 Jiaming Liang, Meiqin Liu, Chao Yao, Chunyu Lin, Yao Zhao

Variable-rate mechanism has improved the flexibility and efficiency of learning-based image compression that trains multiple models for different rate-distortion tradeoffs.

Image Compression

Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awareness

1 code implementation CVPR 2023 Zhijie Shen, Zishuo Zheng, Chunyu Lin, Lang Nie, Kang Liao, Shuai Zheng, Yao Zhao

Based on the Manhattan World assumption, most existing indoor layout estimation schemes focus on recovering layouts from vertically compressed 1D sequences.

Room Layout Estimation Segmentation

Unsupervised OmniMVS: Efficient Omnidirectional Depth Inference via Establishing Pseudo-Stereo Supervision

no code implementations20 Feb 2023 Zisong Chen, Chunyu Lin, Lang Nie, Kang Liao, Yao Zhao

In this paper, we propose the first unsupervised omnidirectional MVS framework based on multiple fisheye images.

Parallax-Tolerant Unsupervised Deep Image Stitching

1 code implementation ICCV 2023 Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao

First, we propose a robust and flexible warp to model the image registration from global homography to local thin-plate spline motion.

Image Registration Image Stitching

Spatiotemporal Deformation Perception for Fisheye Video Rectification

1 code implementation8 Feb 2023 Shangrong Yang, Chunyu Lin, Kang Liao, Yao Zhao

Subsequently, we observe that the inter-frame optical flow of the video is facilitated to perceive the local spatial deformation of the fisheye video.

Optical Flow Estimation

Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalization

no code implementations26 Jan 2023 Shangrong Yang, Chunyu Lin, Kang Liao, Yao Zhao

To this end, we propose a Dual Diffusion Architecture (DDA) for the fisheye rectification with a better generalization ability.

Denoising

RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning

1 code implementation ICCV 2023 Kang Liao, Lang Nie, Chunyu Lin, Zishuo Zheng, Yao Zhao

In this work, we explore constructing a win-win representation on both content and boundary by contributing a new learning model, i. e., Rectangling Rectification Network (RecRecNet).

Innovating Real Fisheye Image Correction with Dual Diffusion Architecture

no code implementations ICCV 2023 Shangrong Yang, Chunyu Lin, Kang Liao, Yao Zhao

Fisheye image rectification is hindered by synthetic models producing poor results for real-world correction.

Denoising

Temporal Consistency Learning of inter-frames for Video Super-Resolution

1 code implementation3 Nov 2022 Meiqin Liu, Shuo Jin, Chao Yao, Chunyu Lin, Yao Zhao

A spatio-temporal stability module is designed to learn the self-alignment from inter-frames.

Video Super-Resolution

Neural Contourlet Network for Monocular 360 Depth Estimation

1 code implementation3 Aug 2022 Zhijie Shen, Chunyu Lin, Lang Nie, Kang Liao, Yao Zhao

For a monocular 360 image, depth estimation is a challenging because the distortion increases along the latitude.

Depth Estimation

Deep Rotation Correction without Angle Prior

1 code implementation7 Jul 2022 Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao

To this end, we leverage a neural network to predict the optical flows that can warp the tilted images to be perceptually horizontal.

Optical Flow Estimation

FishFormer: Annulus Slicing-based Transformer for Fisheye Rectification with Efficacy Domain Exploration

no code implementations5 Jul 2022 Shangrong Yang, Chunyu Lin, Kang Liao, Yao Zhao

To leverage these two characteristics, we introduced Fishformer that processes the fisheye image as a sequence to enhance global and local perception.

FisheyeEX: Polar Outpainting for Extending the FoV of Fisheye Lens

1 code implementation12 Jun 2022 Kang Liao, Chunyu Lin, Yunchao Wei, Yao Zhao

For the distortion synthesis, we propose a spiral distortion-aware perception module, in which the learning path keeps consistent with the distortion prior of the fisheye image.

Image Outpainting

JNMR: Joint Non-linear Motion Regression for Video Frame Interpolation

1 code implementation9 Jun 2022 Meiqin Liu, Chenming Xu, Chao Yao, Chunyu Lin, Yao Zhao

Video frame interpolation (VFI) aims to generate predictive frames by warping learnable motions from the bidirectional historical references.

Motion Estimation regression +1

Cylin-Painting: Seamless {360\textdegree} Panoramic Image Outpainting and Beyond

1 code implementation18 Apr 2022 Kang Liao, Xiangyu Xu, Chunyu Lin, Wenqi Ren, Yunchao Wei, Yao Zhao

Motivated by this analysis, we present a Cylin-Painting framework that involves meaningful collaborations between inpainting and outpainting and efficiently fuses the different arrangements, with a view to leveraging their complementary benefits on a seamless cylinder.

Depth Estimation Image Outpainting +3

Towards Reliable Image Outpainting: Learning Structure-Aware Multimodal Fusion with Depth Guidance

no code implementations12 Apr 2022 Lei Zhang, Kang Liao, Chunyu Lin, Yao Zhao

Concretely, we propose a Depth-Guided Outpainting Network to model different feature representations of two modalities and learn the structure-aware cross-modal fusion.

Image Outpainting

PanoFormer: Panorama Transformer for Indoor 360 Depth Estimation

1 code implementation17 Mar 2022 Zhijie Shen, Chunyu Lin, Kang Liao, Lang Nie, Zishuo Zheng, Yao Zhao

In particular, we divide patches on the spherical tangent domain into tokens to reduce the negative effect of panoramic distortions.

Depth Estimation Semantic Segmentation

Deep Rectangling for Image Stitching: A Learning Baseline

1 code implementation CVPR 2022 Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao

In this paper, we address these issues by proposing the first deep learning solution to image rectangling.

Image Stitching

Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlation

1 code implementation6 Jul 2021 Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao

Homography estimation is an important task in computer vision applications, such as image stitching, video stabilization, and camera calibration.

Camera Calibration Homography Estimation +2

Progressively Complementary Network for Fisheye Image Rectification Using Appearance Flow

1 code implementation CVPR 2021 Shangrong Yang, Chunyu Lin, Kang Liao, Chunjie Zhang, Yao Zhao

We embed a correction layer in skip-connection and leverage the appearance flows in different layers to pre-correct the image features.

Multi-Level Curriculum for Training a Distortion-Aware Barrel Distortion Rectification Model

no code implementations ICCV 2021 Kang Liao, Chunyu Lin, Lixin Liao, Yao Zhao, Weiyao Lin

In this paper, inspired by the curriculum learning, we analyze the barrel distortion rectification task in a progressive and meaningful manner.

Towards Complete Scene and Regular Shape for Distortion Rectification by Curve-Aware Extrapolation

no code implementations ICCV 2021 Kang Liao, Chunyu Lin, Yunchao Wei, Feng Li, Shangrong Yang, Yao Zhao

To our knowledge, we are the first to tackle the challenging rectification via outpainting, and our curve-aware strategy can reach a rectification construction with complete content and regular shape.

Learning Edge-Preserved Image Stitching from Large-Baseline Deep Homography

no code implementations11 Dec 2020 Lang Nie, Chunyu Lin, Kang Liao, Yao Zhao

In this paper, we propose an image stitching learning framework, which consists of a large-baseline deep homography module and an edge-preserved deformation module.

Image Stitching

A Deep Ordinal Distortion Estimation Approach for Distortion Rectification

no code implementations21 Jul 2020 Kang Liao, Chunyu Lin, Yao Zhao

Distortion is widely existed in the images captured by popular wide-angle cameras and fisheye cameras.

Pseudo-LiDAR Point Cloud Interpolation Based on 3D Motion Representation and Spatial Supervision

no code implementations20 Jun 2020 Haojie Liu, Kang Liao, Chunyu Lin, Yao Zhao, Yulan Guo

Pseudo-LiDAR point cloud interpolation is a novel and challenging task in the field of autonomous driving, which aims to address the frequency mismatching problem between camera and LiDAR.

Autonomous Driving Optical Flow Estimation

PLIN: A Network for Pseudo-LiDAR Point Cloud Interpolation

no code implementations16 Sep 2019 Haojie Liu, Kang Liao, Chunyu Lin, Yao Zhao, Yulan Guo

In this paper, we propose a novel Pseudo-LiDAR interpolation network (PLIN) to increase the frequency of LiDAR sensors.

Autonomous Driving

Cannot find the paper you are looking for? You can Submit a new open access paper.