Search Results for author: Liangjun Zhang

Found 35 papers, 14 papers with code

HO-Gaussian: Hybrid Optimization of 3D Gaussian Splatting for Urban Scenes

no code implementations29 Mar 2024 Zhuopeng Li, Yilin Zhang, Chenming Wu, Jianke Zhu, Liangjun Zhang

The rapid growth of 3D Gaussian Splatting (3DGS) has revolutionized neural rendering, enabling real-time production of high-quality renderings.

Autonomous Driving Neural Rendering

RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models

no code implementations11 Mar 2024 Liangliang Chen, Yutian Lei, Shiyu Jin, Ying Zhang, Liangjun Zhang

In this paper, we propose RLingua, a framework that can leverage the internal knowledge of large language models (LLMs) to reduce the sample complexity of RL in robotic manipulations.

Prompt Engineering Reinforcement Learning (RL)

DGNR: Density-Guided Neural Point Rendering of Large Driving Scenes

no code implementations28 Nov 2023 Zhuopeng Li, Chenming Wu, Liangjun Zhang, Jianke Zhu

Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand.

Autonomous Driving Depth Estimation +1

Interpretable and Flexible Target-Conditioned Neural Planners For Autonomous Vehicles

no code implementations23 Sep 2023 Haolan Liu, Jishen Zhao, Liangjun Zhang

Learning-based approaches to autonomous vehicle planners have the potential to scale to many complicated real-world driving scenarios by leveraging huge amounts of driver demonstrations.

Autonomous Vehicles Collision Avoidance

Digging into Depth Priors for Outdoor Neural Radiance Fields

no code implementations8 Aug 2023 Chen Wang, Jiadai Sun, Lina Liu, Chenming Wu, Zhelun Shen, Dayan Wu, Yuchao Dai, Liangjun Zhang

However, the shape-radiance ambiguity of radiance fields remains a challenge, especially in the sparse viewpoints setting.

Novel View Synthesis

Digging Into Uncertainty-based Pseudo-label for Robust Stereo Matching

1 code implementation31 Jul 2023 Zhelun Shen, Xibin Song, Yuchao Dai, Dingfu Zhou, Zhibo Rao, Liangjun Zhang

Due to the domain differences and unbalanced disparity distribution across multiple datasets, current stereo matching approaches are commonly limited to a specific dataset and generalize poorly to others.

Monocular Depth Estimation Pseudo Label +1

MapNeRF: Incorporating Map Priors into Neural Radiance Fields for Driving View Simulation

no code implementations27 Jul 2023 Chenming Wu, Jiadai Sun, Zhelun Shen, Liangjun Zhang

The key insight is that map information can be utilized as a prior to guiding the training of the radiance fields with uncertainty.

Autonomous Driving

Boosting Feedback Efficiency of Interactive Reinforcement Learning by Adaptive Learning from Scores

1 code implementation11 Jul 2023 Shukai Liu, Chenming Wu, Ying Li, Liangjun Zhang

This paper presents a new method that uses scores provided by humans instead of pairwise preferences to improve the feedback efficiency of interactive reinforcement learning.

reinforcement-learning

NeuS-PIR: Learning Relightable Neural Surface using Pre-Integrated Rendering

1 code implementation13 Jun 2023 Shi Mao, Chenming Wu, Zhelun Shen, Yifan Wang, Dayan Wu, Liangjun Zhang

This paper presents a method, namely NeuS-PIR, for recovering relightable neural surfaces using pre-integrated rendering from multi-view images or video.

Disentanglement

LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detection

1 code implementation29 Jan 2023 Jin Fang, Dingfu Zhou, Jingjing Zhao, Chenming Wu, Chulin Tang, Cheng-Zhong Xu, Liangjun Zhang

This setting results in two distinct domain gaps: scenarios and sensors, making it difficult to analyze and evaluate the method accurately.

3D Object Detection Autonomous Driving +2

NeRF-Loc: Transformer-Based Object Localization Within Neural Radiance Fields

no code implementations24 Sep 2022 Jiankai Sun, Yan Xu, Mingyu Ding, Hongwei Yi, Chen Wang, Jingdong Wang, Liangjun Zhang, Mac Schwager

Using current NeRF training tools, a robot can train a NeRF environment model in real-time and, using our algorithm, identify 3D bounding boxes of objects of interest within the NeRF for downstream navigation or manipulation tasks.

Object Localization Robot Navigation

VINet: Visual and Inertial-based Terrain Classification and Adaptive Navigation over Unknown Terrain

no code implementations16 Sep 2022 Tianrui Guan, Ruitao Song, Zhixian Ye, Liangjun Zhang

We present a visual and inertial-based terrain classification network (VINet) for robotic navigation over different traversable surfaces.

Classification Scheduling

ProposalContrast: Unsupervised Pre-training for LiDAR-based 3D Object Detection

1 code implementation26 Jul 2022 Junbo Yin, Dingfu Zhou, Liangjun Zhang, Jin Fang, Cheng-Zhong Xu, Jianbing Shen, Wenguan Wang

Existing approaches for unsupervised point cloud pre-training are constrained to either scene-level or point/voxel-level instance discrimination.

3D Object Detection object-detection +2

Semi-supervised 3D Object Detection with Proficient Teachers

1 code implementation26 Jul 2022 Junbo Yin, Jin Fang, Dingfu Zhou, Liangjun Zhang, Cheng-Zhong Xu, Jianbing Shen, Wenguan Wang

To reduce the dependence on large supervision, semi-supervised learning (SSL) based approaches have been proposed.

3D Object Detection Autonomous Driving +3

Autonomous Wheel Loader Trajectory Tracking Control Using LPV-MPC

no code implementations16 Mar 2022 Ruitao Song, Zhixian Ye, Liyang Wang, Tianyi He, Liangjun Zhang

With the nonlinear dynamic model of a wheel loader, nonlinear model predictive control (MPC) is used in offline trajectory planning to obtain a high-performance state-control trajectory while satisfying the state and control constraints.

Computational Efficiency Model Predictive Control +1

Construction Site Safety Monitoring and Excavator Activity Analysis System

no code implementations6 Oct 2021 Sibo Zhang, Liangjun Zhang

Our perception system could detect multi-class construction machines and humans in real-time while estimating the poses and actions of the excavator.

Action Recognition Object Detection +1

AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

1 code implementation ICCV 2021 Zongdai Liu, Dingfu Zhou, Feixiang Lu, Jin Fang, Liangjun Zhang

For generating the ground truth of 2D/3D keypoints, an automatic model-fitting approach has been proposed by fitting the deformed 3D object model and the object mask in the 2D image.

Autonomous Driving Monocular 3D Object Detection +2

Self-supervised Monocular Depth Estimation for All Day Images using Domain Separation

2 code implementations ICCV 2021 Lina Liu, Xibin Song, Mengmeng Wang, Yong liu, Liangjun Zhang

Meanwhile, to guarantee that the day and night images contain the same information, the domain-separated network takes the day-time images and corresponding night-time images (generated by GAN) as input, and the private and invariant feature extractors are learned by orthogonality and similarity loss, where the domain gap can be alleviated, thus better depth maps can be expected.

Monocular Depth Estimation

FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection

1 code implementation23 Jun 2021 Shaoqing Xu, Dingfu Zhou, Jin Fang, Junbo Yin, Zhou Bin, Liangjun Zhang

Then the segmentation results from different sensors are adaptively fused based on the proposed attention-based semantic fusion module.

3D Object Detection Autonomous Driving +3

Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose Dictionary

1 code implementation29 Apr 2021 Sibo Zhang, Jiahong Yuan, Miao Liao, Liangjun Zhang

With the advance of deep learning technology, automatic video generation from audio or text has become an emerging and promising research topic.

Generative Adversarial Network Talking Face Generation +1

Large Scale Autonomous Driving Scenarios Clustering with Self-supervised Feature Extraction

no code implementations30 Mar 2021 Jinxin Zhao, Jin Fang, Zhixian Ye, Liangjun Zhang

The clustering of autonomous driving scenario data can substantially benefit the autonomous driving validation and simulation systems by improving the simulation tests' completeness and fidelity.

Autonomous Driving Clustering +2

Robust 2D/3D Vehicle Parsing in CVIS

no code implementations11 Mar 2021 Hui Miao, Feixiang Lu, Zongdai Liu, Liangjun Zhang, Dinesh Manocha, Bin Zhou

We combine these novel algorithms and datasets to develop a robust approach for 2D/3D vehicle parsing for CVIS.

Benchmarking Data Augmentation +4

MapFusion: A General Framework for 3D Object Detection with HDMaps

no code implementations10 Mar 2021 Jin Fang, Dingfu Zhou, Xibin Song, Liangjun Zhang

In this paper, we propose a simple but effective framework - MapFusion to integrate the map information into modern 3D object detector pipelines.

3D Object Detection Autonomous Driving +2

FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth Completion

no code implementations15 Dec 2020 Lina Liu, Xibin Song, Xiaoyang Lyu, Junwei Diao, Mengmeng Wang, Yong liu, Liangjun Zhang

Then, a refined depth map is further obtained using a residual learning strategy in the coarse-to-fine stage with a coarse depth map and color image as input.

Depth Completion

Fine-Grained Vehicle Perception via 3D Part-Guided Visual Data Augmentation

1 code implementation15 Dec 2020 Feixiang Lu, Zongdai Liu, Hui Miao, Peng Wang, Liangjun Zhang, Ruigang Yang, Dinesh Manocha, Bin Zhou

For autonomous driving, the dynamics and states of vehicle parts such as doors, the trunk, and the bonnet can provide meaningful semantic information and interaction states, which are essential to ensuring the safety of the self-driving vehicle.

Autonomous Driving Data Augmentation +3

Object-aware Feature Aggregation for Video Object Detection

no code implementations23 Oct 2020 Qichuan Geng, Hong Zhang, Na Jiang, Xiaojuan Qi, Liangjun Zhang, Zhong Zhou

As a consequence, augmenting features with such prior knowledge can effectively improve the classification and localization performance.

Object object-detection +2

PerMO: Perceiving More at Once from a Single Image for Autonomous Driving

no code implementations16 Jul 2020 Feixiang Lu, Zongdai Liu, Xibin Song, Dingfu Zhou, Wei Li, Hui Miao, Miao Liao, Liangjun Zhang, Bin Zhou, Ruigang Yang, Dinesh Manocha

We present a novel approach to detect, segment, and reconstruct complete textured 3D models of vehicles from a single image for autonomous driving.

3D Reconstruction Autonomous Driving +3

PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matching

2 code implementations23 Jun 2020 Zhelun Shen, Yuchao Dai, Xibin Song, Zhibo Rao, Dingfu Zhou, Liangjun Zhang

First, we construct combination volumes on the upper levels of the pyramid and develop a cost volume fusion module to integrate them for initial disparity estimation.

Disparity Estimation Domain Generalization +1

Cannot find the paper you are looking for? You can Submit a new open access paper.