no code implementations • 3 Dec 2024 • Zeqing Zhang, Guangze Zheng, Xuebo Ji, Guanqi Chen, Ruixing Jia, Wentao Chen, Guanhua Chen, Liangjun Zhang, Jia Pan
The generalization capability has also been evaluated and a real-world application on the beach is also demonstrated.
no code implementations • 9 May 2024 • Liangliang Chen, Shiyu Jin, Haoyu Wang, Liangjun Zhang
Excavators are crucial for diverse tasks such as construction and mining, while autonomous excavator systems enhance safety and efficiency, address labor shortages, and improve human working conditions.
no code implementations • 29 Mar 2024 • Zhuopeng Li, Yilin Zhang, Chenming Wu, Jianke Zhu, Liangjun Zhang
The rapid growth of 3D Gaussian Splatting (3DGS) has revolutionized neural rendering, enabling real-time production of high-quality renderings.
no code implementations • 11 Mar 2024 • Liangliang Chen, Yutian Lei, Shiyu Jin, Ying Zhang, Liangjun Zhang
In this paper, we propose RLingua, a framework that can leverage the internal knowledge of large language models (LLMs) to reduce the sample complexity of RL in robotic manipulations.
no code implementations • 28 Nov 2023 • Zhuopeng Li, Chenming Wu, Liangjun Zhang, Jianke Zhu
Despite the recent success of Neural Radiance Field (NeRF), it is still challenging to render large-scale driving scenes with long trajectories, particularly when the rendering quality and efficiency are in high demand.
no code implementations • 23 Sep 2023 • Haolan Liu, Jishen Zhao, Liangjun Zhang
Learning-based approaches to autonomous vehicle planners have the potential to scale to many complicated real-world driving scenarios by leveraging huge amounts of driver demonstrations.
no code implementations • 8 Aug 2023 • Chen Wang, Jiadai Sun, Lina Liu, Chenming Wu, Zhelun Shen, Dayan Wu, Yuchao Dai, Liangjun Zhang
However, the shape-radiance ambiguity of radiance fields remains a challenge, especially in the sparse viewpoints setting.
1 code implementation • 31 Jul 2023 • Zhelun Shen, Xibin Song, Yuchao Dai, Dingfu Zhou, Zhibo Rao, Liangjun Zhang
Due to the domain differences and unbalanced disparity distribution across multiple datasets, current stereo matching approaches are commonly limited to a specific dataset and generalize poorly to others.
no code implementations • 27 Jul 2023 • Chenming Wu, Jiadai Sun, Zhelun Shen, Liangjun Zhang
The key insight is that map information can be utilized as a prior to guiding the training of the radiance fields with uncertainty.
1 code implementation • 27 Jul 2023 • Lingdong Kong, Yaru Niu, Shaoyuan Xie, Hanjiang Hu, Lai Xing Ng, Benoit R. Cottereau, Liangjun Zhang, Hesheng Wang, Wei Tsang Ooi, Ruijie Zhu, Ziyang Song, Li Liu, Tianzhu Zhang, Jun Yu, Mohan Jing, Pengwei Li, Xiaohua Qi, Cheng Jin, Yingfeng Chen, Jie Hou, Jie Zhang, Zhen Kan, Qiang Ling, Liang Peng, Minglei Li, Di Xu, Changpeng Yang, Yuanqi Yao, Gang Wu, Jian Kuai, Xianming Liu, Junjun Jiang, Jiamian Huang, Baojun Li, Jiale Chen, Shuang Zhang, Sun Ao, Zhenyu Li, Runze Chen, Haiyong Luo, Fang Zhao, Jingze Yu
In this paper, we summarize the winning solutions from the RoboDepth Challenge -- an academic competition designed to facilitate and advance robust OoD depth estimation.
1 code implementation • 11 Jul 2023 • Shukai Liu, Chenming Wu, Ying Li, Liangjun Zhang
This paper presents a new method that uses scores provided by humans instead of pairwise preferences to improve the feedback efficiency of interactive reinforcement learning.
no code implementations • 25 Jun 2023 • Haolan Liu, Liangjun Zhang, Siva Kumar Sastry Hari, Jishen Zhao
Generating safety-critical scenarios is essential for testing and verifying the safety of autonomous vehicles.
1 code implementation • 13 Jun 2023 • Shi Mao, Chenming Wu, Zhelun Shen, Yifan Wang, Dayan Wu, Liangjun Zhang
This paper presents a method, namely NeuS-PIR, for recovering relightable neural surfaces using pre-integrated rendering from multi-view images or video.
no code implementations • 9 Mar 2023 • Yaru Niu, Shiyu Jin, Zeqing Zhang, Jiacheng Zhu, Ding Zhao, Liangjun Zhang
In this work, we first formulate the problem of robotic water scooping using goal-conditioned reinforcement learning.
1 code implementation • 29 Jan 2023 • Jin Fang, Dingfu Zhou, Jingjing Zhao, Chenming Wu, Chulin Tang, Cheng-Zhong Xu, Liangjun Zhang
This setting results in two distinct domain gaps: scenarios and sensors, making it difficult to analyze and evaluate the method accurately.
no code implementations • 24 Sep 2022 • Jiankai Sun, Yan Xu, Mingyu Ding, Hongwei Yi, Chen Wang, Jingdong Wang, Liangjun Zhang, Mac Schwager
Using current NeRF training tools, a robot can train a NeRF environment model in real-time and, using our algorithm, identify 3D bounding boxes of objects of interest within the NeRF for downstream navigation or manipulation tasks.
no code implementations • 16 Sep 2022 • Tianrui Guan, Ruitao Song, Zhixian Ye, Liangjun Zhang
We present a visual and inertial-based terrain classification network (VINet) for robotic navigation over different traversable surfaces.
1 code implementation • 26 Jul 2022 • Junbo Yin, Jin Fang, Dingfu Zhou, Liangjun Zhang, Cheng-Zhong Xu, Jianbing Shen, Wenguan Wang
To reduce the dependence on large supervision, semi-supervised learning (SSL) based approaches have been proposed.
1 code implementation • 26 Jul 2022 • Junbo Yin, Dingfu Zhou, Liangjun Zhang, Jin Fang, Cheng-Zhong Xu, Jianbing Shen, Wenguan Wang
Existing approaches for unsupervised point cloud pre-training are constrained to either scene-level or point/voxel-level instance discrimination.
no code implementations • 16 Mar 2022 • Ruitao Song, Zhixian Ye, Liyang Wang, Tianyi He, Liangjun Zhang
With the nonlinear dynamic model of a wheel loader, nonlinear model predictive control (MPC) is used in offline trajectory planning to obtain a high-performance state-control trajectory while satisfying the state and control constraints.
no code implementations • 6 Oct 2021 • Sibo Zhang, Liangjun Zhang
Our perception system could detect multi-class construction machines and humans in real-time while estimating the poses and actions of the excavator.
1 code implementation • ICCV 2021 • Zongdai Liu, Dingfu Zhou, Feixiang Lu, Jin Fang, Liangjun Zhang
For generating the ground truth of 2D/3D keypoints, an automatic model-fitting approach has been proposed by fitting the deformed 3D object model and the object mask in the 2D image.
2 code implementations • ICCV 2021 • Lina Liu, Xibin Song, Mengmeng Wang, Yong liu, Liangjun Zhang
Meanwhile, to guarantee that the day and night images contain the same information, the domain-separated network takes the day-time images and corresponding night-time images (generated by GAN) as input, and the private and invariant feature extractors are learned by orthogonality and similarity loss, where the domain gap can be alleviated, thus better depth maps can be expected.
1 code implementation • 23 Jun 2021 • Shaoqing Xu, Dingfu Zhou, Jin Fang, Junbo Yin, Zhou Bin, Liangjun Zhang
Then the segmentation results from different sensors are adaptively fused based on the proposed attention-based semantic fusion module.
no code implementations • CVPR 2021 • Jin Fang, Xinxin Zuo, Dingfu Zhou, Shengze Jin, Sen Wang, Liangjun Zhang
Finally, we verify the proposed framework on the public KITTI dataset with different 3D object detectors.
1 code implementation • 29 Apr 2021 • Sibo Zhang, Jiahong Yuan, Miao Liao, Liangjun Zhang
With the advance of deep learning technology, automatic video generation from audio or text has become an emerging and promising research topic.
no code implementations • 30 Mar 2021 • Jinxin Zhao, Jin Fang, Zhixian Ye, Liangjun Zhang
The clustering of autonomous driving scenario data can substantially benefit the autonomous driving validation and simulation systems by improving the simulation tests' completeness and fidelity.
no code implementations • 11 Mar 2021 • Hui Miao, Feixiang Lu, Zongdai Liu, Liangjun Zhang, Dinesh Manocha, Bin Zhou
We combine these novel algorithms and datasets to develop a robust approach for 2D/3D vehicle parsing for CVIS.
no code implementations • 10 Mar 2021 • Jin Fang, Dingfu Zhou, Xibin Song, Liangjun Zhang
In this paper, we propose a simple but effective framework - MapFusion to integrate the map information into modern 3D object detector pipelines.
no code implementations • 5 Mar 2021 • Dingfu Zhou, Xibin Song, Yuchao Dai, Junbo Yin, Feixiang Lu, Jin Fang, Miao Liao, Liangjun Zhang
3D object detection from a single image is an important task in Autonomous Driving (AD), where various approaches have been proposed.
Ranked #20 on
Monocular 3D Object Detection
on KITTI Cars Moderate
1 code implementation • ICCV 2021 • Hui Miao, Feixiang Lu, Zongdai Liu, Liangjun Zhang, Dinesh Manocha, Bin Zhou
We combine these novel algorithms and datasets to develop a robust approach for 2D/3D vehicle parsing for CVIS.
no code implementations • 15 Dec 2020 • Lina Liu, Xibin Song, Xiaoyang Lyu, Junwei Diao, Mengmeng Wang, Yong liu, Liangjun Zhang
Then, a refined depth map is further obtained using a residual learning strategy in the coarse-to-fine stage with a coarse depth map and color image as input.
1 code implementation • 15 Dec 2020 • Feixiang Lu, Zongdai Liu, Hui Miao, Peng Wang, Liangjun Zhang, Ruigang Yang, Dinesh Manocha, Bin Zhou
For autonomous driving, the dynamics and states of vehicle parts such as doors, the trunk, and the bonnet can provide meaningful semantic information and interaction states, which are essential to ensuring the safety of the self-driving vehicle.
no code implementations • 23 Oct 2020 • Qichuan Geng, Hong Zhang, Na Jiang, Xiaojuan Qi, Liangjun Zhang, Zhong Zhou
As a consequence, augmenting features with such prior knowledge can effectively improve the classification and localization performance.
no code implementations • 16 Jul 2020 • Feixiang Lu, Zongdai Liu, Xibin Song, Dingfu Zhou, Wei Li, Hui Miao, Miao Liao, Liangjun Zhang, Bin Zhou, Ruigang Yang, Dinesh Manocha
We present a novel approach to detect, segment, and reconstruct complete textured 3D models of vehicles from a single image for autonomous driving.
2 code implementations • 23 Jun 2020 • Zhelun Shen, Yuchao Dai, Xibin Song, Zhibo Rao, Dingfu Zhou, Liangjun Zhang
First, we construct combination volumes on the upper levels of the pyramid and develop a cost volume fusion module to integrate them for initial disparity estimation.