no code implementations • 31 Jul 2024 • Jianxin Huang, Jiahang Li, Ning Jia, Yuxiang Sun, Chengju Liu, Qijun Chen, Rui Fan
These decoupled features are then fused through a dual-branch multi-scale heterogeneous feature fusion block, which employs parallel Transformer attentions and convolutional neural network modules to merge multi-scale features across different scales and receptive fields.
Ranked #1 on Semantic Segmentation on ZJU-RGB-P
no code implementations • 25 Jul 2024 • Guanfeng Tang, Zhiyuan Wu, Jiahang Li, Ping Zhong, Xieyuanli Chen, Huiming Lu, Rui Fan
The major contributions of this study lie in comprehensively tightening the coupling between semantic segmentation and stereo matching.
1 code implementation • 7 Jul 2024 • Yi Feng, Zizhan Guo, Qijun Chen, Rui Fan
Specifically, a confidence-aware feature flow estimator is proposed to acquire 2D feature positional translations and their associated confidence levels.
Ranked #2 on Camera Pose Estimation on KITTI Odometry Benchmark
no code implementations • 27 May 2024 • Mengtan Zhang, Yi Feng, Qijun Chen, Rui Fan
The second novelty arises from the observation that there exists an explicit, deducible relationship between optical flow divergence and depth gradient.
1 code implementation • 13 May 2024 • Qiuchi Xiang, Jintao Cheng, Jiehao Luo, Jin Wu, Rui Fan, Xieyuanli Chen, Xiaoyu Tang
In a novel way, we employ a stochastic reconstruction approach to build shift state space models, compressing the visual representation.
no code implementations • 28 Apr 2024 • Zhiwei Huang, Yikang Zhang, Qijun Chen, Rui Fan
The cornerstone of our framework and toolbox is the cross-modal mask matching (C3M) algorithm, developed based on a state-of-the-art (SoTA) LVM and capable of generating sufficient and reliable matches.
no code implementations • 15 Apr 2024 • Jiayi Wang, Yi-An Mao, Xiaoyu Ma, Sicen Guo, Yuting Shao, Xiao Lv, Wenting Han, Mark Christopher, Linda M. Zangwill, Yanlong Bi, Rui Fan
However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks.
no code implementations • 9 Apr 2024 • Chuang-Wei Liu, Qijun Chen, Rui Fan
We believe this new paradigm will pave the way for the next generation of stereo matching networks.
1 code implementation • 4 Apr 2024 • Jiahang Li, Peng Yun, Qijun Chen, Rui Fan
In this study, we take one step toward this new research area by exploring a feasible strategy to fully exploit VFM features for RGB-thermal scene parsing.
Ranked #1 on Thermal Image Segmentation on KP day-night
no code implementations • 13 Mar 2024 • Sicen Guo, Zhiyuan Wu, Qijun Chen, Ioannis Pitas, Rui Fan
We introduce the Learning to Infuse "X" (LIX) framework, with novel contributions in both logit distillation and feature distillation aspects.
no code implementations • 8 Mar 2024 • Yu Han, Ziwei Long, Yanting Zhang, Jin Wu, Zhijun Fang, Rui Fan
Taking into account the practical applicability of our method in real-world robotics applications, we also propose a novel patch descriptor distillation strategy to further reduce the computational complexity of correspondence matching.
no code implementations • 29 Feb 2024 • Yi Feng, Yu Ma, Qijun Chen, Ioannis Pitas, Rui Fan
Feature-fusion networks with duplex encoders have proven to be an effective technique to solve the freespace detection problem.
1 code implementation • 20 Feb 2024 • Xiaoyu Tang, Xingming Chen, Jintao Cheng, Jin Wu, Rui Fan, Chengxi Zhang, Zebo Zhou
In this article, an antenna dataset is created to address important antenna interference source detection issues and serves as the basis for subsequent research.
1 code implementation • 30 Jan 2024 • Jintao Cheng, Kang Zeng, Zhuoxu Huang, Xiaoyu Tang, Jin Wu, Chengxi Zhang, Xieyuanli Chen, Rui Fan
Moving object segmentation (MOS) provides a reliable solution for detecting traffic participants and thus is of great interest in the autonomous driving field.
no code implementations • 28 Jan 2024 • Nachuan Ma, Rui Fan, Lihua Xie
Subsequently, a generative adversarial network is trained to restore the corrupted regions by leveraging the semantic context learned from surrounding uncorrupted regions.
no code implementations • 21 Jan 2024 • Zhiyuan Wu, Yi Feng, Chuang-Wei Liu, Fisher Yu, Qijun Chen, Rui Fan
Hence, in this article, we introduce S$^3$M-Net, a novel joint learning framework developed to perform semantic segmentation and stereo matching simultaneously.
1 code implementation • 18 Dec 2023 • Yanting Zhang, Shuanghong Wang, Qingxiang Wang, Cairong Yan, Rui Fan
Moreover, to alleviate the impact of the image style variations caused by different cameras, a color transfer module is effectively incorporated to extract cross-camera consistent appearance features for pedestrian association across moving cameras for ICT, resulting in a much improved MTMMC tracking system, which can constitute a step further towards coordinated mining of multiple moving cameras.
no code implementations • 18 Dec 2023 • Zhihao Zhu, Chenwang Wu, Rui Fan, Yi Yang, Zhen Wang, Defu Lian, Enhong Chen
Recent research demonstrates that GNNs are vulnerable to the model stealing attack, a nefarious endeavor geared towards duplicating the target model via query permissions.
no code implementations • 18 Dec 2023 • Zhihao Zhu, Rui Fan, Chenwang Wu, Yi Yang, Defu Lian, Enhong Chen
Some adversarial attacks have achieved model stealing attacks against recommender systems, to some extent, by collecting abundant training data of the target model (target data) or making a mass of queries.
no code implementations • 13 Dec 2023 • Jingwei Yang, Bohuan Xue, Yi Feng, Deming Wang, Rui Fan, Qijun Chen
This article introduces three-filters-to-normal+ (3F2N+), an extension of our previous work three-filters-to-normal (3F2N), with a specific focus on incorporating discontinuity discrimination capability into surface normal estimators (SNEs).
no code implementations • 19 Sep 2023 • Hongbo Zhao, Yikang Zhang, Qijun Chen, Rui Fan
Instead, we introduce four new evaluation metrics to quantify the robustness and accuracy of extrinsic parameter estimation, applicable to both single-pair and multi-pair cases.
no code implementations • 19 Sep 2023 • Jiahang Li, Yikang Zhang, Peng Yun, Guangliang Zhou, Qijun Chen, Rui Fan
Additionally, we release SYN-UDTIRI, the first large-scale road scene parsing dataset that contains over 10, 407 RGB images, dense depth images, and the corresponding pixel-level annotations for both freespace and road defects of different shapes and sizes.
Ranked #2 on Semantic Segmentation on SYN-UDTIRI
no code implementations • 31 Aug 2023 • Chenbo Zhou, Shuai Su, Qijun Chen, Rui Fan
Accurate and robust correspondence matching is of utmost importance for various 3D computer vision tasks.
no code implementations • 29 Jul 2023 • Yi Feng, Ruge Zhang, Jiayuan Du, Qijun Chen, Rui Fan
Additionally, our proposed freespace optical flow model boasts a diverse array of applications within the realm of automated driving, providing a geometric constraint in freespace detection, vehicle localization, and more.
no code implementations • 28 May 2023 • Yurui Lai, Taiyan Zhang, Rui Fan
In this work, we design a novel GNN which is effective for both heterophilic and homophilic graphs.
Ranked #8 on Node Classification on Actor
1 code implementation • 24 Apr 2023 • Yi Feng, Bohuan Xue, Ming Liu, Qijun Chen, Rui Fan
Surface normal holds significant importance in visual environmental perception, serving as a source of rich geometric information.
no code implementations • 18 Apr 2023 • Sicen Guo, Jiahang Li, Yi Feng, Dacheng Zhou, Denghuang Zhang, Chen Chen, Shuai Su, Xingyi Zhu, Qijun Chen, Rui Fan
To foster advancements in this burgeoning field, we have launched an online open-source benchmark suite, referred to as UDTIRI.
no code implementations • 25 Feb 2023 • Zhichao Liu, Leshan Wang, Desen Zhou, Jian Wang, Songyang Zhang, Yang Bai, Errui Ding, Rui Fan
To deal with these issues, we propose an attention based approach which we call \textit{temporal segment transformer}, for joint segment relation modeling and denoising.
1 code implementation • 28 Oct 2022 • Rui Fan, Erick Delage
This research focuses on the bid optimization problem in the real-time bidding setting for online display advertisements, where an advertiser, or the advertiser's agent, has access to the features of the website visitor and the type of ad slots, to decide the optimal bid prices given a predetermined total advertisement budget.
no code implementations • 21 Aug 2022 • Shuai Su, Zhongkai Zhao, Yixin Fei, Shuda Li, Qijun Chen, Rui Fan
The experimental results demonstrate the importance of group equivariant algorithms for correspondence matching on various sim(2) transformation conditions.
no code implementations • 18 Aug 2022 • Nan Ming, Yi Feng, Rui Fan
The state-of-the-art (SoTA) surface normal estimators (SNEs) generally translate depth images into surface normal maps in an end-to-end fashion.
1 code implementation • 28 Apr 2022 • Nachuan Ma, Jiahe Fan, Wenshuo Wang, Jin Wu, Yu Jiang, Lihua Xie, Rui Fan
Computer vision algorithms have been prevalently utilized for 3-D road imaging and pothole detection for over two decades.
1 code implementation • 4 Mar 2022 • Rui Fan, Sicen Guo, Li Wang, Mohammud Junaid Bocus
Road damage is an inconvenience and a safety hazard, severely affecting vehicle condition, driving comfort, and traffic safety.
2 code implementations • Bioarxiv 2022 • Xusheng Cao, Rui Fan, Wanwen Zeng
Computational approaches for accurate predictions of drug-related interactions such as drug-drug interactions (DDIs) and drug-target interactions (DTIs) are highly demanding for biochemical researchers due to their efficiency and cost-effectiveness.
no code implementations • 24 Dec 2021 • Jiahe Fan, Mohammud J. Bocus, Brett Hosking, Rigen Wu, Yanan Liu, Sergey Vityazev, Rui Fan
This further reduces the semantic gap between different feature channel layers.
no code implementations • 25 Oct 2021 • Dehao Huang, Jintao Cheng, Rui Fan, Zhihao Su, Qiongxiong Ma, Jie Li
Therefore, it is crucial to study a robust bone marrow cell detection algorithm for a quantitative automatic analysis system.
no code implementations • 21 Oct 2021 • Kengdong Lu, Jintao Cheng, Yubin Zhou, Juncan Deng, Rui Fan, Kaiqing Luo
This solution used CNN edge detection and Shi-Tomasi corner optimization to extract information from the image.
no code implementations • 6 Sep 2021 • Rui Fan, Hengli Wang, YuAn Wang, Ming Liu, Ioannis Pitas
Existing road pothole detection approaches can be classified as computer vision-based or machine learning-based.
no code implementations • 5 Aug 2021 • Weihao Yuan, Rui Fan, Michael Yu Wang, Qifeng Chen
We design a multiscopic vision system that utilizes a low-cost monocular RGB camera to acquire accurate depth estimation.
no code implementations • 30 Jul 2021 • Hengli Wang, Rui Fan, Peide Cai, Ming Liu
In particular, SNE-RoadSeg, our previously proposed method based on a surface normal estimator (SNE) and a data-fusion DCNN (RoadSeg), has achieved impressive performance in freespace detection.
no code implementations • 17 Jul 2021 • Hengli Wang, Rui Fan, Ming Liu
Convolutional neural network (CNN)-based stereo matching approaches generally require a dense cost volume (DCV) for disparity estimation.
no code implementations • 17 Jul 2021 • Hengli Wang, Rui Fan, Ming Liu
Stereo matching is a key component of autonomous driving perception.
no code implementations • 19 Apr 2021 • Ziyuan Wang, Feiming Yang, Rui Fan
Recent works have sought to address this problem using a two-stage approach, which first aggregates data along graph edges, then trains a classifier without using additional graph information.
no code implementations • 18 Apr 2021 • Hengli Wang, Peide Cai, Rui Fan, Yuxiang Sun, Ming Liu
With the recent advancement of deep learning technology, data-driven approaches for autonomous car prediction and planning have achieved extraordinary performance.
no code implementations • 12 Mar 2021 • Hengli Wang, Rui Fan, Peide Cai, Ming Liu
Supervised learning with deep convolutional neural networks (DCNNs) has seen huge adoption in stereo matching.
1 code implementation • 3 Mar 2021 • Hengli Wang, Rui Fan, Yuxiang Sun, Ming Liu
Therefore, in this paper, we first build a drivable area and road anomaly detection benchmark for ground mobile robots, evaluating the existing state-of-the-art single-modal and data-fusion semantic segmentation CNNs using six modalities of visual features.
no code implementations • 27 Jan 2021 • Rui Fan, Ji Hyung Lee, Youngki Shin
In this paper we propose the adaptive lasso for predictive quantile regression (ALQR).
no code implementations • 19 Dec 2020 • Rui Fan, Umar Ozgunalp, YuAn Wang, Ming Liu, Ioannis Pitas
This paper presents an efficient pothole detection algorithm based on road disparity map estimation and segmentation.
no code implementations • 14 Dec 2020 • Rui Fan, Hengli Wang, Peide Cai, Jin Wu, Mohammud Junaid Bocus, Lei Qiao, Ming Liu
Therefore, this paper mainly explores an effective training data augmentation approach that can be employed to improve the overall DCNN performance, when additional images captured from different views are available.
no code implementations • 9 Dec 2020 • Rui Fan, Christopher Bowd, Nicole Brye, Mark Christopher, Robert N. Weinreb, David Kriegman, Linda M. Zangwill
Our proposed multi-task Siamese network (MTSN) can employ any backbone CNN, and we demonstrate with four backbone CNNs that its accuracy with limited training data approaches the accuracy of backbone CNNs trained with a dataset that is 50 times larger.
no code implementations • 6 Dec 2020 • Rui Fan, Li Wang, Mohammud Junaid Bocus, Ioannis Pitas
As an important component of autonomous systems, autonomous car perception has had a big leap with recent advances in parallel computing architectures.
no code implementations • 29 Nov 2020 • Ellen Yi-Ge, Rui Fan, Zechun Liu, Zhiqiang Shen
Keypoints of objects reflect their concise abstractions, while the corresponding connection links (CL) build the skeleton by detecting the intrinsic relations between keypoints.
no code implementations • 4 Nov 2020 • Hengli Wang, Rui Fan, Ming Liu
The interpretation of ego motion and scene change is a fundamental task for mobile robots.
no code implementations • 29 Sep 2020 • M Usman Maqbool Bhutta, Manohar Kuse, Rui Fan, Yanan Liu, Ming Liu
We develop a generic method for the keychallenging scenarios in multi-agent 3D mapping based on different camera systems.
no code implementations • 27 Sep 2020 • Yanan Liu, Laurie Bose, Colin Greatwood, Jianing Chen, Rui Fan, Thomas Richardson, Stephen J. Carey, Piotr Dudek, Walterio Mayol-Cuevas
Experimental results demonstrate that the algorithm's ability to enable a ground vehicle to navigate at an average speed of 2. 20 m/s for passing through multiple gates and 3. 88 m/s for a 'slalom' task in an environment featuring significant visual clutter.
1 code implementation • 26 Aug 2020 • Hengli Wang, Rui Fan, Yuxiang Sun, Ming Liu
Our NIM can be deployed in existing convolutional neural networks (CNNs) to refine the segmentation performance.
1 code implementation • ECCV 2020 • Rui Fan, Hengli Wang, Peide Cai, Ming Liu
Freespace detection is an essential component of visual perception for self-driving cars.
Ranked #5 on Semantic Segmentation on SYN-UDTIRI
no code implementations • 21 Aug 2020 • Hengli Wang, Yuxuan Liu, Huaiyang Huang, Yuheng Pan, Wenbin Yu, Jialin Jiang, Dianbin Lyu, Mohammud J. Bocus, Ming Liu, Ioannis Pitas, Rui Fan
In this paper, we introduce a novel suspect-and-investigate framework, which can be easily embedded in a drone for automated parking violation detection (PVD).
1 code implementation • 16 Aug 2020 • Rui Fan, Hengli Wang, Mohammud J. Bocus, Ming Liu
The experimental results demonstrate that, firstly, the transformed disparity (or inverse depth) images become more informative; secondly, AA-UNet and AA-RTFNet, our best performing implementations, respectively outperform all other state-of-the-art single-modal and data-fusion networks for road pothole detection; and finally, the training set augmentation technique based on adversarial domain adaptation not only improves the accuracy of the state-of-the-art semantic segmentation networks, but also accelerates their convergence.
2 code implementations • 17 May 2020 • Rui Fan, Hengli Wang, Bohuan Xue, Huaiyang Huang, YuAn Wang, Ming Liu, Ioannis Pitas
To evaluate the performance of our proposed SNE, we created three large-scale synthetic datasets (easy, medium and hard) using 24 3D mesh models, each of which is used to generate 1800--2500 pairs of depth images (resolution: 480X640 pixels) and the corresponding ground-truth surface normal maps from different views.
1 code implementation • 22 Jan 2020 • Weihao Yuan, Rui Fan, Michael Yu Wang, Qifeng Chen
We design a multiscopic vision system that utilizes a low-cost monocular RGB camera to acquire accurate depth estimation for robotic applications.
no code implementations • 20 Nov 2019 • Umar Ozgunalp, Rui Fan, Shanshan Cheng, Yuxiang Sun, Weixun Zuo, Yilong Zhu, Bohuan Xue, Linwei Zheng, Qing Liang, Ming Liu
In this paper, a robust lane detection algorithm is proposed, where the vertical road profile of the road is estimated using dynamic programming from the v-disparity map and, based on the estimated profile, the road area is segmented.
no code implementations • 29 Oct 2019 • Rui Fan, Yu-An Wang, Lei Qiao, Ruiwen Yao, Peng Han, Weidong Zhang, Ioannis Pitas, Ming Liu
This linear model is then utilized to reduce the redundant information in the left and right road images.
no code implementations • 29 Oct 2019 • Huaiyang Huang, Rui Fan, Yilong Zhu, Ming Liu, Ioannis Pitas
Pavement condition is crucial for civil infrastructure maintenance.
1 code implementation • 11 Oct 2019 • Rui Fan, Ming Liu
This paper presents a novel road damage detection algorithm based on unsupervised disparity map segmentation.
no code implementations • 25 Sep 2019 • Rundong Li, Rui Fan
Network quantization is a model compression and acceleration technique that has become essential to neural network deployment.
1 code implementation • 2 Aug 2019 • Rui Fan, Umar Ozgunalp, Brett Hosking, Ming Liu, Ioannis Pitas
Furthermore, the pothole detection accuracy is still far from satisfactory.
no code implementations • 7 Jun 2019 • Rui Fan, Jianhao Jiao, Haoyang Ye, Yang Yu, Ioannis Pitas, Ming Liu
Over the past decade, many research articles have been published in the area of autonomous driving.
no code implementations • 5 Jun 2019 • Rui Fan, Lujia Wang, Ming Liu, Ioannis Pitas
This paper presents a robust roll angle estimation algorithm, which is developed from our previously published work, where the roll angle was estimated from a dense disparity map by minimizing a global energy using golden section search algorithm.
no code implementations • 27 Apr 2019 • Jianhao Jiao, Qinghai Liao, Yilong Zhu, Tianyu Liu, Yang Yu, Rui Fan, Lujia Wang, Ming Liu
Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems.
1 code implementation • 18 Apr 2019 • Rui Fan, Mohammud Junaid Bocus, Yilong Zhu, Jianhao Jiao, Li Wang, Fulong Ma, Shanshan Cheng, Ming Liu
In this paper, we propose a novel road crack detection algorithm based on deep learning and adaptive image segmentation.
no code implementations • 12 Apr 2019 • Rui Fan, Jianhao Jiao, Jie Pan, Huaiyang Huang, Shaojie Shen, Ming Liu
This makes the damaged road areas more distinguishable from the road surface.
1 code implementation • 9 Mar 2019 • Qiuhua Huang, Renke Huang, Weituo Hao, Jie Tan, Rui Fan, Zhenyu Huang
Power system emergency control is generally regarded as the last safety net for grid security and resiliency.
no code implementations • 7 Mar 2019 • Jianhao Jiao, Rui Fan, Han Ma, Ming Liu
We apply the designed model and proposed an algorithm for detecting lanes by formulating it as the shortest path problem.
no code implementations • 28 Aug 2018 • Han Ma, Yixin Ma, Jianhao Jiao, M Usman Maqbool Bhutta, Mohammud Junaid Bocus, Lujia Wang, Ming Liu, Rui Fan
Lane detection is very important for self-driving vehicles.
no code implementations • 8 Aug 2018 • Rui Fan, Mohammud Junaid Bocus, Naim Dahnoun
The transformation is achieved using two parameters: roll angle and fitted disparity value with respect to each row.
no code implementations • 18 Jul 2018 • Rui Fan, Yanan Liu, Xingrui Yang, Mohammud Junaid Bocus, Naim Dahnoun, Scott Tancock
In this paper, we present a real-time stereo vision system used for road surface 3-D reconstruction.
no code implementations • 8 Jul 2018 • Rui Fan, Naim Dahnoun
The proposed system in this paper is developed from our previous work where the dense vanishing point Vp is estimated globally to assist the detection of multiple curved lane markings.
1 code implementation • 5 Jul 2018 • Rui Fan, Yanan Liu, Mohammud Junaid Bocus, Lujia Wang, Ming Liu
Stereo vision technique has been widely used in robotic systems to acquire 3-D information.
1 code implementation • 5 Jul 2018 • Rui Fan, Xiao Ai, Naim Dahnoun
To achieve the millimetre accuracy required for road condition assessment, a disparity map with subpixel resolution needs to be used.
no code implementations • 13 Oct 2014 • Junhui Shen, Peiyan Zhu, Rui Fan, Wei Tan
To the best of our knowledge, the present work is the first attempt that applies sentiment analysis to the domain of TCM on Sina Weibo (a twitter-like microblogging service in China).
Cultural Vocal Bursts Intensity Prediction Sentiment Analysis +1