Search Results for author: Hongkai Yu

Found 44 papers, 17 papers with code

Light the Night: A Multi-Condition Diffusion Framework for Unpaired Low-Light Enhancement in Autonomous Driving

no code implementations CVPR 2024 Jinlong Li, Baolu Li, Zhengzhong Tu, Xinyu Liu, Qing Guo, Felix Juefei-Xu, Runsheng Xu, Hongkai Yu

Vision-centric perception systems for autonomous driving have gained considerable attention recently due to their cost-effectiveness and scalability, especially compared to LiDAR-based systems.

Autonomous Driving

V2X-DGW: Domain Generalization for Multi-agent Perception under Adverse Weather Conditions

no code implementations17 Mar 2024 Baolu Li, Jinlong Li, Xinyu Liu, Runsheng Xu, Zhengzhong Tu, Jiacheng Guo, Xiaopeng Li, Hongkai Yu

In this paper, we propose a Domain Generalization based approach, named V2X-DGW, for LiDAR-based 3D object detection on multi-agent perception system under adverse weather conditions.

3D Object Detection Domain Generalization +2

EVD4UAV: An Altitude-Sensitive Benchmark to Evade Vehicle Detection in UAV

1 code implementation8 Mar 2024 Huiming Sun, Jiacheng Guo, Zibo Meng, Tianyun Zhang, Jianwu Fang, Yuewei Lin, Hongkai Yu

One white-box and two black-box patch based attack methods are implemented to attack three classic deep neural networks based object detectors on EVD4UAV.

Image Segmentation Object Detection +1

Abductive Ego-View Accident Video Understanding for Safe Driving Perception

no code implementations CVPR 2024 Jianwu Fang, Lei-Lei Li, Junfei Zhou, Junbin Xiao, Hongkai Yu, Chen Lv, Jianru Xue, Tat-Seng Chua

This model involves a contrastive interaction loss to learn the pair co-occurrence of normal, near-accident, accident frames with the corresponding text descriptions, such as accident reasons, prevention advice, and accident categories.

Object object-detection +3

Vehicle Behavior Prediction by Episodic-Memory Implanted NDT

1 code implementation13 Feb 2024 Peining Shen, Jianwu Fang, Hongkai Yu, Jianru Xue

In this work, we explore the interpretability of behavior prediction of target vehicles by an Episodic Memory implanted Neural Decision Tree (abbrev.

Autonomous Driving

Breaking Data Silos: Cross-Domain Learning for Multi-Agent Perception from Independent Private Sources

1 code implementation6 Feb 2024 Jinlong Li, Baolu Li, Xinyu Liu, Runsheng Xu, Jiaqi Ma, Hongkai Yu

However, the data source to train the various agents is independent and private in each company, leading to the Distribution Gap of different private data for training distinct agents in multi-agent perception system.

3D Object Detection object-detection

AdvGPS: Adversarial GPS for Multi-Agent Perception Attack

1 code implementation30 Jan 2024 Jinlong Li, Baolu Li, Xinyu Liu, Jianwu Fang, Felix Juefei-Xu, Qing Guo, Hongkai Yu

The multi-agent perception system collects visual data from sensors located on various agents and leverages their relative poses determined by GPS signals to effectively fuse information, mitigating the limitations of single-agent sensing, such as occlusion.

Adversarial Attack object-detection +1

VehicleGAN: Pair-flexible Pose Guided Image Synthesis for Vehicle Re-identification

no code implementations27 Nov 2023 Baolu Li, Ping Liu, Lan Fu, Jinlong Li, Jianwu Fang, Zhigang Xu, Hongkai Yu

Vehicle Re-identification (Re-ID) has been broadly studied in the last decade; however, the different camera view angle leading to confused discrimination in the feature subspace for the vehicles of various poses, is still challenging for the Vehicle Re-ID models in the real world.

Data Augmentation Image Generation +2

SuperInpaint: Learning Detail-Enhanced Attentional Implicit Representation for Super-resolutional Image Inpainting

no code implementations26 Jul 2023 Canyu Zhang, Qing Guo, Xiaoguang Li, Renjie Wan, Hongkai Yu, Ivor Tsang, Song Wang

Given the coordinates of a pixel we want to reconstruct, we first collect its neighboring pixels in the input image and extract their detail-enhanced semantic embeddings, unmask-attentional semantic embeddings, importance values, and spatial distances to the desired pixel.

Image Inpainting Image Reconstruction +2

Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather

1 code implementation18 Jul 2023 Jinlong Li, Runsheng Xu, Xinyu Liu, Jin Ma, Baolu Li, Qin Zou, Jiaqi Ma, Hongkai Yu

To bridge the domain gap and improve the performance of object detection in foggy and rainy weather, this paper presents a novel framework for domain-adaptive object detection.

Autonomous Driving Data Augmentation +4

S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality

no code implementations16 Jul 2023 Jinlong Li, Runsheng Xu, Xinyu Liu, Baolu Li, Qin Zou, Jiaqi Ma, Hongkai Yu

We investigate the effects of these two types of domain gaps and propose a novel uncertainty-aware vision transformer to effectively relief the Deployment Gap and an agent-based feature adaptation module with inter-agent and ego-agent discriminators to reduce the Feature Gap.

3D Object Detection object-detection +1

Defense against Adversarial Cloud Attack on Remote Sensing Salient Object Detection

no code implementations30 Jun 2023 Huiming Sun, Lan Fu, Jinlong Li, Qing Guo, Zibo Meng, Tianyun Zhang, Yuewei Lin, Hongkai Yu

Furthermore, we design DefenseNet as a learn-able pre-processing to the adversarial cloudy images so as to preserve the performance of the deep learning based remote sensing SOD model, without tuning the already deployed deep SOD model.

Adversarial Attack object-detection +2

Deep Transfer Learning for Intelligent Vehicle Perception: a Survey

no code implementations26 Jun 2023 Xinyu Liu, Jinlong Li, Jin Ma, Huiming Sun, Zhigang Xu, Tianyun Zhang, Hongkai Yu

To the best of our knowledge, this paper represents the first comprehensive survey on the topic of the deep transfer learning for intelligent vehicle perception.

Autonomous Driving Decision Making +2

Semi-supervised Large-scale Fiber Detection in Material Images with Synthetic Data

no code implementations10 Feb 2023 Lan Fu, Zhiyuan Liu, Jinlong Li, Jeff Simmons, Hongkai Yu, Song Wang

Accurate detection of large-scale, elliptical-shape fibers, including their parameters of center, orientation and major/minor axes, on the 2D cross-sectioned image slices is very important for characterizing the underlying cylinder 3D structures in microscopic material images.

Domain Adaptation

Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communication

1 code implementation16 Dec 2022 Jinlong Li, Runsheng Xu, Xinyu Liu, Jin Ma, Zicheng Chi, Jiaqi Ma, Hongkai Yu

Due to the beneficial Vehicle-to-Vehicle (V2V) communication, the deep learning based features from other agents can be shared to the ego vehicle so as to improve the perception of the ego vehicle.

3D Object Detection object-detection

Coarse-to-fine Task-driven Inpainting for Geoscience Images

no code implementations20 Nov 2022 Huiming Sun, Jin Ma, Qing Guo, Qin Zou, Shaoyue Song, Yuewei Lin, Hongkai Yu

To the best of our knowledge, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images by ignoring the geoscience related tasks.

Data Augmentation Decoder +3

Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Review

no code implementations9 Nov 2022 Talha Azfar, Jinlong Li, Hongkai Yu, Ruey Long Cheu, Yisheng Lv, Ruimin Ke

This paper conducted an extensive literature review on the applications of computer vision in ITS and AD, and discusses challenges related to data, models, and complex urban environments.

Autonomous Driving Edge-computing

Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning

1 code implementation2 Nov 2022 Jianwu Fang, Chen Zhu, Pu Zhang, Hongkai Yu, Jianru Xue

Heterogeneous trajectory forecasting is critical for intelligent transportation systems, but it is challenging because of the difficulty of modeling the complex interaction relations among the heterogeneous road agents as well as their agent-environment constraints.

Graph Learning Trajectory Forecasting

Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather

1 code implementation27 Oct 2022 Jinlong Li, Runsheng Xu, Jin Ma, Qin Zou, Jiaqi Ma, Hongkai Yu

This paper proposes a novel domain adaptive object detection framework for autonomous driving under foggy weather.

Autonomous Driving Data Augmentation +4

Bridging the Domain Gap for Multi-Agent Perception

1 code implementation16 Oct 2022 Runsheng Xu, Jinlong Li, Xiaoyu Dong, Hongkai Yu, Jiaqi Ma

Existing multi-agent perception algorithms usually select to share deep neural features extracted from raw sensing data between agents, achieving a trade-off between accuracy and communication bandwidth limit.

3D Object Detection Domain Adaptation +1

Pik-Fix: Restoring and Colorizing Old Photos

1 code implementation4 May 2022 Runsheng Xu, Zhengzhong Tu, Yuanqi Du, Xiaoyu Dong, Jinlong Li, Zibo Meng, Jiaqi Ma, Alan Bovik, Hongkai Yu

Our proposed framework consists of three modules: a restoration sub-network that conducts restoration from degradations, a similarity network that performs color histogram matching and color transfer, and a colorization subnet that learns to predict the chroma elements of images conditioned on chromatic reference signals.

Colorization

ROMNet: Renovate the Old Memories

no code implementations5 Feb 2022 Runsheng Xu, Zhengzhong Tu, Yuanqi Du, Xiaoyu Dong, Jinlong Li, Zibo Meng, Jiaqi Ma, Hongkai Yu

Renovating the memories in old photos is an intriguing research topic in computer vision fields.

Colorization

Benchmarking Shadow Removal for Facial Landmark Detection and Beyond

no code implementations27 Nov 2021 Lan Fu, Qing Guo, Felix Juefei-Xu, Hongkai Yu, Wei Feng, Yang Liu, Song Wang

The observation of this work motivates us to design a novel detection-aware shadow removal framework, which empowers shadow removal to achieve higher restoration quality and enhance the shadow robustness of deployed facial landmark detectors.

Benchmarking Blocking +2

Adversarial Relighting Against Face Recognition

no code implementations18 Aug 2021 Qian Zhang, Qing Guo, Ruijun Gao, Felix Juefei-Xu, Hongkai Yu, Wei Feng

To this end, we first propose the physical modelbased adversarial relighting attack (ARA) denoted as albedoquotient-based adversarial relighting attack (AQ-ARA).

Adversarial Attack Face Recognition

JPGNet: Joint Predictive Filtering and Generative Network for Image Inpainting

1 code implementation9 Jul 2021 Qing Guo, Xiaoguang Li, Felix Juefei-Xu, Hongkai Yu, Yang Liu, Song Wang

In this paper, for the first time, we formulate image inpainting as a mix of two problems, predictive filtering and deep generation.

Image Inpainting

Let There be Light: Improved Traffic Surveillance via Detail Preserving Night-to-Day Transfer

no code implementations11 May 2021 Lan Fu, Hongkai Yu, Felix Juefei-Xu, Jinlong Li, Qing Guo, Song Wang

As one of the state-of-the-art perception approaches, detecting the interested objects in each frame of video surveillance is widely desired by ITS.

Object object-detection +2

AdvHaze: Adversarial Haze Attack

no code implementations28 Apr 2021 Ruijun Gao, Qing Guo, Felix Juefei-Xu, Hongkai Yu, Wei Feng

We also visualize the correlation matrices, which inspire us to jointly apply different perturbations to improve the success rate of the attack.

Adversarial Attack

Auto-Exposure Fusion for Single-Image Shadow Removal

2 code implementations CVPR 2021 Lan Fu, Changqing Zhou, Qing Guo, Felix Juefei-Xu, Hongkai Yu, Wei Feng, Yang Liu, Song Wang

We conduct extensive experiments on the ISTD, ISTD+, and SRD datasets to validate our method's effectiveness and show better performance in shadow regions and comparable performance in non-shadow regions over the state-of-the-art methods.

Image Shadow Removal Shadow Removal

DCDLearn: Multi-order Deep Cross-distance Learning for Vehicle Re-Identification

no code implementations25 Mar 2020 Rixing Zhu, Jianwu Fang, Hongke Xu, Hongkai Yu, Jianru Xue

Vehicle re-identification (Re-ID) has become a popular research topic owing to its practicability in intelligent transportation systems.

Triplet Vehicle Re-Identification

DADA: Driver Attention Prediction in Driving Accident Scenarios

1 code implementation18 Dec 2019 Jianwu Fang, Dingxin Yan, Jiahuan Qiao, Jianru Xue, Hongkai Yu

1) With the semantic images, we introduce their semantic context features and verified the manifest promotion effect for helping the driver attention prediction, where the semantic context features are modeled by a graph convolution network (GCN) on semantic images; 2) We fuse the semantic context features of semantic images and the features of RGB frames in an attentive strategy, and the fused details are transferred over frames by a convolutional LSTM module to obtain the attention map of each video frame with the consideration of historical scene variation in driving situations; 3) The superiority of the proposed method is evaluated on our previously collected dataset (named as DADA-2000) and two other challenging datasets with state-of-the-art methods.

Driver Attention Monitoring Scene Understanding

An End-to-End Network for Co-Saliency Detection in One Single Image

no code implementations25 Oct 2019 Yuanhao Yue, Qin Zou, Hongkai Yu, Qian Wang, Zhongyuan Wang, Song Wang

Co-saliency detection within a single image is a common vision problem that has received little attention and has not yet been well addressed.

Clustering Co-Salient Object Detection +2

Identifying Designs from Incomplete, Fragmented Cultural Heritage Objects by Curve-Pattern Matching

no code implementations5 Aug 2016 Jun Zhou, Haozhou Yu, Karen Smith, Colin Wilder, Hongkai Yu, Song Wang

The challenge to reconstruct and study complete designs is stymied because 1) most fragmentary cultural-heritage objects contain only a small portion of the underlying full design, 2) in the case of a stamping application, the same design may be applied multiple times with spatial overlap on one object, and 3) curve patterns detected on an object are usually incomplete and noisy.

Management Object

Groupwise Tracking of Crowded Similar-Appearance Targets From Low-Continuity Image Sequences

no code implementations CVPR 2016 Hongkai Yu, Youjie Zhou, Jeff Simmons, Craig P. Przybyla, Yuewei Lin, Xiaochuan Fan, Yang Mi, Song Wang

In particular, the within-group association is modeled by a nonrigid 2D Thin-Plate transform and a sequence of group shrinking, group growing and group merging operations are then developed to refine the composition of each group.

Cell Tracking

Co-interest Person Detection from Multiple Wearable Camera Videos

no code implementations ICCV 2015 Yuewei Lin, Kareem Ezzeldeen, Youjie Zhou, Xiaochuan Fan, Hongkai Yu, Hui Qian, Song Wang

Wearable cameras, such as Google Glass and Go Pro, enable video data collection over larger areas and from different views.

Human Detection

LooseCut: Interactive Image Segmentation with Loosely Bounded Boxes

no code implementations11 Jul 2015 Hongkai Yu, Youjie Zhou, Hui Qian, Min Xian, Yuewei Lin, Dazhou Guo, Kang Zheng, Kareem Abdelfatah, Song Wang

In this paper, we develop a new LooseCut algorithm that can handle cases where the input bounding box only loosely covers the foreground object.

Image Segmentation Object +5

Feature Sampling Strategies for Action Recognition

no code implementations28 Jan 2015 Youjie Zhou, Hongkai Yu, Song Wang

Although dense local spatial-temporal features with bag-of-features representation achieve state-of-the-art performance for action recognition, the huge feature number and feature size prevent current methods from scaling up to real size problems.

Action Recognition Temporal Action Localization

Cannot find the paper you are looking for? You can Submit a new open access paper.