LLVIP: A Visible-infrared Paired Dataset for Low-light Vision

24 Aug 2021  ·  Xinyu Jia, Chuang Zhu, Minzhen Li, Wenqi Tang, ShengJie Liu, Wenli Zhou ·

It is very challenging for various visual tasks such as image fusion, pedestrian detection and image-to-image translation in low light conditions due to the loss of effective target areas. In this case, infrared and visible images can be used together to provide both rich detail information and effective target areas. In this paper, we present LLVIP, a visible-infrared paired dataset for low-light vision. This dataset contains 30976 images, or 15488 pairs, most of which were taken at very dark scenes, and all of the images are strictly aligned in time and space. Pedestrians in the dataset are labeled. We compare the dataset with other visible-infrared datasets and evaluate the performance of some popular visual algorithms including image fusion, pedestrian detection and image-to-image translation on the dataset. The experimental results demonstrate the complementary effect of fusion on image information, and find the deficiency of existing algorithms of the three visual tasks in very low-light conditions. We believe the LLVIP dataset will contribute to the community of computer vision by promoting image fusion, pedestrian detection and image-to-image translation in very low-light applications. The dataset is being released in https://bupt-ai-cz.github.io/LLVIP. Raw data is also provided for further research such as image registration.

PDF Abstract

Datasets


Introduced in the Paper:

LLVIP
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Thermal Infrared Pedestrian Detection LLVIP YoloV5 AP 0.670 # 1
Image-to-Image Translation LLVIP pix2pix PSNR 10.769 # 4
SSIM 0.1757 # 4
Pedestrian Detection LLVIP YoloV5-RGB AP 0.527 # 2
log average miss rate 22.59% # 3
Pedestrian Detection LLVIP YoloV3-RGB AP 0.466 # 3
log average miss rate 37.70% # 4
Image Generation LLVIP pix2pix PSNR 10.769 # 1
SSIM 0.1757 # 1
Thermal Infrared Pedestrian Detection LLVIP YoloV3 AP 0.582 # 2

Methods