ChangeSim: Towards End-to-End Online Scene Change Detection in Industrial Indoor Environments

9 Mar 2021  ·  Jin-Man Park, Jae-Hyuk Jang, Sahng-Min Yoo, Sun-Kyung Lee, Ue-Hwan Kim, Jong-Hwan Kim ·

We present a challenging dataset, ChangeSim, aimed at online scene change detection (SCD) and more. The data is collected in photo-realistic simulation environments with the presence of environmental non-targeted variations, such as air turbidity and light condition changes, as well as targeted object changes in industrial indoor environments. By collecting data in simulations, multi-modal sensor data and precise ground truth labels are obtainable such as the RGB image, depth image, semantic segmentation, change segmentation, camera poses, and 3D reconstructions. While the previous online SCD datasets evaluate models given well-aligned image pairs, ChangeSim also provides raw unpaired sequences that present an opportunity to develop an online SCD model in an end-to-end manner, considering both pairing and detection. Experiments show that even the latest pair-based SCD models suffer from the bottleneck of the pairing process, and it gets worse when the environment contains the non-targeted variations. Our dataset is available at http://sammica.github.io/ChangeSim/.

PDF Abstract

Datasets


Introduced in the Paper:

ChangeSim

Used in the Paper:

Cityscapes AirSim
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Scene Change Detection ChangeSim RTABMAP+CSCDNet Category mIoU 26.1 # 2
macro F1 30.6 # 1
Scene Change Detection ChangeSim RTABMAP+ChangeNet Category mIoU 23.0 # 3
macro F1 29.8 # 2

Methods


No methods listed for this paper. Add relevant methods here