A Zero-Shot Sketch-based Inter-Modal Object Retrieval Scheme for Remote Sensing Images

12 Aug 2020  ·  Ushasi Chaudhuri, Biplab Banerjee, Avik Bhattacharya, Mihai Datcu ·

Conventional existing retrieval methods in remote sensing (RS) are often based on a uni-modal data retrieval framework. In this work, we propose a novel inter-modal triplet-based zero-shot retrieval scheme utilizing a sketch-based representation of RS data. The proposed scheme performs efficiently even when the sketch representations are marginally prototypical of the image. We conducted experiments on a new bi-modal image-sketch dataset called Earth on Canvas (EoC) conceived during this study. We perform a thorough bench-marking of this dataset and demonstrate that the proposed network outperforms other state-of-the-art methods for zero-shot sketch-based retrieval framework in remote sensing.

PDF Abstract

Datasets


Introduced in the Paper:

Earth on Canvas

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods


No methods listed for this paper. Add relevant methods here