no code implementations • 7 Oct 2024 • Fabian Jaensch, Giuseppe Caire, Begüm Demir
We focus on predicting path loss radio maps using convolutional neural networks, leveraging aerial images alone or in combination with supplementary height information.
no code implementations • 16 Aug 2024 • Martin Hermann Paul Fuchs, Behnood Rasti, Begüm Demir
The development of learning-based hyperspectral image (HSI) compression models has recently attracted significant interest.
4 code implementations • 4 Jul 2024 • Kai Norman Clasen, Leonard Hackel, Tom Burgert, Gencer Sumbul, Begüm Demir, Volker Markl
To construct reBEN, we initially consider the Sentinel-1 and Sentinel-2 tiles used to construct the BigEarthNet dataset and then divide them into patches of size 1200 m x 1200 m. We apply atmospheric correction to the Sentinel-2 patches using the latest version of the sen2cor tool, resulting in higher-quality patches compared to those present in BigEarthNet.
no code implementations • 24 Jun 2024 • Theresa Follath, David Mickisch, Jan Hemmerling, Stefan Erasmi, Marcel Schwieder, Begüm Demir
Using images acquired by different satellite sensors has shown to improve classification performance in the framework of crop mapping from satellite image time series (SITS).
no code implementations • 14 Jun 2024 • Genc Hoxha, Gencer Sumbul, Julia Henkel, Lars Möllenbrok, Begüm Demir
ANNEAL aims to create a small but informative training set made up of similar and dissimilar image pairs to be utilized for accurately learning a metric space.
no code implementations • 24 May 2024 • Barış Büyüktaş, Kenneth Weitzel, Sebastian Völkers, Felix Zailskas, Begüm Demir
Federated learning (FL) aims to collaboratively learn deep learning model parameters from decentralized data archives (i. e., clients) without accessing training data on clients.
1 code implementation • 24 May 2024 • Panagiotis Agrafiotis, Łukasz Janowski, Dimitrios Skarlatos, Begüm Demir
To address this issue, in this paper we present the MagicBathyNet, which is a benchmark dataset made up of image patches of Sentinel2, SPOT-6 and aerial imagery, bathymetry in raster format and annotations of seabed classes.
no code implementations • 22 May 2024 • Tom Burgert, Tim Siebert, Kai Norman Clasen, Begüm Demir
To address this problem, we introduce a label propagation (LP) strategy that allows the effective application of CutMix in the context of MLC problems in RS without being affected by label noise.
no code implementations • 21 Mar 2024 • Tom Burgert, Begüm Demir
The application of data augmentation for deep learning (DL) methods plays an important role in achieving state-of-the-art results in supervised, semi-supervised, and self-supervised image classification.
no code implementations • 15 Feb 2024 • Angelos Zavras, Dimitrios Michail, Begüm Demir, Ioannis Papoutsis
Our two-stage procedure, comprises of robust fine-tuning CLIP in order to deal with the distribution shift, accompanied by the cross-modal alignment of a RS modality encoder, in an effort to extend the zero-shot capabilities of CLIP.
1 code implementation • 15 Jan 2024 • Jakob Hackstein, Gencer Sumbul, Kai Norman Clasen, Begüm Demir
To this end, we present a systematic overview on the possible adaptations of the vanilla MAE to exploit masked image modeling on multi-sensor RS image archives (denoted as cross-sensor masked autoencoders [CSMAEs]) in the context of CBIR.
1 code implementation • 12 Jan 2024 • Fabian Jaensch, Giuseppe Caire, Begüm Demir
Over the last years, several works have explored the application of deep learning algorithms to determine the large-scale signal fading (also referred to as ``path loss'') between transmitter and receiver pairs in urban communication networks.
no code implementations • 10 Nov 2023 • Barış Büyüktaş, Gencer Sumbul, Begüm Demir
After presenting an extensive overview of the selected algorithms, a theoretical comparison of the algorithms is conducted based on their: 1) local training complexity; 2) aggregation complexity; 3) learning efficiency; 4) communication cost; and 5) scalability in terms of number of clients.
1 code implementation • 4 Jul 2023 • Michael Mommert, Nicolas Kesseli, Joëlle Hanna, Linus Scheibenreif, Damian Borth, Begüm Demir
Based on this dataset, we showcase the value of combining different data modalities for the downstream tasks of patch-based land-use/land-cover classification and land-use/land-cover segmentation.
no code implementations • 20 Jun 2023 • Julia Henkel, Genc Hoxha, Gencer Sumbul, Lars Möllenbrok, Begüm Demir
Unlike the existing AL methods for CBIR, at each AL iteration of ANNEAL a human expert is asked to annotate the most informative image pairs as similar/dissimilar.
no code implementations • 14 Jun 2023 • Gencer Sumbul, Begüm Demir
To address this issue, in this paper we propose a label noise robust IRL method that aims to prevent the interference of noisy labels on IRL, independently from the learning task being considered in RS.
no code implementations • 12 Jun 2023 • Lars Möllenbrok, Begüm Demir
In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images.
no code implementations • 2 Jun 2023 • David Hoffmann, Kai Norman Clasen, Begüm Demir
In this paper, we introduce a novel Synchronized Class Token Fusion (SCT Fusion) architecture in the framework of multi-modal multi-label classification (MLC) of remote sensing (RS) images.
no code implementations • 1 Jun 2023 • Barış Büyüktaş, Gencer Sumbul, Begüm Demir
The MF module performs iterative model averaging to learn without accessing data on clients in the case that clients are associated with different data modalities.
no code implementations • 1 Jun 2023 • Leonard Hackel, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir
Visual question answering (VQA) methods in remote sensing (RS) aim to answer natural language questions with respect to an RS image.
no code implementations • 1 Jun 2023 • Martin Hermann Paul Fuchs, Begüm Demir
The development of learning-based hyperspectral image compression methods has recently attracted great attention in remote sensing.
no code implementations • 15 May 2023 • Devis Tuia, Konrad Schindler, Begüm Demir, Xiao Xiang Zhu, Mrinalini Kochupillai, Sašo Džeroski, Jan N. van Rijn, Holger H. Hoos, Fabio Del Frate, Mihai Datcu, Volker Markl, Bertrand Le Saux, Rochelle Schneider, Gustau Camps-Valls
Earth observation (EO) is a prime instrument for monitoring land and ocean processes, studying the dynamics at work, and taking the pulse of our planet.
no code implementations • 15 May 2023 • Martin Hermann Paul Fuchs, Akshara Preethy Byju, Alisa Walda, Behnood Rasti, Begüm Demir
The development of deep learning-based models for the compression of hyperspectral images (HSIs) has recently attracted great attention in remote sensing due to the sharp growing of hyperspectral data archives.
no code implementations • 2 Dec 2022 • Lars Möllenbrok, Gencer Sumbul, Begüm Demir
Unlike the existing AL query functions (which are defined for single-label classification or semantic segmentation problems), each query function in this paper is based on the evaluation of two criteria: i) multi-label uncertainty; and ii) multi-label diversity.
1 code implementation • 2 Dec 2022 • Gencer Sumbul, Begüm Demir
Our approach aims to model the complementary characteristics of discriminative and generative reasoning for IRL under noisy labels.
no code implementations • 10 Oct 2022 • Tim Siebert, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir
To make the intrinsic information of each RS image easily accessible, visual question answering (VQA) has been introduced in RS.
no code implementations • 5 Oct 2022 • Tom-Lukas Breitkopf, Leonard W. Hackel, Mahdyar Ravanbakhsh, Anne-Karin Cooke, Sandra Willkommen, Stefan Broda, Begüm Demir
In this study, we introduce two DL-based models: i) improved U-Net architecture; and ii) Visual Transformer-based encoder-decoder in the framework of tile drainage pipe detection.
no code implementations • 23 Aug 2022 • Ahmet Kerem Aksoy, Pavel Dushev, Eleni Tzirita Zacharatou, Holmer Hemsen, Marcela Charfuelan, Jorge-Arnulfo Quiané-Ruiz, Begüm Demir, Volker Markl
To address this limitation, we have recently proposed MiLaN, a content-based image retrieval approach for fast similarity search in satellite image archives.
no code implementations • 28 Jul 2022 • Tom Burgert, Mahdyar Ravanbakhsh, Begüm Demir
In this paper, we investigate three different noise robust CV SLC methods and adapt them to be robust for multi-label noise scenarios in RS.
no code implementations • 19 Apr 2022 • Georgii Mikriukov, Mahdyar Ravanbakhsh, Begüm Demir
To address this problem, in this paper we introduce a novel unsupervised cross-modal contrastive hashing (DUCH) method for text-image retrieval in RS.
no code implementations • 10 Apr 2022 • Soronzonbold Otgonbaatar, Mihai Datcu, Begüm Demir
Moreover, we trained the SVM on the coreset data by using both a D-Wave QA and a conventional method.
1 code implementation • 26 Feb 2022 • Georgii Mikriukov, Mahdyar Ravanbakhsh, Begüm Demir
The proposed CHNR includes two training phases: i) meta-learning phase that uses a small portion of clean (i. e., reliable) data to train the noise detection module in an adversarial fashion; and ii) the main training phase for which the trained noise detection module is used to identify noisy correspondences while the hashing module is trained on the noisy multi-modal training set.
no code implementations • 23 Feb 2022 • Adina Zell, Gencer Sumbul, Begüm Demir
The proposed DML-S2R method aims to mitigate the problems of insufficient amount of labeled samples without collecting any additional sample with a target value.
no code implementations • 23 Feb 2022 • Gencer Sumbul, Markus Müller, Begüm Demir
Due to the availability of multi-modal remote sensing (RS) image archives, one of the most important research topics is the development of cross-modal RS image retrieval (CM-RSIR) methods that search semantically similar images across different modalities.
no code implementations • 20 Jan 2022 • Georgii Mikriukov, Mahdyar Ravanbakhsh, Begüm Demir
To address this problem, in this paper we introduce a novel deep unsupervised cross-modal contrastive hashing (DUCH) method for RS text-image retrieval.
no code implementations • 19 Jan 2022 • Steve Ahlswede, Nimisha Thekke-Madam, Christian Schulz, Birgit Kleinschmit, Begüm Demir
The collection of a high number of pixel-based labeled training samples for tree species identification is time consuming and costly in operational forestry applications.
no code implementations • 17 Jan 2022 • Gencer Sumbul, Jun Xiang, Nimisha Thekke Madam, Begüm Demir
We also introduce a two stage learning strategy with gradient manipulation techniques to obtain image representations that are compatible with both RS image indexing and compression.
no code implementations • 1 Jun 2021 • Gencer Sumbul, Begüm Demir
Unlike the other graph-based methods, the proposed method contains a novel learning strategy to train a deep neural network for automatically predicting a graph structure of each RS image in the archive.
no code implementations • 17 May 2021 • Gencer Sumbul, Arne de Wall, Tristan Kreuziger, Filipe Marcelino, Hugo Costa, Pedro Benevides, Mário Caetano, Begüm Demir, Volker Markl
In our experiments, we show the potential of BigEarthNet-MM for multi-modal multi-label image retrieval and classification problems by considering several state-of-the-art DL models.
1 code implementation • 8 May 2021 • Gencer Sumbul, Mahdyar Ravanbakhsh, Begüm Demir
The proposed method selects a small set of the most representative and informative triplets based on two main steps.
1 code implementation • 19 Dec 2020 • Ahmet Kerem Aksoy, Mahdyar Ravanbakhsh, Begüm Demir
To address this problem, the publicly available thematic products, which can include noisy labels, can be used to annotate RS images with zero-labeling cost.
no code implementations • 29 Sep 2020 • Hichame Yessou, Gencer Sumbul, Begüm Demir
This paper analyzes and compares different deep learning loss functions in the framework of multi-label remote sensing (RS) image scene classification problems.
no code implementations • 20 Jun 2020 • Akshara Preethy Byju, Gencer Sumbul, Begüm Demir, Lorenzo Bruzzone
This is achieved by taking codestreams associated with the coarsest resolution wavelet sub-band as input to approximate finer resolution sub-bands using a number of transposed convolutional layers.
no code implementations • 15 Jun 2020 • Gencer Sumbul, Sonali Nayak, Begüm Demir
The first step obtains the standard image captions by jointly exploiting convolutional neural networks (CNNs) with long short-term memory (LSTM) networks.
no code implementations • 3 Apr 2020 • Gencer Sumbul, Jian Kang, Begüm Demir
This chapter presents recent advances in content based image search and retrieval (CBIR) systems in remote sensing (RS) for fast and accurate information discovery from massive data archives.
no code implementations • 6 Mar 2020 • Jian Kang, Danfeng Hong, Jialin Liu, Gerald Baier, Naoto Yokoya, Begüm Demir
Interferometric phase restoration has been investigated for decades and most of the state-of-the-art methods have achieved promising performances for InSAR phase restoration.
no code implementations • 17 Jan 2020 • Gencer Sumbul, Jian Kang, Tristan Kreuziger, Filipe Marcelino, Hugo Costa, Pedro Benevides, Mario Caetano, Begüm Demir
This is achieved by interpreting and arranging the CLC Level-3 nomenclature based on the properties of Sentinel-2 images in a new nomenclature of 19 classes.
no code implementations • 12 Dec 2019 • Kexin Zhang, Gencer Sumbul, Begüm Demir
Then, we formulate the adversarial learning of the generator and discriminator networks as a min-max game.
1 code implementation • 2 Apr 2019 • Subhankar Roy, Enver Sangineto, Begüm Demir, Nicu Sebe
Hashing methods have been recently found very effective in retrieval of remote sensing (RS) images due to their computational efficiency and fast search speed.
no code implementations • 28 Feb 2019 • Gencer Sumbul, Begüm Demir
The first module aims to extract preliminary local descriptors of RS image bands that can be associated to different spatial resolutions.
no code implementations • 16 Feb 2019 • Gencer Sumbul, Marcela Charfuelan, Begüm Demir, Volker Markl
This paper presents the BigEarthNet that is a new large-scale multi-label Sentinel-2 benchmark archive.