Search Results for author: Raghavendra Selvan

Found 30 papers, 21 papers with code

Equity through Access: A Case for Small-scale Deep Learning

1 code implementation19 Mar 2024 Raghavendra Selvan, Bob Pepin, Christian Igel, Gabrielle Samuel, Erik B Dam

The recent advances in deep learning (DL) have been accelerated by access to large-scale data and compute.

Adversarial Fine-tuning of Compressed Neural Networks for Joint Improvement of Robustness and Efficiency

2 code implementations14 Mar 2024 Hallgrimur Thorsteinsson, Valdemar J Henriksen, Tong Chen, Raghavendra Selvan

We present experiments on two benchmark datasets showing that adversarial fine-tuning of compressed models can achieve robustness performance comparable to adversarially trained models, while also improving computational efficiency.

Adversarial Robustness Model Compression +2

CHILI: Chemically-Informed Large-scale Inorganic Nanomaterials Dataset for Advancing Graph Machine Learning

1 code implementation20 Feb 2024 Ulrik Friis-Jensen, Frederik L. Johansen, Andy S. Anker, Erik B. Dam, Kirsten M. Ø. Jensen, Raghavendra Selvan

We invite the graph ML community to address these open challenges by presenting two new chemically-informed large-scale inorganic (CHILI) nanomaterials datasets: A medium-scale dataset (with overall >6M nodes, >49M edges) of mono-metallic oxide nanomaterials generated from 12 selected crystal types (CHILI-3K) and a large-scale dataset (with overall >183M nodes, >1. 2B edges) of nanomaterials generated from experimentally determined crystal structures (CHILI-100K).

Atomic number classification Benchmarking +11

Is Adversarial Training with Compressed Datasets Effective?

1 code implementation8 Feb 2024 Tong Chen, Raghavendra Selvan

This synthetic dataset retains the essential information of the original dataset, enabling models trained on it to achieve performance levels comparable to those trained on the full dataset.

Adversarial Robustness Dataset Condensation

Activation Compression of Graph Neural Networks using Block-wise Quantization with Improved Variance Minimization

1 code implementation21 Sep 2023 Sebastian Eliassen, Raghavendra Selvan

Further, we present a correction to the assumptions on the distribution of intermediate activation maps in EXACT (assumed to be uniform) and show improved variance estimations of the quantization and dequantization steps.

Quantization

Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI

no code implementations5 Sep 2023 Dustin Wright, Christian Igel, Gabrielle Samuel, Raghavendra Selvan

The solution lionized by both industry and the ML community to improve the environmental sustainability of ML is to increase the efficiency with which ML systems operate in terms of both compute and energy consumption.

Operating critical machine learning models in resource constrained regimes

1 code implementation17 Mar 2023 Raghavendra Selvan, Julian Schön, Erik B Dam

The resource consumption of deep learning models in terms of amount of training data, compute and energy costs are known to be massive.

Explicit Temporal Embedding in Deep Generative Latent Models for Longitudinal Medical Image Synthesis

1 code implementation13 Jan 2023 Julian Schön, Raghavendra Selvan, Lotte Nygård, Ivan Richter Vogelius, Jens Petersen

This, in contrast to previous methods, allows us to synthesize continuous, smooth, and high-quality longitudinal volumetric data with limited supervision.

Disentanglement Image Generation

Efficient Self-Supervision using Patch-based Contrastive Learning for Histopathology Image Segmentation

1 code implementation23 Aug 2022 Nicklas Boserup, Raghavendra Selvan

Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext tasks.

Contrastive Learning Image Segmentation +2

Interpreting Latent Spaces of Generative Models for Medical Images using Unsupervised Methods

1 code implementation20 Jul 2022 Julian Schön, Raghavendra Selvan, Jens Petersen

The results show that unsupervised methods to discover interpretable directions in GANs generalize to VAEs and can be applied to medical images.

Identifying partial mouse brain microscopy images from Allen reference atlas using a contrastively learned semantic space

1 code implementation14 Sep 2021 Justinas Antanavicius, Roberto Leiras, Raghavendra Selvan

The correspondence between the partial mouse brain image and reference atlas plate is determined based on the distance between low dimensional embeddings of brain slices and atlas plates that are obtained from Siamese networks using contrastive learning.

Contrastive Learning

Segmenting two-dimensional structures with strided tensor networks

1 code implementation13 Feb 2021 Raghavendra Selvan, Erik B Dam, Jens Petersen

We use the matrix product state (MPS) tensor network on non-overlapping patches of a given input image to predict the segmentation mask by learning a pixel-wise linear classification rule in a high dimensional space.

Image Classification Image Segmentation +4

Dynamic $β$-VAEs for quantifying biodiversity by clustering optically recorded insect signals

1 code implementation10 Feb 2021 Klas Rydhmer, Raghavendra Selvan

While insects are the largest and most diverse group of terrestrial animals, constituting ca.

Clustering

Multi-layered tensor networks for image classification

1 code implementation13 Nov 2020 Raghavendra Selvan, Silas Ørting, Erik B Dam

The recently introduced locally orderless tensor network (LoTeNet) for supervised image classification uses matrix product state (MPS) operations on grids of transformed image patches.

Classification General Classification +2

Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models

1 code implementation6 Jul 2020 Lasse F. Wolff Anthony, Benjamin Kanding, Raghavendra Selvan

In this work, we present Carbontracker, a tool for tracking and predicting the energy and carbon footprint of training DL models.

Lung Segmentation from Chest X-rays using Variational Data Imputation

3 code implementations20 May 2020 Raghavendra Selvan, Erik B. Dam, Nicki S. Detlefsen, Sofus Rischel, Kaining Sheng, Mads Nielsen, Akshay Pai

Pulmonary opacification is the inflammation in the lungs caused by many respiratory ailments, including the novel corona virus disease 2019 (COVID-19).

Data Augmentation Image Segmentation +2

Tensor Networks for Medical Image Classification

2 code implementations MIDL 2019 Raghavendra Selvan, Erik B. Dam

With the increasing adoption of machine learning tools like neural networks across several domains, interesting connections and comparisons to concepts from other domains are coming to light.

BIG-bench Machine Learning General Classification +3

A joint 3D UNet-Graph Neural Network-based method for Airway Segmentation from chest CTs

no code implementations22 Aug 2019 Antonio Garcia-Uceda Juarez, Raghavendra Selvan, Zaigham Saghir, Marleen de Bruijne

In this approach, the convolutional layers at the deepest level of the UNet are replaced by a GNN-based module with a series of graph convolutions.

3D Medical Imaging Segmentation

Segmentation of Roots in Soil with U-Net

1 code implementation28 Feb 2019 Abraham George Smith, Jens Petersen, Raghavendra Selvan, Camilla Ruø Rasmussen

We evaluate our system using 867 images for which we have obtained line-intersect counts, attaining a Spearman rank correlation of 0. 9748 and an $r^2$ of 0. 9217.

Image Segmentation Segmentation +1

Graph Refinement based Airway Extraction using Mean-Field Networks and Graph Neural Networks

1 code implementation21 Nov 2018 Raghavendra Selvan, Thomas Kipf, Max Welling, Antonio Garcia-Uceda Juarez, Jesper H. Pedersen, Jens Petersen, Marleen de Bruijne

Graph refinement, or the task of obtaining subgraphs of interest from over-complete graphs, can have many varied applications.

Extracting Tree-structures in CT data by Tracking Multiple Statistically Ranked Hypotheses

no code implementations23 Jun 2018 Raghavendra Selvan, Jens Petersen, Jesper H. Pedersen, Marleen de Bruijne

We propose to use statistical ranking of local hypotheses in constructing the MHT tree, which yields a probabilistic interpretation of scores across scales and helps alleviate the scale-dependence of MHT parameters.

Segmentation

Extraction of Airways using Graph Neural Networks

no code implementations12 Apr 2018 Raghavendra Selvan, Thomas Kipf, Max Welling, Jesper H. Pedersen, Jens Petersen, Marleen de Bruijne

We present extraction of tree structures, such as airways, from image data as a graph refinement task.

Mean Field Network based Graph Refinement with application to Airway Tree Extraction

no code implementations10 Apr 2018 Raghavendra Selvan, Max Welling, Jesper H. Pedersen, Jens Petersen, Marleen de Bruijne

Performance of the method is compared with two methods: the first uses probability images from a trained voxel classifier with region growing, which is similar to one of the best performing methods at EXACT'09 airway challenge, and the second method is based on Bayesian smoothing on these probability images.

Bayesian Inference

Extraction of Airways with Probabilistic State-space Models and Bayesian Smoothing

no code implementations7 Aug 2017 Raghavendra Selvan, Jens Petersen, Jesper H. Pedersen, Marleen de Bruijne

The evolution of individual branches is modelled using a process model and the observed data is incorporated into the update step of the Bayesian smoother using a measurement model that is based on a multi-scale blob detector.

Extraction of airway trees using multiple hypothesis tracking and template matching

no code implementations24 Nov 2016 Raghavendra Selvan, Jens Petersen, Jesper H. Pedersen, Marleen de Bruijne

The results show improvements in performance when compared to the original method and region growing on intensity images.

Template Matching

Cannot find the paper you are looking for? You can Submit a new open access paper.