Search Results for author: John Guttag

Found 37 papers, 20 papers with code

ScribblePrompt: Fast and Flexible Interactive Segmentation for Any Biomedical Image

1 code implementation12 Dec 2023 Hallee E. Wong, Marianne Rakic, John Guttag, Adrian V. Dalca

These include a training strategy that incorporates both a highly diverse set of images and tasks, novel algorithms for simulated user interactions and labels, and a network that enables fast inference.

Image Segmentation Interactive Segmentation +3

GIST: Generating Image-Specific Text for Fine-grained Object Classification

1 code implementation21 Jul 2023 Kathleen M. Lewis, Emily Mu, Adrian V. Dalca, John Guttag

We demonstrate the utility of GIST by fine-tuning vision-language models on the image-and-generated-text pairs to learn an aligned vision-language representation space for improved classification.

Fine-Grained Image Classification Image-text Classification +4

Sequential Multi-Dimensional Self-Supervised Learning for Clinical Time Series

no code implementations20 Jul 2023 Aniruddh Raghu, Payal Chandak, Ridwan Alam, John Guttag, Collin M. Stultz

However, most existing SSL methods for clinical time series are limited in that they are designed for unimodal time series, such as a sequence of structured features (e. g., lab values and vitals signs) or an individual high-dimensional physiological signal (e. g., an electrocardiogram).

Self-Supervised Learning Time Series

Multi-Similarity Contrastive Learning

no code implementations6 Jul 2023 Emily Mu, John Guttag, Maggie Makar

Given a similarity metric, contrastive methods learn a representation in which examples that are similar are pushed together and examples that are dissimilar are pulled apart.

Caption Generation Contrastive Learning +2

Coarse race data conceals disparities in clinical risk score performance

1 code implementation18 Apr 2023 Rajiv Movva, Divya Shanmugam, Kaihua Hou, Priya Pathak, John Guttag, Nikhil Garg, Emma Pierson

Across outcomes and metrics, we show that the risk scores exhibit significant granular performance disparities within coarse race groups.

Magnitude Invariant Parametrizations Improve Hypernetwork Learning

1 code implementation15 Apr 2023 Jose Javier Gonzalez Ortiz, John Guttag, Adrian Dalca

In this work, we identify a fundamental and previously unidentified problem that contributes to the challenge of training hypernetworks: a magnitude proportionality between the inputs and outputs of the hypernetwork.

Image Generation Multi-Task Learning

Scale-Space Hypernetworks for Efficient Biomedical Imaging

no code implementations11 Apr 2023 Jose Javier Gonzalez Ortiz, John Guttag, Adrian Dalca

We find that SSHN consistently provides a better accuracy-efficiency trade-off at a fraction of the training cost.

Computational Efficiency Image Segmentation +1

Improved Text Classification via Test-Time Augmentation

no code implementations27 Jun 2022 Helen Lu, Divya Shanmugam, Harini Suresh, John Guttag

Test-time augmentation -- the aggregation of predictions across transformed examples of test inputs -- is an established technique to improve the performance of image classification models.

Binary Classification Image Classification +2

Data Augmentation for Electrocardiograms

1 code implementation9 Apr 2022 Aniruddh Raghu, Divya Shanmugam, Eugene Pomerantsev, John Guttag, Collin M. Stultz

In experiments, considering three datasets and eight predictive tasks, we find that TaskAug is competitive with or improves on prior work, and the learned policies shed light on what transformations are most effective for different tasks.

Data Augmentation

Learning the Effect of Registration Hyperparameters with HyperMorph

no code implementations30 Mar 2022 Andrew Hoopes, Malte Hoffmann, Douglas N. Greve, Bruce Fischl, John Guttag, Adrian V. Dalca

We design a meta network, or hypernetwork, that predicts the parameters of a registration network for input hyperparameters, thereby comprising a single model that generates the optimal deformation field corresponding to given hyperparameter values.

Image Registration

Multiplying Matrices Without Multiplying

3 code implementations21 Jun 2021 Davis Blalock, John Guttag

Multiplying matrices is among the most fundamental and compute-intensive operations in machine learning.

Learning to Predict with Supporting Evidence: Applications to Clinical Risk Prediction

1 code implementation4 Mar 2021 Aniruddh Raghu, John Guttag, Katherine Young, Eugene Pomerantsev, Adrian V. Dalca, Collin M. Stultz

Inference of latent variables in this model corresponds to both making a prediction and providing supporting evidence for that prediction.

HyperMorph: Amortized Hyperparameter Learning for Image Registration

1 code implementation4 Jan 2021 Andrew Hoopes, Malte Hoffmann, Bruce Fischl, John Guttag, Adrian V. Dalca

We present HyperMorph, a learning-based strategy for deformable image registration that removes the need to tune important registration hyperparameters during training.

Image Registration

Exploiting structured data for learning contagious diseases under incomplete testing

no code implementations1 Jan 2021 Maggie Makar, Lauren West, David Hooper, Eric Horvitz, Erica Shenoy, John Guttag

In this work we ask: can we build reliable infection prediction models when the observed data is collected under limited, and biased testing that prioritizes testing symptomatic individuals?

Better Aggregation in Test-Time Augmentation

no code implementations ICCV 2021 Divya Shanmugam, Davis Blalock, Guha Balakrishnan, John Guttag

In this paper, we present 1) experimental analyses that shed light on cases in which the simple average is suboptimal and 2) a method to address these shortcomings.

Image Classification

Unsupervised Domain Adaptation in the Absence of Source Data

no code implementations20 Jul 2020 Roshni Sahoo, Divya Shanmugam, John Guttag

Current unsupervised domain adaptation methods can address many types of distribution shift, but they assume data from the source domain is freely available.

Unsupervised Domain Adaptation

What is the State of Neural Network Pruning?

1 code implementation6 Mar 2020 Davis Blalock, Jose Javier Gonzalez Ortiz, Jonathan Frankle, John Guttag

Neural network pruning---the task of reducing the size of a network by removing parameters---has been the subject of a great deal of work in recent years.

Network Pruning

Estimation of Bounds on Potential Outcomes For Decision Making

no code implementations ICML 2020 Maggie Makar, Fredrik D. Johansson, John Guttag, David Sontag

Estimation of individual treatment effects is commonly used as the basis for contextual decision making in fields such as healthcare, education, and economics.

Decision Making

Learning Conditional Deformable Templates with Convolutional Networks

1 code implementation NeurIPS 2019 Adrian V. Dalca, Marianne Rakic, John Guttag, Mert R. Sabuncu

We develop a learning framework for building deformable templates, which play a fundamental role in many image analysis and computational anatomy tasks.

Anatomy Deformable Medical Image Registration +1

Unsupervised Data Imputation via Variational Inference of Deep Subspaces

6 code implementations8 Mar 2019 Adrian V. Dalca, John Guttag, Mert R. Sabuncu

In this work, we introduce a general probabilistic model that describes sparse high dimensional imaging data as being generated by a deep non-linear embedding.

Imputation Variational Inference

Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces

1 code implementation8 Mar 2019 Adrian V. Dalca, Guha Balakrishnan, John Guttag, Mert R. Sabuncu

We present a probabilistic generative model and derive an unsupervised learning-based inference algorithm that uses insights from classical registration methods and makes use of recent developments in convolutional neural networks (CNNs).

Constrained Diffeomorphic Image Registration Deformable Medical Image Registration +2

Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation

2 code implementations CVPR 2018 Adrian V. Dalca, John Guttag, Mert R. Sabuncu

The integration of anatomical priors can facilitate CNN-based anatomical segmentation in a range of novel clinical problems, where few or no annotations are available and thus standard networks are not trainable.

MRI segmentation Segmentation

Fast Learning-based Registration of Sparse 3D Clinical Images

no code implementations17 Dec 2018 Kathleen M. Lewis, Natalia S. Rost, John Guttag, Adrian V. Dalca

We present a learning-based registration method, SparseVM, that is more accurate and orders of magnitude faster than the most accurate clinical registration methods.

Image Registration Registration Of Sparse Clinical Images

Multiple Instance Learning for ECG Risk Stratification

no code implementations2 Dec 2018 Divya Shanmugam, Davis Blalock, John Guttag

We focus on estimating a patient's risk of cardiovascular death after an acute coronary syndrome based on a patient's raw electrocardiogram (ECG) signal.

Ecg Risk Stratification Multiple Instance Learning

VoxelMorph: A Learning Framework for Deformable Medical Image Registration

6 code implementations14 Sep 2018 Guha Balakrishnan, Amy Zhao, Mert R. Sabuncu, John Guttag, Adrian V. Dalca

In contrast to this approach, and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images.

Deformable Medical Image Registration Diffeomorphic Medical Image Registration +1

Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICU

1 code implementation7 Jun 2018 Harini Suresh, Jen J. Gong, John Guttag

In this work, we present a two-step framework to 1) learn relevant patient subgroups, and 2) predict an outcome for separate patient populations in a multi-task framework, where each population is a separate task.

Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration

2 code implementations11 May 2018 Adrian V. Dalca, Guha Balakrishnan, John Guttag, Mert R. Sabuncu

We demonstrate our method on a 3D brain registration task, and provide an empirical analysis of the algorithm.

Synthesizing Images of Humans in Unseen Poses

1 code implementation CVPR 2018 Guha Balakrishnan, Amy Zhao, Adrian V. Dalca, Fredo Durand, John Guttag

Given an image of a person and a desired pose, we produce a depiction of that person in that pose, retaining the appearance of both the person and background.

Image Generation

A Video-Based Method for Objectively Rating Ataxia

no code implementations13 Dec 2016 Ronnachai Jaroensri, Amy Zhao, Guha Balakrishnan, Derek Lo, Jeremy Schmahmann, John Guttag, Fredo Durand

The performance of our system is comparable to that of a group of ataxia specialists in terms of mean error and correlation, and our system's predictions were consistently within the range of inter-rater variability.

Optical Flow Estimation Pose Estimation

Detecting Pulse from Head Motions in Video

no code implementations CVPR 2013 Guha Balakrishnan, Fredo Durand, John Guttag

We extract heart rate and beat lengths from videos by measuring subtle head motion caused by the Newtonian reaction to the influx of blood at each beat.

Heart Rate Variability

Cannot find the paper you are looking for? You can Submit a new open access paper.