Search Results for author: Samuel Klein

Found 11 papers, 7 papers with code

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

1 code implementation24 Jan 2024 Lukas Heinrich, Tobias Golling, Michael Kagan, Samuel Klein, Matthew Leigh, Margarita Osadchy, John Andrew Raine

We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data.

Self-Supervised Learning

Improving new physics searches with diffusion models for event observables and jet constituents

no code implementations15 Dec 2023 Debajyoti Sengupta, Matthew Leigh, John Andrew Raine, Samuel Klein, Tobias Golling

We introduce a new technique called Drapes to enhance the sensitivity in searches for new physics at the LHC.

Flows for Flows: Morphing one Dataset into another with Maximum Likelihood Estimation

no code implementations12 Sep 2023 Tobias Golling, Samuel Klein, Radha Mastandrea, Benjamin Nachman, John Andrew Raine

We propose a protocol called flows for flows for training normalizing flows to morph one dataset into another even if the underlying probability density of neither dataset is known explicitly.

MORPH

Multimodal Neurons in Pretrained Text-Only Transformers

no code implementations3 Aug 2023 Sarah Schwettmann, Neil Chowdhury, Samuel Klein, David Bau, Antonio Torralba

Language models demonstrate remarkable capacity to generalize representations learned in one modality to downstream tasks in other modalities.

Image Captioning

CURTAINs Flows For Flows: Constructing Unobserved Regions with Maximum Likelihood Estimation

no code implementations8 May 2023 Debajyoti Sengupta, Samuel Klein, John Andrew Raine, Tobias Golling

Model independent techniques for constructing background data templates using generative models have shown great promise for use in searches for new physics processes at the LHC.

Anomaly Detection

Decorrelation with conditional normalizing flows

1 code implementation4 Nov 2022 Samuel Klein, Tobias Golling

The sensitivity of many physics analyses can be enhanced by constructing discriminants that preferentially select signal events.

Flows for Flows: Training Normalizing Flows Between Arbitrary Distributions with Maximum Likelihood Estimation

1 code implementation4 Nov 2022 Samuel Klein, John Andrew Raine, Tobias Golling

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian.

Flowification: Everything is a Normalizing Flow

1 code implementation30 May 2022 Bálint Máté, Samuel Klein, Tobias Golling, François Fleuret

On the other hand, neural networks only perform a forward pass on the input, there is neither a notion of an inverse of a neural network nor is there one of its likelihood contribution.

Density Estimation

Funnels: Exact maximum likelihood with dimensionality reduction

1 code implementation15 Dec 2021 Samuel Klein, John A. Raine, Sebastian Pina-Otey, Slava Voloshynovskiy, Tobias Golling

Normalizing flows are diffeomorphic, typically dimension-preserving, models trained using the likelihood of the model.

Dimensionality Reduction

Toward a Visual Concept Vocabulary for GAN Latent Space

1 code implementation ICCV 2021 Sarah Schwettmann, Evan Hernandez, David Bau, Samuel Klein, Jacob Andreas, Antonio Torralba

A large body of recent work has identified transformations in the latent spaces of generative adversarial networks (GANs) that consistently and interpretably transform generated images.

Disentanglement

Cannot find the paper you are looking for? You can Submit a new open access paper.