Search Results for author: Marcus A. Brubaker

Found 30 papers, 14 papers with code

PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesis

no code implementations28 Feb 2024 Jason J. Yu, Tristan Aumentado-Armstrong, Fereshteh Forghani, Konstantinos G. Derpanis, Marcus A. Brubaker

This paper considers the problem of generative novel view synthesis (GNVS), generating novel, plausible views of a scene given a limited number of known views.

Novel View Synthesis

Reconstructive Latent-Space Neural Radiance Fields for Efficient 3D Scene Representations

no code implementations27 Oct 2023 Tristan Aumentado-Armstrong, Ashkan Mirzaei, Marcus A. Brubaker, Jonathan Kelly, Alex Levinshtein, Konstantinos G. Derpanis, Igor Gilitschenski

The resulting latent-space NeRF can produce novel views with higher quality than standard colour-space NeRFs, as the AE can correct certain visual artifacts, while rendering over three times faster.

Continual Learning Novel View Synthesis

Dual-Camera Joint Deblurring-Denoising

no code implementations16 Sep 2023 Shayan shekarforoush, Amanpreet Walia, Marcus A. Brubaker, Konstantinos G. Derpanis, Alex Levinshtein

Recent image enhancement methods have shown the advantages of using a pair of long and short-exposure images for low-light photography.

Deblurring Denoising +1

Watch Your Steps: Local Image and Scene Editing by Text Instructions

no code implementations17 Aug 2023 Ashkan Mirzaei, Tristan Aumentado-Armstrong, Marcus A. Brubaker, Jonathan Kelly, Alex Levinshtein, Konstantinos G. Derpanis, Igor Gilitschenski

A field is trained on relevance maps of training views, denoted as the relevance field, defining the 3D region within which modifications should be made.

Denoising Image Generation

Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models

1 code implementation ICCV 2023 Jason J. Yu, Fereshteh Forghani, Konstantinos G. Derpanis, Marcus A. Brubaker

In this paper, we propose a novel generative model capable of producing a sequence of photorealistic images consistent with a specified camera trajectory, and a single starting image.

Novel View Synthesis

Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata

1 code implementation CVPR 2022 Seonghyeon Nam, Abhijith Punnappurath, Marcus A. Brubaker, Michael S. Brown

Our experiments show that our learned sampling can adapt to the image content to produce better raw reconstructions than existing methods.

Raw reconstruction

Noise2NoiseFlow: Realistic Camera Noise Modeling without Clean Images

1 code implementation CVPR 2022 Ali Maleky, Shayan Kousha, Michael S. Brown, Marcus A. Brubaker

This paper proposes a framework for training a noise model and a denoiser simultaneously while relying only on pairs of noisy images rather than noisy/clean paired image data.

Denoising Density Estimation

Modeling sRGB Camera Noise with Normalizing Flows

no code implementations CVPR 2022 Shayan Kousha, Ali Maleky, Michael S. Brown, Marcus A. Brubaker

The nonlinear steps on the ISP culminate in a significantly more complex noise distribution in the sRGB domain and existing raw-domain noise models are unable to capture the sRGB noise distribution.

Denoising

Residual Multiplicative Filter Networks for Multiscale Reconstruction

1 code implementation1 Jun 2022 Shayan shekarforoush, David B. Lindell, David J. Fleet, Marcus A. Brubaker

Coordinate networks like Multiplicative Filter Networks (MFNs) and BACON offer some control over the frequency spectrum used to represent continuous signals such as images or 3D volumes.

Auto White-Balance Correction for Mixed-Illuminant Scenes

1 code implementation17 Sep 2021 Mahmoud Afifi, Marcus A. Brubaker, Michael S. Brown

Auto white balance (AWB) is applied by camera hardware at capture time to remove the color cast caused by the scene illumination.

Neural Image Representations for Multi-Image Fusion and Layer Separation

no code implementations2 Aug 2021 Seonghyeon Nam, Marcus A. Brubaker, Michael S. Brown

We propose a framework for aligning and fusing multiple images into a single view using neural image representations (NIRs), also known as implicit or coordinate-based neural representations.

Optical Flow Estimation

Zero-shot Learning with Class Description Regularization

1 code implementation30 Jun 2021 Shayan Kousha, Marcus A. Brubaker

The purpose of generative Zero-shot learning (ZSL) is to learning from seen classes, transfer the learned knowledge, and create samples of unseen classes from the description of these unseen categories.

Attribute Zero-Shot Learning

Continuous Latent Process Flows

1 code implementation NeurIPS 2021 Ruizhi Deng, Marcus A. Brubaker, Greg Mori, Andreas M. Lehrmann

Partial observations of continuous time-series dynamics at arbitrary time stamps exist in many disciplines.

Time Series Time Series Analysis

CAMS: Color-Aware Multi-Style Transfer

1 code implementation26 Jun 2021 Mahmoud Afifi, Abdullah Abuolaim, Mostafa Hussien, Marcus A. Brubaker, Michael S. Brown

A nice feature of our method is that it enables the users to manually select the color associations between the target style and content image for more transfer flexibility.

Style Transfer

HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms

1 code implementation CVPR 2021 Mahmoud Afifi, Marcus A. Brubaker, Michael S. Brown

This goal has led to significant interest in methods that can intuitively control the appearance of images generated by GANs.

Image Generation

Wavelet Flow: Fast Training of High Resolution Normalizing Flows

1 code implementation NeurIPS 2020 Jason J. Yu, Konstantinos G. Derpanis, Marcus A. Brubaker

Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images.

Super-Resolution Vocal Bursts Intensity Prediction

Modeling Continuous Stochastic Processes with Dynamic Normalizing Flows

1 code implementation NeurIPS 2020 Ruizhi Deng, Bo Chang, Marcus A. Brubaker, Greg Mori, Andreas Lehrmann

Normalizing flows transform a simple base distribution into a complex target distribution and have proved to be powerful models for data generation and density estimation.

Density Estimation Irregular Time Series +2

Variational Hyper RNN for Sequence Modeling

no code implementations24 Feb 2020 Ruizhi Deng, Yanshuai Cao, Bo Chang, Leonid Sigal, Greg Mori, Marcus A. Brubaker

In this work, we propose a novel probabilistic sequence model that excels at capturing high variability in time series data, both across sequences and within an individual sequence.

Time Series Time Series Analysis

Normalizing Flows: An Introduction and Review of Current Methods

2 code implementations25 Aug 2019 Ivan Kobyzev, Simon J. D. Prince, Marcus A. Brubaker

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact.

Walking on Thin Air: Environment-Free Physics-based Markerless Motion Capture

no code implementations4 Dec 2018 Micha Livne, Leonid Sigal, Marcus A. Brubaker, David J. Fleet

To our knowledge, this is the first approach to take physics into account without explicit {\em a priori} knowledge of the environment or body dimensions.

Markerless Motion Capture

Two-Stream Convolutional Networks for Dynamic Texture Synthesis

1 code implementation CVPR 2018 Matthew Tesfaldet, Marcus A. Brubaker, Konstantinos G. Derpanis

Given an input dynamic texture, statistics of filter responses from the object recognition ConvNet encapsulate the per-frame appearance of the input texture, while statistics of filter responses from the optical flow ConvNet model its dynamics.

Object Recognition Optical Flow Estimation +3

Find your Way by Observing the Sun and Other Semantic Cues

no code implementations23 Jun 2016 Wei-Chiu Ma, Shenlong Wang, Marcus A. Brubaker, Sanja Fidler, Raquel Urtasun

In this paper we present a robust, efficient and affordable approach to self-localization which does not require neither GPS nor knowledge about the appearance of the world.

Building Proteins in a Day: Efficient 3D Molecular Reconstruction

no code implementations CVPR 2015 Marcus A. Brubaker, Ali Punjani, David J. Fleet

A new framework for estimation is introduced which relies on modern stochastic optimization techniques to scale to large datasets.

3D Reconstruction Stochastic Optimization

Efficient Optimization for Sparse Gaussian Process Regression

no code implementations NeurIPS 2013 Yanshuai Cao, Marcus A. Brubaker, David J. Fleet, Aaron Hertzmann

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression.

regression

Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization

no code implementations CVPR 2013 Marcus A. Brubaker, Andreas Geiger, Raquel Urtasun

In this paper we propose an affordable solution to selflocalization, which utilizes visual odometry and road maps as the only inputs.

Visual Odometry

Cannot find the paper you are looking for? You can Submit a new open access paper.