Search Results for author: Ashwini Pokle

Found 8 papers, 3 papers with code

One-Step Diffusion Distillation via Deep Equilibrium Models

1 code implementation NeurIPS 2023 Zhengyang Geng, Ashwini Pokle, J. Zico Kolter

We demonstrate that the DEQ architecture is crucial to this capability, as GET matches a $5\times$ larger ViT in terms of FID scores while striking a critical balance of computational cost and image quality.

Deep Equilibrium Based Neural Operators for Steady-State PDEs

no code implementations NeurIPS 2023 Tanya Marwah, Ashwini Pokle, J. Zico Kolter, Zachary C. Lipton, Jianfeng Lu, Andrej Risteski

Motivated by this observation, we propose FNO-DEQ, a deep equilibrium variant of the FNO architecture that directly solves for the solution of a steady-state PDE as the infinite-depth fixed point of an implicit operator layer using a black-box root solver and differentiates analytically through this fixed point resulting in $\mathcal{O}(1)$ training memory.

Training-free Linear Image Inverses via Flows

no code implementations25 Sep 2023 Ashwini Pokle, Matthew J. Muckley, Ricky T. Q. Chen, Brian Karrer

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model.

Path Independent Equilibrium Models Can Better Exploit Test-Time Computation

no code implementations18 Nov 2022 Cem Anil, Ashwini Pokle, Kaiqu Liang, Johannes Treutlein, Yuhuai Wu, Shaojie Bai, Zico Kolter, Roger Grosse

Designing networks capable of attaining better performance with an increased inference budget is important to facilitate generalization to harder problem instances.

Deep Equilibrium Approaches to Diffusion Models

1 code implementation23 Oct 2022 Ashwini Pokle, Zhengyang Geng, Zico Kolter

In this paper, we look at diffusion models through a different perspective, that of a (deep) equilibrium (DEQ) fixed point model.

Denoising

Contrasting the landscape of contrastive and non-contrastive learning

1 code implementation29 Mar 2022 Ashwini Pokle, Jinjin Tian, Yuchen Li, Andrej Risteski

Some recent works however have shown promising results for non-contrastive learning, which does not require negative samples.

Contrastive Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.