Search Results for author: Tianshuo Xu

Found 3 papers, 1 papers with code

Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon

no code implementations14 Mar 2024 Tianshuo Xu, Peng Mi, Ruilin Wang, Yingcong Chen

In this paper, we start with a consistency phenomenon of DMs: we observe that DMs with different initializations or even different architectures can produce very similar outputs given the same noise inputs, which is rare in other generative models.

Attribute

Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer

1 code implementation30 Jun 2023 Peng Mi, Li Shen, Tianhe Ren, Yiyi Zhou, Tianshuo Xu, Xiaoshuai Sun, Tongliang Liu, Rongrong Ji, DaCheng Tao

Sharpness-Aware Minimization (SAM) is a popular solution that smooths the loss landscape by minimizing the maximized change of training loss when adding a perturbation to the weight.

Cannot find the paper you are looking for? You can Submit a new open access paper.