On Training Sample Memorization: Lessons from Benchmarking Generative Modeling with a Large-scale Competition

1 code implementation • 6 Jun 2021 • Ching-Yuan Bai, Hsuan-Tien Lin, Colin Raffel, Wendy Chih-wen Kan

Many recent developments on generative models for natural images have relied on heuristically-motivated metrics that can be easily gamed by memorizing a small sample from the true distribution or training a model directly to improve the metric.

Benchmarking Memorization