Search Results for author: Qunli Li

Found 1 papers, 0 papers with code

Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance

no code implementations17 Jul 2024 Haiquan Lu, Xiaotian Liu, Yefan Zhou, Qunli Li, Kurt Keutzer, Michael W. Mahoney, Yujun Yan, Huanrui Yang, Yaoqing Yang

We discover a trade-off between sharpness and diversity: minimizing the sharpness in the loss landscape tends to diminish the diversity of individual members within the ensemble, adversely affecting the ensemble's improvement.

Diversity

Cannot find the paper you are looking for? You can Submit a new open access paper.