Search Results for author: Sihwan Park

Found 2 papers, 0 papers with code

Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel

no code implementations30 Sep 2022 Sungyub Kim, Sihwan Park, KyungSu Kim, Eunho Yang

Explaining generalizations and preventing over-confident predictions are central goals of studies on the loss landscape of neural networks.

Generalization Bounds

Bias Decay Matters : Improving Large Batch Optimization with Connectivity Sharpness

no code implementations29 Sep 2021 Sungyub Kim, Sihwan Park, Yong-Deok Kim, Eunho Yang

To mitigate this issue, we propose simple bias decay methods including a novel adaptive one and found that this simple remedy can fill a large portion of the performance gaps that occur in large batch optimization.

Cannot find the paper you are looking for? You can Submit a new open access paper.