no code implementations • 16 Jun 2023 • Changhao Wu, Shenan Zhang, Fangsong Long, Ziliang Yin, Tuo Leng
The relaxed kernel orthogonality achieves enhanced performance on models with increased capacity, shedding light on the burden of strict kernel orthogonality on deep model performance.
