Private Matrix Approximation and Geometry of Unitary Orbits

no code implementations • 6 Jul 2022 • Oren Mangoubi, Yikai Wu, Satyen Kale, Abhradeep Guha Thakurta, Nisheeth K. Vishnoi

Consider the following optimization problem: Given $n \times n$ matrices $A$ and $\Lambda$, maximize $\langle A, U\Lambda U^*\rangle$ where $U$ varies over the unitary group $\mathrm{U}(n)$.

Dissecting Hessian: Understanding Common Structure of Hessian in Neural Networks

no code implementations • 8 Oct 2020 • Yikai Wu, Xingyu Zhu, Chenwei Wu, Annie Wang, Rong Ge

We can analyze the properties of these smaller matrices and prove the structure of top eigenspace random 2-layer networks.

Generalization Bounds