Search Results for author:
Found 3 papers, 1 papers with code
Orthogonalising gradients to speed up neural network optimisation
The optimisation of neural networks can be sped up by orthogonalising the gradients before the optimisation step, ensuring the diversification of the learned representations.
Orthogonalising gradients to speedup neural network optimisation
The optimisation of neural networks can be sped up by orthogonalising the gradients before the optimisation step, ensuring the diversification of the learned representations.
Quasi-Newton's method in the class gradient defined high-curvature subspace
Classification problems using deep learning have been shown to have a high-curvature subspace in the loss landscape equal in dimension to the number of classes.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
