Search Results for author: Lachlan Ewen MacDonald

Found 5 papers, 1 papers with code

D'OH: Decoder-Only random Hypernetworks for Implicit Neural Representations

no code implementations28 Mar 2024 Cameron Gordon, Lachlan Ewen MacDonald, Hemanth Saratchandran, Simon Lucey

We instead present a strategy for the initialization of run-time deep implicit functions for single-instance signals through a Decoder-Only randomly projected Hypernetwork (D'OH).

Neural Architecture Search

On progressive sharpening, flat minima and generalisation

no code implementations24 May 2023 Lachlan Ewen MacDonald, Jack Valmadre, Simon Lucey

We present a new approach to understanding the relationship between loss curvature and input-output model behaviour in deep learning.

On skip connections and normalisation layers in deep optimisation

no code implementations NeurIPS 2023 Lachlan Ewen MacDonald, Jack Valmadre, Hemanth Saratchandran, Simon Lucey

We introduce a general theoretical framework, designed for the study of gradient optimisation of deep neural networks, that encompasses ubiquitous architecture choices including batch normalisation, weight normalisation and skip connections.

Enabling equivariance for arbitrary Lie groups

1 code implementation CVPR 2022 Lachlan Ewen MacDonald, Sameera Ramasinghe, Simon Lucey

Our framework enables the implementation of group convolutions over any finite-dimensional Lie group.

Cannot find the paper you are looking for? You can Submit a new open access paper.