1 code implementation • 7 Feb 2024 • Eric J. Michaud, Isaac Liao, Vedang Lad, Ziming Liu, Anish Mudide, Chloe Loughridge, Zifan Carl Guo, Tara Rezaei Kheirkhah, Mateja Vukelić, Max Tegmark
We present MIPS, a novel method for program synthesis based on automated mechanistic interpretability of neural networks trained to perform the desired task, auto-distilling the learned algorithm into Python code.
no code implementations • 5 Dec 2023 • Isaac Liao, Ziming Liu, Max Tegmark
The hypernetwork is carefully designed such that it can control network complexity, leading to a diverse family of interpretable algorithms ranked by their complexity.
no code implementations • 11 Oct 2022 • Isaac Liao, Rumen R. Dangovski, Jakob N. Foerster, Marin Soljačić
This paper introduces a novel machine learning optimizer called LODO, which tries to online meta-learn the best preconditioner during optimization.