Search Results for author: Isaac Liao

Found 3 papers, 1 papers with code

Opening the AI black box: program synthesis via mechanistic interpretability

1 code implementation7 Feb 2024 Eric J. Michaud, Isaac Liao, Vedang Lad, Ziming Liu, Anish Mudide, Chloe Loughridge, Zifan Carl Guo, Tara Rezaei Kheirkhah, Mateja Vukelić, Max Tegmark

We present MIPS, a novel method for program synthesis based on automated mechanistic interpretability of neural networks trained to perform the desired task, auto-distilling the learned algorithm into Python code.

Program Synthesis Symbolic Regression

Generating Interpretable Networks using Hypernetworks

no code implementations5 Dec 2023 Isaac Liao, Ziming Liu, Max Tegmark

The hypernetwork is carefully designed such that it can control network complexity, leading to a diverse family of interpretable algorithms ranked by their complexity.

Systematic Generalization

Learning to Optimize Quasi-Newton Methods

no code implementations11 Oct 2022 Isaac Liao, Rumen R. Dangovski, Jakob N. Foerster, Marin Soljačić

This paper introduces a novel machine learning optimizer called LODO, which tries to online meta-learn the best preconditioner during optimization.

Cannot find the paper you are looking for? You can Submit a new open access paper.