AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functions

no code implementations • 13 Dec 2023 • Esteban Real, Yao Chen, Mirko Rossini, Connal de Souza, Manav Garg, Akhil Verghese, Moritz Firsching, Quoc V. Le, Ekin Dogus Cubuk, David H. Park

Computers calculate transcendental functions by approximating them through the composition of a few limited-precision instructions.

Unified Functional Hashing in Automatic Machine Learning

1 code implementation • 10 Feb 2023 • Ryan Gillard, Stephen Jonany, Yingjie Miao, Michael Munn, Connal de Souza, Jonathan Dungay, Chen Liang, David R. So, Quoc V. Le, Esteban Real

In this paper, we show that large efficiency gains can be obtained by employing a fast unified functional hash, especially through the functional equivalence caching technique, which we also present.

Neural Architecture Search