3 code implementations • 20 Oct 2020 • Adrian de Wynter, Daniel J. Perry
We extract an optimal subset of architectural parameters for the BERT architecture from Devlin et al. (2018) by applying recent breakthroughs in algorithms for neural architecture search.