no code implementations • 1 Jan 2021 • Cristobal Eyzaguirre, Felipe del Rio, Vladimir Araujo, Alvaro Soto
DACT-BERT adds an adaptive computation mechanism to the regular processing pipeline of BERT.
1 code implementation • CVPR 2020 • Cristobal Eyzaguirre, Alvaro Soto
This paper presents a novel attention-based algorithm for achieving adaptive computation called DACT, which, unlike existing ones, is end-to-end differentiable.