Search Results for author:
Found 5 papers, 1 papers with code
Uncovering mesa-optimization algorithms in Transformers
Transformers have become the dominant model in deep learning, but the reason for their superior performance is poorly understood.
Federated Select: A Primitive for Communication- and Memory-Efficient Federated Learning
In order to make this practical, we outline a primitive, federated select, which enables client-specific selection in realistic FL systems.
ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces
Our methodology is designed to leverage visual, linguistic and domain-specific features in user interaction traces to pre-train generic feature representations of UIs and their components.
Now Playing: Continuous low-power music recognition
To reduce battery consumption, a small music detector runs continuously on the mobile device's DSP chip and wakes up the main application processor only when it is confident that music is present.
Communication-Efficient Learning of Deep Networks from Decentralized Data
Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device.
