no code implementations • 9 Apr 2024 • Zihang Song, Osvaldo Simeone, Bipin Rajendran
In-context learning (ICL), a property demonstrated by transformer-based sequence models, refers to the automatic inference of an input-output mapping based on examples of the mapping provided as context.
no code implementations • 14 Feb 2024 • Zihang Song, Prabodh Katti, Osvaldo Simeone, Bipin Rajendran
Spiking Neural Networks (SNNs) have been recently integrated into Transformer architectures due to their potential to reduce computational demands and to improve power efficiency.