no code implementations • 9 Jul 2024 • Kai Biegun, Rares Dolga, Jake Cunningham, David Barber
Linear recurrent neural networks, such as State Space Models (SSMs) and Linear Recurrent Units (LRUs), have recently shown state-of-the-art performance on long sequence modelling benchmarks.
no code implementations • 13 Mar 2024 • Rares Dolga, Ran Zmigrod, Rui Silva, Salwa Alamir, Sameena Shah
Log analysis and monitoring are essential aspects in software maintenance and identifying defects.
no code implementations • 27 Feb 2024 • Rares Dolga, Lucas Maystre, Marius Cobzarenco, David Barber
The time complexity of the standard attention mechanism in transformers scales quadratically with sequence length.