Search Results for author: Rares Dolga

Found 3 papers, 0 papers with code

RotRNN: Modelling Long Sequences with Rotations

no code implementations9 Jul 2024 Kai Biegun, Rares Dolga, Jake Cunningham, David Barber

Linear recurrent neural networks, such as State Space Models (SSMs) and Linear Recurrent Units (LRUs), have recently shown state-of-the-art performance on long sequence modelling benchmarks.

State Space Models

Log Summarisation for Defect Evolution Analysis

no code implementations13 Mar 2024 Rares Dolga, Ran Zmigrod, Rui Silva, Salwa Alamir, Sameena Shah

Log analysis and monitoring are essential aspects in software maintenance and identifying defects.

Latte: Latent Attention for Linear Time Transformers

no code implementations27 Feb 2024 Rares Dolga, Lucas Maystre, Marius Cobzarenco, David Barber

The time complexity of the standard attention mechanism in transformers scales quadratically with sequence length.

Text Generation

Cannot find the paper you are looking for? You can Submit a new open access paper.