Search Results for author: Daniele Giofré

Found 2 papers, 0 papers with code

Legal-HNet: Mixing Legal Long-Context Tokens with Hartley Transform

no code implementations9 Nov 2023 Daniele Giofré, Sneha Ghantasala

Since its introduction, the transformers architecture has seen great adoption in NLP applications, but it also has limitations.

Abstractive Text Summarization Decoder

BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch?

no code implementations30 Nov 2022 Joel Niklaus, Daniele Giofré

In specialized domains though (such as legal, scientific or biomedical), models often need to process very long text (sometimes well above 10000 tokens).

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.