no code implementations • 9 Nov 2023 • Daniele Giofré, Sneha Ghantasala
Since its introduction, the transformers architecture has seen great adoption in NLP applications, but it also has limitations.
no code implementations • 30 Nov 2022 • Joel Niklaus, Daniele Giofré
In specialized domains though (such as legal, scientific or biomedical), models often need to process very long text (sometimes well above 10000 tokens).