no code implementations • 25 Apr 2024 • Sri Harsha Dumpala, Aman Jaiswal, Chandramouli Sastry, Evangelos Milios, Sageev Oore, Hassan Sajjad
This paper introduces the VISLA (Variance and Invariance to Semantic and Lexical Alterations) benchmark, designed to evaluate the semantic and lexical understanding of language models.
no code implementations • 31 Oct 2023 • Aman Jaiswal, Evangelos Milios
Various complex methods have claimed to overcome this limit, but recent research questions the efficacy of these models across different classification tasks.