Search Results for author:
Found 3 papers, 2 papers with code
SCALE: Scaling up the Complexity for Advanced Language Model Evaluation
In this paper, we introduce a novel NLP benchmark that poses challenges to current LLMs across four key dimensions: processing long documents (up to 50K tokens), utilizing domain specific knowledge (embodied in legal texts), multilingual understanding (covering five languages), and multitasking (comprising legal document to document Information Retrieval, Court View Generation, Leading Decision Summarization, Citation Extraction, and eight challenging Text Classification tasks).
MultiLegalPile: A 689GB Multilingual Legal Corpus
Large, high-quality datasets are crucial for training Large Language Models (LLMs).
LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain
To provide a fair comparison, we propose two aggregate scores, one based on the datasets and one on the languages.
