no code implementations • 16 Apr 2024 • David Samuel, Lucas Georges Gabriel Charpentier, Sondre Wold
Retrieval-augmented language models pose a promising alternative to standard language modeling.
1 code implementation • 1 Apr 2024 • Sondre Wold, Petter Mæhlum, Oddbjørn Hove
We also investigate the relationship between our complexity measure and certain features typically associated with complexity in the literature, such as word length, frequency, and the number of syllables.
no code implementations • 5 Jun 2023 • Sondre Wold, Lilja Øvrelid, Erik Velldal
In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information.
1 code implementation • 3 May 2023 • Sardana Ivanova, Fredrik Aas Andreassen, Matias Jentoft, Sondre Wold, Lilja Øvrelid
In this paper we present NorQuAD: the first Norwegian question answering dataset for machine reading comprehension.
1 code implementation • 19 Apr 2023 • Lucas Georges Gabriel Charpentier, Sondre Wold, David Samuel, Egil Rønningstad
After training, we also separate the language model, which we call the reader, from the retriever components, and show that this can be fine-tuned on a range of downstream tasks.
1 code implementation • COLING (TextGraphs) 2022 • Sondre Wold
This paper studies the problem of injecting factual knowledge into large pre-trained language models.