Search Results for author: Jonas Wallat

Found 7 papers, 6 papers with code

Temporal Blind Spots in Large Language Models

1 code implementation22 Jan 2024 Jonas Wallat, Adam Jatowt, Avishek Anand

In this study, we aim to investigate the underlying limitations of general-purpose LLMs when deployed for tasks that require a temporal understanding.

Natural Language Understanding

GeneMask: Fast Pretraining of Gene Sequences to Enable Few-Shot Learning

1 code implementation29 Jul 2023 Soumyadeep Roy, Jonas Wallat, Sowmya S Sundaram, Wolfgang Nejdl, Niloy Ganguly

Large-scale language models such as DNABert and LOGO aim to learn optimal gene representations and are trained on the entire Human Reference Genome.

Few-Shot Learning Language Modelling +1

A Review of the Role of Causality in Developing Trustworthy AI Systems

1 code implementation14 Feb 2023 Niloy Ganguly, Dren Fazlija, Maryam Badar, Marco Fisichella, Sandipan Sikdar, Johanna Schrader, Jonas Wallat, Koustav Rudra, Manolis Koubarakis, Gourab K. Patro, Wadhah Zai El Amri, Wolfgang Nejdl

This review aims to provide the reader with an overview of causal methods that have been developed to improve the trustworthiness of AI models.

Explainable Information Retrieval: A Survey

no code implementations4 Nov 2022 Avishek Anand, Lijun Lyu, Maximilian Idahl, Yumeng Wang, Jonas Wallat, Zijian Zhang

Explainable information retrieval is an emerging research area aiming to make transparent and trustworthy information retrieval systems.

Information Retrieval Retrieval

BERTnesia: Investigating the capture and forgetting of knowledge in BERT

1 code implementation EMNLP (BlackboxNLP) 2020 Jonas Wallat, Jaspreet Singh, Avishek Anand

We found that ranking models forget the least and retain more knowledge in their final layer compared to masked language modeling and question-answering.

Knowledge Base Completion Language Modelling +3

Cannot find the paper you are looking for? You can Submit a new open access paper.