1 code implementation • 14 Aug 2024 • Harsh Poonia, Moritz Willig, Zhongjie Yu, Matej Zečević, Kristian Kersting, Devendra Singh Dhami
Causal inference in hybrid domains, characterized by a mixture of discrete and continuous variables, presents a formidable challenge.
no code implementations • 14 Aug 2024 • Subhabrata Dutta, Timo Kaufmann, Goran Glavaš, Ivan Habernal, Kristian Kersting, Frauke Kreuter, Mira Mezini, Iryna Gurevych, Eyke Hüllermeier, Hinrich Schuetze
While there is a widespread belief that artificial general intelligence (AGI) -- or even superhuman AI -- is imminent, complex problems in expert domains are far from being solved.
1 code implementation • 27 Jun 2024 • Björn Deiseroth, Manuel Brack, Patrick Schramowski, Kristian Kersting, Samuel Weinbach
Tokenizers are crucial for encoding information in Large Language Models, but their development has recently stagnated, and they contain inherent weaknesses.
no code implementations • 24 Jun 2024 • Timo Kaufmann, Jannis Blüml, Antonia Wüst, Quentin Delfosse, Kristian Kersting, Eyke Hüllermeier
Properly defining a reward signal to efficiently train a reinforcement learning (RL) agent is a challenging task.
1 code implementation • 14 Jun 2024 • Wolfgang Stammer, Antonia Wüst, David Steinmann, Kristian Kersting
The challenge in object-based visual reasoning lies in generating descriptive yet distinct concept representations.
1 code implementation • 10 Jun 2024 • Jingyuan Sha, Hikaru Shindo, Quentin Delfosse, Kristian Kersting, Devendra Singh Dhami
In this work, we propose a novel approach, Explanatory Predicate Invention for Learning in Games (EXPIL), that identifies and extracts predicates from a pretrained neural agent, later used in the logic-based agents, reducing the dependency on predefined background knowledge.
no code implementations • 7 Jun 2024 • Lukas Helff, Felix Friedrich, Manuel Brack, Kristian Kersting, Patrick Schramowski
We introduce LlavaGuard, a family of VLM-based safeguard models, offering a versatile framework for evaluating the safety compliance of visual content.
1 code implementation • 6 Jun 2024 • Quentin Delfosse, Jannis Blüml, Bjarne Gregori, Kristian Kersting
Overall, HackAtari can be used to improve the robustness of current and future RL algorithms, allowing Neuro-Symbolic RL, curriculum RL, causal RL, as well as LLM-driven RL.
1 code implementation • 4 Jun 2024 • Dominik Hintersdorf, Lukas Struppek, Kristian Kersting, Adam Dziedzic, Franziska Boenisch
Unfortunately, this practice raises privacy and intellectual property concerns, as DMs can memorize and later reproduce their potentially sensitive or copyrighted training images at inference time.
1 code implementation • 23 May 2024 • Hector Kohler, Quentin Delfosse, Riad Akrour, Kristian Kersting, Philippe Preux
We empirically demonstrate that INTERPRETER compact tree programs match oracles across a diverse set of sequential decision tasks and evaluate the impact of our design choices on interpretability and performances.
1 code implementation • 6 Apr 2024 • Simone Tedeschi, Felix Friedrich, Patrick Schramowski, Kristian Kersting, Roberto Navigli, Huu Nguyen, Bo Li
When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails.
1 code implementation • 26 Mar 2024 • Michael Poli, Armin W Thomas, Eric Nguyen, Pragaash Ponnusamy, Björn Deiseroth, Kristian Kersting, Taiji Suzuki, Brian Hie, Stefano Ermon, Christopher Ré, Ce Zhang, Stefano Massaroli
The development of deep learning architectures is a resource-demanding process, due to a vast design space, long prototyping times, and high compute costs associated with at-scale model training and evaluation.
no code implementations • 5 Mar 2024 • Sahil Sidheekh, Pranuthi Tenali, Saurabh Mathur, Erik Blasch, Kristian Kersting, Sriraam Natarajan
We consider the problem of late multi-modal fusion for discriminative learning.
no code implementations • 23 Feb 2024 • Maurice Kraus, Felix Divo, David Steinmann, Devendra Singh Dhami, Kristian Kersting
Actually, common belief is that multi-dataset pretraining does not work for time series!
1 code implementation • 21 Feb 2024 • Hikaru Shindo, Manuel Brack, Gopika Sudhakaran, Devendra Singh Dhami, Patrick Schramowski, Kristian Kersting
To remedy this issue, we propose DeiSAM -- a combination of large pre-trained neural networks with differentiable logic reasoners -- for deictic promptable segmentation.
1 code implementation • 20 Feb 2024 • Maurice Kraus, David Steinmann, Antonia Wüst, Andre Kokozinski, Kristian Kersting
Feedback on explanations in both domains is then used to constrain the model, steering it away from the annotated confounding factors.
no code implementations • 14 Feb 2024 • Lukas Struppek, Minh Hieu Le, Dominik Hintersdorf, Kristian Kersting
The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research.
1 code implementation • 13 Feb 2024 • Antonia Wüst, Wolfgang Stammer, Quentin Delfosse, Devendra Singh Dhami, Kristian Kersting
The challenge in learning abstract concepts from images in an unsupervised fashion lies in the required integration of visual perception and generalizable relational reasoning.
no code implementations • 13 Feb 2024 • Cedric Derstroff, Jannis Brugger, Jannis Blüml, Mira Mezini, Stefan Kramer, Kristian Kersting
It strategically allocates computational resources to focus on promising segments of the search tree, making it a very attractive search algorithm in large search spaces.
1 code implementation • 9 Feb 2024 • Florian Peter Busch, Roshni Kamath, Rupert Mitchell, Wolfgang Stammer, Kristian Kersting, Martin Mundt
In particular, we provide a formal description of such continual confounders and identify that, in general, spurious correlations are easily ignored when training for all tasks jointly, but it is harder to avoid confounding when they are considered sequentially.
1 code implementation • 7 Feb 2024 • Roshni Kamath, Rupert Mitchell, Subarnaduti Paul, Kristian Kersting, Martin Mundt
The quest to improve scalar performance numbers on predetermined benchmarks seems to be deeply engraved in deep learning.
1 code implementation • 30 Jan 2024 • Felix Helfenstein, Jannis Blüml, Johannes Czech, Kristian Kersting
This paper presents a new approach that integrates deep learning with computational chess, using both the Mixture of Experts (MoE) method and Monte-Carlo Tree Search (MCTS).
1 code implementation • 29 Jan 2024 • Felix Friedrich, Katharina Hämmerl, Patrick Schramowski, Manuel Brack, Jindrich Libovicky, Kristian Kersting, Alexander Fraser
Our results show that not only do models exhibit strong gender biases but they also behave differently across languages.
1 code implementation • 11 Jan 2024 • Quentin Delfosse, Sebastian Sztwiertnia, Mark Rothermel, Wolfgang Stammer, Kristian Kersting
Unfortunately, the black-box nature of deep neural networks impedes the inclusion of domain experts for inspecting the model and revising suboptimal policies.
1 code implementation • NeurIPS 2023 • Zhongjie Yu, Martin Trapp, Kristian Kersting
In many real-world scenarios, it is crucial to be able to reliably and efficiently reason under uncertainty while capturing complex relationships in data.
no code implementations • CVPR 2024 • Manuel Brack, Felix Friedrich, Katharina Kornmeier, Linoy Tsaban, Patrick Schramowski, Kristian Kersting, Apolinário Passos
Our results demonstrate the capabilities of LEDITS++ and its improvements over previous methods.
1 code implementation • 22 Nov 2023 • Yannik Keller, Jannis Blüml, Gopika Sudhakaran, Kristian Kersting
The gameplay of strategic board games such as chess, Go and Hex is often characterized by combinatorial, relational structures -- capturing distinct interactions and non-local patterns -- and not just images.
no code implementations • 2 Nov 2023 • Björn Deiseroth, Max Meuer, Nikolas Gritsch, Constantin Eichenberg, Patrick Schramowski, Matthias Aßenmacher, Kristian Kersting
Large Language Models (LLMs) have reshaped natural language processing with their impressive capabilities.
no code implementations • 20 Oct 2023 • Benjamin Hilprecht, Kristian Kersting, Carsten Binnig
While there has been extensive work on deep neural networks for images and text, deep learning for relational databases (RDBs) is still a rather unexplored field.
1 code implementation • 12 Oct 2023 • Dominik Hintersdorf, Lukas Struppek, Daniel Neider, Kristian Kersting
Our approach provides a new "dual-use" perspective on backdoor attacks and presents a promising avenue to enhance the privacy of individuals within models trained on uncurated web-scraped data.
1 code implementation • 10 Oct 2023 • Lukas Struppek, Martin B. Hentschel, Clifton Poth, Dominik Hintersdorf, Kristian Kersting
To address this challenge, we propose a novel approach that enables model training on potentially poisoned datasets by utilizing the power of recent diffusion models.
1 code implementation • 10 Oct 2023 • Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
Label smoothing -- using softened labels instead of hard ones -- is a widely adopted regularization method for deep learning, showing diverse benefits such as enhanced generalization and calibration.
no code implementations • 20 Sep 2023 • Manuel Brack, Patrick Schramowski, Kristian Kersting
Text-conditioned image generation models have recently achieved astonishing image quality and alignment results.
1 code implementation • 15 Sep 2023 • Wolfgang Stammer, Felix Friedrich, David Steinmann, Manuel Brack, Hikaru Shindo, Kristian Kersting
Current AI research mainly treats explanations as a means for model inspection.
1 code implementation • 25 Aug 2023 • David Steinmann, Wolfgang Stammer, Felix Friedrich, Kristian Kersting
To rectify this, we present concept bottleneck memory models (CB2Ms), which keep a memory of past interventions.
1 code implementation • 24 Aug 2023 • Matej Zečević, Moritz Willig, Devendra Singh Dhami, Kristian Kersting
We conjecture that in the cases where LLM succeed in doing causal inference, underlying was a respective meta SCM that exposed correlations between causal facts in natural language on whose data the LLM was ultimately trained.
no code implementations • 18 Aug 2023 • Dominik Hintersdorf, Lukas Struppek, Kristian Kersting
The field of artificial intelligence (AI) has experienced remarkable progress in recent years, driven by the widespread adoption of open-source machine learning models in both research and industry.
1 code implementation • ICCV 2023 • Gopika Sudhakaran, Devendra Singh Dhami, Kristian Kersting, Stefan Roth
Recent years have seen a growing interest in Scene Graph Generation (SGG), a comprehensive visual scene understanding task that aims to predict entity relationships using a relation encoder-decoder pipeline stacked on top of an object encoder-decoder backbone.
1 code implementation • 10 Jul 2023 • Rupert Mitchell, Robin Menzenbach, Kristian Kersting, Martin Mundt
The results of training a neural network are heavily dependent on the architecture chosen; and even a modification of only its size, however small, typically involves restarting the training process.
1 code implementation • 3 Jul 2023 • Hikaru Shindo, Viktor Pfanschilling, Devendra Singh Dhami, Kristian Kersting
However, due to the memory intensity, most existing approaches do not bring the best of the expressivity of first-order logic, excluding a crucial ability to solve abstract visual reasoning, where agents need to perform reasoning by using analogies on abstract concepts in different scenarios.
1 code implementation • 14 Jun 2023 • Quentin Delfosse, Jannis Blüml, Bjarne Gregori, Sebastian Sztwiertnia, Kristian Kersting
In our work, we extend the Atari Learning Environments, the most-used evaluation framework for deep RL approaches, by introducing OCAtari, that performs resource-efficient extractions of the object-centric states for these games.
1 code implementation • 14 Jun 2023 • Arseny Skryagin, Daniel Ochs, Devendra Singh Dhami, Kristian Kersting
The goal of combining the robustness of neural networks and the expressiveness of symbolic methods has rekindled the interest in Neuro-Symbolic AI.
1 code implementation • 13 Jun 2023 • Lukas Helff, Wolfgang Stammer, Hikaru Shindo, Devendra Singh Dhami, Kristian Kersting
Despite the successes of recent developments in visual AI, different shortcomings still exist; from missing exact logical reasoning, to abstract generalization abilities, to understanding complex and noisy scenes.
1 code implementation • 7 Jun 2023 • Sophie Jentzsch, Kristian Kersting
In a series of exploratory experiments around jokes, i. e., generation, explanation, and detection, we seek to understand ChatGPT's capability to grasp and reproduce human humor.
1 code implementation • 6 Jun 2023 • Subarnaduti Paul, Lars-Joel Frey, Roshni Kamath, Kristian Kersting, Martin Mundt
In parts, federated learning lifts this assumption, as it sets out to solve the real-world challenge of collaboratively learning a shared model from data distributed across clients.
1 code implementation • 3 Jun 2023 • Steven Braun, Martin Mundt, Kristian Kersting
We posit that original data access may however not be required.
no code implementations • 28 May 2023 • Manuel Brack, Felix Friedrich, Patrick Schramowski, Kristian Kersting
Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications.
1 code implementation • NeurIPS 2023 • Marco Bellagente, Manuel Brack, Hannah Teufel, Felix Friedrich, Björn Deiseroth, Constantin Eichenberg, Andrew Dai, Robert Baldock, Souradeep Nanda, Koen Oostermeijer, Andres Felipe Cruz-Salinas, Patrick Schramowski, Kristian Kersting, Samuel Weinbach
The recent popularity of text-to-image diffusion models (DM) can largely be attributed to the intuitive interface they provide to users.
1 code implementation • 22 May 2023 • Jannis Weil, Johannes Czech, Tobias Meuser, Kristian Kersting
In combination with Reinforcement Learning, Monte-Carlo Tree Search has shown to outperform human grandmasters in games such as Chess, Shogi and Go with little to no prior domain knowledge.
no code implementations • 28 Apr 2023 • Johannes Czech, Jannis Blüml, Kristian Kersting, Hedinn Steingrimsson
While transformers have gained recognition as a versatile tool for artificial intelligence (AI), an unexplored challenge arises in the context of chess - a classical AI benchmark.
1 code implementation • 14 Apr 2023 • Felix Friedrich, David Steinmann, Kristian Kersting
Current machine learning models produce outstanding results in many areas but, at the same time, suffer from shortcut learning and spurious correlations.
1 code implementation • 16 Mar 2023 • Lukas Struppek, Dominik Hintersdorf, Felix Friedrich, Manuel Brack, Patrick Schramowski, Kristian Kersting
Neural network-based image classifiers are powerful tools for computer vision tasks, but they inadvertently reveal sensitive attribute information about their classes, raising concerns about their privacy.
2 code implementations • 13 Feb 2023 • Fabrizio Ventola, Steven Braun, Zhongjie Yu, Martin Mundt, Kristian Kersting
In contrast to neural networks, they are often assumed to be well-calibrated and robust to out-of-distribution (OOD) data.
1 code implementation • 7 Feb 2023 • Felix Friedrich, Manuel Brack, Lukas Struppek, Dominik Hintersdorf, Patrick Schramowski, Sasha Luccioni, Kristian Kersting
Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications.
1 code implementation • NeurIPS 2023 • Manuel Brack, Felix Friedrich, Dominik Hintersdorf, Lukas Struppek, Patrick Schramowski, Kristian Kersting
This leaves the user with little semantic control.
1 code implementation • NeurIPS 2023 • Björn Deiseroth, Mayukh Deb, Samuel Weinbach, Manuel Brack, Patrick Schramowski, Kristian Kersting
Generative transformer models have become increasingly complex, with large numbers of parameters and the ability to process multiple input modalities.
no code implementations • 23 Dec 2022 • Matej Zečević, Moritz Willig, Devendra Singh Dhami, Kristian Kersting
Many researchers have voiced their support towards Pearl's counterfactual theory of causation as a stepping stone for AI/ML research's ultimate goal of intelligent systems.
2 code implementations • 12 Dec 2022 • Manuel Brack, Patrick Schramowski, Felix Friedrich, Dominik Hintersdorf, Kristian Kersting
Large, text-conditioned generative diffusion models have recently gained a lot of attention for their impressive performance in generating high-fidelity images from text alone.
no code implementations • 21 Nov 2022 • Zihan Ye, Hikaru Shindo, Devendra Singh Dhami, Kristian Kersting
To make deep learning do more from less, we propose the first neural meta-symbolic system (NEMESYS) for reasoning and learning: meta programming using differentiable forward-chaining reasoning in first-order logic.
1 code implementation • 16 Nov 2022 • Quentin Delfosse, Wolfgang Stammer, Thomas Rothenbacher, Dwarak Vittal, Kristian Kersting
Recent unsupervised multi-object detection models have shown impressive performance improvements, largely attributed to novel architectural inductive biases.
1 code implementation • 14 Nov 2022 • Katharina Hämmerl, Björn Deiseroth, Patrick Schramowski, Jindřich Libovický, Constantin A. Rothkopf, Alexander Fraser, Kristian Kersting
Do the models capture moral norms from English and impose them on other languages?
2 code implementations • CVPR 2023 • Patrick Schramowski, Manuel Brack, Björn Deiseroth, Kristian Kersting
Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications.
3 code implementations • ICCV 2023 • Lukas Struppek, Dominik Hintersdorf, Kristian Kersting
We introduce backdoor attacks against text-guided generative models and demonstrate that their text encoders pose a major tampering risk.
1 code implementation • 19 Oct 2022 • Felix Friedrich, Wolfgang Stammer, Patrick Schramowski, Kristian Kersting
In this work, we question the current common practice of storing all information in the model parameters and propose the Revision Transformer (RiT) to facilitate easy model updating.
2 code implementations • 19 Sep 2022 • Lukas Struppek, Dominik Hintersdorf, Felix Friedrich, Manuel Brack, Patrick Schramowski, Kristian Kersting
Models for text-to-image synthesis, such as DALL-E~2 and Stable Diffusion, have recently drawn a lot of interest from academia and the general public.
3 code implementations • 15 Sep 2022 • Dominik Hintersdorf, Lukas Struppek, Manuel Brack, Felix Friedrich, Patrick Schramowski, Kristian Kersting
Our large-scale experiments on CLIP demonstrate that individuals used for training can be identified with very high accuracy.
no code implementations • 29 Aug 2022 • Björn Deiseroth, Patrick Schramowski, Hikaru Shindo, Devendra Singh Dhami, Kristian Kersting
Text-to-image models have recently achieved remarkable success with seemingly accurate samples in photo-realistic quality.
1 code implementation • 24 Aug 2022 • Frieder Uhlig, Lukas Struppek, Dominik Hintersdorf, Thomas Göbel, Harald Baier, Kristian Kersting
Then DLAM is able to detect the patterns in a typically much larger file, that is DLAM focuses on the use case of fragment detection.
1 code implementation • 17 Aug 2022 • Manuel Brack, Patrick Schramowski, Björn Deiseroth, Kristian Kersting
Bootstrapping from pre-trained language models has been proven to be an efficient approach for building vision-language models (VLM) for tasks such as image captioning or visual question answering.
no code implementations • 24 Jun 2022 • Jonas Seng, Pooja Prasad, Martin Mundt, Devendra Singh Dhami, Kristian Kersting
Deep neural architectures have profound impact on achieved performance in many of today's AI tasks, yet, their design still heavily relies on human prior knowledge and experience.
no code implementations • 14 Jun 2022 • Florian Peter Busch, Matej Zečević, Kristian Kersting, Devendra Singh Dhami
We introduce an approach where we consider neural encodings for LPs that justify the application of attribution methods from explainable artificial intelligence (XAI) designed for neural learning systems.
Explainable artificial intelligence Explainable Artificial Intelligence (XAI)
no code implementations • 14 Jun 2022 • Salahedine Youssef, Matej Zečević, Devendra Singh Dhami, Kristian Kersting
Even though AI has advanced rapidly in recent years displaying success in solving highly complex problems, the class of Bongard Problems (BPs) yet remain largely unsolved by modern ML techniques.
no code implementations • 14 Jun 2022 • Jonas Seng, Matej Zečević, Devendra Singh Dhami, Kristian Kersting
Simulations are ubiquitous in machine learning.
no code implementations • 14 Jun 2022 • David Steinmann, Matej Zečević, Devendra Singh Dhami, Kristian Kersting
In this work, we extend the attribution methods for explaining neural networks to linear programs.
1 code implementation • 14 Jun 2022 • Moritz Willig, Matej Zečević, Devendra Singh Dhami, Kristian Kersting
Foundation models are subject to an ongoing heated debate, leaving open the question of progress towards AGI and dividing the community into two camps: the ones who see the arguably impressive results as evidence to the scaling hypothesis, and the others who are worried about the lack of interpretability and reasoning capabilities.
no code implementations • 16 May 2022 • Xiaoting Shao, Kristian Kersting
Counterfactual examples are an appealing class of post-hoc explanations for machine learning models.
1 code implementation • NAACL 2022 • Nafise Sadat Moosavi, Quentin Delfosse, Kristian Kersting, Iryna Gurevych
The resulting adapters (a) contain about 50% of the learning parameters of the standard adapter and are therefore more efficient at training and inference, and require less storage space, and (b) achieve considerably higher performances in low-data settings.
1 code implementation • 29 Mar 2022 • Matej Zečević, Florian Peter Busch, Devendra Singh Dhami, Kristian Kersting
Linear Programs (LP) are celebrated widely, particularly so in machine learning where they have allowed for effectively solving probabilistic inference tasks or imposing structure on end-to-end learning systems.
no code implementations • 18 Mar 2022 • Katharina Hämmerl, Björn Deiseroth, Patrick Schramowski, Jindřich Libovický, Alexander Fraser, Kristian Kersting
Massively multilingual sentence representations are trained on large corpora of uncurated data, with a very imbalanced proportion of languages included in the training.
3 code implementations • 4 Mar 2022 • Felix Friedrich, Wolfgang Stammer, Patrick Schramowski, Kristian Kersting
In addition, we discuss existing and introduce novel measures and benchmarks for evaluating the overall abilities of a XIL method.
1 code implementation • 2 Mar 2022 • Xuan Xie, Kristian Kersting, Daniel Neider
Formal verification has emerged as a powerful approach to ensure the safety and reliability of deep neural networks.
2 code implementations • 14 Feb 2022 • Patrick Schramowski, Christopher Tauchmann, Kristian Kersting
This calls for increased dataset documentation, e. g., using datasheets.
no code implementations • 1 Feb 2022 • Xiaoting Shao, Karl Stelzner, Kristian Kersting
A key assumption of most statistical machine learning methods is that they have access to independent samples from the distribution of data they encounter at test time.
3 code implementations • 28 Jan 2022 • Lukas Struppek, Dominik Hintersdorf, Antonio De Almeida Correia, Antonia Adler, Kristian Kersting
Model inversion attacks (MIAs) aim to create synthetic images that reflect the class-wise characteristics from a target classifier's private training data by exploiting the model's learned knowledge.
1 code implementation • CVPR 2022 • Wolfgang Stammer, Marius Memmel, Patrick Schramowski, Kristian Kersting
In this work, we show the advantages of prototype representations for understanding and revising the latent space of neural concept learners.
2 code implementations • 17 Nov 2021 • Dominik Hintersdorf, Lukas Struppek, Kristian Kersting
Membership inference attacks (MIAs) aim to determine whether a specific sample was used to train a predictive model.
1 code implementation • 12 Nov 2021 • Lukas Struppek, Dominik Hintersdorf, Daniel Neider, Kristian Kersting
Specifically, we show that current deep perceptual hashing may not be robust.
no code implementations • 22 Oct 2021 • Matej Zečević, Devendra Singh Dhami, Kristian Kersting
More specifically, there are models capable of answering causal queries that are not SCM, which we refer to as \emph{partially causal models} (PCM).
no code implementations • 22 Oct 2021 • Moritz Willig, Matej Zečević, Devendra Singh Dhami, Kristian Kersting
Most algorithms in classical and contemporary machine learning focus on correlation-based dependence between features to drive performance.
1 code implementation • 19 Oct 2021 • Athresh Karanam, Saurabh Mathur, Predrag Radivojac, David M. Haas, Kristian Kersting, Sriraam Natarajan
We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations.
1 code implementation • 18 Oct 2021 • Hikaru Shindo, Devendra Singh Dhami, Kristian Kersting
NSFR factorizes the raw inputs into the object-centric representations, converts them into probabilistic ground atoms, and finally performs differentiable forward-chaining inference using weighted rules for inference.
1 code implementation • 8 Oct 2021 • Patrick Schramowski, Kristian Kersting
Probing or fine-tuning (large-scale) pre-trained models results in state-of-the-art performance for many NLP tasks and, more recently, even for computer vision tasks when combined with image data.
1 code implementation • ICLR 2022 • Martin Mundt, Steven Lang, Quentin Delfosse, Kristian Kersting
What is the state of the art in continual machine learning?
no code implementations • 7 Oct 2021 • Arseny Skryagin, Wolfgang Stammer, Daniel Ochs, Devendra Singh Dhami, Kristian Kersting
The probability estimates resulting from NPPs act as the binding element between the logical program and raw input data, thereby allowing SLASH to answer task-dependent logical queries.
no code implementations • 5 Oct 2021 • Matej Zečević, Devendra Singh Dhami, Constantin A. Rothkopf, Kristian Kersting
The question part on the user's end we believe to be solved since the user's mental model can provide the causal model.
no code implementations • 14 Sep 2021 • Zhongjie Yu, Devendra Singh Dhami, Kristian Kersting
Probabilistic circuits (PCs) have become the de-facto standard for learning and inference in probabilistic modeling.
1 code implementation • 13 Sep 2021 • Steven Lang, Fabrizio Ventola, Kristian Kersting
We present DAFNe, a Dense one-stage Anchor-Free deep Network for oriented object detection.
Ranked #3 on Oriented Object Detection on DOTA 1.5
no code implementations • 9 Sep 2021 • Matej Zečević, Devendra Singh Dhami, Petar Veličković, Kristian Kersting
Causality can be described in terms of a structural causal model (SCM) that carries information on the variables of interest and their mechanistic relations.
1 code implementation • 2 Sep 2021 • Felix Friedrich, Patrick Schramowski, Christopher Tauchmann, Kristian Kersting
Transformer language models are state of the art in a multitude of NLP tasks.
no code implementations • 19 Jul 2021 • Maximilian Otte, Quentin Delfosse, Johannes Czech, Kristian Kersting
Motivated by the interaction between cells, the recently introduced concept of Neural Cellular Automata shows promising results in a variety of tasks.
1 code implementation • 16 Jun 2021 • Zhongjie Yu, Mingye Zhu, Martin Trapp, Arseny Skryagin, Kristian Kersting
Inspired by recent advances in the field of expert-based approximations of Gaussian processes (GPs), we present an expert-based approach to large-scale multi-output regression using single-output GP experts.
no code implementations • 8 Jun 2021 • Nils Thoma, Zhongjie Yu, Fabrizio Ventola, Kristian Kersting
Time series forecasting is a relevant task that is performed in several real-world scenarios such as product sales analysis and prediction of energy demand.
1 code implementation • 26 May 2021 • Matej Zečević, Devendra Singh Dhami, Kristian Kersting
The recent years have been marked by extended research on adversarial attacks, especially on deep neural networks.
2 code implementations • 19 May 2021 • Aidmar Wainakh, Fabrizio Ventola, Till Müßig, Jens Keim, Carlos Garcia Cordero, Ephraim Zimmer, Tim Grube, Kristian Kersting, Max Mühlhäuser
Specifically, we investigate Label Leakage from Gradients (LLG), a novel attack to extract the labels of the users' training data from their shared gradients.
1 code implementation • 2 Apr 2021 • Karl Stelzner, Kristian Kersting, Adam R. Kosiorek
We present ObSuRF, a method which turns a single image of a scene into a 3D model represented as a set of Neural Radiance Fields (NeRFs), with each NeRF corresponding to a different object.
1 code implementation • 8 Mar 2021 • Patrick Schramowski, Cigdem Turan, Nico Andersen, Constantin A. Rothkopf, Kristian Kersting
That is, we show that these norms can be captured geometrically by a direction, which can be computed, e. g., by a PCA, in the embedding space, reflecting well the agreement of phrases to social norms implicitly expressed in the training texts and providing a path for attenuating or even preventing toxic degeneration in LMs.
1 code implementation • NeurIPS 2021 • Matej Zečević, Devendra Singh Dhami, Athresh Karanam, Sriraam Natarajan, Kristian Kersting
While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference.
4 code implementations • 18 Feb 2021 • Quentin Delfosse, Patrick Schramowski, Martin Mundt, Alejandro Molina, Kristian Kersting
Latest insights from biology show that intelligence not only emerges from the connections between neurons but that individual neurons shoulder more computational responsibility than previously anticipated.
Ranked #3 on Atari Games on Atari 2600 Skiing (using extra training data)
3 code implementations • 20 Dec 2020 • Johannes Czech, Patrick Korus, Kristian Kersting
The AlphaZero algorithm has been successfully applied in a range of discrete domains, most notably board games.
no code implementations • 15 Dec 2020 • Sophie Burkhardt, Jannis Brugger, Nicolas Wagner, Zahra Ahmadi, Kristian Kersting, Stefan Kramer
Most deep neural networks are considered to be black boxes, meaning their output is hard to interpret.
3 code implementations • CVPR 2021 • Wolfgang Stammer, Patrick Schramowski, Kristian Kersting
Most explanation methods in deep learning map importance estimates for a model's prediction back to the original input space.
2 code implementations • 16 Jul 2020 • Christopher Morris, Nils M. Kriege, Franka Bause, Kristian Kersting, Petra Mutzel, Marion Neumann
We provide Python-based data loaders, kernel and graph neural network baseline implementations, and evaluation tools.
no code implementations • 10 Jun 2020 • Srijita Das, Sriraam Natarajan, Kaushik Roy, Ronald Parr, Kristian Kersting
We consider the problem of Approximate Dynamic Programming in relational domains.
1 code implementation • ICML 2020 • Robert Peharz, Steven Lang, Antonio Vergari, Karl Stelzner, Alejandro Molina, Martin Trapp, Guy Van Den Broeck, Kristian Kersting, Zoubin Ghahramani
Probabilistic circuits (PCs) are a promising avenue for probabilistic modeling, as they permit a wide range of exact and efficient inference routines.
no code implementations • 3 Feb 2020 • Amos Treiber, Alejandro Molina, Christian Weinert, Thomas Schneider, Kristian Kersting
AI algorithms, and machine learning (ML) techniques in particular, are increasingly important to individuals' lives, but have caused a range of privacy concerns addressed by, e. g., the European GDPR.
1 code implementation • 15 Jan 2020 • Patrick Schramowski, Wolfgang Stammer, Stefano Teso, Anna Brugger, Xiaoting Shao, Hans-Georg Luigs, Anne-Katrin Mahlein, Kristian Kersting
Deep neural networks have shown excellent performances in many real-world applications.
no code implementations • 11 Dec 2019 • Patrick Schramowski, Cigdem Turan, Sophie Jentzsch, Constantin Rothkopf, Kristian Kersting
But has BERT also a better moral compass?
1 code implementation • ICLR 2020 • Jannik Kossen, Karl Stelzner, Marcel Hussing, Claas Voelcker, Kristian Kersting
When humans observe a physical system, they can easily locate objects, understand their interactions, and anticipate future behavior, even in settings with complicated and previously unseen interactions.
no code implementations • 25 Sep 2019 • Nadine Behrmann, Patrick Schramowski, Kristian Kersting
However, by studying the characteristics of the local error function we show that including the partial derivatives of the initial value problem is favorable.
1 code implementation • 2 Sep 2019 • Benjamin Hilprecht, Andreas Schmidt, Moritz Kulessa, Alejandro Molina, Kristian Kersting, Carsten Binnig
The typical approach for learned DBMS components is to capture the behavior by running a representative set of queries and use the observations to train a machine learning model.
Databases
1 code implementation • 28 Aug 2019 • Navdeep Kaur, Gautam Kunapuli, Saket Joshi, Kristian Kersting, Sriraam Natarajan
While deep networks have been enormously successful over the last decade, they rely on flat-feature vector representations, which makes them unsuitable for richly structured domains such as those arising in applications like social network analysis.
3 code implementations • 19 Aug 2019 • Johannes Czech, Moritz Willig, Alena Beyer, Kristian Kersting, Johannes Fürnkranz
Crazyhouse is a game with a higher branching factor than chess and there is only limited data of lower quality available compared to AlphaGo.
no code implementations • 8 Aug 2019 • Fabrizio Ventola, Karl Stelzner, Alejandro Molina, Kristian Kersting
Tractable yet expressive density estimators are a key building block of probabilistic machine learning.
5 code implementations • ICLR 2020 • Alejandro Molina, Patrick Schramowski, Kristian Kersting
The performance of deep network learning strongly depends on the choice of the non-linear activation function associated with each neuron.
no code implementations • 18 Jun 2019 • Parisa Kordjamshidi, Dan Roth, Kristian Kersting
Data-driven approaches are becoming more common as problem-solving techniques in many areas of research and industry.
no code implementations • 22 May 2019 • Andrea Galassi, Kristian Kersting, Marco Lippi, Xiaoting Shao, Paolo Torroni
Deep learning is bringing remarkable contributions to the field of argumentation mining, but the existing approaches still need to fill the gap toward performing advanced reasoning tasks.
no code implementations • 21 May 2019 • Xiaoting Shao, Alejandro Molina, Antonio Vergari, Karl Stelzner, Robert Peharz, Thomas Liebig, Kristian Kersting
In contrast, deep probabilistic models such as sum-product networks (SPNs) capture joint distributions in a tractable fashion, but still lack the expressive power of intractable models based on deep neural networks.
no code implementations • 17 Feb 2019 • Kristian Kersting, Jan Peters, Constantin Rothkopf
The Federal Government of Germany aims to boost the research in the field of Artificial Intelligence (AI).
1 code implementation • Machine Learning 2019 • Marion Neumann, Roman Garnett, Christian Bauckhage, Kristian Kersting
We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data.
Ranked #8 on Graph Classification on NCI109
1 code implementation • 11 Jan 2019 • Alejandro Molina, Antonio Vergari, Karl Stelzner, Robert Peharz, Pranav Subramani, Nicola Di Mauro, Pascal Poupart, Kristian Kersting
We introduce SPFlow, an open-source Python library providing a simple interface to inference, learning and manipulation routines for deep and tractable probabilistic models called Sum-Product Networks (SPNs).
no code implementations • 15 Nov 2018 • Moritz Kulessa, Alejandro Molina, Carsten Binnig, Benjamin Hilprecht, Kristian Kersting
However, classical AQP approaches suffer from various problems that limit the applicability to support the ad-hoc exploration of a new data set: (1) Classical AQP approaches that perform online sampling can support ad-hoc exploration queries but yield low quality if executed over rare subpopulations.
no code implementations • 6 Aug 2018 • Nandini Ramanan, Gautam Kunapuli, Tushar Khot, Bahare Fatemi, Seyed Mehran Kazemi, David Poole, Kristian Kersting, Sriraam Natarajan
We consider the problem of learning Relational Logistic Regression (RLR).
no code implementations • 24 Jul 2018 • Antonio Vergari, Alejandro Molina, Robert Peharz, Zoubin Ghahramani, Kristian Kersting, Isabel Valera
Classical approaches for {exploratory data analysis} are usually not flexible enough to deal with the uncertainty inherent to real-world data: they are often restricted to fixed latent interaction models and homogeneous likelihoods; they are sensitive to missing, corrupt and anomalous data; moreover, their expressiveness generally comes at the price of intractable inference.
no code implementations • 5 Jun 2018 • Robert Peharz, Antonio Vergari, Karl Stelzner, Alejandro Molina, Martin Trapp, Kristian Kersting, Zoubin Ghahramani
The need for consistent treatment of uncertainty has recently triggered increased interest in probabilistic deep learning methods.
no code implementations • 22 May 2018 • Stefano Teso, Kristian Kersting
Although interactive learning puts the user into the loop, the learner remains mostly a black box for the user.
no code implementations • 12 Mar 2018 • Patrick Schramowski, Christian Bauckhage, Kristian Kersting
The move from hand-designed to learned optimizers in machine learning has been quite successful for gradient-based and -free optimizers.
no code implementations • 31 Jan 2018 • Stefan Lüdtke, Max Schröder, Sebastian Bader, Kristian Kersting, Thomas Kirste
We present a model for exact recursive Bayesian filtering based on lifted multiset states.
no code implementations • 9 Oct 2017 • Alejandro Molina, Alexander Munteanu, Kristian Kersting
Many applications infer the structure of a probabilistic graphical model from data to elucidate the relationships between variables.
no code implementations • 9 Oct 2017 • Alejandro Molina, Antonio Vergari, Nicola Di Mauro, Sriraam Natarajan, Floriana Esposito, Kristian Kersting
While all kinds of mixed data -from personal data, over panel and scientific data, to public and commercial data- are collected and stored, building probabilistic graphical models for these hybrid domains becomes more difficult.
1 code implementation • 7 Mar 2017 • Christopher Morris, Kristian Kersting, Petra Mutzel
Specifically, we introduce a novel graph kernel based on the $k$-dimensional Weisfeiler-Lehman algorithm.
no code implementations • 2 Mar 2017 • Nils M. Kriege, Marion Neumann, Christopher Morris, Kristian Kersting, Petra Mutzel
On this basis we propose exact and approximative feature maps for widely used graph kernels based on the kernel trick.
no code implementations • 1 Oct 2016 • Christopher Morris, Nils M. Kriege, Kristian Kersting, Petra Mutzel
While state-of-the-art kernels for graphs with discrete labels scale well to graphs with thousands of nodes, the few existing kernels for graphs with continuous attributes, unfortunately, do not scale well.
no code implementations • 16 Jun 2016 • Elena Erdmann, Karin Boczek, Lars Koppers, Gerret von Nordheim, Christian Pölitz, Alejandro Molina, Katharina Morik, Henrik Müller, Jörg Rahnenführer, Kristian Kersting
Migration crisis, climate change or tax havens: Global challenges need global solutions.
no code implementations • 14 Jun 2016 • Martin Mladenov, Leonard Kleinhans, Kristian Kersting
Symmetry is the essential element of lifted inference that has recently demon- strated the possibility to perform very efficient inference in highly-connected, but symmetric probabilistic models models.
no code implementations • 7 Jun 2016 • Piotr Szymański, Tomasz Kajdanowicz, Kristian Kersting
We show that fastgreedy and walktrap community detection methods on weighted label co-occurence graphs are 85-92% more likely to yield better F1 scores than random partitioning.
no code implementations • 26 May 2016 • Martin Mladenov, Vaishak Belle, Kristian Kersting
A recent trend in probabilistic inference emphasizes the codification of models in a formal syntax, with suitable high-level features such as individuals, relations, and connectives, enabling descriptive clarity, succinctness and circumventing the need for the modeler to engineer a custom solver.
1 code implementation • 13 Oct 2014 • Marion Neumann, Roman Garnett, Christian Bauckhage, Kristian Kersting
We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data.
no code implementations • 12 Oct 2014 • Kristian Kersting, Martin Mladenov, Pavel Tokmakov
A relational linear program (RLP) is a declarative LP template defining the objective and the constraints through the logical concepts of objects, relations, and quantified variables.
no code implementations • NeurIPS 2014 • Daniel Hernández-Lobato, Viktoriia Sharmanska, Kristian Kersting, Christoph H. Lampert, Novi Quadrianto
That is, in contrast to the standard GPC setting, the latent function is not just a nuisance but a feature: it becomes a natural measure of confidence about the training data by modulating the slope of the GPC sigmoid likelihood function.
no code implementations • 26 Oct 2013 • Christian Bauckhage, Kristian Kersting
We consider the problem of clustering data that reside on discrete, low dimensional lattices.
no code implementations • 22 Jul 2013 • Martin Grohe, Kristian Kersting, Martin Mladenov, Erkal Selman
We demonstrate empirically that colour refinement can indeed greatly reduce the cost of solving linear programs.
no code implementations • NeurIPS 2012 • Zahra Zamani, Scott Sanner, Pascal Poupart, Kristian Kersting
In recent years, point- based value iteration methods have proven to be extremely effective techniques for finding (approximately) optimal dynamic programming solutions to POMDPs when an initial set of belief states is known.
no code implementations • 23 Nov 2001 • Kristian Kersting, Luc De Raedt
Theyare a probabilistic extension of propositional logic and, hence, inherit some of the limitations of propositional logic, such as the difficulties to represent objects and relations.