Search Results for author:
Found 16 papers, 12 papers with code
Controlling Latent Diffusion Using Latent CLIP
We train Latent-CLIP on 2. 7B pairs of latent images and descriptive texts, and show that it matches zero-shot classification performance of similarly sized CLIP models on both the ImageNet benchmark and a LDM-generated version of it, demonstrating its effectiveness in assessing both real and generated content.
Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages
In large language models (LLMs), how are multiple languages learned and encoded?
Byte BPE Tokenization as an Inverse string Homomorphism
Tokenization is an important preprocessing step in the training and inference of large language models (LLMs).
Separating Tongue from Thought: Activation Patching Reveals Language-Agnostic Concept Representations in Transformers
In this paper, we address this question by analyzing latent representations (latents) during a word translation task in transformer-based LLMs.
Controllable Context Sensitivity and the Knob Behind It
In this paper, we search for a knob which controls this sensitivity, determining whether language models answer from the context or their prior knowledge.
Unpacking SDXL Turbo: Interpreting Text-to-Image Models with Sparse Autoencoders
We investigated the possibility of using SAEs to learn interpretable features for a few-step text-to-image diffusion models, such as SDXL Turbo.
Multilingual Contrastive Decoding via Language-Agnostic Layers Skipping
Decoding by contrasting layers (DoLa), is designed to improve the generation quality of large language models (LLMs) by contrasting the prediction probabilities between an early exit output (amateur logits) and the final output (expert logits).
Do Llamas Work in English? On the Latent Language of Multilingual Transformers
Tracking intermediate embeddings through their high-dimensional space reveals three distinct phases, whereby intermediate embeddings (1) start far away from output token embeddings; (2) already allow for decoding a semantically correct next token in the middle layers, but give higher probability to its version in English than in the input language; (3) finally move into an input-language-specific region of the embedding space.
Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access
This paper introduces sketch-guided constrained decoding (SGCD), a novel approach to constrained decoding for blackbox LLMs, which operates without access to the logits of the blackbox LLM.
The CausalBench challenge: A machine learning contest for gene network inference from single-cell perturbation data
In drug discovery, mapping interactions between genes within cellular systems is a crucial early step.
Learning DAGs from Data with Few Root Causes
We prove identifiability in this new setting and show that the true DAG is the global minimizer of the $L^0$-norm of the vector of root causes.
Causal Fourier Analysis on Directed Acyclic Graphs and Posets
Specifically, we model the spread of an infection on such a DAG obtained from real-world contact tracing data and learn the infection signal from samples assuming sparsity in the Fourier domain.
Instance-wise algorithm configuration with graph neural networks
We pose this task as a supervised learning problem: First, we compile a large dataset of the solver performance for various configurations and all provided MILP instances.
Learning Set Functions that are Sparse in Non-Orthogonal Fourier Bases
Many applications of machine learning on discrete domains, such as learning preference functions in recommender systems or auctions, can be reduced to estimating a set function that is sparse in the Fourier domain.
Discrete Signal Processing with Set Functions
Set functions are functions (or signals) indexed by the powerset (set of all subsets) of a finite set N. They are fundamental and ubiquitous in many application domains and have been used, for example, to formally describe or quantify loss functions for semantic image segmentation, the informativeness of sensors in sensor networks the utility of sets of items in recommender systems, cooperative games in game theory, or bidders in combinatorial auctions.
Powerset Convolutional Neural Networks
We present a novel class of convolutional neural networks (CNNs) for set functions, i. e., data indexed with the powerset of a finite set.
