Dictionary Learning

152 papers with code • 0 benchmarks • 6 datasets

Dictionary Learning is an important problem in multiple areas, ranging from computational neuroscience, machine learning, to computer vision and image processing. The general goal is to find a good basis for given data. More formally, in the Dictionary Learning problem, also known as sparse coding, we are given samples of a random vector $y\in\mathbb{R}^n$, of the form $y=Ax$ where $A$ is some unknown matrix in $\mathbb{R}^{n×m}$, called dictionary, and $x$ is sampled from an unknown distribution over sparse vectors. The goal is to approximately recover the dictionary $A$.

Source: Polynomial-time tensor decompositions with sum-of-squares

Libraries

Use these libraries to find Dictionary Learning models and implementations

Fusing Dictionary Learning and Support Vector Machines for Unsupervised Anomaly Detection

faceonlive/ai-research 5 Apr 2024

We introduce a new anomaly detection model that unifies the OC-SVM and DL residual functions into a single composite objective, subsequently solved through K-SVD-type iterative algorithms.

131
05 Apr 2024

SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learning

nzolman/sindy-rl 14 Mar 2024

Deep reinforcement learning (DRL) has shown significant promise for uncovering sophisticated control policies that interact in environments with complicated dynamics, such as stabilizing the magnetohydrodynamics of a tokamak fusion reactor or minimizing the drag force exerted on an object in a fluid flow.

10
14 Mar 2024

Seismic Traveltime Tomography with Label-free Learning

linfengyu77/sttwll 1 Feb 2024

To avoid generating and/or collecting labeled samples, we propose a novel method by integrating deep learning and dictionary learning to enhance the VMs with low resolution by using the traditional tomography-least square method (LSQR).

0
01 Feb 2024

Interpretable Online Network Dictionary Learning for Inferring Long-Range Chromatin Interactions

rana95vishal/chromatin_dl 16 Dec 2023

First, we demonstrate that online cvxNDL retains the accuracy of classical DL methods while simultaneously ensuring unique interpretability and scalability.

0
16 Dec 2023

Orthogonally weighted $\ell_{2,1}$ regularization for rank-aware joint sparse recovery: algorithm and analysis

a-petr/owl 21 Nov 2023

We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2, 1}$ ($\mathit{ow}\ell_{2, 1}$), which is specifically designed to take into account the rank of the solution matrix.

0
21 Nov 2023

SC-MIL: Sparsely Coded Multiple Instance Learning for Whole Slide Image Classification

sotiraslab/scmil 31 Oct 2023

In this paper, we proposed a sparsely coded MIL (SC-MIL) that addresses those two aspects at the same time by leveraging sparse dictionary learning.

3
31 Oct 2023

Uncovering hidden geometry in Transformers via disentangling position and context

jiajunsong629/uncover-hidden-geometry 7 Oct 2023

Given embedding vector $\boldsymbol{h}_{c, t} \in \mathbb{R}^d$ at sequence position $t \le T$ in a sequence (or context) $c \le C$, extracting the mean effects yields the decomposition \[ \boldsymbol{h}_{c, t} = \boldsymbol{\mu} + \mathbf{pos}_t + \mathbf{ctx}_c + \mathbf{resid}_{c, t} \] where $\boldsymbol{\mu}$ is the global mean vector, $\mathbf{pos}_t$ and $\mathbf{ctx}_c$ are the mean vectors across contexts and across positions respectively, and $\mathbf{resid}_{c, t}$ is the residual vector.

4
07 Oct 2023

Multi-Source Domain Adaptation through Dataset Dictionary Learning in Wasserstein Space

eddardd/demo-dadil 27 Jul 2023

Based on our dictionary, we propose two novel methods for MSDA: DaDil-R, based on the reconstruction of labeled samples in the target domain, and DaDiL-E, based on the ensembling of classifiers learned on atom distributions.

4
27 Jul 2023

Combating the Curse of Multilinguality in Cross-Lingual WSD by Aligning Sparse Contextualized Word Representations

begab/sparsity_makes_sense NAACL 2022

In this paper, we advocate for using large pre-trained monolingual language models in cross lingual zero-shot word sense disambiguation (WSD) coupled with a contextualized mapping mechanism.

10
25 Jul 2023

Anomaly Detection with Selective Dictionary Learning

denisilie94/pyod-dl 17 Jul 2023

In this paper we present new methods of anomaly detection based on Dictionary Learning (DL) and Kernel Dictionary Learning (KDL).

1
17 Jul 2023