Search Results for author: Andrei Chertkov

Found 7 papers, 4 papers with code

Faster Language Models with Better Multi-Token Prediction Using Tensor Decomposition

no code implementations23 Oct 2024 Artem Basharin, Andrei Chertkov, Ivan Oseledets

We propose a new model for multi-token prediction in transformers, aiming to enhance sampling efficiency without compromising accuracy.

Code Generation Tensor Decomposition

Black-Box Approximation and Optimization with Hierarchical Tucker Decomposition

no code implementations5 Feb 2024 Gleb Ryzhakov, Andrei Chertkov, Artem Basharin, Ivan Oseledets

We develop a new method HTBB for the multidimensional black-box approximation and gradient-free optimization, which is based on the low-rank hierarchical Tucker decomposition with the use of the MaxVol indices selection procedure.

Fast gradient-free activation maximization for neurons in spiking neural networks

1 code implementation28 Dec 2023 Nikita Pospelov, Andrei Chertkov, Maxim Beketov, Ivan Oseledets, Konstantin Anokhin

For a living system, such as a neuron, whose response to a stimulus is unknown and not differentiable, the only way to reveal these features is through a feedback loop that exposes it to a large set of different stimuli.

Tensor Decomposition

Translate your gibberish: black-box adversarial attack on machine translation systems

1 code implementation20 Mar 2023 Andrei Chertkov, Olga Tsymboi, Mikhail Pautov, Ivan Oseledets

Neural networks are deployed widely in natural language processing tasks on the industrial scale, and perhaps the most often they are used as compounds of automatic machine translation systems.

Adversarial Attack Machine Translation +1

Are Quantum Computers Practical Yet? A Case for Feature Selection in Recommender Systems using Tensor Networks

1 code implementation9 May 2022 Artyom Nikitin, Andrei Chertkov, Rafael Ballester-Ripoll, Ivan Oseledets, Evgeny Frolov

The problem is formulated as a Quadratic Unconstrained Binary Optimization (QUBO) which, due to its NP-hard complexity, is solved using Quantum Annealing on a quantum computer provided by D-Wave.

Collaborative Filtering Feature Engineering +3

TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning

1 code implementation30 Apr 2022 Konstantin Sozykin, Andrei Chertkov, Roman Schutski, Anh-Huy Phan, Andrzej Cichocki, Ivan Oseledets

We present a novel procedure for optimization based on the combination of efficient quantized tensor train representation and a generalized maximum matrix volume principle.

reinforcement-learning Reinforcement Learning +1

Understanding DDPM Latent Codes Through Optimal Transport

no code implementations14 Feb 2022 Valentin Khrulkov, Gleb Ryzhakov, Andrei Chertkov, Ivan Oseledets

Diffusion models have recently outperformed alternative approaches to model the distribution of natural images, such as GANs.

Cannot find the paper you are looking for? You can Submit a new open access paper.