Search Results for author: Dmitry Baranchuk

Found 21 papers, 13 papers with code

Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximization

no code implementations3 Oct 2024 Mikhail Persiianov, Arip Asadulaev, Nikita Andreev, Nikita Starodubcev, Dmitry Baranchuk, Anastasis Kratsios, Evgeny Burnaev, Alexander Korotin

To tackle this issue, we propose a new learning paradigm that integrates both paired and unpaired data $\textbf{seamlessly}$ through the data likelihood maximization techniques.

Results of the Big ANN: NeurIPS'23 competition

1 code implementation25 Sep 2024 Harsha Vardhan Simhadri, Martin Aumüller, Amir Ingber, Matthijs Douze, George Williams, Magdalen Dobson Manohar, Dmitry Baranchuk, Edo Liberty, Frank Liu, Ben Landrum, Mazin Karjikar, Laxman Dhulipala, Meng Chen, Yue Chen, Rui Ma, Kai Zhang, Yuzheng Cai, Jiayang Shi, Yizhuo Chen, Weiguo Zheng, Zihao Wan, Jie Yin, Ben Huang

The 2023 Big ANN Challenge, held at NeurIPS 2023, focused on advancing the state-of-the-art in indexing data structures and search algorithms for practical variants of Approximate Nearest Neighbor (ANN) search that reflect the growing complexity and diversity of workloads.

Diversity

Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization

no code implementations31 Aug 2024 Vage Egiazarian, Denis Kuznedelev, Anton Voronov, Ruslan Svirschevski, Michael Goin, Daniil Pavlov, Dan Alistarh, Dmitry Baranchuk

Specifically, we tailor vector-based PTQ methods to recent billion-scale text-to-image models (SDXL and SDXL-Turbo), and show that the diffusion models of 2B+ parameters compressed to around 3 bits using VQ exhibit the similar image quality and textual alignment as previous 4-bit compression techniques.

Image Generation Quantization

Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps

no code implementations20 Jun 2024 Nikita Starodubcev, Mikhail Khoroshikh, Artem Babenko, Dmitry Baranchuk

Diffusion distillation represents a highly promising direction for achieving faithful text-to-image generation in a few sampling steps.

Image Manipulation text-guided-image-editing

Your Student is Better Than Expected: Adaptive Teacher-Student Collaboration for Text-Conditional Diffusion Models

1 code implementation CVPR 2024 Nikita Starodubcev, Artem Fedorov, Artem Babenko, Dmitry Baranchuk

While several powerful distillation methods were recently proposed, the overall quality of student samples is typically lower compared to the teacher ones, which hinders their practical usage.

Image Generation Knowledge Distillation +1

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

2 code implementations NeurIPS 2023 Alexander Borzunov, Max Ryabinin, Artem Chumachenko, Dmitry Baranchuk, Tim Dettmers, Younes Belkada, Pavel Samygin, Colin Raffel

Large language models (LLMs) are useful in many NLP tasks and become more capable with size, with the best open-source models having over 50 billion parameters.

DeDrift: Robust Similarity Search under Content Drift

no code implementations ICCV 2023 Dmitry Baranchuk, Matthijs Douze, Yash Upadhyay, I. Zeki Yalniz

We investigate the impact of this "content drift" for large-scale similarity search tools, based on nearest neighbor search in embedding space.

Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Models

1 code implementation10 Apr 2023 Nikita Starodubcev, Dmitry Baranchuk, Valentin Khrulkov, Artem Babenko

Finally, we show that our approach can adapt the pretrained model to the user-specified image and text description on the fly just for 4 seconds.

Image Manipulation

TabDDPM: Modelling Tabular Data with Diffusion Models

3 code implementations30 Sep 2022 Akim Kotelnikov, Dmitry Baranchuk, Ivan Rubachev, Artem Babenko

Denoising diffusion probabilistic models are currently becoming the leading paradigm of generative modeling for many important data modalities.

Denoising

Petals: Collaborative Inference and Fine-tuning of Large Models

2 code implementations2 Sep 2022 Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers, Max Ryabinin, Younes Belkada, Artem Chumachenko, Pavel Samygin, Colin Raffel

However, these techniques have innate limitations: offloading is too slow for interactive inference, while APIs are not flexible enough for research that requires access to weights, attention or logits.

Collaborative Inference

Label-Efficient Semantic Segmentation with Diffusion Models

1 code implementation ICLR 2022 Dmitry Baranchuk, Ivan Rubachev, Andrey Voynov, Valentin Khrulkov, Artem Babenko

Denoising diffusion probabilistic models have recently received much research attention since they outperform alternative approaches, such as GANs, and currently provide state-of-the-art generative performance.

Denoising Segmentation +2

Graph-based Nearest Neighbor Search in Hyperbolic Spaces

no code implementations ICLR 2022 Liudmila Prokhorenkova, Dmitry Baranchuk, Nikolay Bogachev, Yury Demidovich, Alexander Kolpakov

From a theoretical perspective, we rigorously analyze the time and space complexity of graph-based NNS, assuming that an n-element dataset is uniformly distributed within a d-dimensional ball of radius R in the hyperbolic space of curvature -1.

Information Retrieval Retrieval +1

Distilling the Knowledge from Conditional Normalizing Flows

1 code implementation ICML Workshop INNF 2021 Dmitry Baranchuk, Vladimir Aliev, Artem Babenko

Normalizing flows are a powerful class of generative models demonstrating strong performance in several speech and vision problems.

Image Super-Resolution Speech Synthesis

Discovering Weight Initializers with Meta Learning

1 code implementation ICML Workshop AutoML 2021 Dmitry Baranchuk, Artem Babenko

In this study, we propose a task-agnostic approach that discovers initializers for specific network architectures and optimizers by learning the initial weight distributions directly through the use of Meta-Learning.

Meta-Learning

Towards Similarity Graphs Constructed by Deep Reinforcement Learning

1 code implementation27 Nov 2019 Dmitry Baranchuk, Artem Babenko

New algorithms for similarity graph construction are continuously being proposed and analyzed by both theoreticians and practitioners.

Deep Reinforcement Learning graph construction +2

GP-VAE: Deep Probabilistic Time Series Imputation

3 code implementations9 Jul 2019 Vincent Fortuin, Dmitry Baranchuk, Gunnar Rätsch, Stephan Mandt

Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years.

Deep Learning Dimensionality Reduction +4

Learning to Route in Similarity Graphs

1 code implementation27 May 2019 Dmitry Baranchuk, Dmitry Persiyanov, Anton Sinitsin, Artem Babenko

Recently similarity graphs became the leading paradigm for efficient nearest neighbor search, outperforming traditional tree-based and LSH-based methods.

Cannot find the paper you are looking for? You can Submit a new open access paper.