Search Results for author: Vasilii Feofanov

Found 7 papers, 2 papers with code

Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attention

1 code implementation15 Feb 2024 Romain Ilbert, Ambroise Odonnat, Vasilii Feofanov, Aladin Virmaux, Giuseppe Paolo, Themis Palpanas, Ievgen Redko

Transformer-based architectures achieved breakthrough performance in natural language processing and computer vision, yet they remain inferior to simpler linear baselines in multivariate long-term forecasting.

Time Series Time Series Forecasting

Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift

no code implementations17 Jan 2024 Renchunzi Xie, Ambroise Odonnat, Vasilii Feofanov, Ievgen Redko, Jianfeng Zhang, Bo An

Our key idea is that the model should be adjusted with a higher magnitude of gradients when it does not generalize to the test dataset with a distribution shift.

Random Matrix Analysis to Balance between Supervised and Unsupervised Learning under the Low Density Separation Assumption

no code implementations20 Oct 2023 Vasilii Feofanov, Malik Tiomoko, Aladin Virmaux

As an application, we derive a hyperparameter selection policy that finds the best balance between the supervised and the unsupervised terms of our learning criterion.

Model Selection

Self-Training: A Survey

no code implementations24 Feb 2022 Massih-Reza Amini, Vasilii Feofanov, Loic Pauletto, Lies Hadjadj, Emilie Devijver, Yury Maximov

Semi-supervised algorithms aim to learn prediction functions from a small set of labeled observations and a large set of unlabeled observations.

Image Classification Multi-class Classification +1

Multi-class Probabilistic Bounds for Self-learning

no code implementations29 Sep 2021 Vasilii Feofanov, Emilie Devijver, Massih-Reza Amini

First, we derive a transductive bound over the risk of the multi-class majority vote classifier.

Multi-class Classification Self-Learning

Semi-supervised Wrapper Feature Selection by Modeling Imperfect Labels

no code implementations12 Nov 2019 Vasilii Feofanov, Emilie Devijver, Massih-Reza Amini

In this paper, we propose a new wrapper feature selection approach with partially labeled training examples where unlabeled observations are pseudo-labeled using the predictions of an initial classifier trained on the labeled training set.

feature selection

Cannot find the paper you are looking for? You can Submit a new open access paper.