Search Results for author: Gabriele Merlin

Found 3 papers, 0 papers with code

What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation

no code implementations12 Jul 2023 Gabriele Merlin, Vedant Nanda, Ruchit Rawal, Mariya Toneva

The pretrain-finetune paradigm usually improves downstream performance over training a model from scratch on the same task, becoming commonplace across many areas of machine learning.

Language models and brain alignment: beyond word-level semantics and prediction

no code implementations1 Dec 2022 Gabriele Merlin, Mariya Toneva

The first perturbation is to improve the model's ability to predict the next word in the specific naturalistic stimulus text that the brain recordings correspond to.

Language Modelling

Practical Recommendations for Replay-based Continual Learning Methods

no code implementations19 Mar 2022 Gabriele Merlin, Vincenzo Lomonaco, Andrea Cossu, Antonio Carta, Davide Bacciu

Continual Learning requires the model to learn from a stream of dynamic, non-stationary data without forgetting previous knowledge.

Continual Learning Data Augmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.