Search Results for author: Katrina Evtimova

Found 3 papers, 2 papers with code

Variance-Covariance Regularization Improves Representation Learning

no code implementations23 Jun 2023 Jiachen Zhu, Katrina Evtimova, Yubei Chen, Ravid Shwartz-Ziv, Yann Lecun

In summary, VCReg offers a universally applicable regularization framework that significantly advances transfer learning and highlights the connection between gradient starvation, neural collapse, and feature transferability.

Long-tail Learning Representation Learning +2

Sparse Coding with Multi-Layer Decoders using Variance Regularization

1 code implementation16 Dec 2021 Katrina Evtimova, Yann Lecun

Sparse coding with an $l_1$ penalty and a learned linear dictionary requires regularization of the dictionary to prevent a collapse in the $l_1$ norms of the codes.

Denoising

Emergent Communication in a Multi-Modal, Multi-Step Referential Game

1 code implementation ICLR 2018 Katrina Evtimova, Andrew Drozdov, Douwe Kiela, Kyunghyun Cho

Inspired by previous work on emergent communication in referential games, we propose a novel multi-modal, multi-step referential game, where the sender and receiver have access to distinct modalities of an object, and their information exchange is bidirectional and of arbitrary duration.

Cannot find the paper you are looking for? You can Submit a new open access paper.