Search Results for author:
Found 4 papers, 3 papers with code
Language Model Alignment with Elastic Reset
We periodically reset the online model to an exponentially moving average (EMA) of itself, then reset the EMA model to the initial model.
A surprisingly simple technique to control the pretraining bias for better transfer: Expand or Narrow your representation
Self-Supervised Learning (SSL) models rely on a pretext task to learn representations.
Simplicial Embeddings in Self-Supervised Learning and Downstream Classification
Simplicial Embeddings (SEM) are representations learned through self-supervised learning (SSL), wherein a representation is projected into $L$ simplices of $V$ dimensions each using a softmax operation.
Integrating Categorical Semantics into Unsupervised Domain Translation
While unsupervised domain translation (UDT) has seen a lot of success recently, we argue that mediating its translation via categorical semantic features could broaden its applicability.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
