no code implementations • 23 Dec 2021 • Francesco Moramarco, Damir Juric, Aleksandar Savkov, Jack Flann, Maria Lehl, Kristian Boda, Tessa Grafen, Vitalii Zhelezniak, Sunir Gohil, Alex Papadopoulos Korfiatis, Nils Hammerla
Our method based on a language model trained on medical forum data generates simpler sentences while preserving both grammar and the original meaning, surpassing the current state of the art.
no code implementations • ACL 2020 • Vitalii Zhelezniak, Aleks Savkov, ar, Nils Hammerla
In this work we go through a vast literature on estimating MI in such cases and single out the most promising methods, yielding a simple and elegant similarity measure for word embeddings.
1 code implementation • IJCNLP 2019 • Vitalii Zhelezniak, April Shen, Daniel Busbridge, Aleksandar Savkov, Nils Hammerla
Just like cosine similarity is used to compare individual word vectors, we introduce a novel application of the centered kernel alignment (CKA) as a natural generalisation of squared cosine similarity for sets of word vectors.
no code implementations • 4 Oct 2019 • Joseph Enguehard, Dan Busbridge, Vitalii Zhelezniak, Nils Hammerla
The choice of sentence encoder architecture reflects assumptions about how a sentence's meaning is composed from its constituent words.
1 code implementation • NAACL 2019 • Vitalii Zhelezniak, Aleksandar Savkov, April Shen, Nils Y. Hammerla
Importantly, we show that Pearson correlation is appropriate for some word vectors but not others.
2 code implementations • ICLR 2019 • Vitalii Zhelezniak, Aleksandar Savkov, April Shen, Francesco Moramarco, Jack Flann, Nils Y. Hammerla
Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks.
1 code implementation • ICLR 2018 • Vitalii Zhelezniak, Dan Busbridge, April Shen, Samuel L. Smith, Nils Y. Hammerla
Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks.