1 code implementation • IJCNLP 2019 • Vitalii Zhelezniak, April Shen, Daniel Busbridge, Aleksandar Savkov, Nils Hammerla
Just like cosine similarity is used to compare individual word vectors, we introduce a novel application of the centered kernel alignment (CKA) as a natural generalisation of squared cosine similarity for sets of word vectors.
1 code implementation • NAACL 2019 • Vitalii Zhelezniak, Aleksandar Savkov, April Shen, Nils Y. Hammerla
Importantly, we show that Pearson correlation is appropriate for some word vectors but not others.
2 code implementations • ICLR 2019 • Vitalii Zhelezniak, Aleksandar Savkov, April Shen, Francesco Moramarco, Jack Flann, Nils Y. Hammerla
Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks.
1 code implementation • ICLR 2018 • Vitalii Zhelezniak, Dan Busbridge, April Shen, Samuel L. Smith, Nils Y. Hammerla
Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks.