Search Results for author: Vitalii Zhelezniak

Found 7 papers, 4 papers with code

Towards more patient friendly clinical notes through language models and ontologies

no code implementations23 Dec 2021 Francesco Moramarco, Damir Juric, Aleksandar Savkov, Jack Flann, Maria Lehl, Kristian Boda, Tessa Grafen, Vitalii Zhelezniak, Sunir Gohil, Alex Papadopoulos Korfiatis, Nils Hammerla

Our method based on a language model trained on medical forum data generates simpler sentences while preserving both grammar and the original meaning, surpassing the current state of the art.

Language Modelling Text Simplification

Estimating Mutual Information Between Dense Word Embeddings

no code implementations ACL 2020 Vitalii Zhelezniak, Aleks Savkov, ar, Nils Hammerla

In this work we go through a vast literature on estimating MI in such cases and single out the most promising methods, yielding a simple and elegant similarity measure for word embeddings.

Semantic Textual Similarity STS +1

Correlations between Word Vector Sets

1 code implementation IJCNLP 2019 Vitalii Zhelezniak, April Shen, Daniel Busbridge, Aleksandar Savkov, Nils Hammerla

Just like cosine similarity is used to compare individual word vectors, we introduce a novel application of the centered kernel alignment (CKA) as a natural generalisation of squared cosine similarity for sets of word vectors.

Semantic Textual Similarity STS +1

Neural Language Priors

no code implementations4 Oct 2019 Joseph Enguehard, Dan Busbridge, Vitalii Zhelezniak, Nils Hammerla

The choice of sentence encoder architecture reflects assumptions about how a sentence's meaning is composed from its constituent words.

Sentence

Don't Settle for Average, Go for the Max: Fuzzy Sets and Max-Pooled Word Vectors

2 code implementations ICLR 2019 Vitalii Zhelezniak, Aleksandar Savkov, April Shen, Francesco Moramarco, Jack Flann, Nils Y. Hammerla

Recent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks.

Semantic Textual Similarity Sentence +2

Cannot find the paper you are looking for? You can Submit a new open access paper.