NoPPA: Non-Parametric Pairwise Attention Random Walk Model for Sentence Representation

1 code implementation • 24 Feb 2023 • Xuansheng Wu, Zhiyi Zhao, Ninghao Liu

We propose a novel non-parametric/un-trainable language model, named Non-Parametric Pairwise Attention Random Walk Model (NoPPA), to generate sentence embedding only with pre-trained word embedding and pre-counted word frequency.

Language Modelling Sentence +2