no code implementations • 17 Nov 2022 • Alexander Panaetov, Karim Elhadji Daou, Igor Samenko, Evgeny Tetin, Ilya Ivanov
To address this issue, we propose a general recursively defined residual block (RDRB) for better feature extraction and propagation through network layers.
1 code implementation • 29 Dec 2021 • Vladislav Mosin, Igor Samenko, Alexey Tikhonov, Borislav Kozlovskii, Ivan P. Yamshchikov
Transformers are responsible for the vast majority of recent advances in natural language processing.
no code implementations • EMNLP (Eval4NLP) 2021 • Alexey Tikhonov, Igor Samenko, Ivan P. Yamshchikov
Every language includes 500+ stories.
1 code implementation • 27 Apr 2020 • Igor Samenko, Alexey Tikhonov, Ivan P. Yamshchikov
This paper shows that, modern word embeddings contain information that distinguishes synonyms and antonyms despite small cosine similarities between corresponding vectors.
no code implementations • 12 Mar 2020 • Ivan P. Yamshchikov, Cyrille Merleau Nono Saha, Igor Samenko, Jürgen Jost
This position paper looks into the formation of language and shows ties between structural properties of the words in the English language and their polysemy.