Search Results for author:
Found 6 papers, 4 papers with code
Collapse of Self-trained Language Models
In various fields of knowledge creation, including science, new ideas often build on pre-existing information.
On Difficulties of Attention Factorization through Shared Memory
Transformers have revolutionized deep learning in numerous fields, including natural language processing, computer vision, and audio processing.
Advancing State of the Art in Language Modeling
In this paper, we propose a simple framework that should help advance the state of the art in language modeling in terms of generalization.
Ranked #7 on
Language Modelling
on WikiText-103
Alquist 5.0: Dialogue Trees Meet Generative Models. A Novel Approach for Enhancing SocialBot Conversations
We present our SocialBot -- Alquist~5. 0 -- developed for the Alexa Prize SocialBot Grand Challenge~5.
Preserving Semantics in Textual Adversarial Attacks
Our method outperforms existing sentence encoders used in adversarial attacks by achieving 1. 2x - 5. 1x better real attack success rate.
Emergence of Novelty in Evolutionary Algorithms
This leads to an emergence of a novel behavior of the agents.
