Search Results for author:
Found 11 papers, 7 papers with code
Emergent Communication at Scale
Emergent communication aims for a better understanding of human language evolution and building more efficient representations.
Can Transformers Jump Around Right in Natural Language? Assessing Performance Transfer from SCAN
We present several focused modifications of Transformer that greatly improve generalization capabilities on SCAN and select one that remains on par with a vanilla Transformer on a standard machine translation (MT) task.
``LazImpa'': Lazy and Impatient neural agents learn to communicate efficiently
Previous work has shown that artificial neural agents naturally develop surprisingly non-efficient codes.
"LazImpa": Lazy and Impatient neural agents learn to communicate efficiently
Previous work has shown that artificial neural agents naturally develop surprisingly non-efficient codes.
What they do when in doubt: a study of inductive biases in seq2seq learners
Sequence-to-sequence (seq2seq) learners are widely used, but we still have only limited knowledge about what inductive biases shape the way they generalize.
Compositionality and Generalization in Emergent Languages
Third, while compositionality is not necessary for generalization, it provides an advantage in terms of language transmission: The more compositional a language is, the more easily it will be picked up by new learners, even when the latter differ in architecture from the original agents.
EGG: a toolkit for research on Emergence of lanGuage in Games
There is renewed interest in simulating language emergence among deep neural agents that communicate to jointly solve a task, spurred by the practical aim to develop language-enabled interactive AIs, as well as by theoretical questions about the evolution of human language.
Entropy Minimization In Emergent Languages
There is growing interest in studying the languages that emerge when neural agents are jointly trained to solve tasks requiring communication through a discrete channel.
Anti-efficient encoding in emergent communication
Despite renewed interest in emergent language simulations with neural networks, little is known about the basic properties of the induced code, and how they compare to human language.
Word-order biases in deep-agent emergent communication
We train models to communicate about paths in a simple gridworld, using miniature languages that reflect or violate various natural language trends, such as the tendency to avoid redundancy or to minimize long-distance dependencies.
Learning weakly supervised multimodal phoneme embeddings
Recent works have explored deep architectures for learning multimodal speech representation (e. g. audio and images, articulation and audio) in a supervised way.
