Search Results for author:
Found 5 papers, 2 papers with code
Compressive Transformers for Long-Range Sequence Modelling
We present the Compressive Transformer, an attentive sequence model which compresses past memories for long-range sequence learning.
Ranked #2 on
Language Modelling
on Hutter Prize
Highly accurate protein structure prediction with AlphaFold
Accurate computational approaches are needed to address this gap and to enable large-scale structural bioinformatics.
Interpretable probabilistic embeddings: bridging the gap between topic models and neural networks
We consider probabilistic topic models and more recent word embedding techniques from a perspective of learning hidden semantic representations.
Learning and Evaluating Sparse Interpretable Sentence Embeddings
Previous research on word embeddings has shown that sparse representations, which can be either learned on top of existing dense embeddings or obtained through model constraints during training time, have the benefit of increased interpretability properties: to some degree, each dimension can be understood by a human and associated with a recognizable feature in the data.
Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning
We present a method for combining multi-agent communication and traditional data-driven approaches to natural language learning, with an end goal of teaching agents to communicate with humans in natural language.
