Search Results for author:
Found 6 papers, 3 papers with code
Hyena Hierarchy: Towards Larger Convolutional Language Models
Recent advances in deep learning have relied heavily on the use of large Transformers due to their ability to learn at scale.
Ranked #25 on
Language Modelling
on WikiText-103
Simple Hardware-Efficient Long Convolutions for Sequence Modeling
We find that a key requirement to achieving high performance is keeping the convolution kernels smooth.
S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces
On ImageNet-1k, S4ND exceeds the performance of a Vision Transformer baseline by $1. 5\%$ when training with a $1$D sequence of patches, and matches ConvNeXt when modeling images in $2$D.
Continual Reinforcement Learning with TELLA
Training reinforcement learning agents that continually learn across multiple environments is a challenging problem.
Lifelong Learning Metrics
The DARPA Lifelong Learning Machines (L2M) program seeks to yield advances in artificial intelligence (AI) systems so that they are capable of learning (and improving) continuously, leveraging data on one task to improve performance on another, and doing so in a computationally sustainable way.
OSCAR-Net: Object-centric Scene Graph Attention for Image Attribution
Our key contribution is OSCAR-Net (Object-centric Scene Graph Attention for Image Attribution Network); a robust image hashing model inspired by recent successes of Transformers in the visual domain.
