Search Results for author:
Found 14 papers, 11 papers with code
High-throughput Generative Inference of Large Language Models with a Single GPU
As a result, when running OPT-175B on a single 16GB GPU, FlexGen achieves significantly higher throughput compared to state-of-the-art offloading systems, reaching a generation throughput of 1 token/s for the first time with an effective batch size of 144.
Hyena Hierarchy: Towards Larger Convolutional Language Models
Recent advances in deep learning have relied heavily on the use of large Transformers due to their ability to learn at scale.
Ranked #25 on
Language Modelling
on WikiText-103
Simple Hardware-Efficient Long Convolutions for Sequence Modeling
We find that a key requirement to achieving high performance is keeping the convolution kernels smooth.
Hungry Hungry Hippos: Towards Language Modeling with State Space Models
First, we use synthetic language modeling tasks to understand the gap between SSMs and attention.
Ranked #1 on
Language Modelling
on WikiText-103
(using extra training data)
Lost in Transmission: On the Impact of Networking Corruptions on Video Machine Learning Models
In a simulation study, we investigate (1) what artifacts networking corruptions cause, (2) how such artifacts affect ML models, and (3) whether standard robustness methods can mitigate their negative effects.
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
We also extend FlashAttention to block-sparse attention, yielding an approximate attention algorithm that is faster than any existing approximate attention method.
TABi: Type-Aware Bi-Encoders for Open-Domain Entity Retrieval
Entity retrieval--retrieving information about entity mentions in a query--is a key step in open-domain tasks, such as question answering or fact checking.
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning
We first prove that adding a weighted class-conditional InfoNCE loss to SupCon controls the degree of spread.
Shoring Up the Foundations: Fusing Model Embeddings and Weak Supervision
Despite the black-box nature of foundation models, we prove results characterizing how our approach improves performance and show that lift scales with the smoothness of label distributions in embedding space.
Train and You'll Miss It: Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings
Our goal is to enable machine learning systems to be trained interactively.
Fast and Three-rious: Speeding Up Weak Supervision with Triplet Methods
In this work, we show that, for a class of latent variable models highly applicable to weak supervision, we can find a closed-form solution to model parameters, obviating the need for iterative solutions like stochastic gradient descent (SGD).
Multi-Resolution Weak Supervision for Sequential Data
Multi-resolution sources exacerbate this challenge due to complex correlations and sample complexity that scales in the length of the sequence.
Rekall: Specifying Video Events using Compositions of Spatiotemporal Labels
Many real-world video analysis applications require the ability to identify domain-specific events in video, such as interviews and commercials in TV news broadcasts, or action sequences in film.
Influencing Flock Formation in Low-Density Settings
In the interest of learning how to control flocking behavior, recent work in the multiagent systems literature has explored the use of influencing agents for guiding flocking agents to face a target direction.
