Search Results for author:
Found 5 papers, 5 papers with code
QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
Second, QuIP# uses vector quantization techniques to take advantage of the ball-shaped sub-Gaussian distribution that incoherent weights possess: specifically, we introduce a set of hardware-efficient codebooks based on the highly symmetric $E_8$ lattice, which achieves the optimal 8-dimension unit ball packing.
Coneheads: Hierarchy Aware Attention
These networks rely heavily on the dot product attention operator, which computes the similarity between two points by taking their inner product.
Shadow Cones: A Generalized Framework for Partial Order Embeddings
Specifically, we model partial orders as subset relations between shadows formed by a light source and opaque objects in hyperbolic space.
Automatic Synthesis of Diverse Weak Supervision Sources for Behavior Analysis
We evaluate AutoSWAP in three behavior analysis domains and demonstrate that AutoSWAP outperforms existing approaches using only a fraction of the data.
Learning Calibratable Policies using Programmatic Style-Consistency
We study the problem of controllable generation of long-term sequential behaviors, where the goal is to calibrate to multiple behavior styles simultaneously.
