Search Results for author:
Found 7 papers, 2 papers with code
Instruction Diversity Drives Generalization To Unseen Tasks
We investigate the trade-off between the number of instructions the model is trained on and the number of training samples provided for each instruction and observe that the diversity of the instruction set determines generalization.
A Tale of Tails: Model Collapse as a Change of Scaling Laws
We discover a wide range of decay phenomena, analyzing loss of scaling, shifted scaling with number of generations, the ''un-learning" of skills, and grokking when mixing human and synthesized data.
SALSA PICANTE: a machine learning attack on LWE with binary secrets
However, this attack assumes access to millions of eavesdropped LWE samples and fails at higher Hamming weights or dimensions.
Code Translation with Compiler Representations
Here we propose to augment code translation with IRs, specifically LLVM IR, with results on the C++, Java, Rust, and Go languages.
Leveraging Automated Unit Tests for Unsupervised Code Translation
With little to no parallel data available for programming languages, unsupervised methods are well-suited to source code translation.
Linear algebra with transformers
Most applications of transformers to mathematics, from integration to theorem proving, focus on symbolic computation.
Measuring causal influence with back-to-back regression: the linear case
Identifying causes from observations can be particularly challenging when i) potential factors are difficult to manipulate individually and ii) observations are complex and multi-dimensional.
