Search Results for author:
Found 9 papers, 5 papers with code
Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
We find that such backdoor behavior can be made persistent, so that it is not removed by standard safety training techniques, including supervised fine-tuning, reinforcement learning, and adversarial training (eliciting unsafe behavior and then training to remove it).
Towards Understanding Sycophancy in Language Models
Overall, our results indicate that sycophancy is a general behavior of state-of-the-art AI assistants, likely driven in part by human preference judgments favoring sycophantic responses.
Understanding and Controlling a Maze-Solving Policy Network
To understand the goals and goal representations of AI systems, we carefully study a pretrained reinforcement learning policy that solves mazes by navigating to a range of target squares.
Incorporating Unlabelled Data into Bayesian Neural Networks
Conventional Bayesian Neural Networks (BNNs) cannot leverage unlabelled data to improve their predictions.
Do Bayesian Neural Networks Need To Be Fully Stochastic?
We investigate the benefit of treating all the parameters in a Bayesian neural network stochastically and find compelling theoretical and empirical evidence that this standard construction may be unnecessary.
Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt
But most computation and time is wasted on redundant and noisy points that are already learnt or not learnable.
Prioritized training on points that are learnable, worth learning, and not yet learned (workshop version)
We introduce Goldilocks Selection, a technique for faster model training which selects a sequence of training points that are "just right".
How Robust are the Estimated Effects of Nonpharmaceutical Interventions against COVID-19?
To what extent are effectiveness estimates of nonpharmaceutical interventions (NPIs) against COVID-19 influenced by the assumptions our models make?
Differentially Private Federated Variational Inference
This setting is known as federated learning, in which privacy is a key concern.
