Search Results for author: Tom Brown

Found 22 papers, 12 papers with code

In-context Learning and Induction Heads

no code implementations24 Sep 2022 Catherine Olsson, Nelson Elhage, Neel Nanda, Nicholas Joseph, Nova DasSarma, Tom Henighan, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, Dawn Drain, Deep Ganguli, Zac Hatfield-Dodds, Danny Hernandez, Scott Johnston, Andy Jones, Jackson Kernion, Liane Lovitt, Kamal Ndousse, Dario Amodei, Tom Brown, Jack Clark, Jared Kaplan, Sam McCandlish, Chris Olah

In this work, we present preliminary and indirect evidence for a hypothesis that induction heads might constitute the mechanism for the majority of all "in-context learning" in large transformer models (i. e. decreasing loss at increasing token indices).

In-Context Learning

Long-Term Benefits of Network Boosters for Renewables Integration and Corrective Grid Security

no code implementations13 Dec 2021 Amin Shokri Gazafroudi, Elisabeth Zeyen, Martha Frysztacki, Fabian Neumann, Tom Brown

If instead fast corrective actions are used to overcome network overloading when single lines fail, this has the potential to free up network capacity that is otherwise underused in preventive $N-1$ security strategies.

The strong effect of network resolution on electricity system models with high shares of wind and solar

no code implementations22 Jan 2021 Martha Maria Frysztacki, Jonas Hörsch, Veit Hagenmeyer, Tom Brown

If we focus on the effect of renewable resource resolution and ignore network restrictions, we find that a higher resolution allows the optimal solution to concentrate wind and solar capacity at sites with better capacity factors and thus reduces system costs by up to 10% compared to a low resolution model.

Physics and Society Computation

Extracting Training Data from Large Language Models

3 code implementations14 Dec 2020 Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, Alina Oprea, Colin Raffel

We demonstrate our attack on GPT-2, a language model trained on scrapes of the public Internet, and are able to extract hundreds of verbatim text sequences from the model's training data.

Language Modelling

Mitigating heat demand peaks in buildings in a highly renewable European energy system

no code implementations3 Dec 2020 Elisabeth Zeyen, Veit Hagenmeyer, Tom Brown

Space and water heating accounts for about 40% of final energy consumption in the European Union and thus plays a key role in reducing overall costs and greenhouse gas emissions.

Physics and Society

The Near-Optimal Feasible Space of a Renewable Power System Model

1 code implementation4 Oct 2019 Fabian Neumann, Tom Brown

Models for long-term investment planning of the power system typically return a single optimal solution per set of cost assumptions.

Physics and Society Systems and Control Systems and Control

Testing Robustness Against Unforeseen Adversaries

3 code implementations21 Aug 2019 Max Kaufmann, Daniel Kang, Yi Sun, Steven Basart, Xuwang Yin, Mantas Mazeika, Akul Arora, Adam Dziedzic, Franziska Boenisch, Tom Brown, Jacob Steinhardt, Dan Hendrycks

To narrow in on this discrepancy between research and reality we introduce ImageNet-UA, a framework for evaluating model robustness against a range of unforeseen adversaries, including eighteen new non-L_p attacks.

Adversarial Defense Adversarial Robustness

Transfer of Adversarial Robustness Between Perturbation Types

no code implementations3 May 2019 Daniel Kang, Yi Sun, Tom Brown, Dan Hendrycks, Jacob Steinhardt

We study the transfer of adversarial robustness of deep neural networks between different perturbation types.

Adversarial Robustness

Skill Rating for Generative Models

no code implementations14 Aug 2018 Catherine Olsson, Surya Bhupatiraju, Tom Brown, Augustus Odena, Ian Goodfellow

We explore a new way to evaluate generative models using insights from evaluation of competitive games between human players.

PyPSA-Eur: An Open Optimisation Model of the European Transmission System

3 code implementations5 Jun 2018 Jonas Hörsch, Fabian Hofmann, David Schlachtberger, Tom Brown

PyPSA-Eur, the first open model dataset of the European power system at the transmission network level to cover the full ENTSO-E area, is presented.

Physics and Society

PyPSA: Python for Power System Analysis

2 code implementations31 Jul 2017 Tom Brown, Jonas Hörsch, David Schlachtberger

In this paper the basic functionality of PyPSA is described, including the formulation of the full power flow equations and the multi-period optimisation of operation and investment with linear power flow equations.

Physics and Society

The role of spatial scale in joint optimisations of generation and transmission for European highly renewable scenarios

2 code implementations22 May 2017 Jonas Hörsch, Tom Brown

The effects of the spatial scale on the results of the optimisation of transmission and generation capacity in Europe are quantified under a 95% CO2 reduction compared to 1990 levels, interpolating between one-node-per-country solutions and many-nodes-per-country.

Physics and Society Applied Physics

Cannot find the paper you are looking for? You can Submit a new open access paper.