Search Results for author: Piotr Kozakowski

Found 8 papers, 5 papers with code

Planning and Learning Using Adaptive Entropy Tree Search

1 code implementation12 Feb 2021 Piotr Kozakowski, Mikołaj Pacek, Piotr Miłoś

We present the Adaptive Entropy Tree Search (ANTS) algorithm, a planning method based on the Principle of Maximum Entropy.

Q-Value Weighted Regression: Reinforcement Learning with Limited Data

no code implementations12 Feb 2021 Piotr Kozakowski, Łukasz Kaiser, Henryk Michalewski, Afroz Mohiuddin, Katarzyna Kańska

QWR is an extension of Advantage Weighted Regression (AWR), an off-policy actor-critic algorithm that performs very well on continuous control tasks, also in the offline setting, but has low sample efficiency and struggles with high-dimensional observation spaces.

Atari Games Continuous Control +1

Model Based Reinforcement Learning for Atari

no code implementations ICLR 2020 Łukasz Kaiser, Mohammad Babaeizadeh, Piotr Miłos, Błażej Osiński, Roy H. Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Afroz Mohiuddin, Ryan Sepassi, George Tucker, Henryk Michalewski

We describe Simulated Policy Learning (SimPLe), a complete model-based deep RL algorithm based on video prediction models and present a comparison of several model architectures, including a novel architecture that yields the best results in our setting.

Atari Games Model-based Reinforcement Learning +1

Uncertainty-sensitive Learning and Planning with Ensembles

1 code implementation19 Dec 2019 Piotr Miłoś, Łukasz Kuciński, Konrad Czechowski, Piotr Kozakowski, Maciek Klimek

The former manifests itself through the use of value function, while the latter is powered by a tree search planner.

Montezuma's Revenge

Forecasting Deep Learning Dynamics with Applications to Hyperparameter Tuning

no code implementations25 Sep 2019 Piotr Kozakowski, Łukasz Kaiser, Afroz Mohiuddin

Concretely, we introduce a forecasting model that, given a hyperparameter schedule (e. g., learning rate, weight decay) and a history of training observations (such as loss and accuracy), predicts how the training will continue.

Language Modelling

Uncertainty - sensitive learning and planning with ensembles

1 code implementation25 Sep 2019 Piotr Miłoś, Łukasz Kuciński, Konrad Czechowski, Piotr Kozakowski, Maciej Klimek

Notably, our method performs well in environments with sparse rewards where standard $TD(1)$ backups fail.

Montezuma's Revenge

Model-Based Reinforcement Learning for Atari

4 code implementations1 Mar 2019 Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy H. Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Afroz Mohiuddin, Ryan Sepassi, George Tucker, Henryk Michalewski

We describe Simulated Policy Learning (SimPLe), a complete model-based deep RL algorithm based on video prediction models and present a comparison of several model architectures, including a novel architecture that yields the best results in our setting.

Atari Games Atari Games 100k +2

Cannot find the paper you are looking for? You can Submit a new open access paper.