Playing Atari with Deep Reinforcement Learning

We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning, whose input is raw pixels and whose output is a value function estimating future rewards. We apply our method to seven Atari 2600 games from the Arcade Learning Environment, with no adjustment of the architecture or learning algorithm. We find that it outperforms all previous approaches on six of the games and surpasses a human expert on three of them.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Atari Games Atari 2600 Beam Rider DQN Best Score 5184 # 40
Atari Games Atari 2600 Breakout DQN Best Score 225 # 46
Atari Games Atari 2600 Enduro DQN Best Score 661 # 33
Atari Games Atari 2600 Pong DQN Best Score 21 # 1
Atari Games Atari 2600 Q*Bert DQN Best Score 4500 # 44
Atari Games Atari 2600 Seaquest DQN Best Score 1740 # 42
Atari Games Atari 2600 Space Invaders DQN Best Score 1075 # 44

Methods