Implicit Quantile Networks for Distributional Reinforcement Learning

ICML 2018 • Will Dabney • Georg Ostrovski • David Silver • Rémi Munos

In this work, we build on recent advances in distributional reinforcement learning to give a generally applicable, flexible, and state-of-the-art distributional variant of DQN. We achieve this by using quantile regression to approximate the full quantile function for the state-action return distribution... (read more)

PDF Abstract

Evaluation results from the paper


Task Dataset Model Metric name Metric value Global rank Compare
Atari Games Atari 2600 Alien IQN Score 7022 # 1
Atari Games Atari 2600 Amidar IQN Score 2946 # 1
Atari Games Atari 2600 Assault IQN Score 29091 # 1
Atari Games Atari 2600 Asterix IQN Score 342016 # 4
Atari Games Atari 2600 Asteroids IQN Score 2898 # 4
Atari Games Atari 2600 Atlantis IQN Score 978200 # 3
Atari Games Atari 2600 Bank Heist IQN Score 1416 # 3
Atari Games Atari 2600 Battle Zone IQN Score 42244 # 1
Atari Games Atari 2600 Beam Rider IQN Score 42776 # 1
Atari Games Atari 2600 Berzerk IQN Score 1053 # 9
Atari Games Atari 2600 Bowling IQN Score 86.5 # 2
Atari Games Atari 2600 Boxing IQN Score 99.8 # 1
Atari Games Atari 2600 Breakout IQN Score 734 # 4
Atari Games Atari 2600 Centipede IQN Score 11561 # 2
Atari Games Atari 2600 Chopper Command IQN Score 16836 # 1
Atari Games Atari 2600 Crazy Climber IQN Score 179082 # 2
Atari Games Atari 2600 Defender IQN Score 53537 # 1
Atari Games Atari 2600 Demon Attack IQN Score 128580 # 2
Atari Games Atari 2600 Double Dunk IQN Score 5.6 # 3
Atari Games Atari 2600 Enduro IQN Score 2359 # 2
Atari Games Atari 2600 Fishing Derby IQN Score 33.8 # 5
Atari Games Atari 2600 Freeway IQN Score 34.0 # 1
Atari Games Atari 2600 Frostbite IQN Score 4324 # 5
Atari Games Atari 2600 Gopher IQN Score 118365 # 1
Atari Games Atari 2600 Gravitar IQN Score 911 # 2
Atari Games Atari 2600 HERO IQN Score 28386 # 5
Atari Games Atari 2600 Ice Hockey IQN Score 0.2 # 3
Atari Games Atari 2600 James Bond IQN Score 35108 # 1
Atari Games Atari 2600 Kangaroo IQN Score 15487 # 2
Atari Games Atari 2600 Krull IQN Score 10707 # 2
Atari Games Atari 2600 Kung-Fu Master IQN Score 73512 # 1
Atari Games Atari 2600 Montezuma's Revenge IQN Score 0.0 # 23
Atari Games Atari 2600 Ms. Pacman IQN Score 6349 # 2
Atari Games Atari 2600 Name This Game IQN Score 22682 # 1
Atari Games Atari 2600 Phoenix IQN Score 56599 # 2
Atari Games Atari 2600 Pitfall! IQN Score 0 # 1
Atari Games Atari 2600 Pong IQN Score 21.0 # 1
Atari Games Atari 2600 Private Eye IQN Score 200 # 16
Atari Games Atari 2600 Q*Bert IQN Score 25750 # 1
Atari Games Atari 2600 River Raid IQN Score 17765 # 3
Atari Games Atari 2600 Road Runner IQN Score 57900 # 5
Atari Games Atari 2600 Robotank IQN Score 62.5 # 7
Atari Games Atari 2600 Seaquest IQN Score 30140 # 4
Atari Games Atari 2600 Skiing IQN Score -9289 # 1
Atari Games Atari 2600 Solaris IQN Score 8007 # 1
Atari Games Atari 2600 Space Invaders IQN Score 28888 # 1
Atari Games Atari 2600 Star Gunner IQN Score 74677 # 7
Atari Games Atari 2600 Surround IQN Score 9.4 # 1
Atari Games Atari 2600 Tennis IQN Score 23.6 # 1
Atari Games Atari 2600 Time Pilot IQN Score 12236 # 3
Atari Games Atari 2600 Tutankham IQN Score 293 # 1
Atari Games Atari 2600 Up and Down IQN Score 88148 # 2
Atari Games Atari 2600 Venture IQN Score 1318 # 3
Atari Games Atari 2600 Video Pinball IQN Score 698045 # 3
Atari Games Atari 2600 Wizard of Wor IQN Score 31190 # 1
Atari Games Atari 2600 Yars Revenge IQN Score 28379 # 1
Atari Games Atari 2600 Zaxxon IQN Score 21772 # 3