Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model

19 Nov 2019Julian SchrittwieserIoannis AntonoglouThomas HubertKaren SimonyanLaurent SifreSimon SchmittArthur GuezEdward LockhartDemis HassabisThore GraepelTimothy LillicrapDavid Silver

Constructing agents with planning capabilities has long been one of the main challenges in the pursuit of artificial intelligence. Tree-based planning methods have enjoyed huge success in challenging domains, such as chess and Go, where a perfect simulator is available... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Atari Games Atari 2600 Alien MuZero Score 741812.63 # 1
Atari Games Atari 2600 Amidar MuZero Score 28634.39 # 2
Atari Games Atari 2600 Assault MuZero Score 143972.03 # 1
Atari Games Atari 2600 Asterix MuZero Score 998425.00 # 2
Atari Games Atari 2600 Asteroids MuZero Score 678558.64 # 1
Atari Games Atari 2600 Atlantis MuZero Score 1674767.20 # 1
Atari Games Atari 2600 Bank Heist MuZero Score 1278.98 # 6
Atari Games Atari 2600 Battle Zone MuZero Score 848623.00 # 1
Atari Games Atari 2600 Beam Rider MuZero Score 454993.53 # 1
Atari Games Atari 2600 Berzerk MuZero Score 85932.60 # 1
Atari Games Atari 2600 Bowling MuZero Score 260.13 # 1
Atari Games Atari 2600 Boxing MuZero Score 100.00 # 1
Atari Games Atari 2600 Breakout MuZero Score 864.00 # 1
Atari Games Atari 2600 Centipede MuZero Score 1159049.27 # 1
Atari Games Atari 2600 Chopper Command MuZero Score 991039.70 # 1
Atari Games Atari 2600 Crazy Climber MuZero Score 458315.40 # 1
Atari Games Atari 2600 Defender MuZero Score 839642.95 # 1
Atari Games Atari 2600 Demon Attack MuZero Score 143964.26 # 1
Atari Games Atari 2600 Double Dunk MuZero Score 23.94 # 1
Atari Games Atari 2600 Enduro MuZero Score 2382.44 # 2
Atari Games Atari 2600 Fishing Derby MuZero Score 91.16 # 1
Atari Games Atari 2600 Freeway MuZero Score 33.03 # 6
Atari Games Atari 2600 Frostbite MuZero Score 631378.53 # 1
Atari Games Atari 2600 Gopher MuZero Score 130345.58 # 1
Atari Games Atari 2600 Gravitar MuZero Score 6682.70 # 2
Atari Games Atari 2600 HERO MuZero Score 49244.11 # 1
Atari Games Atari 2600 Ice Hockey MuZero Score 67.04 # 2
Atari Games Atari 2600 James Bond MuZero Score 41063.25 # 2
Atari Games Atari 2600 Kangaroo MuZero Score 16763.60 # 1
Atari Games Atari 2600 Krull MuZero Score 269358.27 # 1
Atari Games Atari 2600 Kung-Fu Master MuZero Score 204824.00 # 2
Atari Games Atari 2600 Montezuma's Revenge MuZero Score 0.00 # 25
Atari Games Atari 2600 Ms. Pacman MuZero Score 243401.10 # 1
Atari Games Atari 2600 Name This Game MuZero Score 157177.85 # 1
Atari Games Atari 2600 Phoenix MuZero Score 955137.84 # 1
Atari Games Atari 2600 Pitfall! MuZero Score 0.00 # 1
Atari Games Atari 2600 Pong MuZero Score 21.00 # 1
Atari Games Atari 2600 Private Eye MuZero Score 15299.98 # 1
Atari Games Atari 2600 Q*Bert MuZero Score 72276.00 # 4
Atari Games Atari 2600 River Raid MuZero Score 323417.18 # 1
Atari Games Atari 2600 Road Runner MuZero Score 613411.80 # 1
Atari Games Atari 2600 Robotank MuZero Score 131.13 # 1
Atari Games Atari 2600 Seaquest MuZero Score 999976.52 # 2
Atari Games Atari 2600 Skiing MuZero Score -29968.36 # 5
Atari Games Atari 2600 Solaris MuZero Score 56.62 # 6
Atari Games Atari 2600 Space Invaders MuZero Score 74335.30 # 1
Atari Games Atari 2600 Star Gunner MuZero Score 549271.70 # 2
Atari Games Atari 2600 Surround MuZero Score 9.99 # 1
Atari Games Atari 2600 Tennis MuZero Score 0.00 # 10
Atari Games Atari 2600 Time Pilot MuZero Score 476763.90 # 1
Atari Games Atari 2600 Tutankham MuZero Score 491.48 # 1
Atari Games Atari 2600 Up and Down MuZero Score 715545.61 # 1
Atari Games Atari 2600 Venture MuZero Score 0.40 # 29
Atari Games Atari 2600 Video Pinball MuZero Score 981791.88 # 2
Atari Games Atari 2600 Wizard of Wor MuZero Score 197126.00 # 1
Atari Games Atari 2600 Yars Revenge MuZero Score 553311.46 # 2
Atari Games Atari 2600 Zaxxon MuZero Score 725853.90 # 1
Atari Games Atari-57 MuZero Medium Human-Normalized Score 2041.1% # 1
Atari Games Atari-57 MuZero Reanalyze Medium Human-Normalized Score 731.1% # 3