Self-critical Sequence Training for Image Captioning

31 code implementations • CVPR 2017 • Steven J. Rennie, Etienne Marcheret, Youssef Mroueh, Jarret Ross, Vaibhava Goel

In this paper we consider the problem of optimizing image captioning systems using reinforcement learning, and show that by carefully optimizing our systems using the test metrics of the MSCOCO task, significant gains in performance can be realized.

Image Captioning Policy Gradient Methods +2