Hierarchical Scene Graph Encoder-Decoder for Image Paragraph Captioning

no code implementations • ACM International Conference on Multimedia 2020 • Yang, Xu, Chongyang Gao, Hanwang Zhang, and Jianfei Cai

We propose irredundant attention in SSG-RNN to improve the possibility of abstracting topics from rarely described sub-graphs and inheriting attention in WSG-RNN to generate more grounded sentences with the abstracted topics, both of which give rise to more distinctive paragraphs.

Image Paragraph Captioning Sentence