Consensus-based Sequence Training for Video Captioning

no code implementations • 27 Dec 2017 • Sang Phan, Gustav Eje Henter, Yusuke Miyao, Shin'ichi Satoh

First we show that, by replacing model samples with ground-truth sentences, RL training can be seen as a form of weighted cross-entropy loss, giving a fast, RL-based pre-training algorithm.

Reinforcement Learning (RL) Video Captioning

Generating Video Description using Sequence-to-sequence Model with Temporal Attention

no code implementations • COLING 2016 • Natsuda Laokulrat, Sang Phan, Noriki Nishida, Raphael Shu, Yo Ehara, Naoaki Okazaki, Yusuke Miyao, Hideki Nakayama

Automatic video description generation has recently been getting attention after rapid advancement in image caption generation.

Caption Generation Sentence +2

Video Event Detection by Exploiting Word Dependencies from Image Captions

no code implementations • COLING 2016 • Sang Phan, Yusuke Miyao, Duy-Dinh Le, Shin{'}ichi Satoh

We conduct extensive experiments to analyze the effectiveness of using the new dependency representation for event detection on two large-scale TRECVID Multimedia Event Detection 2013 and 2014 datasets.

Action Detection Event Detection +2