Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning

no code implementations • CVPR 2016 • Pingbo Pan, Zhongwen Xu, Yi Yang, Fei Wu, Yueting Zhuang

In this paper, we propose a new approach, namely Hierarchical Recurrent Neural Encoder (HRNE), to exploit temporal information of videos.

Image Classification Video Captioning

Learning Discriminators as Energy Networks in Adversarial Learning

no code implementations • ICLR 2019 • Pingbo Pan, Yan Yan, Tianbao Yang, Yi Yang

In this work, we propose to refine the predictions of structured prediction models by effectively integrating discriminative models into the prediction.

Image Segmentation Multi-Label Classification +2

DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesis

4 code implementations • CVPR 2019 • Minfeng Zhu, Pingbo Pan, Wei Chen, Yi Yang

If the initial image is not well initialized, the following processes can hardly refine the image to a satisfactory quality.

Generative Adversarial Network Text-to-Image Generation

Continual Deep Learning by Functional Regularisation of Memorable Past

1 code implementation • NeurIPS 2020 • Pingbo Pan, Siddharth Swaroop, Alexander Immer, Runa Eschenhagen, Richard E. Turner, Mohammad Emtiyaz Khan

Continually learning new skills is important for intelligent systems, yet standard deep learning methods suffer from catastrophic forgetting of the past.