PMMTalk: Speech-Driven 3D Facial Animation from Complementary Pseudo Multi-modal Features

no code implementations • 5 Dec 2023 • Tianshun Han, Shengnan Gui, Yiqing Huang, Baihui Li, Lijian Liu, Benjia Zhou, Ning Jiang, Quan Lu, Ruicong Zhi, Yanyan Liang, Du Zhang, Jun Wan

The framework entails three modules: PMMTalk encoder, cross-modal alignment module, and PMMTalk decoder.

speech-recognition Speech Recognition +1

Teacher-Critical Training Strategies for Image Captioning

no code implementations • 30 Sep 2020 • Yiqing Huang, Jiansheng Chen

To effectively learn from the teacher model, we propose Teacher-Critical Training Strategies (TCTS) for both XE and RL training to facilitate better learning processes for the caption model.

Image Captioning Reinforcement Learning (RL)

Coalitional Games with Stochastic Characteristic Functions and Private Types

no code implementations • 25 Oct 2019 • Dengji Zhao, Yiqing Huang, Liat Cohen, Tal Grinshpoun

The research on coalitional games has focused on how to share the reward among a coalition such that players are incentivised to collaborate together.