Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization

no code implementations • 24 Mar 2024 • Linzhi Wu, Xingyu Zhang, Yakun Zhang, Changyan Zheng, Tiejun Liu, Liang Xie, Ye Yan, Erwei Yin

Lip reading, the process of interpreting silent speech from visual lip movements, has gained rising attention for its wide range of realistic applications.

Lip Reading

Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigation

1 code implementation • ICCV 2023 • Yibo Cui, Liang Xie, Yakun Zhang, Meishan Zhang, Ye Yan, Erwei Yin

To address this problem, we propose a novel Grounded Entity-Landmark Adaptive (GELA) pre-training paradigm for VLN tasks.

Descriptive Vision and Language Navigation

Planimation

1 code implementation • 11 Aug 2020 • Gang Chen, Yi Ding, Hugo Edwards, Chong Hin Chau, Sai Hou, Grace Johnson, Mohammed Sharukh Syed, Haoyuan Tang, Yue Wu, Ye Yan, Gil Tidhar, Nir Lipovetzky

Planimation is a modular and extensible open source framework to visualise sequential solutions of planning problems specified in PDDL.