Game-MUG: Multimodal Oriented Game Situation Understanding and Commentary Generation Dataset

no code implementations • 30 Apr 2024 • Zhihao Zhang, Feiqi Cao, Yingbin Mo, Yiran Zhang, Josiah Poon, Caren Han

In addition, we also propose a new audience conversation augmented commentary dataset by covering the game situation and audience conversation understanding, and introducing a robust joint multimodal dual learning model as a baseline.

FedRDMA: Communication-Efficient Cross-Silo Federated LLM via Chunked RDMA Transmission

no code implementations • 1 Mar 2024 • Zeling Zhang, Dongqi Cai, Yiran Zhang, Mengwei Xu, Shangguang Wang, Ao Zhou

Communication overhead is a significant bottleneck in federated learning (FL), which has been exaggerated with the increasing size of AI models.

Federated Learning

A Marker-free Head Tracker Using Vision-based Head Pose Estimation with Adaptive Kalman Filter

no code implementations • 24 Mar 2021 • Zhongxu Hu, Chen Lv, Yanxin Zhou, Yiran Zhang, Wenhui Huang

To handle the error of the head pose estimation model, this paper proposes an adaptive Kalman Filter.

Head Pose Estimation Position