1 code implementation • 19 Sep 2024 • Zuyan Liu, Yuhao Dong, Ziwei Liu, Winston Hu, Jiwen Lu, Yongming Rao
Visual data comes in various forms, ranging from small icons of just a few pixels to long videos spanning hours.
Ranked #1 on Video Question Answering on Perception Test
1 code implementation • 13 Aug 2024 • Tianyu Liu, Yun Li, Qitan Lv, Kai Liu, Jianchen Zhu, Winston Hu
Speculative decoding (SD), where an extra draft model is employed to provide multiple \textit{draft} tokens first and then the original target model verifies these tokens in parallel, has shown great power for LLM inference acceleration.