VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity

no code implementations • 14 Mar 2025 • Jing Bi, Junjia Guo, Susan Liang, Guangyu Sun, Luchuan Song, Yunlong Tang, Jinxi He, Jiarui Wu, Ali Vosoughi, Chen Chen, Chenliang Xu

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment.

Benchmarking Decision Making +2

Generative AI for Cel-Animation: A Survey

1 code implementation • 8 Jan 2025 • Yunlong Tang, Junjia Guo, Pinxin Liu, Zhiyuan Wang, Hang Hua, Jia-Xing Zhong, Yunzhong Xiao, Chao Huang, Luchuan Song, Susan Liang, Yizhi Song, Liu He, Jing Bi, Mingqian Feng, Xinyang Li, Zeliang Zhang, Chenliang Xu

Traditional Celluloid (Cel) Animation production pipeline encompasses multiple essential steps, including storyboarding, layout design, keyframe animation, inbetweening, and colorization, which demand substantial manual effort, technical expertise, and significant time investment.

Colorization Layout Design +1

Unveiling Visual Perception in Language Models: An Attention Head Analysis Approach

no code implementations • 24 Dec 2024 • Jing Bi, Junjia Guo, Yunlong Tang, Lianggong Bruce Wen, Zhang Liu, Chenliang Xu

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated remarkable progress in visual understanding.

VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?

no code implementations • 17 Nov 2024 • Yunlong Tang, Junjia Guo, Hang Hua, Susan Liang, Mingqian Feng, Xinyang Li, Rui Mao, Chao Huang, Jing Bi, Zeliang Zhang, Pooyan Fazli, Chenliang Xu

The advancement of Multimodal Large Language Models (MLLMs) has enabled significant progress in multimodal understanding, expanding their capacity to analyze video content.

Multiple-choice