Search Results for author: Jihao Gu

Found 5 papers, 0 papers with code

"See the World, Discover Knowledge": A Chinese Factuality Evaluation for Large Vision Language Models

no code implementations17 Feb 2025 Jihao Gu, Yingyao Wang, Pi Bu, Chen Wang, ZiMing Wang, Tengtao Song, Donglai Wei, Jiale Yuan, Yingxiu Zhao, Yancheng He, Shilong Li, Jiaheng Liu, Meng Cao, Jun Song, Yingshui Tan, Xiang Li, Wenbo Su, Zhicheng Zheng, Xiaoyong Zhu, Bo Zheng

The evaluation of factual accuracy in large vision language models (LVLMs) has lagged behind their rapid development, making it challenging to fully reflect these models' knowledge capacity and reliability.

Object Recognition Question Answering +1

Performance Analysis of Traditional VQA Models Under Limited Computational Resources

no code implementations9 Feb 2025 Jihao Gu

In real-world applications where computational resources are limited, effectively integrating visual and textual information for Visual Question Answering (VQA) presents significant challenges.

Question Answering Visual Question Answering

Token Preference Optimization with Self-Calibrated Visual-Anchored Rewards for Hallucination Mitigation

no code implementations19 Dec 2024 Jihao Gu, Yingyao Wang, Meng Cao, Pi Bu, Jun Song, Yancheng He, Shilong Li, Bo Zheng

Direct Preference Optimization (DPO) has been demonstrated to be highly effective in mitigating hallucinations in Large Vision Language Models (LVLMs) by aligning their outputs more closely with human preferences.

Hallucination

2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision

no code implementations25 Oct 2024 Shilong Li, Yancheng He, Hui Huang, Xingyuan Bu, Jiaheng Liu, Hangyu Guo, Weixun Wang, Jihao Gu, Wenbo Su, Bo Zheng

Recent advancements in Direct Preference Optimization (DPO) have significantly enhanced the alignment of Large Language Models (LLMs) with human preferences, owing to its simplicity and effectiveness.

SARA: Singular-Value Based Adaptive Low-Rank Adaption

no code implementations6 Aug 2024 Jihao Gu, Shuai Chen, Zelin Wang, Yibo Zhang, Ping Gong

However, the rank values need to be manually verified to match different downstream tasks, and they cannot accommodate the varying importance of different layers in the model.

parameter-efficient fine-tuning

Cannot find the paper you are looking for? You can Submit a new open access paper.