Search Results for author:
Found 7 papers, 6 papers with code
Video-R1: Reinforcing Video Reasoning in MLLMs
However, directly applying RL training with the GRPO algorithm to video reasoning presents two primary challenges: (i) a lack of temporal modeling for video reasoning, and (ii) the scarcity of high-quality video-reasoning data.
HiddenDetect: Detecting Jailbreak Attacks against Large Vision-Language Models via Monitoring Hidden States
The integration of additional modalities increases the susceptibility of large vision-language models (LVLMs) to safety risks, such as jailbreak attacks, compared to their language-only counterparts.
GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-training
Given the significant differences between geometric diagram-symbol and natural image-text, we introduce unimodal pre-training to develop a diagram encoder and symbol decoder, enhancing the understanding of geometric images and corpora.
Chimera: Improving Generalist Model with Domain-Specific Experts
This results in a versatile model that excels across the chart, table, math, and document domains, achieving state-of-the-art performance on multi-modal reasoning and visual content extraction tasks, both of which are challenging tasks for assessing existing LMMs.
Multi-modal Auto-regressive Modeling via Visual Words
Large Language Models (LLMs), benefiting from the auto-regressive modelling approach performed on massive unannotated texts corpora, demonstrates powerful perceptual and reasoning capabilities.
Ranked #91 on
Visual Question Answering
on MM-Vet
A Novel Energy based Model Mechanism for Multi-modal Aspect-Based Sentiment Analysis
However, previous methods still have certain limitations: (i) They ignore the difference in the focus of visual information between different analysis targets (aspect or sentiment).
FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction
To address these deficiencies, we propose the Fuzzy Span Universal Information Extraction (FSUIE) framework.
