Search Results for author:
Found 28 papers, 18 papers with code
FGAseg: Fine-Grained Pixel-Text Alignment for Open-Vocabulary Semantic Segmentation
The core of FGAseg is a Pixel-Level Alignment module that employs a cross-modal attention mechanism and a text-pixel alignment loss to refine the coarse-grained alignment from CLIP, achieving finer-grained pixel-text semantic alignment.
Open Vocabulary Semantic Segmentation
Open-Vocabulary Semantic Segmentation
+1
OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
Document content extraction is crucial in computer vision, especially for meeting the high-quality data needs of large language models (LLMs) and retrieval-augmented generation (RAG) technologies.
DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
Pre-training on the resulting DocSynth-300K dataset significantly improves fine-tuning performance across various document types.
Ranked #2 on
Document Layout Analysis
on D4LA
MinerU: An Open-Source Solution for Precise Document Content Extraction
Document content analysis has been a crucial research area in computer vision.
Quantum-inspired Interpretable Deep Learning Architecture for Text Sentiment Analysis
Text has become the predominant form of communication on social media, embedding a wealth of emotional nuances.
TSI-Bench: Benchmarking Time Series Imputation
Despite the development of numerous deep learning algorithms for time series imputation, the community lacks standardized and comprehensive benchmark platforms to effectively evaluate imputation performance across different settings.
Time-Series Forecasting for Out-of-Distribution Generalization Using Invariant Learning
In this paper, we aim to alleviate the inherent OOD problem in TSF via invariant learning.
Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysis
To overcome this obstacle, we introduce Time-MMD, the first multi-domain, multimodal time series dataset covering 9 primary data domains.
Follow-Your-Pose v2: Multiple-Condition Guided Character Image Animation for Stable Pose Control
While existing character image animation methods using pose sequences and reference images have shown promising performance, they tend to struggle with incoherent animation in complex scenarios, such as multiple character animation and body occlusion.
DSDL: Data Set Description Language for Bridging Modalities and Tasks in AI Data
In the era of artificial intelligence, the diversity of data modalities and annotation formats often renders data unusable directly, requiring understanding and format conversion before it can be used by researchers or developers with different needs.
U3M: Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation
To address this issue, we leverage the inherent capabilities of the model itself to discover the optimal equilibrium in multimodal fusion and introduce U3M: An Unbiased Multiscale Modal Fusion Model for Multimodal Semantic Segmentation.
LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Prompting
Time-series forecasting (TSF) finds broad applications in real-world scenarios.
ART$\boldsymbol{\cdot}$V: Auto-Regressive Text-to-Video Generation with Diffusion Models
Second, it preserves the high-fidelity generation ability of the pre-trained image diffusion models by making only minimal network modifications.
Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
Multimodal large language models have made significant advancements in recent years, yet they still suffer from a common issue known as the "hallucination problem", in which the models generate textual descriptions that inaccurately depict or entirely fabricate content from associated images.
Performative Time-Series Forecasting
Time-series forecasting is a critical challenge in various domains and has witnessed substantial progress in recent years.
InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition
We propose InternLM-XComposer, a vision-language large model that enables advanced image-text comprehension and composition.
Ranked #9 on
Visual Question Answering (VQA)
on InfiMM-Eval
MLLM-DataEngine: An Iterative Refinement Approach for MLLM
Despite the great advance of Multimodal Large Language Models (MLLMs) in both instruction dataset building and benchmarking, the independence of training and evaluation makes current MLLMs hard to further improve their capability under the guidance of evaluation results with a relatively low human cost.
PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networks
Physics-Informed Neural Networks (PINNs) have emerged as a promising deep learning framework for approximating numerical solutions to partial differential equations (PDEs).
Filler Word Detection with Hard Category Mining and Inter-Category Focal Loss
Filler words like ``um" or ``uh" are common in spontaneous speech.
TridentSE: Guiding Speech Enhancement with 32 Global Tokens
In this paper, we present TridentSE, a novel architecture for speech enhancement, which is capable of efficiently capturing both global information and local details.
Exploring Effective Knowledge Transfer for Few-shot Object Detection
For the high-shot regime, we propose to use the knowledge learned from ImageNet as guidance for the feature learning in the fine-tuning stage, which will implicitly align the distributions of the novel classes.
An Anchor-Free Detector for Continuous Speech Keyword Spotting
Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefined keywords in a continuous speech.
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion
In the proposed paradigm, global and local factors in speech are explicitly decomposed and separately manipulated to achieve high speaker similarity and continuous prosody.
Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration
Given a piece of speech and its transcript text, text-based speech editing aims to generate speech that can be seamlessly inserted into the given speech by editing the transcript.
VisDrone-CC2020: The Vision Meets Drone Crowd Counting Challenge Results
Crowd counting on the drone platform is an interesting topic in computer vision, which brings new challenges such as small object inference, background clutter and wide viewpoint.
General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework
This paper presents a self-supervised learning framework, named MGF, for general-purpose speech representation learning.
Beating the Standard Quantum Limit under Ambient Conditions with Solid-State Spins
However, it has not been realized in solid-state spin systems at ambient conditions, owing to its intrinsic complexity for the preparation and survival of pure and entangled quantum states.
Quantum Physics
A Flow Base Bi-path Network for Cross-scene Video Crowd Understanding in Aerial View
Drones shooting can be applied in dynamic traffic monitoring, object detecting and tracking, and other vision tasks.
