Search Results for author:
Found 21 papers, 12 papers with code
VEGA: Learning Interleaved Image-Text Comprehension in Vision-Language Large Models
In support of this task, we further craft a new VEGA dataset, tailored for the IITC task on scientific content, and devised a subtask, Image-Text Association (ITA), to refine image-text correlation skills.
Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
With Video-MME, we extensively evaluate various state-of-the-art MLLMs, including GPT-4 series and Gemini 1. 5 Pro, as well as open-source image models like InternVL-Chat-V1. 5 and video models like LLaVA-NeXT-Video.
Cantor: Inspiring Multimodal Chain-of-Thought of MLLM
This paper delves into the realm of multimodal CoT to solve intricate visual reasoning tasks with multimodal large language models(MLLMs) and their cognitive capability.
SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation
To mitigate the problem of under-fitting, we design a transformer module named Multi-Cycled Transformer(MCT) based on multiple-cycled forwards to more fully exploit the potential of small model parameters.
A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise
They endow Large Language Models (LLMs) with powerful capabilities in visual understanding, enabling them to tackle diverse multi-modal tasks.
Aligning and Prompting Everything All at Once for Universal Visual Perception
However, predominant paradigms, driven by casting instance-level tasks as an object-word alignment, bring heavy cross-modality interaction, which is not effective in prompting object detection and visual grounding.
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image.
Multi-modal Queried Object Detection in the Wild
To address the learning inertia problem brought by the frozen detector, a vision conditioned masked language prediction strategy is proposed.
Ranked #2 on
Few-Shot Object Detection
on ODinW-35
Open Vocabulary Object Detection with Proposal Mining and Prediction Equalization
Open-vocabulary object detection (OVD) aims to scale up vocabulary size to detect objects of novel categories beyond the training vocabulary.
Ranked #17 on
Open Vocabulary Object Detection
on LVIS v1.0
Efficient Decoder-free Object Detection with Transformers
A natural usage of ViTs in detection is to replace the CNN-based backbone with a transformer-based backbone, which is straightforward and effective, with the price of bringing considerable computation burden for inference.
ARM: Any-Time Super-Resolution Method
To that effect, we construct an Edge-to-PSNR lookup table that maps the edge score of an image patch to the PSNR performance for each subnet, together with a set of computation costs for the subnets.
Aha! Adaptive History-Driven Attack for Decision-Based Black-Box Models
A common practice is to start from a large perturbation and then iteratively reduce it with a deterministic direction and a random one while keeping it adversarial.
Occlude Them All: Occlusion-Aware Attention Network for Occluded Person Re-ID
To avoid such problematic models in occluded person ReID, we propose the Occlusion-Aware Mask Network (OAMN).
Dual Distribution Alignment Network for Generalizable Person Re-Identification
Domain generalization (DG) serves as a promising solution to handle person Re-Identification (Re-ID), which trains the model using labels from the source domain alone, and then directly adopts the trained model to the target domain without model updating.
Domain Generalization
Generalizable Person Re-identification
Learning Task-oriented Disentangled Representations for Unsupervised Domain Adaptation
This drawback limits the flexibility of UDA in complicated open-set tasks where no labels are shared between domains.
Video-based Person Re-identification with Two-stream Convolutional Network and Co-attentive Snippet Embedding
Recently, the applications of person re-identification in visual surveillance and human-computer interaction are sharply increasing, which signifies the critical role of such a problem.
Optical Flow Estimation
Video-Based Person Re-Identification
A Novel Document Generation Process for Topic Detection based on Hierarchical Latent Tree Models
It is the new state-of-the-art for the hierarchical topic detection.
Sparse Boltzmann Machines with Structure Learning as Applied to Text Analysis
We are interested in exploring the possibility and benefits of structure learning for deep models.
Latent Tree Models for Hierarchical Topic Detection
The variables at other levels are binary latent variables, with those at the lowest latent level representing word co-occurrence patterns and those at higher levels representing co-occurrence of patterns at the level below.
Progressive EM for Latent Tree Models and Hierarchical Topic Detection
It is as efficient as the state-of-the-art LDA-based method for hierarchical topic detection and finds substantially better topics and topic hierarchies.
Bayesian Adaptive Matrix Factorization With Automatic Model Selection
Low-rank matrix factorization has long been recognized as a fundamental problem in many computer vision applications.
