Search Results for author:
Found 12 papers, 9 papers with code
Honeybee: Locality-enhanced Projector for Multimodal LLM
In Multimodal Large Language Models (MLLMs), a visual projector plays a crucial role in bridging pre-trained vision encoders with LLMs, enabling profound visual understanding while harnessing the LLMs' robust capabilities.
Ranked #1 on
Science Question Answering
on ScienceQA
(using extra training data)
Learning Pseudo-Labeler beyond Noun Concepts for Open-Vocabulary Object Detection
Specifically, the proposed method aims to learn arbitrary image-to-text mapping for pseudo-labeling of arbitrary concepts, named Pseudo-Labeling for Arbitrary Concepts (PLAC).
Learning to Generate Text-grounded Mask for Open-world Semantic Segmentation from Only Image-Text Pairs
Existing open-world segmentation methods have shown impressive advances by employing contrastive learning (CL) to learn diverse visual concepts and transferring the learned image-level understanding to the segmentation task.
Ranked #2 on
Semantic Segmentation
on CC3M-TagMask
Contrastive Learning
Open Vocabulary Semantic Segmentation
+4
Domain Generalization by Mutual-Information Regularization with Pre-trained Models
Domain generalization (DG) aims to learn a generalized model to an unseen target domain using only limited source domains.
Ranked #2 on
Domain Generalization
on TerraIncognita
Few-shot Font Generation with Weakly Supervised Localized Representations
Existing methods learn to disentangle style and content elements by developing a universal style representation for each font style.
HoughCL: Finding Better Positive Pairs in Dense Self-supervised Learning
Compared to previous works, our method shows better or comparable performance on dense prediction fine-tuning tasks.
Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Experts
MX-Font extracts multiple style features not explicitly conditioned on component labels, but automatically by multiple experts to represent different local concepts, e. g., left-side sub-glyph.
SWAD: Domain Generalization by Seeking Flat Minima
Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains.
Ranked #17 on
Domain Generalization
on TerraIncognita
Scale down Transformer by Grouping Features for a Lightweight Character-level Language Model
This paper introduces a method that efficiently reduces the computational cost and parameter size of Transformer.
Few-shot Font Generation with Localized Style Representations and Factorization
However, learning component-wise styles solely from reference glyphs is infeasible in the few-shot font generation scenario, when a target script has a large number of components, e. g., over 200 for Chinese.
Few-shot Compositional Font Generation with Dual Memory
By utilizing the compositionality of compositional scripts, we propose a novel font generation framework, named Dual Memory-augmented Font Generation Network (DM-Font), which enables us to generate a high-quality font library with only a few samples.
Group-Transformer: Towards A Lightweight Character-level Language Model
When compared to Transformers with a comparable number of parameters and time complexity, the proposed model shows better performance.
