Search Results for author:
Found 11 papers, 8 papers with code
Conditional Prototype Rectification Prompt Learning
Recent advancements in efficient transfer learning (ETL) have shown remarkable success in fine-tuning VLMs within the scenario of limited data, introducing only a few parameters to harness task-specific insights from VLMs.
Segment Anything Model Meets Image Harmonization
Image harmonization is a crucial technique in image composition that aims to seamlessly match the background by adjusting the foreground of composite images.
Boosting Audio-visual Zero-shot Learning with Large Language Models
Audio-visual zero-shot learning aims to recognize unseen categories based on paired audio-visual sequences.
Ranked #1 on
GZSL Video Classification
on ActivityNet-GZSL (cls)
Realizing In-Memory Baseband Processing for Ultra-Fast and Energy-Efficient 6G
To support emerging applications ranging from holographic communications to extended reality, next-generation mobile wireless communication systems require ultra-fast and energy-efficient baseband processors.
ControlCom: Controllable Image Composition using Diffusion Model
To address these challenges, we propose a controllable image composition method that unifies four tasks in one diffusion model: image blending, image harmonization, view synthesis, and generative composition.
DiffUTE: Universal Text Editing Diffusion Model
Specifically, we build our model on a diffusion model and carefully modify the network structure to enable the model for drawing multilingual characters with the help of glyph and position information.
Mobile User Interface Element Detection Via Adaptively Prompt Tuning
Recent object detection approaches rely on pretrained vision-language models for image-text alignment.
DiffusionInst: Diffusion Model for Instance Segmentation
Extensive experimental results on COCO and LVIS show that DiffusionInst achieves competitive performance compared to existing instance segmentation models with various backbones, such as ResNet and Swin Transformers.
Ranked #8 on
Instance Segmentation
on LVIS v1.0 val
Hierarchical Dynamic Image Harmonization
The MGD effectively applies distinct convolution to the foreground and background, learning the representations of foreground and background regions as well as their correlations to the global harmonization, facilitating local visual consistency for the images much more efficiently.
Ranked #2 on
Image Harmonization
on HAdobe5k(1024$\times$1024)
Realizing Ultra-Fast and Energy-Efficient Baseband Processing Using Analogue Resistive Switching Memory
To support emerging applications ranging from holographic communications to extended reality, next-generation mobile wireless communication systems require ultra-fast and energy-efficient (UFEE) baseband processors.
XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding
Recently, various multimodal networks for Visually-Rich Document Understanding(VRDU) have been proposed, showing the promotion of transformers by integrating visual and layout information with the text embeddings.
document understanding
Optical Character Recognition (OCR)
+1
