p-Laplacian Adaptation for Generative Pre-trained Vision-Language Models

1 code implementation • 17 Dec 2023 • Haoyuan Wu, Xinyun Zhang, Peng Xu, Peiyu Liao, Xufeng Yao, Bei Yu

In this paper, we present a novel modeling framework that recasts adapter tuning after attention as a graph message passing process on attention graphs, where the projected query and value features and attention matrix constitute the node features and the graph adjacency matrix, respectively.

Image Captioning Question Answering +3