Codebook Transfer with Part-of-Speech for Vector-Quantized Image Modeling

no code implementations • 15 Mar 2024 • Baoquan Zhang, Huaibin Wang, Luo Chuyao, Xutao Li, Liang Guotao, Yunming Ye, Xiaochen Qi, Yao He

To this end, we propose a novel codebook transfer framework with part-of-speech, called VQCT, which aims to transfer a well-trained codebook from pretrained language models to VQIM for robust codebook learning.

Image Generation