SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a Spectral Perspective

1 code implementation • 16 Mar 2023 • Zipeng Xu, Songlong Xing, Enver Sangineto, Nicu Sebe

However, directly using CLIP to guide style transfer leads to undesirable artifacts (mainly written words and unrelated visual entities) spread over the image.

Image Generation Style Transfer

Analyzing Unaligned Multimodal Sequence via Graph Convolution and Graph Pooling Fusion

no code implementations • 27 Nov 2020 • Sijie Mai, Songlong Xing, Jiaxuan He, Ying Zeng, Haifeng Hu

A majority of existing works generally focus on aligned fusion, mostly at word level, of the three modalities to accomplish this task, which is impractical in real-world scenarios.

Modality to Modality Translation: An Adversarial Representation Learning and Graph Fusion Network for Multimodal Fusion

1 code implementation • 18 Nov 2019 • Sijie Mai, Haifeng Hu, Songlong Xing

Visualization of the learned embeddings suggests that the joint embedding space learned by our method is discriminative.

Representation Learning Translation

Divide, Conquer and Combine: Hierarchical Feature Fusion Network with Local and Global Perspectives for Multimodal Affective Computing

no code implementations • ACL 2019 • Sijie Mai, Haifeng Hu, Songlong Xing

We propose a general strategy named {`}divide, conquer and combine{'} for multimodal fusion.