no code implementations • 28 Mar 2024 • Yiyu Wang, Hao Luo, Jungang Xu, Yingfei Sun, Fan Wang
Among them, the mainstream solution is to project image embeddings into the text embedding space with the assistance of consistent representations between image-text pairs from the CLIP model.
2 code implementations • 29 Mar 2022 • Yiyu Wang, Jungang Xu, Yingfei Sun
Firstly, we adopt SwinTransformer to replace Faster R-CNN as the backbone encoder to extract grid-level features from given images; Then, referring to Transformer, we build a refining encoder and a decoder.
no code implementations • NeurIPS 2020 • Eli Sennesh, Zulqarnain Khan, Yiyu Wang, Jennifer Dy, Ajay B. Satpute, J. Benjamin Hutchinson, Jan-Willem van de Meent
Neuroimaging studies produce gigabytes of spatio-temporal data for a small number of participants and stimuli.
no code implementations • 20 May 2019 • Yiyu Wang, Jungang Xu, Yingfei Sun, Ben He
Image captioning is a challenging task and attracting more and more attention in the field of Artificial Intelligence, and which can be applied to efficient image retrieval, intelligent blind guidance and human-computer interaction, etc.