no code implementations • 16 Feb 2023 • Yanhong Fei, Xian Wei, Yingjie Liu, Zhengyu Li, Mingsong Chen
Although Deep Learning (DL) has achieved success in complex Artificial Intelligence (AI) tasks, it suffers from various notorious problems (e. g., feature redundancy, and vanishing or exploding gradients), since updating parameters in Euclidean space cannot fully exploit the geometric structure of the solution space.
no code implementations • 28 Jan 2022 • Yanhong Fei, Yingjie Liu, Xian Wei, Mingsong Chen
Inspired by the tremendous success of the self-attention mechanism in natural language processing, the Vision Transformer (ViT) creatively applies it to image patch sequences and achieves incredible performance.