no code implementations • 8 Apr 2022 • Yong Li, Heng Wang, Xiang Ye
Motivated by ANIL, we rethink the role of adaption in the feature extractor of CNAPs, which is a state-of-the-art representative few-shot method.
no code implementations • 29 Jun 2021 • Xiang Ye, Zihang He, Heng Wang, Yong Li
Instead, we verify the crucial role of feature map multiplication in attention mechanism and uncover a fundamental impact of feature map multiplication on the learned landscapes of CNNs: with the high order non-linearity brought by the feature map multiplication, it played a regularization role on CNNs, which made them learn smoother and more stable landscapes near real samples compared to vanilla CNNs.
