no code implementations • 6 Mar 2024 • John Day, Tushar Arora, Jirui Liu, Li Erran Li, Ming Bo Cai
As part of human core knowledge, the representation of objects is the building block of mental representation that supports high-level concepts and symbolic reasoning.
1 code implementation • 11 Jan 2024 • Chenghao Li, Boheng Zeng, Yi Lu, Pengbo Shi, Qingzi Chen, Jirui Liu, Lingyun Zhu
We revisit the relationship between attention mechanisms and large kernel ConvNets in visual transformers and propose a new spatial attention named Large Kernel Convolutional Attention (LKCA).