no code implementations • 26 Feb 2022 • Wentao Zhu, Hang Shang, Tingxun Lv, Chao Liao, Sen yang, Ji Liu
Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention.
no code implementations • NeurIPS 2021 • Xuefan Zha, Wentao Zhu, Tingxun Lv, Sen yang, Ji Liu
However, the pure-Transformer based spatio-temporal learning can be prohibitively costly on memory and computation to extract fine-grained features from a tiny patch.