Search Results for author: Zhengqi Liu

Found 2 papers, 1 papers with code

Good helper is around you: Attention-driven Masked Image Modeling

1 code implementation28 Nov 2022 Zhengqi Liu, Jie Gui, Hao Luo

Most previous works mask patches of the image randomly, which underutilizes the semantic information that is beneficial to visual representation learning.

Representation Learning Self-Supervised Learning

Neural networks with trainable matrix activation functions

no code implementations21 Sep 2021 Yuwen Li, Zhengqi Liu, Ludmil Zikatanov

The training process of neural networks usually optimize weights and bias parameters of linear transformations, while nonlinear activation functions are pre-specified and fixed.

Cannot find the paper you are looking for? You can Submit a new open access paper.