1 code implementation • 8 Mar 2024 • Amir M. Mansourian, Arya Jalali, Rozhan Ahmadi, Shohreh Kasaei
In contrast to existing complex methodologies commonly employed for distilling knowledge from a teacher to a student, the pro-posed method showcases the efficacy of a simple yet powerful method for utilizing refined feature maps to transfer attention.