Feature-based Knowledge Distillation is a subfield of KD that relies on intermediate network representations, either unaltered or depth-reduced via maximum activation maps, as the source knowledge.
Action recognition is currently one of the top-challenging research fields in computer vision.
Scene recognition is currently one of the top-challenging research fields in computer vision.
Ranked #1 on Scene Recognition on ADE20K
Contrarily to the majority of the methods of the state-of-the-art, the proposed approach is scene-agnostic, not requiring a tailored adaptation to the target scenario\textemdash e. g., via fine-tunning.