Focal and Global Knowledge Distillation for Detectors

1 code implementation • 23 Nov 2021 • Zhendong Yang, Zhe Li, Xiaohu Jiang, Yuan Gong, Zehuan Yuan, Danpei Zhao, Chun Yuan

Global distillation rebuilds the relation between different pixels and transfers it from teachers to students, compensating for missing global information in focal distillation.

Knowledge Distillation Object Detection

Guiding Query Position and Performing Similar Attention for Transformer-Based Detection Heads

no code implementations • 22 Aug 2021 • Xiaohu Jiang, Ze Chen, Zhicheng Wang, Erjin Zhou, ChunYuan

After DETR was proposed, this novel transformer-based detection paradigm which performs several cross-attentions between object queries and feature maps for predictions has subsequently derived a series of transformer-based detection heads.