Detr, or Detection Transformer, is a set-based object detector using a Transformer on top of a convolutional backbone. It uses a conventional CNN backbone to learn a 2D representation of an input image. The model flattens it and supplements it with a positional encoding before passing it into a transformer encoder. A transformer decoder then takes as input a small fixed number of learned positional embeddings, which we call object queries, and additionally attends to the encoder output. We pass each output embedding of the decoder to a shared feed forward network (FFN) that predicts either a detection (class and bounding box) or a “no object” class.
Source: End-to-End Object Detection with TransformersPaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Object Detection | 144 | 25.09% |
Object | 72 | 12.54% |
Decoder | 53 | 9.23% |
Semantic Segmentation | 16 | 2.79% |
Instance Segmentation | 14 | 2.44% |
Real-Time Object Detection | 10 | 1.74% |
Autonomous Driving | 9 | 1.57% |
2D Object Detection | 8 | 1.39% |
Image Classification | 7 | 1.22% |
Component | Type |
|
---|---|---|
![]() |
Convolutional Neural Networks | (optional) |
![]() |
Convolutions | |
![]() |
Feedforward Networks | |
![]() |
Transformers |