OCR Models
TrOCR
Introduced by Li et al. in TrOCR: Transformer-based Optical Character Recognition with Pre-trained ModelsTrOCR is an end-to-end Transformer-based OCR model for text recognition with pre-trained CV and NLP models. It leverages the Transformer architecture for both image understanding and wordpiece-level text generation. It first resizes the input text image into $384 × 384$ and then the image is split into a sequence of 16 patches which are used as the input to image Transformers. Standard Transformer architecture with the self-attention mechanism is leveraged on both encoder and decoder parts, where wordpiece units are generated as the recognized text from the input image.
Source: TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Optical Character Recognition (OCR) | 3 | 37.50% |
| Adversarial Attack | 1 | 12.50% |
| Handwritten Text Recognition | 1 | 12.50% |
| Language Modelling | 1 | 12.50% |
| Scene Text Recognition | 1 | 12.50% |
| Text Generation | 1 | 12.50% |
Layer Normalization
Multi-Head Attention
Residual Connection
Scaled Dot-Product Attention
