Deep High-Resolution Representation Learning for Visual Recognition

20 Aug 2019Jingdong WangKe SunTianheng ChengBorui JiangChaorui DengYang ZhaoDong LiuYadong MuMingkui TanXinggang WangWenyu LiuBin Xiao

High-resolution representations are essential for position-sensitive vision problems, such as human pose estimation, semantic segmentation, and object detection. Existing state-of-the-art frameworks first encode the input image as a low-resolution representation through a subnetwork that is formed by connecting high-to-low resolution convolutions \emph{in series} (e.g., ResNet, VGGNet), and then recover the high-resolution representation from the encoded low-resolution representation... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Semantic Segmentation CamVid HRNetV2 (HRNetV2-W48) Mean IoU 78.47% # 2
Semantic Segmentation Cityscapes val HRNetV2 (HRNetV2-W48) mIoU 81.1% # 2
Semantic Segmentation Cityscapes val HRNetV2 (HRNetV2-W40) mIoU 80.2% # 5
Object Detection COCO minival Mask R-CNN (HRNetV2p-W18) box AP 39.2 # 39
Object Detection COCO minival Mask R-CNN (HRNetV2p-W18) APS 23.7 # 21
Object Detection COCO minival Mask R-CNN (HRNetV2p-W18) APM 41.7 # 29
Object Detection COCO minival Mask R-CNN (HRNetV2p-W18) APL 51.0 # 26
Object Detection COCO minival Faster R-CNN (HRNetV2p-W48) box AP 41.8 # 27
Object Detection COCO minival Faster R-CNN (HRNetV2p-W48) AP50 62.8 # 7
Object Detection COCO minival Faster R-CNN (HRNetV2p-W48) AP75 45.9 # 12
Object Detection COCO minival Faster R-CNN (HRNetV2p-W48) APS 25.0 # 17
Object Detection COCO minival Faster R-CNN (HRNetV2p-W48) APM 44.7 # 19
Object Detection COCO minival Faster R-CNN (HRNetV2p-W48) APL 54.6 # 18
Object Detection COCO minival HTC (HRNetV2p-W18) box AP 43.1 # 20
Object Detection COCO minival HTC (HRNetV2p-W18) APS 26.6 # 12
Object Detection COCO minival HTC (HRNetV2p-W18) APM 46 # 16
Object Detection COCO minival HTC (HRNetV2p-W18) APL 56.9 # 14
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32) box AP 42.3 # 23
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32) APS 25.0 # 17
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32) APM 45.4 # 18
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32) APL 54.9 # 17
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32, cascade) box AP 44.5 # 16
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32, cascade) APS 26.1 # 14
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32, cascade) APM 47.9 # 11
Object Detection COCO minival Mask R-CNN (HRNetV2p-W32, cascade) APL 58.5 # 8
Object Detection COCO minival HTC (HRNetV2p-W32) box AP 45.3 # 10
Object Detection COCO minival HTC (HRNetV2p-W32) APS 27 # 10
Object Detection COCO minival HTC (HRNetV2p-W32) APM 48.4 # 8
Object Detection COCO minival HTC (HRNetV2p-W32) APL 59.5 # 4
Object Detection COCO minival Mask R-CNN (HRNetV2p-W48, cascade) box AP 46.0 # 8
Object Detection COCO minival Mask R-CNN (HRNetV2p-W48, cascade) APS 27.5 # 9
Object Detection COCO minival Mask R-CNN (HRNetV2p-W48, cascade) APM 48.9 # 7
Object Detection COCO minival Mask R-CNN (HRNetV2p-W48, cascade) APL 60.1 # 3
Object Detection COCO minival HTC (HRNetV2p-W48) box AP 47.0 # 5
Object Detection COCO minival HTC (HRNetV2p-W48) APS 28.8 # 5
Object Detection COCO minival HTC (HRNetV2p-W48) APM 50.3 # 5
Object Detection COCO minival HTC (HRNetV2p-W48) APL 62.2 # 1
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W48) box AP 44.6 # 15
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W48) AP50 62.7 # 8
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W48) AP75 48.7 # 7
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W48) APS 26.3 # 13
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W48) APM 48.1 # 10
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W48) APL 58.5 # 8
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W18) box AP 41.3 # 31
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W18) AP50 59.2 # 23
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W18) AP75 44.9 # 14
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W18) APS 23.7 # 21
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W18) APM 44.2 # 21
Object Detection COCO minival Cascade R-CNN (HRNetV2p-W18) APL 54.1 # 19
Object Detection COCO minival Faster R-CNN (HRNetV2p-W32) box AP 40.9 # 33
Object Detection COCO minival Faster R-CNN (HRNetV2p-W32) AP50 61.8 # 12
Object Detection COCO minival Faster R-CNN (HRNetV2p-W32) AP75 44.8 # 15
Object Detection COCO minival Faster R-CNN (HRNetV2p-W32) APS 24.4 # 19
Object Detection COCO minival Faster R-CNN (HRNetV2p-W32) APM 43.7 # 24
Object Detection COCO minival Faster R-CNN (HRNetV2p-W32) APL 53.3 # 20
Object Detection COCO minival Faster R-CNN (HRNetV2p-W18) box AP 38.0 # 45
Object Detection COCO minival Faster R-CNN (HRNetV2p-W18) AP50 58.9 # 24
Object Detection COCO minival Faster R-CNN (HRNetV2p-W18) AP75 41.5 # 26
Object Detection COCO minival Faster R-CNN (HRNetV2p-W18) APS 22.6 # 25
Object Detection COCO minival Faster R-CNN (HRNetV2p-W18) APM 40.8 # 31
Object Detection COCO minival Faster R-CNN (HRNetV2p-W18) APL 49.6 # 29
Object Detection COCO test-dev CenterNet (HRNetV2-W48) box AP 43.5 # 29
Object Detection COCO test-dev CenterNet (HRNetV2-W48) AP50 62.1 # 35
Object Detection COCO test-dev CenterNet (HRNetV2-W48) AP75 46.5 # 27
Object Detection COCO test-dev CenterNet (HRNetV2-W48) APS 22.2 # 45
Object Detection COCO test-dev CenterNet (HRNetV2-W48) APM 46.5 # 25
Object Detection COCO test-dev CenterNet (HRNetV2-W48) APL 57.8 # 13
Object Detection COCO test-dev Faster R-CNN (HRNetV2p-W48) box AP 42.4 # 37
Object Detection COCO test-dev Faster R-CNN (HRNetV2p-W48) AP50 63.6 # 25
Object Detection COCO test-dev Faster R-CNN (HRNetV2p-W48) AP75 46.4 # 28
Object Detection COCO test-dev Faster R-CNN (HRNetV2p-W48) APS 24.9 # 31
Object Detection COCO test-dev Faster R-CNN (HRNetV2p-W48) APM 44.6 # 34
Object Detection COCO test-dev Faster R-CNN (HRNetV2p-W48) APL 53.0 # 36
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W48 + cascade) box AP 46.1 # 17
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W48 + cascade) AP50 64.0 # 23
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W48 + cascade) AP75 50.3 # 16
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W48 + cascade) APS 27.1 # 19
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W48 + cascade) APM 48.6 # 16
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W48 + cascade) APL 58.3 # 11
Object Detection COCO test-dev Cascade R-CNN (HRNetV2p-W48) box AP 44.8 # 21
Object Detection COCO test-dev Cascade R-CNN (HRNetV2p-W48) AP50 63.1 # 28
Object Detection COCO test-dev Cascade R-CNN (HRNetV2p-W48) AP75 48.6 # 20
Object Detection COCO test-dev Cascade R-CNN (HRNetV2p-W48) APS 26.0 # 24
Object Detection COCO test-dev Cascade R-CNN (HRNetV2p-W48) APM 47.3 # 20
Object Detection COCO test-dev Cascade R-CNN (HRNetV2p-W48) APL 56.3 # 19
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W32 + cascade) box AP 44.7 # 22
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W32 + cascade) AP50 62.5 # 32
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W32 + cascade) AP75 48.6 # 20
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W32 + cascade) APS 25.8 # 25
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W32 + cascade) APM 47.1 # 22
Object Detection COCO test-dev Mask R-CNN (HRNetV2p-W32 + cascade) APL 56.3 # 19
Object Detection COCO test-dev FCOS (HRNetV2p-W48) box AP 40.5 # 47
Object Detection COCO test-dev FCOS (HRNetV2p-W48) AP50 59.3 # 47
Object Detection COCO test-dev FCOS (HRNetV2p-W48) AP75 43.3 # 45
Object Detection COCO test-dev FCOS (HRNetV2p-W48) APS 23.4 # 40
Object Detection COCO test-dev FCOS (HRNetV2p-W48) APM 42.6 # 43
Object Detection COCO test-dev FCOS (HRNetV2p-W48) APL 51.0 # 47
Semantic Segmentation PASCAL Context CFNet (ResNet-101) mIoU 54.0 # 4