Semantic Segmentation

1929 papers with code • 51 benchmarks • 185 datasets

Semantic segmentation, or image segmentation, is the task of clustering parts of an image together which belong to the same object class. It is a form of pixel-level prediction because each pixel in an image is classified according to a category. Some example benchmarks for this task are Cityscapes, PASCAL VOC and ADE20K. Models are usually evaluated with the Mean Intersection-Over-Union (Mean IoU) and Pixel Accuracy metrics.

( Image credit: CSAILVision )

Greatest papers with code

The surprising impact of mask-head architecture on novel class segmentation

tensorflow/models 1 Apr 2021

Within this family, we show that the architecture of the mask-head plays a surprisingly important role in generalization to classes for which we do not observe masks during training.

Instance Segmentation Semantic Segmentation

Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation

tensorflow/models ECCV 2020

We view this work as a notable step towards building a simple procedure to harness unlabeled video sequences and extra images to surpass state-of-the-art performance on core computer vision tasks.

Optical Flow Estimation Panoptic Segmentation +2

Searching for MobileNetV3

tensorflow/models ICCV 2019

We achieve new state of the art results for mobile classification, detection and segmentation.

Ranked #57 on Semantic Segmentation on Cityscapes test (using extra training data)

Image Classification Neural Architecture Search +2

FEELVOS: Fast End-to-End Embedding Learning for Video Object Segmentation

tensorflow/models CVPR 2019

Many of the recent successful methods for video object segmentation (VOS) are overly complicated, heavily rely on fine-tuning on the first frame, and/or are slow, and are hence of limited practical use.

Semantic Segmentation Semi-Supervised Video Object Segmentation +1

Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation

tensorflow/models CVPR 2019

Therefore, we propose to search the network level structure in addition to the cell level structure, which forms a hierarchical architecture search space.

Image Classification Neural Architecture Search +1

Searching for Efficient Multi-Scale Architectures for Dense Image Prediction

tensorflow/models NeurIPS 2018

Recent progress has demonstrated that such meta-learning methods may exceed scalable human-invented architectures on image classification tasks.

Image Classification Meta-Learning +2

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

tensorflow/models ECCV 2018

The former networks are able to encode multi-scale contextual information by probing the incoming features with filters or pooling operations at multiple rates and multiple effective fields-of-view, while the latter networks can capture sharper object boundaries by gradually recovering the spatial information.

Ranked #2 on Semantic Segmentation on PASCAL VOC 2012 test (using extra training data)

Image Classification Lesion Segmentation +1

MobileNetV2: Inverted Residuals and Linear Bottlenecks

tensorflow/models CVPR 2018

In this paper we describe a new mobile architecture, MobileNetV2, that improves the state of the art performance of mobile models on multiple tasks and benchmarks as well as across a spectrum of different model sizes.

Image Classification Object Detection +3

Rethinking Atrous Convolution for Semantic Image Segmentation

tensorflow/models 17 Jun 2017

To handle the problem of segmenting objects at multiple scales, we design modules which employ atrous convolution in cascade or in parallel to capture multi-scale context by adopting multiple atrous rates.

Ranked #6 on Semantic Segmentation on PASCAL VOC 2012 val (using extra training data)

Semantic Segmentation

Mask R-CNN

tensorflow/models ICCV 2017

Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance.

3D Instance Segmentation Human Part Segmentation +7