Biologically-Constrained Graphs for Global Connectomics Reconstruction

Most current state-of-the-art connectome reconstruction pipelines have two major steps: initial pixel-based segmentation with affinity prediction and watershed transform, and refined segmentation by merging over-segmented regions. These methods rely only on local context and are typically agnostic to the underlying biology. Since a few merge errors can lead to several incorrectly merged neuronal processes, these algorithms are currently tuned towards over-segmentation producing an overburden of costly proofreading. We propose a third step for connectomics reconstruction pipelines to refine an over-segmentation using both local and global context with an emphasis on adhering to the underlying biology. We first extract a graph from an input segmentation where nodes correspond to segment labels and edges indicate potential split errors in the over-segmentation. In order to increase throughput and allow for large-scale reconstruction, we employ biologically inspired geometric constraints based on neuron morphology to reduce the number of nodes and edges. Next, two neural networks learn these neuronal shapes to further aid the graph construction process. Lastly, we reformulate the region merging problem as a graph partitioning one to leverage global context. We demonstrate the performance of our approach on four real-world connectomics datasets with an average variation of information improvement of 21.3%.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


 Ranked #1 on Electron Microscopy Image Segmentation on SNEMI3D (Total Variation of Information metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Electron Microscopy Image Segmentation SNEMI3D Waterz (3D U-Net) + Refinement Total Variation of Information 0.647 # 1
VI Split 0.438 # 1
VI Merge 0.209 # 1
Electron Microscopy Image Segmentation SNEMI3D Waterz (3D U-Net) Total Variation of Information 0.807 # 2
VI Split 0.571 # 2
VI Merge 0.236 # 2

Methods


No methods listed for this paper. Add relevant methods here