Universe Points Representation Learning for Partial Multi-Graph Matching

1 Dec 2022  ·  Zhakshylyk Nurlanov, Frank R. Schmidt, Florian Bernard ·

Many challenges from natural world can be formulated as a graph matching problem. Previous deep learning-based methods mainly consider a full two-graph matching setting. In this work, we study the more general partial matching problem with multi-graph cycle consistency guarantees. Building on a recent progress in deep learning on graphs, we propose a novel data-driven method (URL) for partial multi-graph matching, which uses an object-to-universe formulation and learns latent representations of abstract universe points. The proposed approach advances the state of the art in semantic keypoint matching problem, evaluated on Pascal VOC, CUB, and Willow datasets. Moreover, the set of controlled experiments on a synthetic graph matching dataset demonstrates the scalability of our method to graphs with large number of nodes and its robustness to high partiality.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Graph Matching CUB URL F1 score 0.951 # 1
Graph Matching PASCAL VOC URL matching accuracy 0.818 # 5
F1 score 0.717±0.005 # 1
Graph Matching Willow Object Class URL matching accuracy 0.989 # 3

Methods


No methods listed for this paper. Add relevant methods here