Convolutional Hough Matching Networks

31 Mar 2021  ·  Juhong Min, Minsu Cho ·

Despite advances in feature representation, leveraging geometric relations is crucial for establishing reliable visual correspondences under large variations of images. In this work we introduce a Hough transform perspective on convolutional matching and propose an effective geometric matching algorithm, dubbed Convolutional Hough Matching (CHM)... The method distributes similarities of candidate matches over a geometric transformation space and evaluate them in a convolutional manner. We cast it into a trainable neural layer with a semi-isotropic high-dimensional kernel, which learns non-rigid matching with a small number of interpretable parameters. To validate the effect, we develop the neural network with CHM layers that perform convolutional matching in the space of translation and scaling. Our method sets a new state of the art on standard benchmarks for semantic visual correspondence, proving its strong robustness to challenging intra-class variations. read more

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Semantic correspondence PF-PASCAL CHM PCK 91.6 # 2
Semantic correspondence PF-WILLOW CHM PCK 79.4 # 1
Semantic correspondence SPair-71k CHM PCK 46.3 # 2

Methods


No methods listed for this paper. Add relevant methods here