LandscapeAR: Large Scale Outdoor Augmented Reality by Matching Photographs with Terrain Models Using Learned Descriptors

We introduce a solution to large scale Augmented Reality for outdoor scenes by registering camera images to textured Digital Elevation Models (DEMs). To accomodate the inherent differences in appearance between real images and DEMs, we train a cross-domain feature descriptor using Structure From Motion (SFM) reconstructions to acquire training data. Our method runs efficiently on a mobile device, and outperforms existing learned and hand designed feature descriptors for this task.

PDF Abstract

Datasets


Results from the Paper


Ranked #2 on Patch Matching on HPatches (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Benchmark
Patch Matching HPatches LSAR-aux-render Patch Verification 95.6 # 1
Patch Matching 45.3 # 2
Patch Retrieval 55.6 # 2

Methods


No methods listed for this paper. Add relevant methods here