Mathematical Justification of Hard Negative Mining via Isometric Approximation Theorem

no code implementations • 20 Oct 2022 • Albert Xu, Jhih-Yi Hsieh, Bhaskar Vundurthy, Eliana Cohen, Howie Choset, Lu Li

In this paper, we utilize the mathematical theory of isometric approximation to show an equivalence between the Triplet Loss sampled by hard negative mining and an optimization problem that minimizes a Hausdorff-like distance between the neural network and its ideal counterpart function.

Contrastive Learning Metric Learning +2