Loss Functions

Edit

General • 29 methods

Loss Functions are used to frame the problem to be optimized within deep learning. Below you will find a continuously updating list of (specialized) loss functions for neutral networks.

Methods

Add a Method

Method	Year	Papers
Focal Loss Focal Loss for Dense Object Detection	2017	221
Cycle Consistency Loss Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks	2017	216
Triplet Loss Triplet Loss in Siamese Network for Object Tracking	2018	215
GAN Least Squares Loss Least Squares Generative Adversarial Networks	2016	206
InfoNCE Representation Learning with Contrastive Predictive Coding	2018	111
GAN Hinge Loss Geometric GAN	2017	77
NT-Xent Improved Deep Metric Learning with Multi-class N-pair Loss Objective	2016	52
WGAN-GP Loss Improved Training of Wasserstein GANs	2017	41
ArcFace ArcFace: Additive Angular Margin Loss for Deep Face Recognition	2018	33
VGG Loss Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network	2016	25
Adaptive Loss A General and Adaptive Robust Loss Function	2017	23
CTC Loss	2000	22
Early exiting BranchyNet: Fast Inference via Early Exiting from Deep Neural Networks	2017	16
Supervised Contrastive Loss Supervised Contrastive Learning	2020	13
uPIT Permutation Invariant Training of Deep Models for Speaker-Independent Multi-talker Speech Separation	2016	7
Lovasz-Softmax	2000	5
Balanced L1 Loss Libra R-CNN: Towards Balanced Learning for Object Detection	2019	4
Generalized Focal Loss Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection	2020	2
Varifocal Loss VarifocalNet: An IoU-aware Dense Object Detector	2020	2
Dynamic SmoothL1 Loss Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training	2020	1
Self-Adjusting Smooth L1 Loss RetinaMask: Learning to predict masks improves state-of-the-art single-shot detection for free	2019	1
DSAM loss DSAM: A Distance Shrinking with Angular Marginalizing Loss for High Performance Vehicle Re-identificatio	2020	1
Triplet Entropy Loss Triplet Entropy Loss: Improving The Generalisation of Short Speech Language Identification Systems	2020	1
GHM-C Gradient Harmonized Single-stage Detector	2018	1
GHM-R Gradient Harmonized Single-stage Detector	2018	1
Metrix It Takes Two to Tango: Mixup for Deep Metric Learning	2021	1
PIoU Loss PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments	2020	1
Dual Softmax Loss Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss	2021	1
UFLoss High Fidelity Deep Learning-based MRI Reconstruction with Instance-wise Discriminative Feature Matching Loss	2021	1

Loss Functions Edit

Methods Add a Method

Loss Functions

Edit

Methods

Add a Method