no code implementations • 18 Oct 2022 • Benjamin Chamand, Olivier Risser-Maroix, Camille Kurtz, Philippe Joly, Nicolas Loménie
Temperature is a widely used hyperparameter in various tasks involving neural networks, such as classification or metric learning, whose choice can have a direct impact on the model performance.
no code implementations • 2 Aug 2022 • Olivier Risser-Maroix, Benjamin Chamand
The formula discovered on more than 260 datasets of embeddings has a Pearson's correlation of 0. 96 and a $r^2$ of 0. 93.