Search Results for author: Giovanni Catania

Found 6 papers, 2 papers with code

The Copycat Perceptron: Smashing Barriers Through Collective Learning

no code implementations7 Aug 2023 Giovanni Catania, Aurélien Decelle, Beatriz Seoane

We characterize the equilibrium properties of a model of $y$ coupled binary perceptrons in the teacher-student scenario, subject to a learning rule, with an explicit ferromagnetic coupling proportional to the Hamming distance between the students' weights.

Federated Learning

Explaining the effects of non-convergent sampling in the training of Energy-Based Models

no code implementations23 Jan 2023 Elisabeth Agoritsas, Giovanni Catania, Aurélien Decelle, Beatriz Seoane

In this paper, we quantify the impact of using non-convergent Markov chains to train Energy-Based models (EBMs).

Thermodynamics of bidirectional associative memories

no code implementations17 Nov 2022 Adriano Barra, Giovanni Catania, Aurélien Decelle, Beatriz Seoane

Introduced by Kosko in 1988 as a generalization of the Hopfield model to a bipartite structure, the simplest architecture is defined by two layers of neurons, with synaptic connections only between units of different layers: even without internal connections within each layer, information storage and retrieval are still possible through the reverberation of neural activities passing from one layer to another.

Retrieval

Inference in conditioned dynamics through causality restoration

1 code implementation18 Oct 2022 Alfredo Braunstein, Giovanni Catania, Luca Dall'Asta, Matteo Mariani, Anna Paola Muntoni

Computing observables from conditioned dynamics is typically computationally hard, because, although obtaining independent samples efficiently from the unconditioned dynamics is usually feasible, generally most of the samples must be discarded (in a form of importance sampling) because they do not satisfy the imposed conditions.

Loop corrections in spin models through density consistency

1 code implementation24 Oct 2018 Alfredo Braunstein, Giovanni Catania, Luca Dall'Asta

Computing marginal distributions of discrete or semidiscrete Markov random fields (MRFs) is a fundamental, generally intractable problem with a vast number of applications in virtually all fields of science.

Cannot find the paper you are looking for? You can Submit a new open access paper.