no code implementations • 23 Jan 2024 • Daniel Goldfarb, Itay Evron, Nir Weinberger, Daniel Soudry, Paul Hand
Previous works have analyzed separately how forgetting is affected by either task similarity or overparameterization.
no code implementations • 1 Jun 2022 • Daniel Goldfarb, Paul Hand
We show experimentally that in permuted MNIST image classification tasks, the generalization performance of multilayer perceptrons trained by vanilla stochastic gradient descent can be improved by overparameterization, and the extent of the performance increase achieved by overparameterization is comparable to that of state-of-the-art continual learning algorithms.
no code implementations • 31 Oct 2019 • Daniel Goldfarb, Scott Evans
Recent developments have linked causal inference with Algorithmic Information Theory, and methods have been developed that utilize Conditional Kolmogorov Complexity to determine causation between two random variables.