Search Results for author:
Found 10 papers, 1 papers with code
In-Context Data Distillation with TabPFN
Foundation models have revolutionized tasks in computer vision and natural language processing.
The Role of Baselines in Policy Gradient Optimization
Instead, the analysis reveals that the primary effect of the value baseline is to \textbf{reduce the aggressiveness of the updates} rather than their variance.
Bridging the Gap Between Target Networks and Functional Regularization
However, learning the value function via bootstrapping often leads to unstable training due to fast-changing target values.
Bridging the Gap Between Target Networks and Functional Regularization
Our findings emphasize that Functional Regularization can be used as a drop-in replacement for Target Networks and result in performance improvement.
Beyond variance reduction: Understanding the true impact of baselines on policy optimization
Traditionally, stochastic optimization theory predicts that learning dynamics are governed by the curvature of the loss function and the noise of the gradient estimates.
On the interplay between noise and curvature and its effect on optimization and generalization
The speed at which one can minimize an expected loss using stochastic methods depends on two properties: the curvature of the loss and the variance of the gradients.
Probabilistic Planning with Sequential Monte Carlo methods
In this work, we propose a novel formulation of planning which views it as a probabilistic inference problem over future optimal trajectories.
Disentangling the independently controllable factors of variation by interacting with the world
It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation.
Independently Controllable Factors
It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation.
Independently Controllable Features
Finding features that disentangle the different causes of variation in real data is a difficult task, that has nonetheless received considerable attention in static domains like natural images.
