no code implementations • 30 Dec 2022 • Aolin Xu, Peng Guan
The traditional statistical inference is static, in the sense that the estimate of the quantity of interest does not affect the future evolution of the quantity.
no code implementations • 29 Nov 2021 • Aolin Xu
How the optimal estimation strategy works is illustrated through two examples, stock trend prediction and vehicle behavior prediction.
no code implementations • 31 Dec 2020 • Aolin Xu
We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical learning theory: the excess risk analyses for various learning methods.
no code implementations • 29 Dec 2020 • Aolin Xu, Maxim Raginsky
We analyze the best achievable performance of Bayesian learning under generative models by defining and upper-bounding the minimum excess risk (MER): the gap between the minimum expected loss attainable by learning from data and the minimum expected loss that could be achieved if the model realization were known.
no code implementations • NeurIPS 2017 • Aolin Xu, Maxim Raginsky
We derive upper bounds on the generalization error of a learning algorithm in terms of the mutual information between its input and output.