Search Results for author: Haiyun He

Found 5 papers, 1 papers with code

Information-Theoretic Generalization Bounds for Deep Neural Networks

no code implementations4 Apr 2024 Haiyun He, Christina Lee Yu, Ziv Goldfeld

This enables refining our generalization bounds to capture the contraction as a function of the network architecture parameters.

Generalization Bounds

How Does Pseudo-Labeling Affect the Generalization Error of the Semi-Supervised Gibbs Algorithm?

no code implementations15 Oct 2022 Haiyun He, Gholamali Aminian, Yuheng Bu, Miguel Rodrigues, Vincent Y. F. Tan

Our findings offer new insights that the generalization performance of SSL with pseudo-labeling is affected not only by the information between the output hypothesis and input training data but also by the information {\em shared} between the {\em labeled} and {\em pseudo-labeled} data samples.

regression

Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning

1 code implementation3 Oct 2021 Haiyun He, Hanshu Yan, Vincent Y. F. Tan

Using information-theoretic principles, we consider the generalization error (gen-error) of iterative semi-supervised learning (SSL) algorithms that iteratively generate pseudo-labels for a large amount of unlabelled data to progressively refine the model parameters.

Generalization Bounds

Information-Theoretic Generalization Bounds for Iterative Semi-Supervised Learning

no code implementations29 Sep 2021 Haiyun He, Hanshu Yan, Vincent Tan

We consider iterative semi-supervised learning (SSL) algorithms that iteratively generate pseudo-labels for a large amount unlabelled data to progressively refine the model parameters.

Generalization Bounds

Optimal Change-Point Detection with Training Sequences in the Large and Moderate Deviations Regimes

no code implementations13 Mar 2020 Haiyun He, Qiaosheng Zhang, Vincent Y. F. Tan

This paper investigates a novel offline change-point detection problem from an information-theoretic perspective.

Change Point Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.