Search Results for author: Liyao Gao

Found 9 papers, 2 papers with code

On Optimal Early Stopping: Over-informative versus Under-informative Parametrization

no code implementations20 Feb 2022 Ruoqi Shen, Liyao Gao, Yi-An Ma

We demonstrate experimentally that our theoretical results on optimal early stopping time corresponds to the training process of deep neural networks.

Deformation Robust Roto-Scale-Translation Equivariant CNNs

no code implementations22 Nov 2021 Liyao Gao, Guang Lin, Wei Zhu

Incorporating group symmetry directly into the learning process has proved to be an effective guideline for model design.

Out-of-Distribution Generalization Translation

On Optimal Early Stopping: Overparametrization versus Underparametrization

no code implementations29 Sep 2021 Ruoqi Shen, Liyao Gao, Yian Ma

Early stopping is a simple and widely used method to prevent over-training neural networks.

Non-convex Learning via Replica Exchange Stochastic Gradient MCMC

2 code implementations ICML 2020 Wei Deng, Qi Feng, Liyao Gao, Faming Liang, Guang Lin

Replica exchange Monte Carlo (reMC), also known as parallel tempering, is an important technique for accelerating the convergence of the conventional Markov Chain Monte Carlo (MCMC) algorithms.

Ranked #77 on Image Classification on CIFAR-100 (using extra training data)

Image Classification

Learning with Collaborative Neural Network Group by Reflection

no code implementations8 Jan 2019 Liyao Gao, Zehua Cheng

CNNG is a progression of neural systems that work cooperatively to deal with various errands independently in a similar learning framework.

Cortex Neural Network: learning with Neural Network groups

no code implementations10 Apr 2018 Liyao Gao

The Cortex Neural Network is an upper architecture of neural networks which motivated from cerebral cortex in the brain to handle different tasks in the same learning system.

Machine Translation

Cannot find the paper you are looking for? You can Submit a new open access paper.