Search Results for author: Zhangchen Zhou

Found 3 papers, 0 papers with code

Anchor function: a type of benchmark functions for studying language models

no code implementations16 Jan 2024 Zhongwang Zhang, Zhiwei Wang, Junjie Yao, Zhangchen Zhou, Xiaolong Li, Weinan E, Zhi-Qin John Xu

However, language model research faces significant challenges, especially for academic research groups with constrained resources.

Language Modelling

Understanding the Initial Condensation of Convolutional Neural Networks

no code implementations17 May 2023 Zhangchen Zhou, Hanxu Zhou, Yuqing Li, Zhi-Qin John Xu

Previous research has shown that fully-connected networks with small initialization and gradient-based training methods exhibit a phenomenon known as condensation during training.

Phase Diagram of Initial Condensation for Two-layer Neural Networks

no code implementations12 Mar 2023 Zhengan Chen, Yuqing Li, Tao Luo, Zhangchen Zhou, Zhi-Qin John Xu

The phenomenon of distinct behaviors exhibited by neural networks under varying scales of initialization remains an enigma in deep learning research.

Vocal Bursts Valence Prediction

Cannot find the paper you are looking for? You can Submit a new open access paper.