# Cross-Iteration Batch Normalization

13 Feb 2020Zhuliang YaoYue CaoShuxin ZhengGao HuangStephen Lin

A well-known issue of Batch Normalization is its significantly reduced effectiveness in the case of small mini-batch sizes. When a mini-batch contains few examples, the statistics upon which the normalization is defined cannot be reliably estimated from it during a training iteration... (read more)

PDF Abstract