Evaluating Large Language Models for Generalization and Robustness via Data Compression

1 code implementation • 1 Feb 2024 • Yucheng Li, Yunhao Guo, Frank Guerin, Chenghua Lin

We measure: 1) the compression performance on the testing period as a measure of generalization on unseen data; and 2) the performance gap between the training and testing period as a measure of robustness.

Data Compression