StatLLM: A Dataset for Evaluating the Performance of Large Language Models in Statistical Analysis

1 code implementation • 24 Feb 2025 • Xinyi Song, Lina Lee, Kexin Xie, Xueying Liu, Xinwei Deng, Yili Hong

A major challenge in this evaluation lies in the absence of a benchmark dataset for statistical code (e. g., SAS and R).

Performance Evaluation of Large Language Models in Statistical Programming

1 code implementation • 18 Feb 2025 • Xinyi Song, Kexin Xie, Lina Lee, Ruizhe Chen, Jared M. Clark, Hao He, Haoran He, Jie Min, Xinlei Zhang, Simin Zheng, Zhiyang Zhang, Xinwei Deng, Yili Hong

This study offers valuable insights into the capabilities and limitations of LLMs in statistical programming, providing guidance for future advancements in AI-assisted coding systems for statistical analysis.

Code Generation

A Comprehensive Case Study on the Performance of Machine Learning Methods on the Classification of Solar Panel Electroluminescence Images

1 code implementation • 12 Aug 2024 • Xinyi Song, Kennedy Odongo, Francis G. Pascual, Yili Hong

In this paper, we comprehensively compare different machine learning and deep learning methods under different performance metrics on the classification of solar cell EL images from monocrystalline and polycrystalline modules.