CloudEval-YAML: A Practical Benchmark for Cloud Configuration Generation

1 code implementation • 10 Nov 2023 • Yifei Xu, Yuning Chen, Xumiao Zhang, Xianshang Lin, Pan Hu, Yunfei Ma, Songwu Lu, Wan Du, Zhuoqing Mao, Ennan Zhai, Dennis Cai

We develop the CloudEval-YAML benchmark with practicality in mind: the dataset consists of hand-written problems with unit tests targeting practical scenarios.

Benchmarking Cloud Computing +3