Search Results for author: Simon Brunner

Found 1 papers, 1 papers with code

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

4 code implementations • 22 Jun 2024 • Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, Binyuan Hui, Niklas Muennighoff, David Lo, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro von Werra

In addition, using multiple tools to solve a task needs compositional reasoning by accurately understanding complex instructions.

Ranked #1 on Code Generation on BigCodeBench-Instruct

Benchmarking Code Generation

462

Paper
Code

Cannot find the paper you are looking for? You can Submit a new open access paper.