1 code implementation • 26 Mar 2024 • Xinglu Pan, Chenxiao Liu, Yanzhen Zou, Tao Xie, Bing Xie
In this paper, we raise the awareness of the supplementary nature of method-level comments and propose a new metric named MESIA (Mean Supplementary Information Amount) to assess the extent of supplementary information that a code comment can provide.
1 code implementation • 8 May 2023 • Chenxiao Liu, Shuai Lu, Weizhu Chen, Daxin Jiang, Alexey Svyatkovskiy, Shengyu Fu, Neel Sundaresan, Nan Duan
Code execution is a fundamental aspect of programming language semantics that reflects the exact behavior of the code.
1 code implementation • 2 Dec 2021 • Chenxiao Liu, Guanzhi Deng, Tao Ji, Difei Tang, Silai Zheng
One challenge for evaluating current sequence- or dialogue-level chatbots, such as Empathetic Open-domain Conversation Models, is to determine whether the chatbot performs in an emotionally consistent way.
1 code implementation • Findings (EMNLP) 2021 • Chenxiao Liu, Xiaojun Wan
We propose CodeQA, a free-form question answering dataset for the purpose of source code comprehension: given a code snippet and a question, a textual answer is required to be generated.