Search Results for author: Jiachi Chen

Found 6 papers, 2 papers with code

RepoTransBench: A Real-World Benchmark for Repository-Level Code Translation

no code implementations23 Dec 2024 Yanli Wang, Yanlin Wang, Suiquan Wang, Daya Guo, Jiachi Chen, John Grundy, Xilin Liu, Yuchi Ma, Mingzhi Mao, Hongyu Zhang, Zibin Zheng

However, even with this improvement, the Success@1 score of the best-performing LLM is only 21%, which may not meet the need for reliable automatic repository-level code translation.

Code Translation Translation

LLM Hallucinations in Practical Code Generation: Phenomena, Mechanism, and Mitigation

no code implementations30 Sep 2024 Ziyao Zhang, Yanlin Wang, Chong Wang, Jiachi Chen, Zibin Zheng

In this paper, we conduct an empirical study to study the phenomena, mechanism, and mitigation of LLM hallucinations within more practical and complex development contexts in repository-level generation scenario.

Code Generation Hallucination +1

RMCBench: Benchmarking Large Language Models' Resistance to Malicious Code

1 code implementation23 Sep 2024 Jiachi Chen, Qingyuan Zhong, Yanlin Wang, Kaiwen Ning, Yongkun Liu, Zenan Xu, Zhe Zhao, Ting Chen, Zibin Zheng

Despite their benefits, LLMs also pose notable risks, including the potential to generate harmful content and being abused by malicious developers to create malicious code.

Benchmarking Code Generation

Agents in Software Engineering: Survey, Landscape, and Vision

1 code implementation13 Sep 2024 Yanlin Wang, Wanjun Zhong, Yanxian Huang, Ensheng Shi, Min Yang, Jiachi Chen, Hui Li, Yuchi Ma, Qianxiang Wang, Zibin Zheng

In recent years, Large Language Models (LLMs) have achieved remarkable success and have been widely used in various downstream tasks, especially in the tasks of the software engineering (SE) field.

Survey

Beyond Functional Correctness: Investigating Coding Style Inconsistencies in Large Language Models

no code implementations29 Jun 2024 Yanlin Wang, Tianyue Jiang, Mingwei Liu, Jiachi Chen, Zibin Zheng

In this paper, we empirically analyze the differences in coding style between the code generated by mainstream Code LLMs and the code written by human developers, and summarize coding style inconsistency taxonomy.

Code Generation

Smart Contract Security: a Practitioners' Perspective

no code implementations22 Feb 2021 Zhiyuan Wan, Xin Xia, David Lo, Jiachi Chen, Xiapu Luo, Xiaohu Yang

Given numerous research efforts in addressing the security issues of smart contracts, we wondered how software practitioners build security into smart contracts in practice.

Software Engineering

Cannot find the paper you are looking for? You can Submit a new open access paper.