EFIM: Efficient Serving of LLMs for Infilling Tasks with Improved KV Cache Reuse

1 code implementation • 28 May 2025 • Tianyu Guo, Hande Dong, Yichong Leng, Feng Liu, Cheater Lin, Nong Xiao, Xianwei Zhang

However, in infilling tasks, the KV cache reuse is often hindered by the structure of the prompt format, which typically consists of a prefix and suffix relative to the insertion point.

VecTrans: Enhancing Compiler Auto-Vectorization through LLM-Assisted Code Transformations

no code implementations • 25 Mar 2025 • Zhongchun Zheng, Kan Wu, Long Cheng, Lu Li, Rodrigo C. O. Rocha, Tianyi Liu, Wei Wei, Jianjiang Zeng, Xianwei Zhang, Yaoqing Gao

Auto-vectorization is a fundamental optimization for modern compilers to exploit SIMD parallelism.

Code Generation

THUEE system description for NIST 2019 SRE CTS Challenge

no code implementations • 25 Dec 2019 • Yi Liu, Tianyu Liang, Can Xu, Xianwei Zhang, Xianhong Chen, Wei-Qiang Zhang, Liang He, Dandan song, Ruyun Li, Yangcheng Wu, Peng Ouyang, Shouyi Yin

This paper describes the systems submitted by the department of electronic engineering, institute of microelectronics of Tsinghua university and TsingMicro Co. Ltd. (THUEE) to the NIST 2019 speaker recognition evaluation CTS challenge.

Speaker Recognition