no code implementations • 18 Jan 2024 • Wei Huang, Yinggui Wang, Anda Cheng, Aihui Zhou, Chaofan Yu, Lei Wang
In this paper, we propose a secure distributed LLM based on model slicing.
no code implementations • 13 Oct 2020 • Junming Ma, Chaofan Yu, Aihui Zhou, Bingzhe Wu, Xibin Wu, Xingyu Chen, Xiangqun Chen, Lei Wang, Donggang Cao
We present S3ML, a secure serving system for machine learning inference in this paper.