MERGE: Fast Private Text Generation

1 code implementation • 25 May 2023 • Zi Liang, Pinghui Wang, Ruofei Zhang, Nuo Xu, Lifeng Xing, Shuo Zhang

The drastic increase in language models' parameters has led to a new trend of deploying models in cloud servers, raising growing concerns about private inference for Transformer-based models.

Code Completion Natural Language Understanding +2