Search Results for author:
Found 2 papers, 2 papers with code
ServerlessLLM: Low-Latency Serverless Inference for Large Language Models
This paper presents ServerlessLLM, a distributed system designed to support low-latency serverless inference for Large Language Models (LLMs).
Benchmarking, Analysis, and Optimization of Serverless Function Snapshots
We find that the execution time of a function started from a snapshot is 95% higher, on average, than when the same function is memory-resident.
Distributed, Parallel, and Cluster Computing
Cannot find the paper you are looking for? You can
Submit a new open access paper.
