Search Results for author:
Found 4 papers, 1 papers with code
MoE-Infinity: Activation-Aware Expert Offloading for Efficient MoE Serving
This paper presents MoE-Infinity, a cost-efficient mixture-of-expert (MoE) serving system that realizes activation-aware expert offloading.
ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models
This paper presents ServerlessLLM, a locality-enhanced serverless inference system for Large Language Models (LLMs).
Enhancing the long-term performance of recommender system
Notably, an optimal parameter n* of ARL existed in long-term recommendation, indicating that there is a trade-off between keeping diversity of item and user's preference to maximize the long-term recommendation accuracy.
Predictability of diffusion-based recommender systems
The results show that the higher recommendation accuracy based on diffusion algorithms can still be achieved by optimizing the way of resource allocation on a density network.
