Search Results for author:
Found 1 papers, 0 papers with code
Privacy-Aware Semantic Cache for Large Language Models
Caching is a natural solution to reduce LLM inference costs on repeated queries which constitute about 31% of the total queries.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
