Search Results for author:
Found 1 papers, 0 papers with code
vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention
Thus, vAttention unburdens the attention kernel developer from having to explicitly support paging and avoids re-implementation of memory management in the serving framework.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
