Search Results for author:
Found 2 papers, 2 papers with code
KV Prediction for Improved Time to First Token
In our method, a small auxiliary model is used to process the prompt and produce an approximation of the KV cache used by a base model.
OpenELM: An Efficient Language Model Family with Open Training and Inference Framework
To this end, we release OpenELM, a state-of-the-art open language model.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
