Search Results for author:
Found 4 papers, 4 papers with code
White-box Compiler Fuzzing Empowered by Large Language Models
Nonetheless, prompting LLMs with compiler source-code information remains a missing piece of research in compiler testing.
CacheGen: KV Cache Compression and Streaming for Fast Language Model Serving
Compared to the recent systems that reuse the KV cache, CacheGen reduces the KV cache size by 3. 7-4. 3x and the total delay in fetching and processing contexts by 2. 7-3. 2x while having negligible impact on the LLM response quality in accuracy or perplexity.
A pruning method based on the dissimilarity of angle among channels and filters
Firstly, we train a sparse model by GL penalty, and impose an angle dissimilarity constraint on the channels and filters of convolutional network to obtain a more sparse structure.
Neural Network Panning: Screening the Optimal Sparse Network Before Training
Pruning on neural networks before training not only compresses the original models, but also accelerates the network training phase, which has substantial application value.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
