Search Results for author:
Found 5 papers, 2 papers with code
Decoding Speculative Decoding
Speculative Decoding is a widely used technique to speed up inference for Large Language Models (LLMs) without sacrificing quality.
PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices
As neural networks (NN) are deployed across diverse sectors, their energy demand correspondingly grows.
Distributed SLIDE: Enabling Training Large Neural Networks on Low Bandwidth and Simple CPU-Clusters via Model Parallelism and Sparsity
We show that with reduced communication, due to sparsity, we can train close to a billion parameter model on simple 4-16 core CPU nodes connected by basic low bandwidth interconnect.
PairConnect: A Compute-Efficient MLP Alternative to Attention
The dot product self-attention in Transformer allows us to model interactions between words.
Fast Processing and Querying of 170TB of Genomics Data via a Repeated And Merged BloOm Filter (RAMBO)
Interestingly, it is a count-min sketch type arrangement of a membership testing utility (Bloom Filter in our case).
Cannot find the paper you are looking for? You can
Submit a new open access paper.
