Search Results for author:
Found 5 papers, 1 papers with code
Decoding Speculative Decoding
However, our experiments indicate the contrary with throughput diminishing as the probability of generated tokens to be accepted by the target model increases.
PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices
As neural networks (NN) are deployed across diverse sectors, their energy demand correspondingly grows.
Distributed SLIDE: Enabling Training Large Neural Networks on Low Bandwidth and Simple CPU-Clusters via Model Parallelism and Sparsity
We show that with reduced communication, due to sparsity, we can train close to a billion parameter model on simple 4-16 core CPU nodes connected by basic low bandwidth interconnect.
PairConnect: A Compute-Efficient MLP Alternative to Attention
The dot product self-attention in Transformer allows us to model interactions between words.
Fast Processing and Querying of 170TB of Genomics Data via a Repeated And Merged BloOm Filter (RAMBO)
Interestingly, it is a count-min sketch type arrangement of a membership testing utility (Bloom Filter in our case).
