Search Results for author:
Found 7 papers, 1 papers with code
Accelerating Sparse Deep Neural Networks
We present the design and behavior of Sparse Tensor Cores, which exploit a 2:4 (50%) sparsity pattern that leads to twice the math throughput of dense matrix units.
Exploration of Low Numeric Precision Deep Learning Inference Using Intel FPGAs
This results in a trade-off between throughput and accuracy and can be tailored for different networks through various combinations of activation and weight data widths.
Distributed, Parallel, and Cluster Computing Hardware Architecture
WRPN & Apprentice: Methods for Training and Inference using Low-Precision Numerics
Today's high performance deep learning architectures involve large models with numerous parameters.
Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy
Low-precision numerics and model compression using knowledge distillation are popular techniques to lower both the compute requirements and memory footprint of these deployed models.
Low Precision RNNs: Quantizing RNNs Without Losing Accuracy
Similar to convolution neural networks, recurrent neural networks (RNNs) typically suffer from over-parameterization.
WRPN: Wide Reduced-Precision Networks
We reduce the precision of activation maps (along with model parameters) and increase the number of filter maps in a layer, and find that this scheme matches or surpasses the accuracy of the baseline full-precision network.
WRPN: Training and Inference using Wide Reduced-Precision Networks
For computer vision applications, prior works have shown the efficacy of reducing the numeric precision of model parameters (network weights) in deep neural networks but also that reducing the precision of activations hurts model accuracy much more than reducing the precision of model parameters.
