Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications

no code implementations • 24 Nov 2018 • Jongsoo Park, Maxim Naumov, Protonu Basu, Summer Deng, Aravind Kalaiah, Daya Khudia, James Law, Parth Malani, Andrey Malevich, Satish Nadathur, Juan Pino, Martin Schatz, Alexander Sidorov, Viswanath Sivakumar, Andrew Tulloch, Xiaodong Wang, Yiming Wu, Hector Yuen, Utku Diril, Dmytro Dzhulgakov, Kim Hazelwood, Bill Jia, Yangqing Jia, Lin Qiao, Vijay Rao, Nadav Rotem, Sungjoo Yoo, Mikhail Smelyanskiy

The application of deep learning techniques resulted in remarkable improvement of machine learning models.

BIG-bench Machine Learning

On Periodic Functions as Regularizers for Quantization of Neural Networks

no code implementations • 24 Nov 2018 • Maxim Naumov, Utku Diril, Jongsoo Park, Benjamin Ray, Jedrzej Jablonski, Andrew Tulloch

We apply these functions component-wise and add the sum over the model parameters as a regularizer to the model loss during training.

Quantization