Search Results for author: Chas Leichner

Found 4 papers, 2 papers with code

PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks

no code implementations CVPR 2024 Marina Neseem, Conor McCullough, Randy Hsin, Chas Leichner, Shan Li, In Suk Chong, Andrew Howard, Lukasz Lew, Sherief Reda, Ville-Mikko Rautio, Daniele Moro

Our analysis reveals that non-quantized elementwise operations which are prevalent in layers such as parameterized activation functions batch normalization and quantization scaling dominate the inference cost of low-precision models.

Quantization

Data-Free Neural Architecture Search via Recursive Label Calibration

no code implementations3 Dec 2021 Zechun Liu, Zhiqiang Shen, Yun Long, Eric Xing, Kwang-Ting Cheng, Chas Leichner

We identify that the NAS task requires the synthesized data (we target at image domain here) with enough semantics, diversity, and a minimal domain gap from the natural images.

Diversity Neural Architecture Search

Pareto-Optimal Quantized ResNet Is Mostly 4-bit

6 code implementations7 May 2021 Amirali Abdolrashidi, Lisa Wang, Shivani Agrawal, Jonathan Malmaud, Oleg Rybakov, Chas Leichner, Lukasz Lew

In this work, we use ResNet as a case study to systematically investigate the effects of quantization on inference compute cost-quality tradeoff curves.

Quantization

Cannot find the paper you are looking for? You can Submit a new open access paper.