Search Results for author: Berry Weinstein

Found 6 papers, 4 papers with code

Pairwise Margin Maximization for Deep Neural Networks

1 code implementation9 Oct 2021 Berry Weinstein, Shai Fine, Yacov Hel-Or

The weight decay regularization term is widely used during training to constrain expressivity, avoid overfitting, and improve generalization.

Multi-class Classification

Variance Pruning: Pruning Language Models via Temporal Neuron Variance

no code implementations29 Sep 2021 Berry Weinstein, Yonatan Belinkov

As language models become larger, different pruning methods have been proposed to reduce model size.

Natural Language Understanding

MixSize: Training Convnets With Mixed Image Sizes for Improved Accuracy, Speed and Scale Resiliency

2 code implementations1 Jan 2021 Elad Hoffer, Berry Weinstein, Itay Hubara, Tal Ben-Nun, Torsten Hoefler, Daniel Soudry

Although trained on images of a specific size, it is well established that CNNs can be used to evaluate a wide range of image sizes at test time, by adjusting the size of intermediate feature maps.

Margin-Based Regularization and Selective Sampling in Deep Neural Networks

no code implementations13 Sep 2020 Berry Weinstein, Shai Fine, Yacov Hel-Or

We derive a new margin-based regularization formulation, termed multi-margin regularization (MMR), for deep neural networks (DNNs).

General Classification Image Classification +7

Selective sampling for accelerating training of deep neural networks

1 code implementation16 Nov 2019 Berry Weinstein, Shai Fine, Yacov Hel-Or

We present a selective sampling method designed to accelerate the training of deep neural networks.

Binary Classification Classification +2

Mix & Match: training convnets with mixed image sizes for improved accuracy, speed and scale resiliency

2 code implementations12 Aug 2019 Elad Hoffer, Berry Weinstein, Itay Hubara, Tal Ben-Nun, Torsten Hoefler, Daniel Soudry

Although trained on images of aspecific size, it is well established that CNNs can be used to evaluate a wide range of image sizes at test time, by adjusting the size of intermediate feature maps.

Cannot find the paper you are looking for? You can Submit a new open access paper.