Search Results for author: Ran El-Yaniv

Found 40 papers, 12 papers with code

Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1

26 code implementations9 Feb 2016 Matthieu Courbariaux, Itay Hubara, Daniel Soudry, Ran El-Yaniv, Yoshua Bengio

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time.

Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations

5 code implementations22 Sep 2016 Itay Hubara, Matthieu Courbariaux, Daniel Soudry, Ran El-Yaniv, Yoshua Bengio

Quantized recurrent neural networks were tested over the Penn Treebank dataset, and achieved comparable accuracy as their 32-bit counterparts using only 4-bits.

Learn on Source, Refine on Target:A Model Transfer Learning Framework with Random Forests

2 code implementations4 Nov 2015 Noam Segev, Maayan Harel, Shie Mannor, Koby Crammer, Ran El-Yaniv

We propose novel model transfer-learning methods that refine a decision forest model M learned within a "source" domain using a training set sampled from a "target" domain, assumed to be a variation of the source.

Transfer Learning

SelectiveNet: A Deep Neural Network with an Integrated Reject Option

4 code implementations26 Jan 2019 Yonatan Geifman, Ran El-Yaniv

We consider the problem of selective prediction (also known as reject option) in deep neural networks, and introduce SelectiveNet, a deep neural architecture with an integrated reject option.

Classification General Classification +1

A framework for benchmarking class-out-of-distribution detection and its application to ImageNet

1 code implementation ICLR 2023 Ido Galil, Mohammed Dabbah, Ran El-Yaniv

In this paper we present a novel framework to benchmark the ability of image classifiers to detect class-out-of-distribution instances (i. e., instances whose true labels do not appear in the training distribution) at various levels of detection difficulty.

Benchmarking Knowledge Distillation +2

TransBoost: Improving the Best ImageNet Performance using Deep Transduction

1 code implementation26 May 2022 Omer Belhasin, Guy Bar-Shalom, Ran El-Yaniv

This paper deals with deep transductive learning, and proposes TransBoost as a procedure for fine-tuning any deep neural model to improve its performance on any (unlabeled) test set provided at training time.

Image Classification Transductive Learning

What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers

1 code implementation23 Feb 2023 Ido Galil, Mohammed Dabbah, Ran El-Yaniv

Here we examine the relationship between deep architectures and their respective training regimes, with their corresponding selective prediction and uncertainty estimation performance.

Benchmarking Out-of-Distribution Detection

Disrupting Deep Uncertainty Estimation Without Harming Accuracy

1 code implementation NeurIPS 2021 Ido Galil, Ran El-Yaniv

In this paper we present a novel and simple attack, which unlike adversarial attacks, does not cause incorrect predictions but instead cripples the network's capacity for uncertainty estimation.

Adversarial Attack

Deep Active Learning over the Long Tail

no code implementations2 Nov 2017 Yonatan Geifman, Ran El-Yaniv

This paper is concerned with pool-based active learning for deep neural networks.

Active Learning

Growth-Optimal Portfolio Selection under CVaR Constraints

no code implementations27 May 2017 Guy Uziel, Ran El-Yaniv

Online portfolio selection research has so far focused mainly on minimizing regret defined in terms of wealth growth.

Decision Making

The Prediction Advantage: A Universally Meaningful Performance Measure for Classification and Regression

no code implementations23 May 2017 Ran El-Yaniv, Yonatan Geifman, Yair Wiener

We introduce the Prediction Advantage (PA), a novel performance measure for prediction functions under any loss function (e. g., classification or regression).

General Classification imbalanced classification +1

The Relationship Between Agnostic Selective Classification Active Learning and the Disagreement Coefficient

no code implementations19 Mar 2017 Roei Gelbhart, Ran El-Yaniv

We focus on the agnostic setting, for which there is a known algorithm called LESS that learns a PCS classifier and achieves a fast rejection rate (depending on Hanneke's disagreement coefficient) under strong assumptions.

Active Learning General Classification

Multi-Objective Non-parametric Sequential Prediction

no code implementations NeurIPS 2017 Guy Uziel, Ran El-Yaniv

Recently, an algorithm for dealing with several objective functions in the i. i. d.

Online Learning of Commission Avoidant Portfolio Ensembles

no code implementations3 May 2016 Guy Uziel, Ran El-Yaniv

We present a novel online ensemble learning strategy for portfolio selection.

Ensemble Learning

Online Learning of Portfolio Ensembles with Sector Exposure Regularization

no code implementations12 Apr 2016 Guy Uziel, Ran El-Yaniv

We consider online learning of ensembles of portfolio selection algorithms and aim to regularize risk by encouraging diversification with respect to a predefined risk-driven grouping of stocks.

A Compression Technique for Analyzing Disagreement-Based Active Learning

no code implementations5 Apr 2014 Yair Wiener, Steve Hanneke, Ran El-Yaniv

We introduce a new and improved characterization of the label complexity of disagreement-based active learning, in which the leading quantity is the version space compression set size.

Active Learning

Transductive Rademacher Complexity and its Applications

no code implementations15 Jan 2014 Ran El-Yaniv, Dmitry Pechyony

We develop a technique for deriving data-dependent error bounds for transductive learning algorithms based on transductive Rademacher complexity.

Transductive Learning

Semantic Sort: A Supervised Approach to Personalized Semantic Relatedness

no code implementations10 Nov 2013 Ran El-Yaniv, David Yanay

We propose and study a novel supervised approach to learning statistical semantic relatedness models from subjectively annotated training examples.

Pointwise Tracking the Optimal Regression Function

no code implementations NeurIPS 2012 Yair Wiener, Ran El-Yaniv

This paper examines the possibility of a `reject option' in the context of least squares regression.

regression

Selective Prediction of Financial Trends with Hidden Markov Models

no code implementations NeurIPS 2011 Dmitry Pidan, Ran El-Yaniv

Our results indicate that both methods are effective, and that the sHMM model is superior.

Agnostic Selective Classification

no code implementations NeurIPS 2011 Yair Wiener, Ran El-Yaniv

For a learning problem whose associated excess loss class is $(\beta, B)$-Bernstein, we show that it is theoretically possible to track the same classification performance of the best (unknown) hypothesis in our class, provided that we are free to abstain from prediction in some region of our choice.

Classification General Classification

ML for Flood Forecasting at Scale

no code implementations28 Jan 2019 Sella Nevo, Vova Anisimov, Gal Elidan, Ran El-Yaniv, Pete Giencke, Yotam Gigi, Avinatan Hassidim, Zach Moshe, Mor Schlesinger, Guy Shalev, Ajai Tirumali, Ami Wiesel, Oleg Zlydenko, Yossi Matias

We propose to build on these strengths and develop ML systems for timely and accurate riverine flood prediction.

Leveraging Auxiliary Text for Deep Recognition of Unseen Visual Relationships

no code implementations27 Oct 2019 Gal Sadeh Kenigsfield, Ran El-Yaniv

Our model relies on a shared text--image representation of subject-verb-object relationships appearing in the text, and object interactions in images.

Graph Generation Relationship Detection +2

MadNet: Using a MAD Optimization for Defending Against Adversarial Attacks

no code implementations3 Nov 2019 Shai Rozenberg, Gal Elidan, Ran El-Yaniv

Given a deep neural network (DNN) for a classification problem, an application of MAD optimization results in MadNet, a version of the original network, now equipped with an adversarial defense mechanism.

Adversarial Defense Adversarial Robustness

Accurate Hydrologic Modeling Using Less Information

no code implementations21 Nov 2019 Guy Shalev, Ran El-Yaniv, Daniel Klotz, Frederik Kratzert, Asher Metzger, Sella Nevo

Joint models are a common and important tool in the intersection of machine learning and the physical sciences, particularly in contexts where real-world measurements are scarce.

HydroNets: Leveraging River Structure for Hydrologic Modeling

no code implementations1 Jul 2020 Zach Moshe, Asher Metzger, Gal Elidan, Frederik Kratzert, Sella Nevo, Ran El-Yaniv

In this work we present a novel family of hydrologic models, called HydroNets, which leverages river network structure.

Management

Train on Small, Play the Large: Scaling Up Board Games with AlphaZero and GNN

no code implementations18 Jul 2021 Shai Ben-Assayag, Ran El-Yaniv

Our ScalableAlphaZero is capable of learning to play incrementally on small boards, and advancing to play on large ones.

Board Games Incremental Learning

How to measure deep uncertainty estimation performance and which models are naturally better at providing it

no code implementations29 Sep 2021 Ido Galil, Mohammed Dabbah, Ran El-Yaniv

Moreover, we consider some of the most popular estimation performance metrics previously proposed including AUROC, ECE, AURC, and coverage for selective accuracy constraint.

Improved Detection of Adversarial Attacks via Penetration Distortion Maximization

no code implementations25 Sep 2019 Shai Rozenberg, Gal Elidan, Ran El-Yaniv

This paper is concerned with the defense of deep models against adversarial at- tacks.

Using Fictitious Class Representations to Boost Discriminative Zero-Shot Learners

no code implementations26 Nov 2021 Mohammed Dabbah, Ran El-Yaniv

Focusing on discriminative zero-shot learning, in this work we introduce a novel mechanism that dynamically augments during training the set of seen classes to produce additional fictitious classes.

Attribute Generalized Zero-Shot Learning

Which models are innately best at uncertainty estimation?

no code implementations5 Jun 2022 Ido Galil, Mohammed Dabbah, Ran El-Yaniv

Due to the comprehensive nature of this paper, it has been updated and split into two separate papers: "A Framework For Benchmarking Class-out-of-distribution Detection And Its Application To ImageNet" and "What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers".

Benchmarking Out-of-Distribution Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.