Search Results for author: Oren Pereg

Found 12 papers, 3 papers with code

Exploring the Boundaries of Low-Resource BERT Distillation

no code implementations EMNLP (sustainlp) 2020 Moshe Wasserblat, Oren Pereg, Peter Izsak

We also show that the distillation of large pre-trained models is more effective in real-life scenarios where limited amounts of labeled training are available.

Model Compression

Opinion-based Relational Pivoting for Cross-domain Aspect Term Extraction

no code implementations WASSA (ACL) 2022 Ayal Klein, Oren Pereg, Daniel Korat, Vasudev Lal, Moshe Wasserblat, Ido Dagan

In this paper, we investigate and establish empirically a prior conjecture, which suggests that the linguistic relations connecting opinion terms to their aspects transfer well across domains and therefore can be leveraged for cross-domain aspect term extraction.

Domain Adaptation Term Extraction

Efficient Few-Shot Learning Without Prompts

1 code implementation22 Sep 2022 Lewis Tunstall, Nils Reimers, Unso Eun Seo Jo, Luke Bates, Daniel Korat, Moshe Wasserblat, Oren Pereg

This simple framework requires no prompts or verbalizers, and achieves high accuracy with orders of magnitude less parameters than existing techniques.

Few-Shot Learning Few-Shot Text Classification +1

TangoBERT: Reducing Inference Cost by using Cascaded Architecture

no code implementations13 Apr 2022 Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Roy Schwartz

In order to reduce this computational load in inference time, we present TangoBERT, a cascaded model architecture in which instances are first processed by an efficient but less accurate first tier model, and only part of those instances are additionally processed by a less efficient but more accurate second tier model.

Reading Comprehension SST-2 +2

InterpreT: An Interactive Visualization Tool for Interpreting Transformers

no code implementations EACL 2021 Vasudev Lal, Arden Ma, Estelle Aflalo, Phillip Howard, Ana Simoes, Daniel Korat, Oren Pereg, Gadi Singer, Moshe Wasserblat

With the increasingly widespread use of Transformer-based models for NLU/NLP tasks, there is growing interest in understanding the inner workings of these models, why they are so effective at a wide range of tasks, and how they can be further tuned and improved.

Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA)

Multi-Context Term Embeddings: the Use Case of Corpus-based Term Set Expansion

no code implementations WS 2019 Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Ido Dagan

In this paper, we present a novel algorithm that combines multi-context term embeddings using a neural classifier and we test this approach on the use case of corpus-based term set expansion.

Term Set Expansion based NLP Architect by Intel AI Lab

no code implementations EMNLP 2018 Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Alon Eirew, Yael Green, Shira Guskin, Peter Izsak, Daniel Korat

We present SetExpander, a corpus-based system for expanding a seed set of terms into amore complete set of terms that belong to the same semantic class.

Term Set Expansion based on Multi-Context Term Embeddings: an End-to-end Workflow

no code implementations26 Jul 2018 Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Ido Dagan, Yoav Goldberg, Alon Eirew, Yael Green, Shira Guskin, Peter Izsak, Daniel Korat

We present SetExpander, a corpus-based system for expanding a seed set of terms into a more complete set of terms that belong to the same semantic class.

Cannot find the paper you are looking for? You can Submit a new open access paper.