Search Results for author: Yassine Benajiba

Found 21 papers, 4 papers with code

ODIST: Open World Classification via Distributionally Shifted Instances

no code implementations Findings (EMNLP) 2021 Lei Shu, Yassine Benajiba, Saab Mansour, Yi Zhang

In this work, we address the open-world classification problem with a method called ODIST, open world classification via distributionally shifted instances.

Classification Language Modelling

Inference time LLM alignment in single and multidomain preference spectrum

no code implementations24 Oct 2024 Sadat Shahriar, Zheng Qi, Nikolaos Pappas, Srikanth Doss, Monica Sunkara, Kishaloy Halder, Manuel Mager, Yassine Benajiba

Aligning Large Language Models (LLM) to address subjectivity and nuanced preference levels requires adequate flexibility and control, which can be a resource-intensive and time-consuming procedure.

Model Editing Prompt Engineering

Open Domain Question Answering with Conflicting Contexts

no code implementations16 Oct 2024 Siyi Liu, Qiang Ning, Kishaloy Halder, Wei Xiao, Zheng Qi, Phu Mon Htut, Yi Zhang, Neha Anna John, Bonan Min, Yassine Benajiba, Dan Roth

Open domain question answering systems frequently rely on information retrieved from large collections of text (such as the Web) to answer questions.

Open-Domain Question Answering

Unraveling and Mitigating Safety Alignment Degradation of Vision-Language Models

no code implementations11 Oct 2024 Qin Liu, Chao Shang, Ling Liu, Nikolaos Pappas, Jie Ma, Neha Anna John, Srikanth Doss, Lluis Marquez, Miguel Ballesteros, Yassine Benajiba

The safety alignment ability of Vision-Language Models (VLMs) is prone to be degraded by the integration of the vision module compared to its LLM backbone.

Safety Alignment

Active Evaluation Acquisition for Efficient LLM Benchmarking

no code implementations8 Oct 2024 Yang Li, Jie Ma, Miguel Ballesteros, Yassine Benajiba, Graham Horwood

Our approach models the dependencies across test examples, allowing accurate prediction of the evaluation outcomes for the remaining examples based on the outcomes of the selected ones.

Benchmarking

General Purpose Verification for Chain of Thought Prompting

no code implementations30 Apr 2024 Robert Vacareanu, Anurag Pratik, Evangelia Spiliopoulou, Zheng Qi, Giovanni Paolini, Neha Anna John, Jie Ma, Yassine Benajiba, Miguel Ballesteros

Many of the recent capabilities demonstrated by Large Language Models (LLMs) arise primarily from their ability to exploit contextual information.

From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verification

no code implementations10 Mar 2024 Fei Wang, Chao Shang, Sarthak Jain, Shuai Wang, Qiang Ning, Bonan Min, Vittorio Castelli, Yassine Benajiba, Dan Roth

We investigate common constraints in NLP tasks, categorize them into three classes based on the types of their arguments, and propose a unified framework, ACT (Aligning to ConsTraints), to automatically produce supervision signals for user alignment with constraints.

Abstractive Text Summarization Entity Typing +2

Diable: Efficient Dialogue State Tracking as Operations on Tables

1 code implementation26 May 2023 Pietro Lesci, Yoshinari Fujinuma, Momchil Hardalov, Chao Shang, Yassine Benajiba, Lluis Marquez

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue turn.

Dialogue State Tracking

Taxonomy Expansion for Named Entity Recognition

no code implementations22 May 2023 Karthikeyan K, Yogarshi Vyas, Jie Ma, Giovanni Paolini, Neha Anna John, Shuai Wang, Yassine Benajiba, Vittorio Castelli, Dan Roth, Miguel Ballesteros

We experiment with 6 diverse datasets and show that PLM consistently performs better than most other approaches (0. 5 - 2. 5 F1), including in novel settings for taxonomy expansion not considered in prior work.

named-entity-recognition Named Entity Recognition +2

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

2 code implementations25 Apr 2023 James Gung, Raphael Shu, Emily Moeng, Wesley Rose, Salvatore Romeo, Yassine Benajiba, Arshit Gupta, Saab Mansour, Yi Zhang

With increasing demand for and adoption of virtual assistants, recent work has investigated ways to accelerate bot schema design through the automatic induction of intents or the induction of slots and dialogue states.

Instruction Tuning for Few-Shot Aspect-Based Sentiment Analysis

1 code implementation12 Oct 2022 Siddharth Varia, Shuai Wang, Kishaloy Halder, Robert Vacareanu, Miguel Ballesteros, Yassine Benajiba, Neha Anna John, Rishita Anubhai, Smaranda Muresan, Dan Roth

Aspect-based Sentiment Analysis (ABSA) is a fine-grained sentiment analysis task which involves four elements from user-generated texts: aspect term, aspect category, opinion term, and sentiment polarity.

Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA) +3

Aspect On: an Interactive Solution for Post-Editing the Aspect Extraction based on Online Learning

no code implementations LREC 2020 Mara Chinea-Rios, Marc Franco-Salvador, Yassine Benajiba

Experimental results show that Aspect On dramatically reduces the number of user clicks and effort required to post-edit the aspects extracted by the model.

Aspect-Based Sentiment Analysis Aspect Extraction

Siamese Networks for Semantic Pattern Similarity

no code implementations17 Dec 2018 Yassine Benajiba, Jin Sun, Yong Zhang, Longquan Jiang, Zhiliang Weng, Or Biran

Semantic Pattern Similarity is an interesting, though not often encountered NLP task where two sentences are compared not by their specific meaning, but by their more abstract semantic pattern (e. g., preposition or frame).

Question Answering

MainiwayAI at IJCNLP-2017 Task 2: Ensembles of Deep Architectures for Valence-Arousal Prediction

no code implementations IJCNLP 2017 Yassine Benajiba, Jin Sun, Yong Zhang, Zhiliang Weng, Or Biran

This paper introduces Mainiway AI Labs submitted system for the IJCNLP 2017 shared task on Dimensional Sentiment Analysis of Chinese Phrases (DSAP), and related experiments.

Sentiment Analysis Task 2 +1

The Sentimental Value of Chinese Sub-Character Components

no code implementations WS 2017 Yassine Benajiba, Or Biran, Zhiliang Weng, Yong Zhang, Jin Sun

Sub-character components of Chinese characters carry important semantic information, and recent studies have shown that utilizing this information can improve performance on core semantic tasks.

Sentiment Analysis Word Embeddings

Cannot find the paper you are looking for? You can Submit a new open access paper.