Search Results for author: Herna Viktor

Found 8 papers, 5 papers with code

Faithful to Whom? Questioning Interpretability Measures in NLP

no code implementations13 Aug 2023 Evan Crothers, Herna Viktor, Nathalie Japkowicz

A common approach to quantifying model interpretability is to calculate faithfulness metrics based on iteratively masking input tokens and measuring how much the predicted label changes as a result.

Measuring Improvement of F$_1$-Scores in Detection of Self-Admitted Technical Debt

no code implementations16 Mar 2023 William Aiken, Paul K. Mvula, Paula Branco, Guy-Vincent Jourdan, Mehrdad Sabetzadeh, Herna Viktor

We find that our trained BERT model improves over the best performance of all previous methods in 19 of the 20 projects in cross-project scenarios.

Data Augmentation

In BLOOM: Creativity and Affinity in Artificial Lyrics and Art

1 code implementation13 Jan 2023 Evan Crothers, Herna Viktor, Nathalie Japkowicz

We apply a large multilingual language model (BLOOM-176B) in open-ended generation of Chinese song lyrics, and evaluate the resulting lyrics for coherence and creativity using human reviewers.

Language Modelling Large Language Model

Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods

no code implementations13 Oct 2022 Evan Crothers, Nathalie Japkowicz, Herna Viktor

Detection of machine generated text is a key countermeasure for reducing abuse of NLG models, with significant technical challenges and numerous open problems.

Abuse Detection Fairness +2

Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformers

1 code implementation2 Mar 2022 Evan Crothers, Nathalie Japkowicz, Herna Viktor, Paula Branco

The detection of computer-generated text is an area of rapidly increasing significance as nascent generative models allow for efficient creation of compelling human-like text, which may be abused for the purposes of spam, disinformation, phishing, or online influence campaigns.

Adversarial Robustness Adversarial Text

Towards Ethical Content-Based Detection of Online Influence Campaigns

1 code implementation29 Aug 2019 Evan Crothers, Nathalie Japkowicz, Herna Viktor

The detection of clandestine efforts to influence users in online communities is a challenging problem with significant active development.

Native Language Identification Sentence

McDiarmid Drift Detection Methods for Evolving Data Streams

2 code implementations5 Oct 2017 Ali Pesaranghader, Herna Viktor, Eric Paquet

Accordingly, concept drifts need to be detected, and handled, as soon as possible.

General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.