Search Results for author: Herna Viktor

Found 8 papers, 5 papers with code

Robust Infidelity: When Faithfulness Measures on Masked Language Models Are Misleading

no code implementations13 Aug 2023 Evan Crothers, Herna Viktor, Nathalie Japkowicz

A common approach to quantifying neural text classifier interpretability is to calculate faithfulness metrics based on iteratively masking salient input tokens and measuring changes in the model prediction.

Measuring Improvement of F$_1$-Scores in Detection of Self-Admitted Technical Debt

no code implementations16 Mar 2023 William Aiken, Paul K. Mvula, Paula Branco, Guy-Vincent Jourdan, Mehrdad Sabetzadeh, Herna Viktor

We find that our trained BERT model improves over the best performance of all previous methods in 19 of the 20 projects in cross-project scenarios.

Data Augmentation

In BLOOM: Creativity and Affinity in Artificial Lyrics and Art

1 code implementation13 Jan 2023 Evan Crothers, Herna Viktor, Nathalie Japkowicz

We apply a large multilingual language model (BLOOM-176B) in open-ended generation of Chinese song lyrics, and evaluate the resulting lyrics for coherence and creativity using human reviewers.

Language Modeling Language Modelling +1

Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods

no code implementations13 Oct 2022 Evan Crothers, Nathalie Japkowicz, Herna Viktor

Detection of machine generated text is a key countermeasure for reducing abuse of NLG models, with significant technical challenges and numerous open problems.

Abuse Detection Fairness +3

Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformers

1 code implementation2 Mar 2022 Evan Crothers, Nathalie Japkowicz, Herna Viktor, Paula Branco

The detection of computer-generated text is an area of rapidly increasing significance as nascent generative models allow for efficient creation of compelling human-like text, which may be abused for the purposes of spam, disinformation, phishing, or online influence campaigns.

Adversarial Robustness Adversarial Text

Towards Ethical Content-Based Detection of Online Influence Campaigns

1 code implementation29 Aug 2019 Evan Crothers, Nathalie Japkowicz, Herna Viktor

The detection of clandestine efforts to influence users in online communities is a challenging problem with significant active development.

Native Language Identification Sentence

Cannot find the paper you are looking for? You can Submit a new open access paper.