Detecting Abusive Albanian

28 Jul 2021  ·  Erida Nurce, Jorgel Keci, Leon Derczynski ·

The ever growing usage of social media in the recent years has had a direct impact on the increased presence of hate speech and offensive speech in online platforms. Research on effective detection of such content has mainly focused on English and a few other widespread languages, while the leftover majority fail to have the same work put into them and thus cannot benefit from the steady advancements made in the field. In this paper we present \textsc{Shaj}, an annotated Albanian dataset for hate speech and offensive speech that has been constructed from user-generated content on various social media platforms. Its annotation follows the hierarchical schema introduced in OffensEval. The dataset is tested using three different classification models, the best of which achieves an F1 score of 0.77 for the identification of offensive language, 0.64 F1 score for the automatic categorization of offensive types and lastly, 0.52 F1 score for the offensive language target identification.

PDF Abstract
No code implementations yet. Submit your code now


Introduced in the Paper:


Used in the Paper:

Hate Speech Hate Speech and Offensive Language

Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Hate Speech Detection SHAJ Baseline BERT (task A) F1 0.77 # 1


No methods listed for this paper. Add relevant methods here