no code implementations • 30 Oct 2023 • Iftitahu Ni'mah, Samaneh Khoshrou, Vlado Menkovski, Mykola Pechenizkiy
Interestingly, although in general the absolute advantage of learning embeddings through label supervision is highly positive across evaluation datasets, KeyGen2Vec is shown to be competitive with classifier that exploits topic label supervision in Yahoo!
7 code implementations • 15 May 2023 • Iftitahu Ni'mah, Meng Fang, Vlado Menkovski, Mykola Pechenizkiy
Our proposed framework provides access: (i) for verifying whether automatic metrics are faithful to human preference, regardless of their correlation level to human; and (ii) for inspecting the strengths and limitations of NLG systems via pairwise evaluation.
1 code implementation • Findings (EMNLP) 2021 • Iftitahu Ni'mah, Meng Fang, Vlado Menkovski, Mykola Pechenizkiy
The ability to detect Out-of-Domain (OOD) inputs has been a critical requirement in many real-world NLP applications.
no code implementations • 17 Sep 2019 • Iftitahu Ni'mah, Vlado Menkovski, Mykola Pechenizkiy
This study mainly investigates two decoding problems in neural keyphrase generation: sequence length bias and beam diversity.
no code implementations • 8 Nov 2018 • Wenting Xiong, Iftitahu Ni'mah, Juan M. G. Huesca, Werner van Ipenburg, Jan Veldsink, Mykola Pechenizkiy
Layer-wise Relevance Propagation (LRP) and saliency maps have been recently used to explain the predictions of Deep Learning models, specifically in the domain of text classification.