Search Results for author: Blaž Škrlj

Found 41 papers, 19 papers with code

RaKUn: Rank-based Keyword extraction via Unsupervised learning and Meta vertex aggregation

1 code implementation15 Jul 2019 Blaž Škrlj, Andraž Repar, Senja Pollak

Keyword extraction is used for summarizing the content of a document and supports efficient document retrieval, and is as such an indispensable part of modern text-based systems.

Keyword Extraction Retrieval

SNoRe: Scalable Unsupervised Learning of Symbolic Node Representations

1 code implementation8 Sep 2020 Sebastian Mežnar, Nada Lavrač, Blaž Škrlj

Learning from complex real-life networks is a lively research area, with recent advances in learning information-rich, low-dimensional network node representations.

Node Classification Structural Node Embedding

OutRank: Speeding up AutoML-based Model Search for Large Sparse Data sets with Cardinality-aware Feature Ranking

1 code implementation4 Sep 2023 Blaž Škrlj, Blaž Mramor

The proposed approach's feasibility is demonstrated by speeding up the state-of-the-art AutoML system on a synthetic data set with no performance loss.

Anomaly Detection AutoML +2

Knowledge Graph informed Fake News Classification via Heterogeneous Representation Ensembles

2 code implementations20 Oct 2021 Boshko Koloski, Timen Stepišnik-Perdih, Marko Robnik-Šikonja, Senja Pollak, Blaž Škrlj

Increasing amounts of freely available data both in textual and relational form offers exploration of richer document representations, potentially improving the model performance and robustness.

Classification Fake News Detection +4

Ensemble- and Distance-Based Feature Ranking for Unsupervised Learning

1 code implementation23 Nov 2020 Matej Petković, Dragi Kocev, Blaž Škrlj, Sašo Džeroski

In this work, we propose two novel (groups of) methods for unsupervised feature ranking and selection.

Clustering

Embedding-based Silhouette Community Detection

1 code implementation17 Jul 2019 Blaž Škrlj, Jan Kralj, Nada Lavrač

Mining complex data in the form of networks is of increasing interest in many scientific disciplines.

Clustering Community Detection +1

AttViz: Online exploration of self-attention for transparent neural language modeling

1 code implementation12 May 2020 Blaž Škrlj, Nika Eržen, Shane Sheehan, Saturnino Luz, Marko Robnik-Šikonja, Senja Pollak

Neural language models are becoming the prevailing methodology for the tasks of query answering, text classification, disambiguation, completion and translation.

Language Modelling text-classification +2

ReliefE: Feature Ranking in High-dimensional Spaces via Manifold Embeddings

1 code implementation23 Jan 2021 Blaž Škrlj, Sašo Džeroski, Nada Lavrač, Matej Petković

The utility of ReliefE for high-dimensional data sets is ensured by its implementation that utilizes sparse matrix algebraic operations.

Multi-Label Classification Vocal Bursts Intensity Prediction

Exploring Neural Language Models via Analysis of Local and Global Self-Attention Spaces

1 code implementation EACL (Hackashop) 2021 Blaž Škrlj, Shane Sheehan, Nika Eržen, Marko Robnik-Šikonja, Saturnino Luz, Senja Pollak

Large pretrained language models using the transformer neural network architecture are becoming a dominant methodology for many natural language processing tasks, such as question answering, text classification, word sense disambiguation, text completion and machine translation.

Machine Translation Question Answering +4

Link Analysis meets Ontologies: Are Embeddings the Answer?

1 code implementation23 Nov 2021 Sebastian Mežnar, Matej Bevec, Nada Lavrač, Blaž Škrlj

The increasing amounts of semantic resources offer valuable storage of human knowledge; however, the probability of wrong entries increases with the increased size.

Anomaly Detection

TNT-KID: Transformer-based Neural Tagger for Keyword Identification

1 code implementation20 Mar 2020 Matej Martinc, Blaž Škrlj, Senja Pollak

With growing amounts of available textual data, development of algorithms capable of automatic analysis, categorization and summarization of these data has become a necessity.

Keyword Extraction Language Modelling

Fuzzy Jaccard Index: A robust comparison of ordered lists

2 code implementations5 Aug 2020 Matej Petković, Blaž Škrlj, Dragi Kocev, Nikola Simidjievski

In real-life, and in particular high-dimensional domains, where only a small percentage of the whole feature space might be relevant, a robust and confident feature ranking leads to interpretable findings as well as efficient computation and good predictive performance.

BIG-bench Machine Learning

Extending Neural Keyword Extraction with TF-IDF tagset matching

1 code implementation EACL (Hackashop) 2021 Boshko Koloski, Senja Pollak, Blaž Škrlj, Matej Martinc

Keyword extraction is the task of identifying words (or multi-word expressions) that best describe a given document and serve in news portals to link articles of similar topics.

Keyword Extraction

Propositionalization and Embeddings: Two Sides of the Same Coin

2 code implementations8 Jun 2020 Nada Lavrač, Blaž Škrlj, Marko Robnik-Šikonja

This paper outlines some of the modern data processing techniques used in relational learning that enable data fusion from different input data types and formats into a single table data representation, focusing on the propositionalization and embedding data transformation approaches.

Relational Reasoning Vocal Bursts Valence Prediction

Transfer Learning for Node Regression Applied to Spreading Prediction

1 code implementation31 Mar 2021 Sebastian Mežnar, Nada Lavrač, Blaž Škrlj

This work is one of the first to explore transferability of the learned representations for the task of node regression; we show there exist pairs of networks with similar structure between which the trained models can be transferred (zero-shot), and demonstrate their competitive performance.

Misinformation regression +1

Language comparison via network topology

1 code implementation16 Jul 2019 Blaž Škrlj, Senja Pollak

In our experiments, we employ eight different network topology metrics, and empirically showcase on a parallel corpus, how the methods can be used for modeling the relations between nine selected languages.

Feature Importance Estimation with Self-Attention Networks

no code implementations11 Feb 2020 Blaž Škrlj, Sašo Džeroski, Nada Lavrač, Matej Petkovič

Black-box neural network models are widely used in industry and science, yet are hard to understand and interpret.

Feature Importance

Predicting Generalization in Deep Learning via Metric Learning -- PGDL Shared task

no code implementations16 Dec 2020 Sebastian Mežnar, Blaž Škrlj

The competition "Predicting Generalization in Deep Learning (PGDL)" aims to provide a platform for rigorous study of generalization of deep learning models and offer insight into the progress of understanding and explaining these models.

Metric Learning

Identification of COVID-19 related Fake News via Neural Stacking

no code implementations11 Jan 2021 Boshko Koloski, Timen Stepišnik Perdih, Senja Pollak, Blaž Škrlj

Identification of Fake News plays a prominent role in the ongoing pandemic, impacting multiple aspects of day-to-day life.

Fake News Detection General Classification

Semantic Reasoning from Model-Agnostic Explanations

no code implementations29 Jun 2021 Timen Stepišnik Perdih, Nada Lavrač, Blaž Škrlj

The derived semantic explanations are potentially more informative, as they describe the key attributes in the context of more general background knowledge, e. g., at the biological process level.

Compressibility of Distributed Document Representations

no code implementations14 Oct 2021 Blaž Škrlj, Matej Petkovič

Contemporary natural language processing (NLP) revolves around learning from latent document representations, generated either implicitly by neural language models or explicitly by methods such as doc2vec or similar.

text-classification Text Classification

BERT meets Shapley: Extending SHAP Explanations to Transformer-based Classifiers

no code implementations EACL (Hackashop) 2021 Enja Kokalj, Blaž Škrlj, Nada Lavrač, Senja Pollak, Marko Robnik-Šikonja

Transformer-based neural networks offer very good classification performance across a wide range of domains, but do not provide explanations of their predictions.

Interesting cross-border news discovery using cross-lingual article linking and document similarity

no code implementations EACL (Hackashop) 2021 Boshko Koloski, Elaine Zosa, Timen Stepišnik-Perdih, Blaž Škrlj, Tarmo Paju, Senja Pollak

Team Name: team-8 Embeddia Tool: Cross-Lingual Document Retrieval Zosa et al. Dataset: Estonian and Latvian news datasets abstract: Contemporary news media face increasing amounts of available data that can be of use when prioritizing, selecting and discovering new news.

Retrieval

Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?

no code implementations LREC 2022 Boshko Koloski, Senja Pollak, Blaž Škrlj, Matej Martinc

We find that the pretrained models fine-tuned on a multilingual corpus covering languages that do not appear in the test set (i. e. in a zero-shot setting), consistently outscore unsupervised models in all six languages.

Keyword Extraction Pretrained Multilingual Language Models

E8-IJS@LT-EDI-ACL2022 - BERT, AutoML and Knowledge-graph backed Detection of Depression

no code implementations LTEDI (ACL) 2022 Ilija Tavchioski, Boshko Koloski, Blaž Škrlj, Senja Pollak

Depression is a mental illness that negatively affects a person’s well-being and can, if left untreated, lead to serious consequences such as suicide.

AutoML

Dynamic Surrogate Switching: Sample-Efficient Search for Factorization Machine Configurations in Online Recommendations

no code implementations29 Sep 2022 Blaž Škrlj, Adi Schwartz, Jure Ferlež, Davorin Kopič, Naama Ziporin

The main idea underlying this paradigm considers an incrementally updated model of the relation between the hyperparameter space and the output (target) space; the data for this model are obtained by evaluating the main learning engine, which is, for example, a factorization machine-based model.

Hyperparameter Optimization

DDeMON: Ontology-based function prediction by Deep Learning from Dynamic Multiplex Networks

no code implementations8 Feb 2023 Jan Kralj, Blaž Škrlj, Živa Ramšak, Nada Lavrač, Kristina Gruden

Biological systems can be studied at multiple levels of information, including gene, protein, RNA and different interaction networks levels.

Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning Strategies

no code implementations12 Sep 2023 Boshko Koloski, Blaž Škrlj, Marko Robnik-Šikonja, Senja Pollak

As cross-lingual transfer strategies, we compare the intermediate-training (\textit{IT}) that uses each language sequentially and cross-lingual validation (\textit{CLV}) that uses a target language already in the validation phase of fine-tuning.

Cross-Lingual Transfer Hate Speech Detection

Latent Graphs for Semi-Supervised Learning on Biomedical Tabular Data

no code implementations27 Sep 2023 Boshko Koloski, Nada Lavrač, Senja Pollak, Blaž Škrlj

In the domain of semi-supervised learning, the current approaches insufficiently exploit the potential of considering inter-instance relationships among (un)labeled data.

AHAM: Adapt, Help, Ask, Model -- Harvesting LLMs for literature mining

no code implementations25 Dec 2023 Boshko Koloski, Nada Lavrač, Bojan Cestnik, Senja Pollak, Blaž Škrlj, Andrej Kastrin

Our system aims to reduce both the ratio of outlier topics to the total number of topics and the similarity between topic definitions.

Domain Adaptation Language Modelling +6

Cannot find the paper you are looking for? You can Submit a new open access paper.