Search Results for author: Josip Jukić

Found 8 papers, 3 papers with code

From Robustness to Improved Generalization and Calibration in Pre-trained Language Models

no code implementations31 Mar 2024 Josip Jukić, Jan Šnajder

Enhancing generalization and uncertainty quantification in pre-trained language models (PLMs) is crucial for their effectiveness and reliability.

Domain Generalization Uncertainty Quantification

Out-of-Distribution Detection by Leveraging Between-Layer Transformation Smoothness

1 code implementation4 Oct 2023 Fran Jelenić, Josip Jukić, Martin Tutek, Mate Puljiz, Jan Šnajder

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training.

Out-of-Distribution Detection Out of Distribution (OOD) Detection +2

Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settings

1 code implementation23 May 2023 Josip Jukić, Jan Šnajder

Pre-trained language models (PLMs) have ignited a surge in demand for effective fine-tuning techniques, particularly in low-resource domains and languages.

Active Learning Language Modelling +2

On Dataset Transferability in Active Learning for Transformers

1 code implementation16 May 2023 Fran Jelenić, Josip Jukić, Nina Drobac, Jan Šnajder

We link the AL dataset transferability to the similarity of instances queried by the different PLMs and show that AL methods with similar acquisition sequences produce highly transferable datasets regardless of the models used.

Active Learning text-classification +1

You Are What You Talk About: Inducing Evaluative Topics for Personality Analysis

no code implementations1 Feb 2023 Josip Jukić, Iva Vukojević, Jan Šnajder

Expressing attitude or stance toward entities and concepts is an integral part of human behavior and personality.

Topic Models

Smooth Sailing: Improving Active Learning for Pre-trained Language Models with Representation Smoothness Analysis

no code implementations20 Dec 2022 Josip Jukić, Jan Šnajder

Developed to alleviate prohibitive labeling costs, active learning (AL) methods aim to reduce label complexity in supervised learning.

Active Learning

Easy to Decide, Hard to Agree: Reducing Disagreements Between Saliency Methods

no code implementations15 Nov 2022 Josip Jukić, Martin Tutek, Jan Šnajder

By connecting our findings to instance categories based on training dynamics, we show that the agreement of saliency method explanations is very low for easy-to-learn instances.

ALANNO: An Active Learning Annotation System for Mortals

no code implementations11 Nov 2022 Josip Jukić, Fran Jelenić, Miroslav Bićanić, Jan Šnajder

Supervised machine learning has become the cornerstone of today's data-driven society, increasing the need for labeled data.

Active Learning Management

Cannot find the paper you are looking for? You can Submit a new open access paper.