Search Results for author: Maria Perez-Ortiz

Found 17 papers, 6 papers with code

A practical guide and software for analysing pairwise comparison experiments

2 code implementations11 Dec 2017 Maria Perez-Ortiz, Rafal K. Mantiuk

Most popular strategies to capture subjective judgments from humans involve the construction of a unidimensional relative measurement scale, representing order preferences or judgments about a set of objects or conditions.

Image Quality Assessment

TrueLearn: A Family of Bayesian Algorithms to Match Lifelong Learners to Open Educational Resources

1 code implementation21 Nov 2019 Sahan Bulathwela, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

The recent advances in computer-assisted learning systems and the availability of open educational resources today promise a pathway to providing cost-efficient, high-quality education to large masses of learners.

Knowledge Tracing

Towards an Integrative Educational Recommender for Lifelong Learners

1 code implementation3 Dec 2019 Sahan Bulathwela, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

One of the most ambitious use cases of computer-assisted learning is to build a recommendation system for lifelong learning.

Active Sampling for Pairwise Comparisons via Approximate Message Passing and Information Gain Maximization

1 code implementation12 Apr 2020 Aliaksei Mikhailiuk, Clifford Wilmot, Maria Perez-Ortiz, Dingcheng Yue, Rafal Mantiuk

In this paper we propose ASAP, an active sampling algorithm based on approximate message passing and expected information gain maximization.

Video Quality Assessment

VLEngagement: A Dataset of Scientific Video Lectures for Evaluating Population-based Engagement

1 code implementation2 Nov 2020 Sahan Bulathwela, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

This paper introduces VLEngagement, a novel dataset that consists of content-based and video-specific features extracted from publicly available scientific video lectures and several metrics related to user engagement.

Consolidated Dataset and Metrics for High-Dynamic-Range Image Quality

no code implementations19 Dec 2020 Aliaksei Mikhailiuk, Maria Perez-Ortiz, Dingcheng Yue, Wilson Suen, Rafal K. Mantiuk

As the existing HDR quality datasets are limited in size, we created a Unified Photometric Image Quality dataset (UPIQ) with over 4, 000 images by realigning and merging existing HDR and standard-dynamic-range (SDR) datasets.

Image Compression Vocal Bursts Intensity Prediction

PEEK: A Large Dataset of Learner Engagement with Educational Videos

no code implementations3 Sep 2021 Sahan Bulathwela, Maria Perez-Ortiz, Erik Novak, Emine Yilmaz, John Shawe-Taylor

One of the main challenges in advancing this research direction is the scarcity of large, publicly available datasets.

Recommendation Systems

Learning PAC-Bayes Priors for Probabilistic Neural Networks

no code implementations21 Sep 2021 Maria Perez-Ortiz, Omar Rivasplata, Benjamin Guedj, Matthew Gleeson, Jingyu Zhang, John Shawe-Taylor, Miroslaw Bober, Josef Kittler

We experiment on 6 datasets with different strategies and amounts of data to learn data-dependent PAC-Bayes priors, and we compare them in terms of their effect on test performance of the learnt predictors and tightness of their risk certificate.

Progress in Self-Certified Neural Networks

no code implementations15 Nov 2021 Maria Perez-Ortiz, Omar Rivasplata, Emilio Parrado-Hernandez, Benjamin Guedj, John Shawe-Taylor

We then show that in data starvation regimes, holding out data for the test set bounds adversely affects generalisation performance, while self-certified strategies based on PAC-Bayes bounds do not suffer from this drawback, proving that they might be a suitable choice for the small data regime.

valid

An AI-based Learning Companion Promoting Lifelong Learning Opportunities for All

no code implementations16 Nov 2021 Maria Perez-Ortiz, Erik Novak, Sahan Bulathwela, John Shawe-Taylor

Artifical Intelligence (AI) in Education has great potential for building more personalised curricula, as well as democratising education worldwide and creating a Renaissance of new ways of teaching and learning.

Can Population-based Engagement Improve Personalisation? A Novel Dataset and Experiments

no code implementations22 Jun 2022 Sahan Bulathwela, Meghana Verma, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

This work explores how population-based engagement prediction can address cold-start at scale in large learning resource collections.

Descriptive

Auditing Large Language Models for Enhanced Text-Based Stereotype Detection and Probing-Based Bias Evaluation

no code implementations2 Apr 2024 Zekun Wu, Sahan Bulathwela, Maria Perez-Ortiz, Adriano Soares Koshiyama

Recent advancements in Large Language Models (LLMs) have significantly increased their presence in human-facing Artificial Intelligence (AI) applications.

Common Sense Reasoning Text Generation

The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Models

no code implementations4 Apr 2024 Noah Y. Siegel, Oana-Maria Camburu, Nicolas Heess, Maria Perez-Ortiz

In this work, we introduce Correlational Explanatory Faithfulness (CEF), a metric that can be used in faithfulness tests based on input interventions.

counterfactual Decision Making

Cannot find the paper you are looking for? You can Submit a new open access paper.