Search Results for author: Maria Perez-Ortiz

Found 17 papers, 6 papers with code

The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Models

no code implementations4 Apr 2024 Noah Y. Siegel, Oana-Maria Camburu, Nicolas Heess, Maria Perez-Ortiz

In this work, we introduce Correlational Explanatory Faithfulness (CEF), a metric that can be used in faithfulness tests based on input interventions.

counterfactual Decision Making

Auditing Large Language Models for Enhanced Text-Based Stereotype Detection and Probing-Based Bias Evaluation

no code implementations2 Apr 2024 Zekun Wu, Sahan Bulathwela, Maria Perez-Ortiz, Adriano Soares Koshiyama

Recent advancements in Large Language Models (LLMs) have significantly increased their presence in human-facing Artificial Intelligence (AI) applications.

Common Sense Reasoning Text Generation

Can Population-based Engagement Improve Personalisation? A Novel Dataset and Experiments

no code implementations22 Jun 2022 Sahan Bulathwela, Meghana Verma, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

This work explores how population-based engagement prediction can address cold-start at scale in large learning resource collections.

Descriptive

An AI-based Learning Companion Promoting Lifelong Learning Opportunities for All

no code implementations16 Nov 2021 Maria Perez-Ortiz, Erik Novak, Sahan Bulathwela, John Shawe-Taylor

Artifical Intelligence (AI) in Education has great potential for building more personalised curricula, as well as democratising education worldwide and creating a Renaissance of new ways of teaching and learning.

Progress in Self-Certified Neural Networks

no code implementations15 Nov 2021 Maria Perez-Ortiz, Omar Rivasplata, Emilio Parrado-Hernandez, Benjamin Guedj, John Shawe-Taylor

We then show that in data starvation regimes, holding out data for the test set bounds adversely affects generalisation performance, while self-certified strategies based on PAC-Bayes bounds do not suffer from this drawback, proving that they might be a suitable choice for the small data regime.

valid

Learning PAC-Bayes Priors for Probabilistic Neural Networks

no code implementations21 Sep 2021 Maria Perez-Ortiz, Omar Rivasplata, Benjamin Guedj, Matthew Gleeson, Jingyu Zhang, John Shawe-Taylor, Miroslaw Bober, Josef Kittler

We experiment on 6 datasets with different strategies and amounts of data to learn data-dependent PAC-Bayes priors, and we compare them in terms of their effect on test performance of the learnt predictors and tightness of their risk certificate.

PEEK: A Large Dataset of Learner Engagement with Educational Videos

no code implementations3 Sep 2021 Sahan Bulathwela, Maria Perez-Ortiz, Erik Novak, Emine Yilmaz, John Shawe-Taylor

One of the main challenges in advancing this research direction is the scarcity of large, publicly available datasets.

Recommendation Systems

Consolidated Dataset and Metrics for High-Dynamic-Range Image Quality

no code implementations19 Dec 2020 Aliaksei Mikhailiuk, Maria Perez-Ortiz, Dingcheng Yue, Wilson Suen, Rafal K. Mantiuk

As the existing HDR quality datasets are limited in size, we created a Unified Photometric Image Quality dataset (UPIQ) with over 4, 000 images by realigning and merging existing HDR and standard-dynamic-range (SDR) datasets.

Image Compression Vocal Bursts Intensity Prediction

VLEngagement: A Dataset of Scientific Video Lectures for Evaluating Population-based Engagement

1 code implementation2 Nov 2020 Sahan Bulathwela, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

This paper introduces VLEngagement, a novel dataset that consists of content-based and video-specific features extracted from publicly available scientific video lectures and several metrics related to user engagement.

Active Sampling for Pairwise Comparisons via Approximate Message Passing and Information Gain Maximization

1 code implementation12 Apr 2020 Aliaksei Mikhailiuk, Clifford Wilmot, Maria Perez-Ortiz, Dingcheng Yue, Rafal Mantiuk

In this paper we propose ASAP, an active sampling algorithm based on approximate message passing and expected information gain maximization.

Video Quality Assessment

Towards an Integrative Educational Recommender for Lifelong Learners

1 code implementation3 Dec 2019 Sahan Bulathwela, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

One of the most ambitious use cases of computer-assisted learning is to build a recommendation system for lifelong learning.

TrueLearn: A Family of Bayesian Algorithms to Match Lifelong Learners to Open Educational Resources

1 code implementation21 Nov 2019 Sahan Bulathwela, Maria Perez-Ortiz, Emine Yilmaz, John Shawe-Taylor

The recent advances in computer-assisted learning systems and the availability of open educational resources today promise a pathway to providing cost-efficient, high-quality education to large masses of learners.

Knowledge Tracing

A practical guide and software for analysing pairwise comparison experiments

2 code implementations11 Dec 2017 Maria Perez-Ortiz, Rafal K. Mantiuk

Most popular strategies to capture subjective judgments from humans involve the construction of a unidimensional relative measurement scale, representing order preferences or judgments about a set of objects or conditions.

Image Quality Assessment

Cannot find the paper you are looking for? You can Submit a new open access paper.