Search Results for author: Aythami Morales

Found 65 papers, 26 papers with code

Is my Data in your AI Model? Membership Inference Test with Application to Face Images

no code implementations14 Feb 2024 Daniel DeAlcala, Aythami Morales, Gonzalo Mancera, Julian Fierrez, Ruben Tolosana, Javier Ortega-Garcia

This paper introduces the Membership Inference Test (MINT), a novel approach that aims to empirically assess if specific data was used during the training of Artificial Intelligence (AI) models.

Face Recognition Test

IEEE BigData 2023 Keystroke Verification Challenge (KVC)

1 code implementation29 Jan 2024 Giuseppe Stragapede, Ruben Vera-Rodriguez, Ruben Tolosana, Aythami Morales, Ivan DeAndres-Tame, Naser Damer, Julian Fierrez, Javier-Ortega Garcia, Nahuel Gonzalez, Andrei Shadrikov, Dmitrii Gordin, Leon Schmitt, Daniel Wimmer, Christoph Grossmann, Joerdis Krieger, Florian Heinz, Ron Krestel, Christoffer Mayer, Simon Haberl, Helena Gschrey, Yosuke Yamagishi, Sanjay Saha, Sanka Rasnayaka, Sandareka Wickramanayake, Terence Sim, Weronika Gutfeter, Adam Baran, Mateusz Krzyszton, Przemyslaw Jaskola

Several neural architectures were proposed by the participants, leading to global Equal Error Rates (EERs) as low as 3. 33% and 3. 61% achieved by the best team respectively in the desktop and mobile scenario, outperforming the current state of the art biometric verification performance for KD.

Keystroke Verification Challenge (KVC): Biometric and Fairness Benchmark Evaluation

no code implementations10 Nov 2023 Giuseppe Stragapede, Ruben Vera-Rodriguez, Ruben Tolosana, Aythami Morales, Naser Damer, Julian Fierrez, Javier Ortega-Garcia

Analyzing keystroke dynamics (KD) for biometric verification has several advantages: it is among the most discriminative behavioral traits; keyboards are among the most common human-computer interfaces, being the primary means for users to enter textual data; its acquisition does not require additional hardware, and its processing is relatively lightweight; and it allows for transparently recognizing subjects.


mEBAL2 Database and Benchmark: Image-based Multispectral Eyeblink Detection

1 code implementation14 Sep 2023 Roberto Daza, Aythami Morales, Julian Fierrez, Ruben Tolosana, Ruben Vera-Rodriguez

This work introduces a new multispectral database and novel approaches for eyeblink detection in RGB and Near-Infrared (NIR) individual images.

EEG Electroencephalogram (EEG)

AI4Food-NutritionFW: A Novel Framework for the Automatic Synthesis and Analysis of Eating Behaviours

1 code implementation12 Sep 2023 Sergio Romero-Tapiador, Ruben Tolosana, Aythami Morales, Isabel Espinosa-Salinas, Gala Freixer, Julian Fierrez, Ruben Vera-Rodriguez, Enrique Carrillo de Santa Pau, Ana Ramírez de Molina, Javier Ortega-Garcia

In addition to the framework, we also provide and describe a unique food image dataset that includes 4, 800 different weekly eating behaviours from 15 different profiles and 1, 200 subjects.


M2LADS: A System for Generating MultiModal Learning Analytics Dashboards in Open Education

no code implementations21 May 2023 Álvaro Becerra, Roberto Daza, Ruth Cobos, Aythami Morales, Mutlu Cukurova, Julian Fierrez

In this article, we present a Web-based System called M2LADS, which supports the integration and visualization of multimodal data recorded in learning sessions in a MOOC in the form of Web-based Dashboards.

OTB-morph: One-Time Biometrics via Morphing

no code implementations17 Feb 2023 Mahdi Ghafourian, Julian Fierrez, Ruben Vera-Rodriguez, Aythami Morales, Ignacio Serna

Cancelable biometrics are a group of techniques to transform the input biometric to an irreversible feature intentionally using a transformation function and usually a key in order to provide security and privacy in biometric recognition systems.


Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment

1 code implementation13 Feb 2023 Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez, Alfonso Ortega, Ainhoa Herrarte, Manuel Alcantara, Javier Ortega-Garcia

With the aim of studying how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data, we propose a fictitious case study focused on automated recruitment: FairCVtest.

Decision Making Fairness

TypeFormer: Transformers for Mobile Keystroke Biometrics

1 code implementation26 Dec 2022 Giuseppe Stragapede, Paula Delgado-Santos, Ruben Tolosana, Ruben Vera-Rodriguez, Richard Guest, Aythami Morales

The broad usage of mobile devices nowadays, the sensitiveness of the information contained in them, and the shortcomings of current mobile user authentication methods are calling for novel, secure, and unobtrusive solutions to verify the users' identity.

BeCAPTCHA-Type: Biometric Keystroke Data Generation for Improved Bot Detection

no code implementations27 Jul 2022 Daniel DeAlcala, Aythami Morales, Ruben Tolosana, Alejandro Acien, Julian Fierrez, Santiago Hernandez, Miguel A. Ferrer, Moises Diaz

Different bot detectors are considered based on several supervised classifiers (Support Vector Machine, Random Forest, Gaussian Naive Bayes and a Long Short-Term Memory network) and a learning framework including human and synthetic samples.

Few-Shot Learning Vocal Bursts Type Prediction

Mobile Keystroke Biometrics Using Transformers

1 code implementation15 Jul 2022 Giuseppe Stragapede, Paula Delgado-Santos, Ruben Tolosana, Ruben Vera-Rodriguez, Richard Guest, Aythami Morales

One of the most popular traits in the literature is keystroke dynamics due to the large deployment of computers and mobile devices in our society.

BehavePassDB: Public Database for Mobile Behavioral Biometrics and Benchmark Evaluation

1 code implementation6 Jun 2022 Giuseppe Stragapede, Ruben Vera-Rodriguez, Ruben Tolosana, Aythami Morales

Mobile behavioral biometrics have become a popular topic of research, reaching promising results in terms of authentication, exploiting a multimodal combination of touchscreen and background sensor data.

Mobile Behavioral Biometrics for Passive Authentication

no code implementations14 Mar 2022 Giuseppe Stragapede, Ruben Vera-Rodriguez, Ruben Tolosana, Aythami Morales, Alejandro Acien, Gael Le Lan

Current mobile user authentication systems based on PIN codes, fingerprint, and face recognition have several shortcomings.

Face Recognition

FaceQgen: Semi-Supervised Deep Learning for Face Image Quality Assessment

1 code implementation3 Jan 2022 Javier Hernandez-Ortega, Julian Fierrez, Ignacio Serna, Aythami Morales

This comparison shows that, even though FaceQgen does not surpass the best existing face quality assessment methods in terms of face recognition accuracy prediction, it achieves good enough results to demonstrate the potential of semi-supervised learning approaches for quality estimation (in particular, data-driven learning based on a single high quality image per subject), having the capacity to improve its performance in the future with adequate refinement of the model and the significant advantage over competing methods of not needing quality labels for its development.

Face Image Quality Face Image Quality Assessment +4

ALEBk: Feasibility Study of Attention Level Estimation via Blink Detection applied to e-Learning

no code implementations16 Dec 2021 Roberto Daza, Daniel DeAlcala, Aythami Morales, Ruben Tolosana, Ruth Cobos, Julian Fierrez

The experimental framework is carried out using a public multimodal database for eye blink detection and attention level estimation called mEBAL, which comprises data from 38 students and multiples acquisition sensors, in particular, i) an electroencephalogram (EEG) band which provides the time signals coming from the student's cognitive information, and ii) RGB and NIR cameras to capture the students face gestures.

EEG Electroencephalogram (EEG)

OTB-morph: One-Time Biometrics via Morphing applied to Face Templates

no code implementations25 Nov 2021 Mahdi Ghafourian, Julian Fierrez, Ruben Vera-Rodriguez, Ignacio Serna, Aythami Morales

Cancelable biometrics refers to a group of techniques in which the biometric inputs are transformed intentionally using a key before processing or storage.


Introduction to Presentation Attack Detection in Iris Biometrics and Recent Advances

no code implementations24 Nov 2021 Aythami Morales, Julian Fierrez, Javier Galbally, Marta Gomez-Barrero

Iris recognition technology has attracted an increasing interest in the last decades in which we have witnessed a migration from research laboratories to real world applications.

Iris Recognition

Introduction to Presentation Attack Detection in Face Biometrics and Recent Advances

no code implementations23 Nov 2021 Javier Hernandez-Ortega, Julian Fierrez, Aythami Morales, Javier Galbally

The main scope of this chapter is to serve as an introduction to face presentation attack detection, including key resources and advances in the field in the last few years.

Face Presentation Attack Detection Face Recognition

FaceQvec: Vector Quality Assessment for Face Biometrics based on ISO Compliance

no code implementations3 Nov 2021 Javier Hernandez-Ortega, Julian Fierrez, Luis F. Gomez, Aythami Morales, Jose Luis Gonzalez-de-Suso, Francisco Zamora-Martinez

In this paper we develop FaceQvec, a software component for estimating the conformity of facial images with each of the points contemplated in the ISO/IEC 19794-5, a quality standard that defines general quality guidelines for face images that would make them acceptable or unacceptable for use in official documents such as passports or ID cards.

Face Recognition

GaitPrivacyON: Privacy-Preserving Mobile Gait Biometrics using Unsupervised Learning

no code implementations8 Oct 2021 Paula Delgado-Santos, Ruben Tolosana, Richard Guest, Ruben Vera, Farzin Deravi, Aythami Morales

This study proposes GaitPrivacyON, a novel mobile gait biometrics verification approach that provides accurate authentication results while preserving the sensitive information of the subject.

Privacy Preserving

IFBiD: Inference-Free Bias Detection

1 code implementation9 Sep 2021 Ignacio Serna, Daniel DeAlcala, Aythami Morales, Julian Fierrez, Javier Ortega-Garcia

This paper is the first to explore an automatic way to detect bias in deep convolutional neural networks by simply looking at their weights.

Bias Detection

SetMargin Loss applied to Deep Keystroke Biometrics with Circle Packing Interpretation

no code implementations2 Sep 2021 Aythami Morales, Julian Fierrez, Alejandro Acien, Ruben Tolosana, Ignacio Serna

This work presents a new deep learning approach for keystroke biometrics based on a novel Distance Metric Learning method (DML).

Metric Learning

SVC-onGoing: Signature Verification Competition

1 code implementation13 Aug 2021 Ruben Tolosana, Ruben Vera-Rodriguez, Carlos Gonzalez-Garcia, Julian Fierrez, Aythami Morales, Javier Ortega-Garcia, Juan Carlos Ruiz-Garcia, Sergio Romero-Tapiador, Santiago Rengifo, Miguel Caruana, Jiajia Jiang, Songxuan Lai, Lianwen Jin, Yecheng Zhu, Javier Galbally, Moises Diaz, Miguel Angel Ferrer, Marta Gomez-Barrero, Ilya Hodashinsky, Konstantin Sarin, Artem Slezkin, Marina Bardamova, Mikhail Svetlakov, Mohammad Saleem, Cintia Lia Szucs, Bence Kovari, Falk Pulsmeyer, Mohamad Wehbi, Dario Zanca, Sumaiya Ahmad, Sarthak Mishra, Suraiya Jabin

This article presents SVC-onGoing, an on-going competition for on-line signature verification where researchers can easily benchmark their systems against the state of the art in an open common platform using large-scale public databases, such as DeepSignDB and SVC2021_EvalDB, and standard experimental protocols.

Task 2

A Comprehensive Study on Face Recognition Biases Beyond Demographics

no code implementations2 Mar 2021 Philipp Terhörst, Jan Niklas Kolf, Marco Huber, Florian Kirchbuchner, Naser Damer, Aythami Morales, Julian Fierrez, Arjan Kuijper

However, to enable a trustworthy FR technology, it is essential to know the influence of an extended range of facial attributes on FR beyond demographics.

Attribute Decision Making +1

Child-Computer Interaction with Mobile Devices: Recent Works, New Dataset, and Age Detection

no code implementations2 Feb 2021 Ruben Tolosana, Juan Carlos Ruiz-Garcia, Ruben Vera-Rodriguez, Jaime Herreros-Rodriguez, Sergio Romero-Tapiador, Aythami Morales, Julian Fierrez

This article provides an overview of recent research in Child-Computer Interaction with mobile devices and describe our framework ChildCI intended for: i) overcoming the lack of large-scale publicly available databases in the area, ii) generating a better understanding of the cognitive and neuromotor development of children along time, contrary to most previous studies in the literature focused on a single-session acquisition, and iii) enabling new applications in e-Learning and e-Health through the acquisition of additional information such as the school grades and children's disorders, among others.

TypeNet: Deep Learning Keystroke Biometrics

1 code implementation14 Jan 2021 Alejandro Acien, Aythami Morales, John V. Monaco, Ruben Vera-Rodriguez, Julian Fierrez

We study the performance of Long Short-Term Memory networks for keystroke biometric authentication at large scale in free-text scenarios.

Exploring Facial Expressions and Affective Domains for Parkinson Detection

no code implementations11 Dec 2020 Luis Felipe Gomez-Gomez, Aythami Morales, Julian Fierrez, Juan Rafael Orozco-Arroyave

The principal contributions of this work are: (1) a novel framework to exploit deep face architectures to model hypomimia in PD patients; (2) we experimentally compare PD detection based on single images vs. image sequences while the patients are evoked various face expressions; (3) we explore different domain adaptation techniques to exploit existing models initially trained either for Face Recognition or to detect FAUs for the automatic discrimination between PD patients and healthy subjects; and (4) a new approach to use triplet-loss learning to improve hypomimia modeling and PD detection.

Domain Adaptation Face Recognition

Symbolic AI for XAI: Evaluating LFIT Inductive Programming for Fair and Explainable Automatic Recruitment

no code implementations1 Dec 2020 Alfonso Ortega, Julian Fierrez, Aythami Morales, Zilong Wang, Tony Ribeiro

Machine learning methods are growing in relevance for biometrics and personal information processing in domains such as forensics, e-health, recruitment, and e-learning.

BIG-bench Machine Learning Explainable Artificial Intelligence (XAI) +1

Facial Expressions as a Vulnerability in Face Recognition

no code implementations17 Nov 2020 Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez, Agata Lapedriza

This work explores facial expression bias as a security vulnerability of face recognition systems.

Face Recognition

Learning Emotional-Blinded Face Representations

no code implementations18 Sep 2020 Alejandro Peña, Julian Fierrez, Agata Lapedriza, Aythami Morales

We propose two face representations that are blind to facial expressions associated to emotional responses.

Attribute Emotion Recognition +1

DeepWriteSYN: On-Line Handwriting Synthesis via Deep Short-Term Representations

no code implementations14 Sep 2020 Ruben Tolosana, Paula Delgado-Santos, Andres Perez-Uribe, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales

These two properties give a lot of flexibility to our synthesiser, e. g., as shown in our experiments, DeepWriteSYN can generate realistic handwriting variations of a given handwritten structure corresponding to the natural variation within a given population or a given subject.

Handwriting generation One-Shot Learning

FairCVtest Demo: Understanding Bias in Multimodal Learning with a Testbed in Fair Automatic Recruitment

no code implementations12 Sep 2020 Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez

With the aim of studying how current multimodal AI algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data, this demonstrator experiments over an automated recruitment testbed based on Curriculum Vitae: FairCVtest.

Decision Making

A Comparative Evaluation of Heart Rate Estimation Methods using Face Videos

no code implementations22 May 2020 Javier Hernandez-Ortega, Julian Fierrez, Aythami Morales, David Diaz

This paper presents a comparative evaluation of methods for remote heart rate estimation using face videos, i. e., given a video sequence of the face as input, methods to process it to obtain a robust estimation of the subjects heart rate at each moment.

Heart rate estimation

BeCAPTCHA-Mouse: Synthetic Mouse Trajectories and Improved Bot Detection

2 code implementations2 May 2020 Alejandro Acien, Aythami Morales, Julian Fierrez, Ruben Vera-Rodriguez

We propose two new mouse trajectory synthesis methods for generating realistic data: a) a function-based method based on heuristic functions, and b) a data-driven method based on Generative Adversarial Networks (GANs) in which a Generator synthesizes human-like trajectories from a Gaussian noise input.

Bias in Multimodal AI: Testbed for Fair Automatic Recruitment

1 code implementation15 Apr 2020 Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez

With the aim of studying how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data, we propose a fictitious automated recruitment testbed: FairCVtest.

Decision Making Person Recognition

InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometrics

no code implementations14 Apr 2020 Ignacio Serna, Alejandro Peña, Aythami Morales, Julian Fierrez

We analyze how bias affects deep learning processes through a toy example using the MNIST database and a case study in gender detection from face images.

Bias Detection

Blockchain in the Internet of Things: Architectures and Implementation

no code implementations13 Apr 2020 Oscar Delgado-Mohatar, Ruben Tolosana, Julian Fierrez, Aythami Morales

The world is becoming more interconnected every day.

Cryptography and Security Computers and Society

TypeNet: Scaling up Keystroke Biometrics

no code implementations7 Apr 2020 Alejandro Acien, John V. Monaco, Aythami Morales, Ruben Vera-Rodriguez, Julian Fierrez

We study the suitability of keystroke dynamics to authenticate 100K users typing free-text.

DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection

2 code implementations1 Jan 2020 Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales, Javier Ortega-Garcia

The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding implications towards society in this era of fake news.

Attribute DeepFake Detection +2

edBB: Biometrics and Behavior for Assessing Remote Education

1 code implementation10 Dec 2019 Javier Hernandez-Ortega, Roberto Daza, Aythami Morales, Julian Fierrez, Javier Ortega-Garcia

We present a platform for student monitoring in remote education consisting of a collection of sensors and software that capture biometric and behavioral data.

EEG Electroencephalogram (EEG)

Algorithmic Discrimination: Formulation and Exploration in Deep Learning-based Face Biometrics

1 code implementation4 Dec 2019 Ignacio Serna, Aythami Morales, Julian Fierrez, Manuel Cebrian, Nick Obradovich, Iyad Rahwan

We experimentally show that demographic groups highly represented in popular face databases have led to popular pre-trained deep face models presenting strong algorithmic discrimination.

Face Recognition

Quality-based Pulse Estimation from NIR Face Video with Application to Driver Monitoring

no code implementations16 May 2019 Javier Hernandez-Ortega, Shigenori Nagae, Julian Fierrez, Aythami Morales

In this paper we develop a robust for heart rate (HR) estimation method using face video for challenging scenarios with high variability sources such as head movement, illumination changes, vibration, blur, etc.

SensitiveNets: Learning Agnostic Representations with Application to Face Images

1 code implementation1 Feb 2019 Aythami Morales, Julian Fierrez, Ruben Vera-Rodriguez, Ruben Tolosana

Our method is based on an adversarial regularizer that introduces a sensitive information removal function in the learning objective.

Face Recognition Fairness +2

MultiLock: Mobile Active Authentication based on Multiple Biometric and Behavioral Patterns

no code implementations29 Jan 2019 Alejandro Acien, Aythami Morales, Ruben Vera-Rodriguez, Julian Fierrez

In this paper we evaluate mobile active authentication based on an ensemble of biometrics and behavior-based profiling signals.

Cannot find the paper you are looking for? You can Submit a new open access paper.