GASP: Gated Attention For Saliency Prediction

1 code implementation • International Joint Conference on Artificial Intelligence 2021 • Fares Abawi, Tom Weber, Stefan Wermter

We show that gaze direction and affective representations contribute a prediction to ground-truth correspondence improvement of at least 5% compared to dynamic saliency models without social cues.

Saliency Prediction Video Saliency Detection +1

A trained humanoid robot can perform human-like crossmodal social attention and conflict resolution

no code implementations • 2 Nov 2021 • Di Fu, Fares Abawi, Hugo Carneiro, Matthias Kerzel, Ziwei Chen, Erik Strahl, Xun Liu, Stefan Wermter

Our saliency prediction model was trained to detect social cues, predict audio-visual saliency, and attend selectively for the robot study.

Saliency Prediction

DRILL: Dynamic Representations for Imbalanced Lifelong Learning

1 code implementation • 18 May 2021 • Kyra Ahrens, Fares Abawi, Stefan Wermter

Continual or lifelong learning has been a long-standing challenge in machine learning to date, especially in natural language processing (NLP).

Continual Learning Meta-Learning +2

Enhancing a Neurocognitive Shared Visuomotor Model for Object Identification, Localization, and Grasping With Learning From Auxiliary Tasks

1 code implementation • 26 Sep 2020 • Matthias Kerzel, Fares Abawi, Manfred Eppe, Stefan Wermter

In this follow-up study, we expand the task and the model to reaching for objects in a three-dimensional space with a novel dataset based on augmented reality and a simulation environment.