About

Gaze Estimation is a task to predict where a person is looking at given the person’s full face. The task contains two directions: 3-D gaze vector and 2-D gaze position estimation. 3-D gaze vector estimation is to predict the gaze vector, which is usually used in the automotive safety. 2-D gaze position estimation is to predict the horizontal and vertical coordinates on a 2-D screen, which allows utilizing gaze point to control a cursor for human-machine interaction.

Source: A Generalized and Robust Method Towards Practical Gaze Estimation on Smart Phone

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Greatest papers with code

Learning from Simulated and Unsupervised Images through Adversarial Training

CVPR 2017 tensorflow/models

With recent progress in graphics, it has become more tractable to train models on synthetic images, potentially avoiding the need for expensive annotations.

DOMAIN ADAPTATION GAZE ESTIMATION HAND POSE ESTIMATION IMAGE-TO-IMAGE TRANSLATION

Fine-Grained Head Pose Estimation Without Keypoints

2 Oct 2017natanielruiz/deep-head-pose

Estimating the head pose of a person is a crucial problem that has a large amount of applications such as aiding in gaze estimation, modeling attention, fitting 3D models to video and performing face alignment.

Ranked #4 on Head Pose Estimation on BIWI (MAE (trained with BIWI data) metric)

FACE ALIGNMENT GAZE ESTIMATION HEAD POSE ESTIMATION

Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction

30 Apr 2014pupil-labs/pupil

Commercial head-mounted eye trackers provide useful features to customers in industry and research but are expensive and rely on closed source hardware and software.

EYE TRACKING GAZE ESTIMATION

Eye Tracking for Everyone

CVPR 2016 CSAILVision/GazeCapture

We believe that we can put the power of eye tracking in everyone's palm by building eye tracking software that works on commodity hardware such as mobile phones and tablets, without the need for additional sensors or devices.

EYE TRACKING GAZE ESTIMATION

Deep Pictorial Gaze Estimation

ECCV 2018 swook/GazeML

In this paper, we introduce a novel deep neural network architecture specifically designed for the task of gaze estimation from single eye input.

GAZE ESTIMATION

RT-BENE: A Dataset and Baselines for Real-Time Blink Estimation in Natural Environments

IEEE International Conference on Computer Vision Workshops 2019 Tobias-Fischer/rt_gene

We further incorporate our proposed RT-BENE baselines in the recently presented RT-GENE gaze estimation framework where it provides a real-time inference of the openness of the eyes.

BLINK ESTIMATION GAZE ESTIMATION HUMAN ROBOT INTERACTION

RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments

ECCV 2018 Tobias-Fischer/rt_gene

We first record a novel dataset of varied gaze and head pose images in a natural environment, addressing the issue of ground truth annotation by measuring head pose using a motion capture system and eye gaze using mobile eyetracking glasses.

GAZE ESTIMATION IMAGE INPAINTING MOTION CAPTURE

Few-Shot Adaptive Gaze Estimation

ICCV 2019 NVlabs/few_shot_gaze

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks.

 Ranked #1 on Gaze Estimation on MPII Gaze (using extra training data)

GAZE ESTIMATION META-LEARNING

MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

24 Nov 2017hysts/pytorch_mpiigaze

Second, we present an extensive evaluation of state-of-the-art gaze estimation methods on three current datasets, including MPIIGaze.

GAZE ESTIMATION

It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation

27 Nov 2016hysts/pytorch_mpiigaze

Eye gaze is an important non-verbal cue for human affect analysis.

GAZE ESTIMATION