1 code implementation • 1 Aug 2024 • Lingyu Du, Jinyuan Jia, Xucong Zhang, Guohao Lan
Eye gaze contains rich information about human attention and cognitive processes.
no code implementations • 16 Apr 2024 • Zhi-Yi Lin, Jouh Yeong Chew, Jan van Gemert, Xucong Zhang
We propose an end-to-end approach for gaze target detection: predicting a head-target connection between individuals and the target image regions they are looking at.
no code implementations • 20 Feb 2024 • Zhi-Yi Lin, Bofan Lyu, Judith Cueto Fernandez, Eline van der Kruk, Ajay Seth, Xucong Zhang
Accurate 3D kinematics estimation of human body is crucial in various applications for human health and mobility, such as rehabilitation, injury prevention, and diagnosis, as it helps to understand the biomechanical loading experienced during movement.
no code implementations • 8 Sep 2023 • Lingyu Du, Xucong Zhang, Guohao Lan
Appearance-based gaze estimation has shown great promise in many applications by using a single general-purpose camera as the input device.
1 code implementation • 18 Aug 2023 • Yunhan Wang, Xiangwei Shi, Shalini De Mello, Hyung Jin Chang, Xucong Zhang
With the rapid development of deep learning technology in the past decade, appearance-based gaze estimation has attracted great attention from both computer vision and human-computer interaction research communities.
no code implementations • 25 May 2023 • Jiawei Qin, Takuru Shimoyama, Xucong Zhang, Yusuke Sugano
This work proposes an effective model training pipeline consisting of a training data synthesis and a gaze estimation model for unsupervised domain adaptation.
no code implementations • 9 May 2023 • Haldun Balim, Seonwook Park, Xi Wang, Xucong Zhang, Otmar Hilliges
In this paper, we propose a frame-to-gaze network that directly predicts both 3D gaze origin and 3D gaze direction from the raw frame out of the camera without any face or eye cropping.
1 code implementation • 13 Jan 2023 • Marian Bittner, Wei-Tse Yang, Xucong Zhang, Ajay Seth, Jan van Gemert, Frans C. T. van der Helm
Markerless estimation of 3D Kinematics has the great potential to clinically diagnose and monitor movement disorders without referrals to expensive motion capture labs; however, current approaches are limited by performing multiple de-coupled steps to estimate the kinematics of a person from videos.
1 code implementation • CVPR 2023 • Alessandro Ruzzi, Xiangwei Shi, Xi Wang, Gengyan Li, Shalini De Mello, Hyung Jin Chang, Xucong Zhang, Otmar Hilliges
We propose GazeNeRF, a 3D-aware method for the task of gaze redirection.
1 code implementation • ICCV 2021 • Adrian Spurr, Aneesh Dahiya, Xi Wang, Xucong Zhang, Otmar Hilliges
Encouraged by the success of contrastive learning on image classification tasks, we propose a new self-supervised method for the structured regression task of 3D hand pose estimation.
Ranked #16 on 3D Hand Pose Estimation on FreiHAND
2 code implementations • NeurIPS 2020 • Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, Otmar Hilliges
Furthermore, we show that in the presence of limited amounts of real-world training data, our method allows for improvements in the downstream task of semi-supervised cross-dataset gaze estimation.
1 code implementation • ECCV 2020 • Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang, Otmar Hilliges
We show that our dataset can significantly improve the robustness of gaze estimation methods across different head poses and gaze angles.
Ranked #1 on Gaze Estimation on ETH-XGaze (using extra training data)
1 code implementation • ECCV 2020 • Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges
Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors.
1 code implementation • 8 Nov 2019 • Marcel Bühler, Seonwook Park, Shalini De Mello, Xucong Zhang, Otmar Hilliges
Accurately labeled real-world training data can be scarce, and hence recent works adapt, modify or generate images to boost target datasets.
1 code implementation • ICCV 2019 • Zhe He, Adrian Spurr, Xucong Zhang, Otmar Hilliges
In this work, we present a novel method to alleviate this problem by leveraging generative adversarial training to synthesize an eye image conditioned on a target gaze direction.
no code implementations • ECCV 2018 • Yihua Cheng, Feng Lu, Xucong Zhang
Inspired by this, we design the multi-stream ARE-Net; one asymmetric regression network (AR-Net) predicts 3D gaze directions for both eyes with a novel asymmetric strategy, and the evaluation network (E-Net) adaptively adjusts the strategy by evaluating the two eyes in terms of their performance during optimization.
2 code implementations • 12 May 2018 • Seonwook Park, Xucong Zhang, Andreas Bulling, Otmar Hilliges
Conventional feature-based and model-based gaze estimation methods have proven to perform well in settings with controlled illumination and specialized cameras.
6 code implementations • 24 Nov 2017 • Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling
Second, we present an extensive evaluation of state-of-the-art gaze estimation methods on three current datasets, including MPIIGaze.
4 code implementations • 27 Nov 2016 • Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling
Eye gaze is an important non-verbal cue for human affect analysis.
no code implementations • 18 Nov 2015 • Marc Tonsen, Xucong Zhang, Yusuke Sugano, Andreas Bulling
We further study the influence of image resolution, vision aids, as well as recording location (indoor, outdoor) on pupil detection performance.
no code implementations • ICCV 2015 • Erroll Wood, Tadas Baltrusaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, Andreas Bulling
Images of the eye are key in several computer vision problems, such as shape registration and gaze estimation.
6 code implementations • CVPR 2015 • Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling
Appearance-based gaze estimation is believed to work well in real-world settings, but existing datasets have been collected under controlled laboratory conditions and methods have been not evaluated across multiple datasets.
no code implementations • CVPR 2013 • Junjie Yan, Xucong Zhang, Zhen Lei, Shengcai Liao, Stan Z. Li
The model contains resolution aware transformations to map pedestrians in different resolutions to a common space, where a shared detector is constructed to distinguish pedestrians from background.