Collection and Validation of Psychophysiological Data from Professional and Amateur Players: a Multimodal eSports Dataset

2 Nov 2020  ยท  Anton Smerdov, Bo Zhou, Paul Lukowicz, Andrey Somov ยท

Proper training and analytics in eSports require accurately collected and annotated data. Most eSports research focuses exclusively on in-game data analysis, and there is a lack of prior work involving eSports athletes' psychophysiological data. In this paper, we present a dataset collected from professional and amateur teams in 22 matches in League of Legends video game with more than 40 hours of recordings. Recorded data include the players' physiological activity, e.g. movements, pulse, saccades, obtained from various sensors, self-reported aftermatch survey, and in-game data. An important feature of the dataset is simultaneous data collection from five players, which facilitates the analysis of sensor data on a team level. Upon the collection of dataset we carried out its validation. In particular, we demonstrate that stress and concentration levels for professional players are less correlated, meaning more independent playstyle. Also, we show that the absence of team communication does not affect the professional players as much as amateur ones. To investigate other possible use cases of the dataset, we have trained classical machine learning algorithms for skill prediction and player re-identification using 3-minute sessions of sensor data. Best models achieved 0.856 and 0.521 (0.10 for a chance level) accuracy scores on a validation set for skill prediction and player re-id problems, respectively. The dataset is available at https://github.com/smerdov/eSports Sensors Dataset.

PDF Abstract

Datasets


Introduced in the Paper:

eSports Sensors Dataset
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Skills Evaluation eSports Sensors Dataset SVM Accuracy 85.6 # 1
ROC AUC 0.945 # 1
LogLoss 0.311 # 1
Person Re-Identification eSports Sensors Dataset Random Guess LogLoss 0.02303 # 4
Accuracy 10 # 5
ROC AUC 0.5 # 5
Person Re-Identification eSports Sensors Dataset KNN LogLoss 0.05735 # 5
Accuracy 41.5 # 4
ROC AUC 0.84 # 4
Skills Evaluation eSports Sensors Dataset Random Guess Accuracy 50 # 5
ROC AUC 0.5 # 5
LogLoss 0.693 # 5
Skills Evaluation eSports Sensors Dataset KNN Accuracy 74.1 # 4
ROC AUC 0.899 # 2
LogLoss 0.442 # 2
Person Re-Identification eSports Sensors Dataset SVM LogLoss 0.01588 # 1
Accuracy 45 # 3
ROC AUC 0.89 # 2
Person Re-Identification eSports Sensors Dataset Logistic Regression LogLoss 0.01615 # 2
Accuracy 48.8 # 2
ROC AUC 0.884 # 3
Skills Evaluation eSports Sensors Dataset Random Forest Accuracy 80 # 3
ROC AUC 0.885 # 4
LogLoss 0.456 # 3
Skills Evaluation eSports Sensors Dataset Logistic Regression Accuracy 83.8 # 2
ROC AUC 0.886 # 3
LogLoss 0.596 # 4
Person Re-Identification eSports Sensors Dataset Random Forest LogLoss 0.01617 # 3
Accuracy 52.1 # 1
ROC AUC 0.919 # 1

Methods


No methods listed for this paper. Add relevant methods here