Piano Skills Assessment

13 Jan 2021  ·  Paritosh Parmar, Jaiden Reddy, Brendan Morris ·

Can a computer determine a piano player's skill level? Is it preferable to base this assessment on visual analysis of the player's performance or should we trust our ears over our eyes? Since current CNNs have difficulty processing long video videos, how can shorter clips be sampled to best reflect the players skill level? In this work, we collect and release a first-of-its-kind dataset for multimodal skill assessment focusing on assessing piano player's skill level, answer the asked questions, initiate work in automated evaluation of piano playing skills and provide baselines for future work. Dataset is available from: https://github.com/ParitoshParmar/Piano-Skills-Assessment.

PDF Abstract

Datasets


Introduced in the Paper:

Multimodal PISA

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Skills Assessment Multimodal PISA MMDL Accuracy (%) 74.60 # 1
Audio Classification Multimodal PISA Audio Accuracy (%) 64.50 # 1
Video Classification Multimodal PISA Video Accuracy (%) 73.95 # 1

Methods


No methods listed for this paper. Add relevant methods here