Impact of the Number of Votes on the Reliability and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach

1 code implementation • 25 Mar 2020 • Babak Naderi, Tobias Hossfeld, Matthias Hirth, Florian Metzger, Sebastian Möller, Rafael Zequeira Jiménez

The subjective quality of transmitted speech is traditionally assessed in a controlled laboratory environment according to ITU-T Rec.

Multimedia

A Survey of Crowdsourcing in Medical Image Analysis

no code implementations • 25 Feb 2019 • Silas Ørting, Andrew Doyle, Arno van Hilten, Matthias Hirth, Oana Inel, Christopher R. Madan, Panagiotis Mavridis, Helen Spiers, Veronika Cheplygina

Despite the growing popularity of this approach, there has not yet been a comprehensive literature review to provide guidance to researchers considering using crowdsourcing methodologies in their own medical imaging analysis.