Methods of Assessing the Rank Order of Prediction Models with Respect to Variance of Listening Test Ratings

Although predictive models are widely used to predict the results of listening tests, there are currently no standardized statistical metrics for assessing the rank order, and commonly used rank order metrics do not consider the variance of the listening test data. This paper proposes two novel metrics for assessing rank order with respect to variance by adapting Spearman's Rho and Kendall's Tau and assesses the performance of these metrics against actual listening test data with standardized prediction models.