Metrics for Multi-Class Classification: an Overview
Published in
arXiv.org(2020)External Links:
TL
TL;DR
A list of the most promising multi-class metrics is reviewed, which highlight their advantages and disadvantages and show their possible usages during the development of a classification model.
Abstract
Classification tasks in machine learning involving more than two classes are known by the name of "multi-class classification". Performance indicators are very useful when the aim is to evaluate and compare different classification models or machine learning techniques. Many metrics come in handy to test the ability of a multi-class classifier. Those metrics turn out to be useful at different stage of the development process, e.g. comparing the performance of two different models or analysing the behaviour of the same model by tuning different parameters. In this white paper we review a list of the most promising multi-class metrics, we highlight their advantages and disadvantages and show their possible usages during the development of a classification model.
References14 items
1
The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation
2
Macro F1 and Macro F1
3
Classifiers and their Metrics Quantified
4
Common pitfalls in statistical analysis: Measures of agreement
5