Understanding Micro and Macro Averages in Multiclass Multilabel Problems

When working with multiclass multilabel problems, it's important to understand how to calculate micro and macro averages in order to evaluate the performance of a model. Micro and macro averages provide different perspectives on the performance of a model and are useful in different situations. In this article, we will explore the concepts of micro and macro averages and how to calculate them.

Multiclass vs Multilabel

Before diving into micro and macro averages, let's first understand the difference between multiclass and multilabel problems.

In a multiclass problem, there is only one correct label per example. For example, in a problem of classifying animals into different categories (e.g. mammals, birds, reptiles, etc.) each example can only have one correct label.

On the other hand, in a multilabel problem, there can be multiple correct labels per example. For example, in a problem of categorizing music into different genres (e.g. rock, pop, hip hop, etc.) an example can belong to multiple genres.

Micro and Macro Averages

In multiclass multilabel problems, there are two commonly used measures of performance: micro and macro averages.

Micro Average

Micro average is calculated by taking the total number of true positives (TP), false positives (FP), true negatives (TN), and false negatives (FN) and then using these counts to calculate the precision, recall, and F1-score. Micro average gives more weight to the majority class and is particularly useful when the classes are imbalanced. The formula for calculating micro average is as follows:

Macro Average

Macro average, on the other hand, calculates the performance of each class individually and then takes the unweighted mean of the class-wise performance. Macro average gives equal weight to each class and is useful when all classes are of equal importance. The formula for calculating macro average is as follows:

where n is the number of classes.

It's important to note that in multilabel problems, these metrics are calculated for each label independently and then combined by taking the mean, sum or some other combination.

Choosing between Micro and Macro averages

The choice between micro and macro averages depends on the specific problem and the desired perspective on the model's performance.

Micro averages are useful when the classes are imbalanced and it is important to have a better understanding of the model's performance on the majority class.

Macro averages, on the other hand, are useful when all classes are of equal importance and you want to have a better understanding of the model's performance on each class individually.

In some cases, it may be useful to report both micro and macro averages to get a more comprehensive understanding of the model's performance.

It's also important to note that micro and macro averages are not the only metrics to evaluate the performance of a model in multiclass multilabel problems. Other metrics such as ROC-AUC, Hamming loss and Jaccard similarity can also be used.

Conclusion

Micro and macro averages are important measures of performance in multiclass multilabel problems. They provide different perspectives on the model's performance and should be used depending on the specific problem and desired perspective. It's important to consider the class imbalance and the relative importance of each class when choosing between micro and macro averages.

Any comments or suggestions? Let me know.

Credits:

Heading image from Unsplash by vackground.com