plot_critical_difference

plot_critical_difference(scores, labels, errors=False, cliques=None, clique_method='nemenyi', alpha=0.05, width=10, textspace=2.5, reverse=True)

Draw critical difference diagram.

Step 1 & 2: Calculate average ranks from data Step 3: Use Friedman test to check whether the strategy significantly affects the classification performance Step 4: Compute critical differences using Nemenyi post-hoc test. (How much should the average rank of two strategies differ to be

statistically significant)

Step 5: Compute statistically similar cliques of strategies Step 6: Draw the diagram

See Janez Demsar, Statistical Comparisons of Classifiers over Multiple Data Sets, 7(Jan):1–30, 2006.

Parts of the code are copied and adapted from here: https://github.com/hfawaz/cd-diagram