Skip to main content

All Questions

1 vote
0 answers
14 views

Alternative to Nemenyi posthoc test that can use variance

I am applying statistical tests from paper "Statistical Comparisons of Classifiers over Multiple Data Sets" J. Demsar (link) in my own work. However, variance is pretty important, since ...
qalis's user avatar
  • 238
3 votes
1 answer
2k views

Post-hoc tests after Friedman test

In Statistical Comparisons of Classifiers over Multiple Data Sets (p. 12) Janez Demsar suggests to use the Bonferroni-Dunn test as a post-hoc test after the null hypothesis of an initial Friedman test ...
user378615's user avatar
1 vote
1 answer
761 views

Friedman's test is very significant, but its post hoc comparisons are not significant

This post does not include an answer for my question. I have perform a Friedman test on a results obtained by several methods on multiple datasets, as described in this paper: "Statistical ...
SHdotCom's user avatar
1 vote
1 answer
514 views

Should I rank my data before doing post hoc Dunn test?

I am trying to compare multiple algorithms using the Friedman test and post hoc Dunn test. I know that we should use the rank of our data before performing the Friedman test, but should we rank the ...
Sajjad's user avatar
  • 11
0 votes
0 answers
57 views

Kruskal-Wallis test for ranking data

I have a complex experimental design where there are 3 groups, and in each group, a ranking/comparison is made between items (list of items). Each ranking is associated with 9 measurements on a 5 ...
deadendtux's user avatar
0 votes
1 answer
1k views

How to obtain the results of the Nemenyi post-hoc test in a table showing grouped pairs?

I performed a Friedman's test, which showed that there are differences among my treatments. Thus, I choose to perform the Nemenyi's post-hoc test in order to infer which treatments statistically ...
Iago Carvalho's user avatar
5 votes
1 answer
3k views

How to interpret the result of Friedman's test?

I uploaded the data and then I used bootstrapping to have 10 different samples from the original data but with the same length as the original data. For each sample, I used 7 distance metrics, and I ...
jeza's user avatar
  • 2,109
4 votes
1 answer
10k views

Why run a post hoc wilcoxon signed rank test after Friedman test, why not just skip to Wilcoxon sign test instead?

I understand that one is required to run post hoc tests after the Friedman test. For example, while the Friedman test may find a statistically significant change amongst 3 treatments, one may follow ...
user6306773's user avatar
10 votes
4 answers
20k views

Friedman's test is very significant, but its post hoc comparisons (SPSS) are not significant

I ran a non-parametric Friedman's test for my data in SPSS 22 and significantly rejected the null. That would mean that among the $k$ paired samples (3 in my case), there should be detected at least ...
Niksr's user avatar
  • 277
0 votes
0 answers
646 views

Significant Friedman's test vs. non-significant multiple comparisons

I am currently running a randomized, placebo-controlled, cross-over design for a new type of intervention. This intervention is compared to a placebo and another more conventional type of treatment. ...
D.B's user avatar
  • 1