Skip to main content

All Questions

0 votes
1 answer
145 views

Do I always have to consider all possible pairs in post-hoc pairwise comparison?

I performed an ANOVA on some test results of N groups (N = 7), which yielded a significant difference of the group means, followed by a wilcoxon signed-rank test to determine which groups are ...
StrictlyStationaryPoster's user avatar
3 votes
1 answer
2k views

Post-hoc tests after Friedman test

In Statistical Comparisons of Classifiers over Multiple Data Sets (p. 12) Janez Demsar suggests to use the Bonferroni-Dunn test as a post-hoc test after the null hypothesis of an initial Friedman test ...
user378615's user avatar
0 votes
1 answer
539 views

Calculating effect size of wilcoxon test after correction for multiple comparisons using R

I am trying to compare two amino acid concentrations after two treatment variations. The data is not normal distributed, so I have to use non-parametric tests. I calculated the adjusted p values, but ...
Mats's user avatar
  • 1
3 votes
1 answer
178 views

Relationship between p-values and effect size

I did a Wilcoxon signed rank test to understand whether there is a difference in average sales in 9 different counties. There are multiple pairs of counties that are significantly different. Would it ...
Rnovice's user avatar
  • 45
0 votes
0 answers
581 views

Should I perform multiple testing correction (FDR) for all the P-values regardless if they derive from Ttest or Wilcoxon?

There are 100 participants and I want to test if 50 metabolites change before and after intervention (antiobesity drug). First, I check the normality for each variable, and then I perform a T-test or ...
Geli's user avatar
  • 1
0 votes
0 answers
520 views

Pairwise comparison - too many groups

I have 23 groups that I am comparing. I was just going to show the distribution of the groups with boxplots but a reviewer of my manuscript wants me to do group testing. The trouble is that pairwise ...
nateroe's user avatar
  • 101
1 vote
1 answer
322 views

Do multiple wilcoxon tests of drug sensitivity between mutated grp and wild-type grp need multiple testing correction?

I am doing wilcoxon-rank-sum tests of the sensitivity (AUC) of over 1000 drugs between mutated gene A and wild-type gene A. So, for each drug, there will be one wilcoxon test and one p-value. Since I ...
Idiotsum's user avatar
2 votes
1 answer
200 views

Test for multiple samples of ordinal data

I have 10 independent samples of ordinal data ranked 1-3. I also have predicted ranks for the same data set. I want to test if the predicted ranking matches the observed ranking at a rate better ...
Barker's user avatar
  • 1,212
1 vote
0 answers
198 views

Is it appropriate to use Kruskal-Wallis test for one comparison and Wilcoxon Signed Rank Test for another?

I have a data set that I would like to perform several tests on to see if there are significant changes over time. I have replicated measures of 3 experimental ponds and 1 control pond that I have ...
Samaj Oruel's user avatar
1 vote
1 answer
94 views

Interpretation of paired test

I am unsure how to interpret the significance of a paired test. I have data for six days of the week; for each day I have relevant data for 11 hours minutewise. I want to determine, whether a trait '...
Neuneck's user avatar
  • 138
1 vote
2 answers
1k views

Multiple comparisons - Exactly when is it appropriate outside of ANOVA?

and thanks for taking the time to look at this thread! I'm massively stumped about exactly when it's 'correct' to be correcting for multiple comparisons by adjusting the threshold p-value. I know in ...
Greg Simmonds's user avatar
4 votes
1 answer
10k views

Why run a post hoc wilcoxon signed rank test after Friedman test, why not just skip to Wilcoxon sign test instead?

I understand that one is required to run post hoc tests after the Friedman test. For example, while the Friedman test may find a statistically significant change amongst 3 treatments, one may follow ...
user6306773's user avatar
1 vote
2 answers
986 views

multiple comparisons correction

Let's say I have the done the following biological experiment: I have 10 genetically different bacterial clones, which I have competed against a common reference clone (ancestral). I can then ...
ramiro's user avatar
  • 309
1 vote
0 answers
145 views

Bonferroni adjustment according to which families?

We have 17 subjects in a crossover design of three groups: Challenge agent (CA) CA+ compound of interest (CI) CI - Our data proves this has no physiological effect, and is thus not used in ...
Anne-Marie's user avatar
1 vote
2 answers
286 views

Testing which groups have had a significant change

I have three groups with two hundred individuals each, and each individual within a group has a pre and post treatment measurement. A single group contains individuals with similar pre measurement ...
GeneticsGuy's user avatar

15 30 50 per page