Questions tagged [bonferroni]
Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.
402
questions
0
votes
0
answers
25
views
Appropriate way to correct for multiple comparisons in this case
I am trying to compare the performance of an optimisation algorithm on different objective functions. The functions can vary in their form (4 different types) and dimension. I would like to first ...
- 3
2
votes
2
answers
43
views
Bonferroni correction necessary? regression to predict ONE outcome
I am working on a project with a small sample size where I have multiple predictors at baseline and one IV. I am trying to see if any of the DVs are good predictors for the score on the IV (continuous)...
- 21
0
votes
0
answers
23
views
The problem of double adjustment of p-values in multilevel models with categorical predictors
I have a set of around 30 multilevel models which have the same predictor variables (and the same cluster variable), but different outcome variables. Since there are so many models, I want to perform ...
- 357
0
votes
0
answers
12
views
external internal validation and chi square
The internal test set, created from 20 percent of the train data set, consists of 'a' and 'b' labels. I take the 'a' labels from the internal test and combine them with the 'c' group of another ...
- 1
0
votes
0
answers
17
views
Bootstrapped Confidence Intervals controlling for FWER?
I'm currently using the bootci package in MATLAB to compute bootstrapped confidence intervals. I have data for two variables and I'm interested in comparing differences in means of these variables. ...
- 1
0
votes
0
answers
42
views
When to use an adjustment method for Kruskal-Wallis + Dunn's and which method?
I need to do multiple pairwise comparisons among 5 groups (Treatment 1, Treatment 2, Treatment 3, Positive Control, Negative Control) for different tests and times. Each group has $10$ individuals, ...
4
votes
2
answers
482
views
multiple linear mixed models - multiple comparisons adjustment
I recently started to work on a case-control study using repeated measures over time (Modeling repeated measures data in R - Interpretation and Validation). I have several dependent variables and I ...
- 391
2
votes
1
answer
64
views
Quantitatively distinguishing between multiple-comparison tests
As someone relatively new to applied statistics, I have been trying to better understand some of the best practices for applying statistical methods. I have been recently trying to understand when to ...
- 153
0
votes
0
answers
18
views
Multiple comparisons (i.e., cluster 1 vs cluster 2+3), how to adjust p-value
I am analyzing the differences in mean of a continuos variable between 3 clusters. I used anova (after testing whether it has a parametric distribution) and obtained p-value lower than 0.05. As post-...
0
votes
0
answers
30
views
FDR q-values interpretation
In performing 43 test on two groups of individuals (independent t-test) I obtained 27 significant results, then adjusting the pvalues with BH procedure for controlling FDR I obtained the so-called q-...
- 391
0
votes
0
answers
34
views
Is it necessary to perform correction on confidence intervals of some specific coefficients of different models on same dataset?
I have a dataset which is about daily death rate of a specific disease and meteorological data:
The dataset structure is as below:
data =
Death count
Daily pm2.5 (lag 0)
Daily pm2.5 (lag 1)
Daily pm2....
- 250
1
vote
0
answers
22
views
Bonferroni-Dunn Critical differences
I was reading about visualizing post-hoc tests and I happened to come across a Python package called Orange.
Looking into the package, the function used for calculating the CD value seems to be ...
6
votes
1
answer
88
views
Which family-wise correction is needed for one-sided t-tests in a randomized controlled trial with several independent measures across groups?
I conducted a randomized controlled experiment with groups $A$, $B$, $C$, and $D$, each containing around $40$ human participants who saw one of four variants of a website. Group $A$ saw a baseline, ...
- 161
4
votes
2
answers
275
views
Am I right that the Bonferroni correction does NOT apply to randomness testing?
There are statistical test suites (below) that are commonly used to determine whether a sequence appears to be (pseudo) random. Some of these test suites have a few tests (ent/ent3000), whilst others ...
- 666
0
votes
0
answers
11
views
Statistical model for multi-subject multi-trial group comparisons
I am quite a novice in statistics and I have a complex model (at least for me) that I need to build for a test. I have a treatment plan and I am doing some frequency measurements in different regions ...
- 1