Questions tagged [multiple-comparisons]
Signals situations where one is concerned about achieving intended power and size when more than one hypothesis test is performed.
1,867
questions
1
vote
1
answer
56
views
Estimated marginal trends after regression of isometric log ratio transformed compositional data
I have longitudinal compositional data with four base response variables. I would like to compare the slopes of groups across time, but not for the ilr-transformed composition. I wish to compare the ...
- 1,109
3
votes
1
answer
39
views
multiplicity-adjustment w/ unequal variance & pre-planned vs post hoc
The (only) answer to this question says
If the variability of the data in each category of your factor is
non-constant, that would invalidate ... your multiplicity-adjusted
post-hoc p-values.
Why ...
- 123
1
vote
0
answers
30
views
When assessing significance of identification variables (e.g., race) after applying a regression model, is it correct to use a Bonferroni adjustment?
I am building a regression model to assess whether being a member of any particular race (compared to the control group, which is White) is associated with a statistically significant loan application ...
- 807
0
votes
0
answers
36
views
Appropriate way to correct for multiple hypotheses with multiple one-way ANOVAs and Tukey's post-hoc
I have a dataset with four groups and 14 different dependent variables. Based on the answer given here, I think the best approach for my analytical question is to perform multiple one-way ANOVAs, ...
- 11
0
votes
1
answer
16
views
Is there a statistical test where you test whether any of multiple separate analyses of variances or chi-square tests are statistically significant?
Is there a statistical test where you test whether any of multiple separate analyses of variances or chi-square tests are statistically significant?
- 1
0
votes
0
answers
27
views
Is correction for multiple comparisons necessary in this instance (single variable)?
Coming here from a more analytical chemistry background, but I figured I would run my current thoughts here before committing to anything after looking around for a bit. I'm used to always using ...
- 1
0
votes
0
answers
30
views
False Discovery Rate-Adjusted Multiple Confidence Intervals after p-value-adjustment
I apologize in advance if my question is incomprehensible, I am very new to this topic.
My data consists of 6 dependent variables (DV1-6) and 5 independent variables (IV1-5) of interest. For reasons ...
- 1
1
vote
0
answers
22
views
is it acceptable to do pairewise comparisons for mixed regressions that aren't independent?
I have a model specified as lmer(log(dv) ~ chosen*tasktype +(1|id)+(1|qs), data)
The key issue in the data is that the groups are not indepedent, i.e., ...
- 111
0
votes
0
answers
15
views
Mixing MLE and Hypothesis Testing
In my field of biology, we have spatial data with known distances, so we know a general formula for our error structure that we can use in a generalized least squares context, it is
$$
(1-\lambda)\...
- 385
1
vote
0
answers
71
views
Statistical significance of hierarchical (multi-level) associations
Association rule mining is a common technique in Data mining used to find itemsets which appear together very frequently in large transaction databases (e.g. in Table 3 we see that in a transactions ...
0
votes
0
answers
10
views
Methods for discriminating between Markov kernels
I'm interested in problems of the following form, which I've deliberately specified a bit vaguely. I would like to know if problems of this kind have been studied, and if so what they're called and ...
- 425
6
votes
1
answer
182
views
How to adjust p-values in a multiple regression when variables have been a selected by Lasso?
I have designed an analysis where I am testing a lot of variables together. So I first apply a Lasso regression to select the top variables, and then I run a standard (unregularized) multiple ...
- 163
1
vote
1
answer
133
views
multiple testing adjustment for fisher exact test
I have 4 groups (G1, G2, G3, G4) consisting of samples of biological material, and we test them in order to identify are there any bacteria present. We also know that all of the samples contain virus ...
1
vote
1
answer
22
views
Group Comparison with serial mediation
I'm trying to compare two groups for a serial mediation model. I wrote my code like in this link
to make it clearer, here is my code:
...
- 21
2
votes
1
answer
94
views
Am I using emmeans correctly to look at pairwise differences after running a type III ANOVA model?
I am looking at how the weight of female individuals is influenced by the two factors A (5 levels) and B (2 levels) using a type III ANOVA as follows:
...
- 441