Questions tagged [false-discovery-rate]
An expected fraction of rejected null hypotheses that are falsely rejected, i.e. the fraction of significant findings that are actually not true. One method to control FDR in multiple testing is Benjamini-Hochberg procedure.
287
questions
0
votes
1
answer
9
views
Filter one-sided tests before FDR
In this blog post, the author shows one example of "weird" p-value histogram ("Scenario C"):
One provided explanation is that a one-sided test was run, and the tests where the ...
- 145
0
votes
0
answers
19
views
Variation in the total number of samples when performing multiple fisher exact tests
I have dataset of 2 time points. In each time point I have to compare the counts of different components at each position (number of positions =1000). I used fisher exact test to compare if there is a ...
- 309
0
votes
0
answers
19
views
False Discovery Rate (FDR) correction on variables not analyzed simultaneously
I've collected data from a nutritional clinical trial involving 50 individuals divided into 2 groups: Control and Treatment. At baseline and after 1 month, the nutrient composition of the habitual ...
- 23
2
votes
3
answers
101
views
FDR in a gene expression experiment with two similar treatments
Given is the following experiment. Gene expression profiles across thousands of genes are obtained for three conditions: two drugs (= treatments) with a similar phenotypic effect and a control group. ...
- 121
2
votes
0
answers
31
views
Problem regarding False discovery rate correction for multiple comparison
I am conducting research to find association of a gene with a disease. It's a case-control study. I have divided the cases into groups A and B based on genotype and controls into groups C and D. I ...
2
votes
1
answer
60
views
What does a FDR of 0.05 really mean
I recently study about the FDR. A FDR of 0.05 indicates that around 5% of significantly reported results are actually false positives. Is this always the case? I tried this on a dataset and I found ...
- 287
1
vote
1
answer
45
views
How to apply FDR correction, and which method is most appropriate?
So I am a little confused with the application of q-values or more broadly, FDR correction (BH or BKY).
I have run multiple linear mixed effect models to assess the impact of medication on several ...
- 11
1
vote
0
answers
21
views
Benjamini Hochberg Procedure [closed]
I am working on a problem for class related to multiple testing where I would like to run the BH procedure with a known $\pi_{0}$, denoting the proportion of hypothesis that are truly null, given ...
- 345
0
votes
0
answers
37
views
FDR adjustment for confidence intervals
I have a multiple regression model in R, and I'm supposed to report the beta estimates, 95 CIs, and p-values. There are a lot of variables in the model so I used the Benjamini-Hochberg method to ...
- 1
1
vote
0
answers
40
views
Knockoff R package removing ALL variables based on LASSO, Why?
I am simulating a data set from a linear regression model and selecting the variables using LASSO (glmnet). The selection works relatively well with ...
- 11
0
votes
0
answers
29
views
False Discovery Rate-Adjusted Multiple Confidence Intervals after p-value-adjustment
I apologize in advance if my question is incomprehensible, I am very new to this topic.
My data consists of 6 dependent variables (DV1-6) and 5 independent variables (IV1-5) of interest. For reasons ...
- 1
1
vote
1
answer
100
views
Estimating effect after Benjamini-Hochberg procedure
I run an AB test and I have results at city level (keep in mind I run a one-sided test):
...
- 257
2
votes
1
answer
64
views
Quantitatively distinguishing between multiple-comparison tests
As someone relatively new to applied statistics, I have been trying to better understand some of the best practices for applying statistical methods. I have been recently trying to understand when to ...
- 153
0
votes
0
answers
30
views
FDR q-values interpretation
In performing 43 test on two groups of individuals (independent t-test) I obtained 27 significant results, then adjusting the pvalues with BH procedure for controlling FDR I obtained the so-called q-...
- 391
3
votes
1
answer
287
views
FDR adjusted p-values and q-values
I am currently working on adjusting p-values in R using the False Discovery Rate (FDR) method and have encountered some confusion regarding the basic concepts of ...
- 391