All Questions
Tagged with bias hypothesis-testing
25
questions
3
votes
1
answer
79
views
Testing for answer order bias
Answer order bias is something I occasionally hear about, especially in the context of election ballots. But presumably, it can also occur in various other situations like online polls, multiple-...
- 557
13
votes
6
answers
2k
views
Power paradox: overestimated effect size in low-powered study, but the estimator is unbiased
If we have an underpowered study but manage to reject the null hypothesis, anyway, it makes sense to wonder if we have overestimated the effect size.
However, such a concern seems unwarranted if we ...
- 65k
3
votes
1
answer
282
views
Can I check the reliability of my test after collecting my data?
I have performed a study where I tested 2 groups, before and after two different types of manipulations. The main outcome of my study were the group differences at time point 2.
Now someone asks what ...
- 299
1
vote
1
answer
143
views
Can we apply hypothesis testing to not-actively sampled groups?
For argument's sake, in the below please assume that the hypothesis test we'd be considering would be a simple z-test to check whether an observed difference between two groups' means or proportions ...
- 11
12
votes
2
answers
1k
views
Is this question based on inspection bias?
This table describes the positive corona tests in all three open ports of country X, in two different days, plus for the total positive for all people entering the country via those three ports:
...
- 543
0
votes
0
answers
114
views
Bias Correction for Hypothesis Test
I have some random data $X$ and an estimator $F(X)$ that estimates the magnitude of a certain effect corresponding to the underlying model. I am interested in testing whether the magnitude of the ...
- 2,121
1
vote
0
answers
23
views
Adequate statistical method to compare objective measure vs estimations
I am using a software for image recognition to do the following:
calculate the percentage of a surface that is painted black.
On the other hand, there are several observers that estimate the ...
- 23
2
votes
1
answer
55
views
One Sample or Two Sample Test [closed]
I have a large group of 40m with performance $P_i$ known for each month $i.$
Out of that group, I have a random sample of about 5k with performance $P_{1i}$ for each month $i.$
I want to be able ...
- 23
3
votes
1
answer
755
views
Test for bias in the residuals of regressions
Most of the answers I found say "look at the residual plots". Which is great!
But I have a large set of curves, and would like to "distinguish" time series curves that fit a model ...
- 51
5
votes
0
answers
98
views
How can statistics be used to avoid "Lending False Credibility To Decisions We've Already Made" [closed]
In light of this article Data Science Has Become About Lending False Credibility To Decisions We've Already Made published in Forbes, I would appreciate input from the statistical and data science ...
0
votes
0
answers
20
views
cumulative effect of near significant differences?
My knowledge of statistics is pretty limited at this point, so you'll have to excuse my ignorance.
We've performed prospective randomised study looking at the differences in detection rates of cancer ...
8
votes
1
answer
4k
views
Comparison of variance between two samples with unequal sample size
The primary goal of my analysis is to compare the variability in the response variable, Blood Pressure, between sample1 and sample2. The secondary goal is to test for a difference in means. I do not ...
- 130
3
votes
1
answer
191
views
Measuring accuracy of estimates from lognormal distributions
Our org need to make estimates of movie box office results relative to our estimates pre-release.
We know that, generally, box office results are lognormally distributed.
we can determine a good fit ...
- 93
1
vote
1
answer
65
views
Skill Bias in Gaming Statistics
I have a data set consisting of a competitive, semi-deterministic game.
It records all the moves and the final outcome.
I would like to derive a value for each move.
I already know it is wrong to use ...
- 11
1
vote
0
answers
420
views
How to compare values between groups if data is left censored
Data
I have a measurement with a detection threshold. I can see that one group has more succesfull measurements (larger number) and also have more higher measurements (longer tail). Comparing the ...
- 495