All Questions
Tagged with bias statistical-significance
25
questions
2
votes
2
answers
125
views
Correcting for pre-experiment bias in proportions test?
Say I have an obstacle course, which not everyone completes, though, globally, most do. I hypothesize that the treatment, drinking Gatorade, will cause an increase in the obstacle course completion ...
- 3,382
1
vote
1
answer
143
views
Can we apply hypothesis testing to not-actively sampled groups?
For argument's sake, in the below please assume that the hypothesis test we'd be considering would be a simple z-test to check whether an observed difference between two groups' means or proportions ...
- 11
0
votes
0
answers
16
views
How many times would i have to flip a coin to determine bias? [duplicate]
I want to be clear because there are a few similar questions but none of the answers really answer my question (or im just not smart enough to make it work). The question is, HOW MANY FLIPS. My ...
- 1
1
vote
0
answers
16
views
Super noob requesting help testing dice balance [duplicate]
So, I have a few sets of polyhedral dice (77 individual dice) that I'd like to try to test for balance. I'm thinking a decent sample size is to roll each of them 100 times, then plot the proportional ...
- 11
12
votes
1
answer
313
views
Should AstraZeneca's results be discounted?
This question is in regard to AstraZeneca's phase 3 clinical trial on the effectiveness of their COVID-19 vaccine.
Patients were randomized to a two dose treatment group compared to a two dose placebo ...
- 43.1k
1
vote
1
answer
68
views
Boostrap estimator: sample or population?
As stated here: Do we use bootstrapping with population data?
"The general idea of bootstrap is that by sampling from your data you re-create the sampling process that happened when sampling your ...
- 187
0
votes
0
answers
22
views
Statistical proof to exclude less frequent records from data during analysis
I am working on reviewing the results of an automated task. For ex, To give you an idea, the data that I have to review looks like as shown below
Let's say from the downstream analytics perspective, ...
- 3,302
1
vote
1
answer
104
views
How to compare the results of surveys for two different type of users
I am working on an online store as analyst. We are constantly running a satisfaction survey (rated -3 to 3). The response rate is very low (10%). We want to compare the results of surveys between ...
- 314
62
votes
10
answers
11k
views
What does "Scientists rise up against statistical significance" mean? (Comment in Nature)
The title of the Comment in Nature Scientists rise up against statistical significance begins with:
Valentin Amrhein, Sander Greenland, Blake McShane and more than 800 signatories call for an end to ...
- 695
1
vote
0
answers
12
views
Probability of detecting small bias in a die in the low confidence regime
We are given a biased $m$-sided die: one of the sides has probability $\frac{1}{m} + \gamma$ and all the rest have probability $\frac{1}{m} - \frac{\gamma}{m-1}$ each. The goal is to figure out which ...
- 21
1
vote
0
answers
210
views
Non-response bias and margin of error for product feedback
If 1,000 people received a household product and later they were emailed a survey asking for their feedback, how would you avoid non-response bias? As an example, the survey would ask them to rate the ...
- 121
3
votes
1
answer
191
views
Measuring accuracy of estimates from lognormal distributions
Our org need to make estimates of movie box office results relative to our estimates pre-release.
We know that, generally, box office results are lognormally distributed.
we can determine a good fit ...
- 93
2
votes
1
answer
165
views
Is cumulative sum large deviation an alarm for bad normal pseudo-random number generator?
Given a pseudo-random number generator of standard normal distribution, I generate a matrix $(z_{t,n})_{(t,n)=(1,1)}^{(T,N)}$ of samples. I computed the mean of the cumulative sum, i.e., $\...
- 1,015
4
votes
1
answer
228
views
Significance versus the bias-variance trade off
I'm taking an online course. In one of the lessons about methods to select explanatory variables, it is said that you can use the t-test or F-test to add/remove a single or group of terms to/from a ...
- 637
1
vote
1
answer
617
views
Unbiasedness of a test
p is the probability of success in a
series of Bernoullian trials. To test
H0:P= 0·5, trials are conducted and
H0 is rejected if 7 or 8 successes are
observed.
If H1 is double sided, how do I ...
- 1,387