All Questions
Tagged with two-sample hypothesis-testing
40
questions
0
votes
0
answers
46
views
How to Run a Standard Two-Sample t-test when given delta and not the two means
I am trying to find the p-value to test a null hypothesis using a Standard Two-Sample t-Test. Usually I would use
...
1
vote
1
answer
78
views
Two sample proportions: How to test the hypothesis that the difference in proportions is less than a specified threshold?
Say I have treatment and control, perfectly randomized.
I have 70000 conversions for treatment in 80000 users.
I have 70100 converions for control in 800100 users.
My null hypothesis is that there is ...
0
votes
1
answer
25
views
Is two-sample Kolmogorov test working correctly?
I have two one-dimensional samples that I'm trying to quantifiably distinguish (or deny such distinction). I.e. the null-hypothesis is that they come from the same population (distribution?). The ...
- 45
0
votes
1
answer
113
views
two-sample proportions hypothesis test: 10 successes and failures rule
I asked this question on mathematics stack exchange, and reposting here as it did not get resolved.
Suppose the sample sizes and number of successes are ($n_1, y_1$) and ($n_2, y_2$), for the two ...
- 3
2
votes
0
answers
62
views
How does the following term happen when using the Wald Test on two-sample binomials?
I'm having trouble understanding one of the steps of the Wald test used in two-sample binomial proportions.
More specifically, when $X_1, ..., X_{n_1}$ are iid Binomial$(1, p_1$), $Y_1, ..., Y_{n_2}$ ...
- 21
3
votes
3
answers
1k
views
Two-sample Kolmogorov-Smirnov discrete distributions
Let's say that two Census takers interview a number of couples and ask for the number of children they have. I want to compare the two resulting samples to find out if they could have come from the ...
- 55
4
votes
0
answers
122
views
Do asymptotic statistics "solve" the Behrens-Fisher problem?
The Behrens-Fisher problem concerns comparing two means from independent (maybe multivariate) samples in a way robust to heteroskedasticity in the populations being compared. It seems that if one ...
- 1,373
2
votes
0
answers
92
views
Test for distribution equality
This question touches Kolmogorov-Smirnov testing, but asks actually something different.
Consider independent random variables $X_1, \dots, X_n$. I want to test the following hypothesis:
$$
H_0: X_i\ ...
- 419
1
vote
0
answers
47
views
Testing difference of medians and stochastic ordering using paired samples
I have paired samples from skewed distributions with unequal variance (before and after treatment), and would like to test for
difference of means
difference of medians
stochastic ordering of treated ...
- 41
2
votes
2
answers
774
views
Two-sample test with bootstrap and different sizes
I have two independent i.i.d., respectively $Y_1,\dots,Y_{n_Y} \sim F_Y$ of size $n_Y$ and $X_1,\dots,X_{n_X} \sim G_X$ of size $n_X$. I would like to test:
$$
H_0:\mu_X = \mu_Y
$$
versus any ...
- 333
1
vote
2
answers
82
views
What is the theoretical justification of testing for equal mean/distribution via resampling?
If we have two data sets $X_1,\ldots,X_m$ and $Y_1,\ldots,Y_n$, each i.i.d., and wanted to determine whether $\mathbb{E}[X_1] = \mathbb{E}[Y_1]$ or not using $\bar{X}_m - \bar{Y}_n = \hat{\Delta}_{m,n}...
- 1,373
1
vote
0
answers
65
views
Two sample similarity analysis for non-independent daily time series data
What two sample or other relevant statistical tests can be performed in R between two samples which are independent of each other, but the observations within each ...
- 111
5
votes
1
answer
253
views
Why is the two-sample test giving me inconsistent results?
I am applying a two-sample t-test to determine whether we have software regressions on latency measurements.
Procedure
Run the test for build b1 and gather 60 latency measurements.
Run the test for ...
- 187
4
votes
2
answers
2k
views
Testing for equal proportions when sample sizes are very small
Suppose I observe binary data for two samples (hopefully the notation below is obvious) and I wish to test the hypotheses:
$$H_0: p_1 = p_2$$
$$H_A: p_1 \neq p_2$$
I know there is a $z$-test for doing ...
- 1,373
8
votes
2
answers
36k
views
what is the difference between a two-sample t-test and a paired t-test
While I was glancing at hypothesis tests, I saw paired and two-sample t-test but couldn't understand the difference. For the explanation of these two tests, I saw the following sentence
" Two-...
- 505