All Questions
12
questions
2
votes
2
answers
165
views
Multiple regression on unpaired data (A~B+C)
I am not sure how to test one of my hypothesis from my data.
Basically, I have 3 behavioral measures A, B and C, and I want to test that A is a composite of B and C: A = B+C
However, for practical ...
- 21
1
vote
1
answer
689
views
Small sample size: Permutation test or Wilcoxon test?
What do you think about using a permutation test each time the sample size is too small to meet the the assumptions of normality and homogeneity of variance etc ? Why do we use a non parametric ...
- 579
2
votes
1
answer
138
views
How does violation of normality conditions affect p-values (relative to permutation tests)
I am running some t-tests using data from small samples (n=25) whose distributions do not appear to be normally distributed (they are not extremely skewed, but the skew is apparent in the plots and ...
1
vote
1
answer
2k
views
Permutation test and wilcoxon rank-sum test giving different results
I am comparing the revenue (at user level) between control & test to see if there is a significant difference. Both control & test have roughly about 39k data points . I am doing a permutation ...
- 43
1
vote
0
answers
364
views
Permutation test for A/B testing
I have done an extensive survey of testing methodologies in A/B practices. It seemed that default non parametric test choice is MWW U test. However, permutation test is known to generally have a ...
0
votes
1
answer
157
views
randomization/permutation test for mean > 0
I'd like to know if the following procedure is a valid way to test if the mean of a population is greater than zero, based on a random sample of observations:
1) Calculate the sample mean
2) On each ...
- 117
1
vote
1
answer
682
views
Can a one-tailed permutation test really use all permutations in the denominator?
In a permutation test I calculate all of the permutations that could have given rise to an effect assuming exchangeability. In the case of a two-tailed test it makes sense to check the proportion of ...
- 23.2k
4
votes
1
answer
225
views
Testing median of a sample using randomisation methods
I am given a sample of data for which I need to test the hypothesis:
$H_0: m=m_0$ vs. $H_1: m \neq m_0$
where $m$ is the population median and $m_0$ is the hypothesized median.
The question asks to ...
- 1,779
15
votes
5
answers
16k
views
How to test an interaction effect with a non-parametric test (e.g. a permutation test)?
I have two categorical / nominal variables. Each of them can take only two distinct values (so, I have 4 combinations in total).
Each combination of values comes with a set of numerical values. So, I ...
- 622
5
votes
0
answers
2k
views
In a permutation test, how to get a confidence interval for the estimated p-value? [duplicate]
Suppose that I have two groups of data of size $50$ and $51$. Assuming that I did an approximate Monte Carlo permutation test with 10,000 permutations randomly drawn, is there a way to find a ...
- 2,107
52
votes
3
answers
51k
views
Bootstrap vs. permutation hypothesis testing
There are several popular resampling techniques, which are often used in practice, such as bootstrapping, permutation test, jackknife, etc. There are numerous articles & books discuss these ...
- 2,957
6
votes
1
answer
9k
views
Friedman's test and post-hoc analysis
I am carrying out a statistical analysis for my research. I am using a Friedman's test with post hoc analysis. At present I am using the function ...
- 61