All Questions
38
questions
0
votes
0
answers
22
views
Statistical Significance Testing for Nested Cross-Validation in ML Experiment
I am currently working on an ML experiment where I use a nested 5-cross validation procedure and obtain a NDCG@10 scores for each test user. I am comparing 6 different ML algorithms and have data for ...
- 101
0
votes
0
answers
39
views
Non parametric tests for 2 way anova and linear model? [duplicate]
My dissertation is due very soon and I have only just realised a large mistake in my work. I misread the normality test I used, which actually showed non normal data- but I still have homogeneity of ...
- 1
0
votes
0
answers
10
views
How to compare peak location and tail length of two different distributions?
I have the distributions of the fraction of people in each income bracket in a town in 1990 and 2020. The total sample size is the same in both, and assume that the incomes have been adjusted to ...
2
votes
1
answer
80
views
What non-parametric test for multivariate binary data should I use?
I have two different groups of participants ("g" and "b") answering the same set of questions. Group "g" answered questions in the same order. Group "b" ...
- 21
2
votes
2
answers
163
views
Multiple regression on unpaired data (A~B+C)
I am not sure how to test one of my hypothesis from my data.
Basically, I have 3 behavioral measures A, B and C, and I want to test that A is a composite of B and C: A = B+C
However, for practical ...
- 21
0
votes
0
answers
174
views
0
votes
1
answer
485
views
which non parametric test is best for ordinal data?
I want to to do the test where i have to check if first column which is income, and 1 shows < 500, 2 = 1000, 3 = 2000 income values from the data, and which the other column which is a dependent ...
- 31
0
votes
0
answers
31
views
What type of test should be used in this case?
I have a pandas data frame with a target variable, which is binary (classes progressive / non-progressive), that I want to ...
- 699
0
votes
0
answers
229
views
Which statistical test for comparing ratios of independent samples
I have two conditions: A and B. Under each condition two parameters were measured in triplicates: x and y. Both are independent from each other (meaning the first x value does not experimentally ...
- 11
0
votes
0
answers
62
views
Non-parametric or parametric t-test: which one to trust?
I have two simple bimodal distributions that I'm sampling from, and I know that they are actually exactly the same. In my setting, I collect one sample from each and compare them, i.e., I'm doing a ...
- 152
8
votes
1
answer
377
views
What is the parameter in Spearman's $\rho$
For Kendall's $\tau$ the parameter of interest is
$$E[\text{sign}(X_1-X_2)\text{sign}(Y_1-Y_2)]$$
where $(X_1,Y_1),(X_2,Y_2)$ are iid copies of $(X,Y)$.
The estimator is the famous Kendall's tau
But ...
- 183
2
votes
3
answers
478
views
When is a hypothesis test appropriate? [closed]
For example, when would a hypothesis test bed used?
- 51
0
votes
1
answer
107
views
Calculate fraction of multiple tests for which the null hypothesis was rejected
Consider a test (e.g., a permutation test) that tests, at the individual level, if a binary event occured or not.
A paper that I was recently reading, for example, tested whether or not a pair of two ...
- 3
0
votes
0
answers
28
views
Non parametric test to compare variances [duplicate]
I have two samples of same size but at least at one of them is not normal distributed (tested by Shapiro-Wilk-test). How can a compare the variances of theses samples? Especially, I want to know the p-...
1
vote
0
answers
106
views
Bounds for hypothesis testing with non-normal distributions
After doing randomized experiment with two variants (AB tests), I want to do hypothesis testing without the normal distribution assumption to compare their means. Since the samples sizes are different,...
