All Questions
Tagged with nonparametric hypothesis-testing
308
questions
1
vote
0
answers
25
views
Paired Non-parametric test with more than 3 groups but just two timepoints
I may not have found the right term to search for, so I am asking what might be a straightforward question:
Assume we have an experiment with paired non-normal distributed data, called "Pre" ...
1
vote
0
answers
35
views
Combining Data from Multiple Participants for Statistical Analysis of a Facial Expression Memory Task
Context of the Query: I am working on a project involving a memory task for facial expressions, consisting of two phases:
Encoding Phase: In this phase, participants are exposed to 8 virtual ...
5
votes
3
answers
134
views
Non-parametric one-sample mean test for a bounded variable (based on Chebyshev's inequality?)
The problem
I have $x_1, \ldots , x_n$ i.i.d. draws from r.v. $X$ such that $0 \leq X \leq 1$, but I can't make any other assumptions about the distribution.
I want to test the null hypothesis that $E(...
- 2,637
3
votes
2
answers
204
views
sample size in chi-squared test
The chi-square test of independence is a type of non-parametric test, but in cases of small sample sizes, the Fisher's exact test should be used instead. My understanding of non-parametric methods is ...
- 103
22
votes
7
answers
2k
views
Isn't it problematic to look at the data to decide to use a parametric vs. non-parametric test?
I've seen in some instances of people mentioning that using a parametric vs. non-parametric approach may be decided by looking at the data. For example this question: nonparametric vs. parametric
Isn'...
- 243
0
votes
0
answers
34
views
How do I get from integral to computational formula of Cramér-von Mises statistic step by step?
My question is related to the calculus procedures behind Cramér-von Mises test.
How do I get from integral:
to computational formula:
of Cramér-von Mises statistic, step by step?
I understand the ...
0
votes
0
answers
22
views
Statistical Significance Testing for Nested Cross-Validation in ML Experiment
I am currently working on an ML experiment where I use a nested 5-cross validation procedure and obtain a NDCG@10 scores for each test user. I am comparing 6 different ML algorithms and have data for ...
- 101
0
votes
0
answers
29
views
Why does the Dunn's test in online calculator rejects the null hypothesis while my manual computations cannot reject it?
In my own manual calculations of the Dunn's Test in google sheet, using the formula from a YouTube video, I managed to calculate the same Test Statistic as the online calculator.
However, using the ...
0
votes
0
answers
25
views
Appropriate Trend Analysis Test for Small Sample Size
Note: I have read Finding an appropriate trend test but unfortunately this post does not apply for me
Suppose I have a small sample of data for 2 numeric variables $T$ and $Y$ where $T$ represents ...
- 215
0
votes
0
answers
39
views
Non parametric tests for 2 way anova and linear model? [duplicate]
My dissertation is due very soon and I have only just realised a large mistake in my work. I misread the normality test I used, which actually showed non normal data- but I still have homogeneity of ...
- 1
0
votes
0
answers
10
views
How to compare peak location and tail length of two different distributions?
I have the distributions of the fraction of people in each income bracket in a town in 1990 and 2020. The total sample size is the same in both, and assume that the incomes have been adjusted to ...
1
vote
1
answer
121
views
Deriving Sample version of Anderson Darling test statistic from the theoretical version
In literature, I have seen two types of Anderson-Darling test statistic. One is expressed as
$A_T^2 = n\int_{-\infty}^{\infty}\frac{(F_n(x)-F(x))^2}{F(x)(1-F(x))}dF(x)$ and the other is given by $A_s^...
- 115
2
votes
1
answer
80
views
What non-parametric test for multivariate binary data should I use?
I have two different groups of participants ("g" and "b") answering the same set of questions. Group "g" answered questions in the same order. Group "b" ...
- 21
2
votes
2
answers
370
views
How could Lilliefors use Monte Carlo if the estimand is not distribution-free?
Lilliefors test is a well-known statistical test for normality. Its idea is based on the Kolmogorov-Smirnov test, except the CDF is replaced by the CDF of the normal distribution with $\mu, \sigma^2$ ...
- 235
0
votes
0
answers
103
views
How to construct homogeneous subsets table for nonparametric tests?
Does post-hoc for friedman tests or nonparametric testshave like a homogeneous subset table from SPSS? Mean doesn't represent it well so I tried using median but my data was zero-inflated so the most ...
- 295
3
votes
1
answer
131
views
If I have a very small n for one group and a very large number of features, should I choose a parametric or a non-parametric test?
I have a dataset that contains human metabolite concetration in a fluid. One group has about 12 samples, while another only has 5. My question is if I can assume normality for this data and do ANOVA/t-...
1
vote
0
answers
23
views
Appropriate tests and normalization approaches for highly non-normal data
I'm trying to ascertain whether a particular type of article, $T$, is associated with higher engagement scores in academic journals, and how substantial the effect size might be. I have raw data of ...
- 323
2
votes
2
answers
165
views
Multiple regression on unpaired data (A~B+C)
I am not sure how to test one of my hypothesis from my data.
Basically, I have 3 behavioral measures A, B and C, and I want to test that A is a composite of B and C: A = B+C
However, for practical ...
- 21
1
vote
1
answer
237
views
In an A/B test, how can you check if assignment to the various buckets was truly random?
Trying to figure out how I can confirm that my A/B Test assignment is truly random. I know the runs test is used to test for randomness.
Is it possible to use the runs test to check if my A/B Test ...
- 65
0
votes
0
answers
37
views
Relation between the sample size with the powers of Kolmogorov Smirnov, Cramer Von Mises and Anderson Darling?
I want to know the mathematical relation between the sample size with the powers of 1. Kolmogorov Smirnov, 2. Cramer Von Mises, and 3. Anderson Darling.
I have seen many posts and other websites ...
1
vote
1
answer
106
views
Statistical test for differences where output is -1, 0, 1?
He's the situation, say we have n data points. There are two treatments A and B. If treatment A was better than treatment B we give a score of 1, in the opposite case we give a -1, and if there is ...
- 83
2
votes
2
answers
115
views
Distribution and variable analysis
I am doing a statistical test (program used is SPSS). On the basis of distribution and sample size, I have to chose the correct variable analysis. I also have to justify every decision. I have two ...
- 21
2
votes
1
answer
61
views
How to Replicate result that probabilities in included table are different 7 times?
Question: In the table at the bottom of this question, the total number of times that $\hat{P}(x;z) > \hat{P}_y(x;z) $ and $\hat{P}(y;z)>\hat{P}_x(y;z)$ is 7.
Can someone please replicate this ...
- 219
1
vote
0
answers
44
views
Which Non-Parametric Test should I use?
I want to make sure I am choosing the right statistical test.
I am working with 7 semesters of exams scores for a particular course.
Each semester the course ran with many sections. However, the ...
- 11
0
votes
1
answer
68
views
Bootstrap P-value and confidence intervals with more than two samples
I have been trying to find a simple way to use the bootstrap for a hypothesis test that involves more than two samples. The motivation for using the bootstrap is for the usual reasons: the test ...
1
vote
0
answers
64
views
I'm having trouble choosing between Wilcoxon matched pairs test and McNemar test for a data set
I have a data set on a large group of long-term stroke survivors. I need to determine whether there is a difference in ability (on a scale of 1-10) between their left and right arms. The ordinal data ...
4
votes
1
answer
77
views
Which statistical method to use to compare reinforced colour and speed of learning?
I'm working on my master's thesis where I'm trying to determine whether sea turtles are capable of discriminating between colour. One subcategory I'm looking into is seeing whether the speed they ...
0
votes
0
answers
175
views
0
votes
1
answer
485
views
which non parametric test is best for ordinal data?
I want to to do the test where i have to check if first column which is income, and 1 shows < 500, 2 = 1000, 3 = 2000 income values from the data, and which the other column which is a dependent ...
- 31
0
votes
0
answers
229
views
How to interpret results from the data if Levene's test is violated?
I'm doing ANCOVA analysis. So, the assumption of Levene's test is violated which means I have to run a non-parametric test. Does that mean I can't interpret other results that I obtained from the data ...
- 1