All Questions
Tagged with nonparametric statistical-significance
110
questions
0
votes
0
answers
22
views
Statistical Significance Testing for Nested Cross-Validation in ML Experiment
I am currently working on an ML experiment where I use a nested 5-cross validation procedure and obtain a NDCG@10 scores for each test user. I am comparing 6 different ML algorithms and have data for ...
1
vote
0
answers
57
views
Welch ANOVA for Comparisons of Elevation & altered Sediment Accretion of Sea Ecosystems: Large DEM with no normal distribution & heterogeneity
I am investigating the elevation characteristics and sediment accretion effects of two distinct ecosystems within the Wadden Sea, impacted by the bioinvasion of one species (ecosystem one) and ...
0
votes
0
answers
39
views
Non parametric tests for 2 way anova and linear model? [duplicate]
My dissertation is due very soon and I have only just realised a large mistake in my work. I misread the normality test I used, which actually showed non normal data- but I still have homogeneity of ...
0
votes
0
answers
10
views
How to compare peak location and tail length of two different distributions?
I have the distributions of the fraction of people in each income bracket in a town in 1990 and 2020. The total sample size is the same in both, and assume that the incomes have been adjusted to ...
1
vote
0
answers
48
views
Doubt on non-parametric ANCOVA with two groups and pre-post scores and pre scores (baseline) as covariate
I have used a non parametric ANCOVA to analyze scores of a questionnaire (BSCS) with factors: Type of intervention(A and B) and timepoint (pre- and post) as well as baseline (same distribution as pre-)...
0
votes
0
answers
28
views
What test should I perform given repeated measures of one subject in three time periods?
I have data that represents the measurements of the concentration of PM particles in the air at different times (every hour of every day from 2018 onwards), and I am supposed to test whether the rules ...
0
votes
0
answers
61
views
Statistical significance test on 2-sample percentages
In the context of my thesis, i have created a corpus in order to compare the use of "z" vs "s" in specific words like organisation, organised, recognise, authorise etc.
I have ...
1
vote
1
answer
183
views
What do these Wilcoxon values tell me?
I did a pre and post-test with a small number of students ($n=12$).These values came after a science intervention that took $4$ weeks. I used a Wilcoxon test for 2 related samples as there was not a ...
1
vote
2
answers
351
views
SIgnificant ANOVA but not significant post hoc ... what can I do?
I am analyzing some IHC data on the density of cells in two brain regions(factor 1) in two closely related species(factor 2). My data is composed of an n of 6 for each species and is not normally ...
2
votes
1
answer
80
views
What non-parametric test for multivariate binary data should I use?
I have two different groups of participants ("g" and "b") answering the same set of questions. Group "g" answered questions in the same order. Group "b" ...
0
votes
1
answer
56
views
Non-Parametric Test for Regression Significance
I have created a plot of the regression slope of sea surface temperatures (x) and an atmospheric variable (y). Although, I need to test the statistical significance of these trends using a non-...
2
votes
2
answers
163
views
Multiple regression on unpaired data (A~B+C)
I am not sure how to test one of my hypothesis from my data.
Basically, I have 3 behavioral measures A, B and C, and I want to test that A is a composite of B and C: A = B+C
However, for practical ...
3
votes
1
answer
217
views
What exactly does the “symmetric distribution” assumption of the Wilcoxon signed-rank test refer to? [duplicate]
I have two lists (or sets) of data that I would like to statistically compare. More precisely, I would like to check if the difference between data list one and data list two is statistically ...
2
votes
0
answers
24
views
Is there a statistical test for five groups with averages ONLY?
The data I collected was measuring plant shoot masses and these were extremely small, so I could only find the total mass of the shoots from 30 plants. Hence, I only have the mean and none of the ...
0
votes
0
answers
174
views
1 sample wilcoxon sign test
I see the implementation of wilcoxon test in scipy as follows -
...
0
votes
1
answer
485
views
which non parametric test is best for ordinal data?
I want to to do the test where i have to check if first column which is income, and 1 shows < 500, 2 = 1000, 3 = 2000 income values from the data, and which the other column which is a dependent ...
2
votes
1
answer
513
views
Wilcoxon signed-rank test with an additional covariate
Problem formulation
I have 5 strains on which I administered treatment and repeated the experiment two times independently. So my data looks something like this:
...
0
votes
0
answers
31
views
What type of test should be used in this case?
I have a pandas data frame with a target variable, which is binary (classes progressive / non-progressive), that I want to ...
2
votes
0
answers
69
views
When is the central limit theorem not applied?
I am trying to compare two matched samples. In total I have a sample of 34 people. Each patient receives two treatments, a C1 treatment and a C2 treatment. So each patient will be compared to himself ...
1
vote
1
answer
60
views
Repeated Measures, or just measuring the same thing, repeatedly?
I understand what "repeated measures" denotes - given a set of subjects, if each subject receives more than one treatment, we call this repeated measures, or "within subjects." But ...
1
vote
1
answer
172
views
Interpretation of interaction coefficients and p-values with categorical predictors
Let's say that we have gene expression measurements from bacteria after heatshock. The expression changes are collected as log2 changes, and are approximately normal and centered around 0. Ribosomal ...
1
vote
0
answers
134
views
Alternative for Wilcoxon Test?
I'm ending my Master's Thesis, and I'm trying to figure out which test to use to calculate the significance of my data.
Basically, we measured the Free Kick biomechanical parameters of several ...
3
votes
1
answer
150
views
Which non parametric test can be used for multiple repeated measures at the same site?
I have repeated monthly measurements of some variable at several different sites, so that I have 21 data points (21 months) for each site. Now, I want to see if there are significant seasonal ...
1
vote
0
answers
18
views
What statistical analysis should I use [duplicate]
I have been measuring flux of CO2 in (mmol m-2 d-1) from two different rivers and I now want to do a statistical analysis using IBM SPSS but Im not sure where to start. One lake is showing negative ...
0
votes
0
answers
229
views
Which statistical test for comparing ratios of independent samples
I have two conditions: A and B. Under each condition two parameters were measured in triplicates: x and y. Both are independent from each other (meaning the first x value does not experimentally ...
0
votes
0
answers
30
views
How to find out how much statistical difference is there between the two groups in mann whiney U test?
So, i applied mann whitney U test to find out the difference in salary between two groups( eg- gender - male and female). There is indeed a statistical difference between the groups.
Result of Mann ...
0
votes
0
answers
39
views
Appropriate test for two not-normally-distributed data samples
I have some data comparing training participants who experienced the same training course either face-to-face or virtually (via Zoom). I have two survey items I am comparing. Sample A is for virtual ...
0
votes
0
answers
62
views
Non-parametric or parametric t-test: which one to trust?
I have two simple bimodal distributions that I'm sampling from, and I know that they are actually exactly the same. In my setting, I collect one sample from each and compare them, i.e., I'm doing a ...
8
votes
1
answer
377
views
What is the parameter in Spearman's $\rho$
For Kendall's $\tau$ the parameter of interest is
$$E[\text{sign}(X_1-X_2)\text{sign}(Y_1-Y_2)]$$
where $(X_1,Y_1),(X_2,Y_2)$ are iid copies of $(X,Y)$.
The estimator is the famous Kendall's tau
But ...
6
votes
3
answers
351
views
T-tests provide info about the margin of mean difference?
I have 2 unpaired datasets where the difference of the sample means is quite substantial (with the naked eye). The t-test shows that the difference is significant (p-value=0.007) and I would like to ...
2
votes
0
answers
30
views
Testing tuples of response variables
I'm struggling with comparing samples with multiple response variables, where such variables have a strict precedence or importance order. For the sake of this exercise, let's assume that each sample ...
2
votes
3
answers
478
views
When is a hypothesis test appropriate? [closed]
For example, when would a hypothesis test bed used?
0
votes
1
answer
107
views
Calculate fraction of multiple tests for which the null hypothesis was rejected
Consider a test (e.g., a permutation test) that tests, at the individual level, if a binary event occured or not.
A paper that I was recently reading, for example, tested whether or not a pair of two ...
0
votes
0
answers
240
views
Whitney Mann U test vs Kolmogorov Smirnov for a highly skewed continuous variable
I would like to compare task time to completion distributions (measured in minutes) across two groups. The distributions are highly skewed (the means are 300 to 400 times larger than the medians) and ...
1
vote
0
answers
37
views
Can I use parametric and non-parametric tests for different groups in my data?
I have different transcript expression data (continuous variable) and genotype data (categorical variable with 3 levels).
Most of the transcript data is normally distributed so I would like to use a ...
0
votes
0
answers
28
views
Non parametric test to compare variances [duplicate]
I have two samples of same size but at least at one of them is not normal distributed (tested by Shapiro-Wilk-test). How can a compare the variances of theses samples? Especially, I want to know the p-...
1
vote
0
answers
106
views
Bounds for hypothesis testing with non-normal distributions
After doing randomized experiment with two variants (AB tests), I want to do hypothesis testing without the normal distribution assumption to compare their means. Since the samples sizes are different,...
10
votes
2
answers
2k
views
Confused about the Mann-Whitney $U$ test. Does it test distribution equality (pdf) or just mean/median equality?
I am rather confused about the Mann Whitney test, many statements I read state it tests for distribution equality between two populations and some state it tests for means/median/central tendency only....
0
votes
1
answer
10k
views
Differences between Mann-Whitney U and chi-square tests for if two-samples come from same distribution
In a textbook, it introduces the chi-square goodness of fit test to test independence between two variables (organized in a contingency table), which can also be used to test if m samples are likely ...
0
votes
2
answers
121
views
What is the alternative for one sample z test?
I have a sample of 350 and I have to compare the anxiety score among different variables. I wanted to apply the z test to compare the means but my data is not normally distributed. Is there an ...
3
votes
3
answers
131
views
Parametric hypothesis testing for non-normal data
Are there any methods to make parametric hypothesis testing assuming that data is sampled from a known but non-normal continuous distribution?
I'm glad to see a solution to any particular ...
3
votes
1
answer
83
views
How to ascertain statistical significance for nonparametric tests if the sample size is small
In literature about nonparametric rank tests in event studies, I often encounter a variety of test statistics and authors often attempt to convince their readers that their methods overcome certain ...
0
votes
0
answers
71
views
Help with the Mann–Whitney U test
I am new to statistics and really struggling here. I would appreciate any help that I could get. I am supposed to use a non-parametric test (Mann-Whitney U test was suggested) to check the difference ...
3
votes
0
answers
208
views
Parameter estimation when the likelihood function does not exist
The observations $Z_1,Z_2\cdots$ are i.i.d. We have
$$Z_k = \sum_{i=1}^\infty \frac{X_{ki}}{2^k}.$$
where the $X_{ki}$'s are i.i.d. with a Bernouilli$(p)$ distribution. If $p=\frac{1}{2}$ then $Z_k$ ...
0
votes
0
answers
147
views
Kruskal Wallis test gives significance, multiple comparision table doesn't
I'm comparing physico-chemical properties of 8 different kefir samples like viscosity at different storage times. I have 4 viscosity measurements for each group. When I conduct Kruskal Wallis test; ...
2
votes
1
answer
450
views
Which statistical test works for paired and grouped data?
I have a small set of samples of plants where I've made some changes to some but not others and want to know if there was any significant effect on the number of leaves as a result of this change. My ...
3
votes
0
answers
446
views
Multiple comparisons between two groups (non-parametric)
Update Added more details about the Experimental setup.
My experiment comprised two groups, control (N=25) and experimental (N=26). Each participant belonged to one group. Their performance has been ...
1
vote
0
answers
20
views
Statistical Comparison of Algorithms by User Ratings
I have an experimental setting where I compare 3 algorithms on the same dataset(n_sources), through user subjective evaluation of the produced outcomes(each algorithm does a different kind of sound ...
2
votes
1
answer
384
views
Which statistical test to use for multi-modal and mixed type data?
I researched for hours but cannot find the direction for the right statistical test to use. Here is the situation for Population A and B:
When plotting this frequency distribution, it looks like this:...
0
votes
1
answer
553
views
Significance test with non-normal, bounded data?
I am attempting to do a one-sample significance test to determine whether a set of data differs from a given value (0 in this case). The issues I have with these data:
Non-normally distributed data, ...