Skip to main content

All Questions

0 votes
0 answers
22 views

Statistical Significance Testing for Nested Cross-Validation in ML Experiment

I am currently working on an ML experiment where I use a nested 5-cross validation procedure and obtain a NDCG@10 scores for each test user. I am comparing 6 different ML algorithms and have data for ...
4 votes
1 answer
2k views

Friedman's test to identify best of multiple classifiers on multiple domains

I have several classifiers $f_i\ (i=1, \cdots, N)$ and calculated performance measures on multiple domains $(D)$ for each. Thus, there are $N \times D$ values. I want to find out (increasing ...
1 vote
0 answers
57 views

Welch ANOVA for Comparisons of Elevation & altered Sediment Accretion of Sea Ecosystems: Large DEM with no normal distribution & heterogeneity

I am investigating the elevation characteristics and sediment accretion effects of two distinct ecosystems within the Wadden Sea, impacted by the bioinvasion of one species (ecosystem one) and ...
0 votes
0 answers
39 views

Non parametric tests for 2 way anova and linear model? [duplicate]

My dissertation is due very soon and I have only just realised a large mistake in my work. I misread the normality test I used, which actually showed non normal data- but I still have homogeneity of ...
0 votes
0 answers
10 views

How to compare peak location and tail length of two different distributions?

I have the distributions of the fraction of people in each income bracket in a town in 1990 and 2020. The total sample size is the same in both, and assume that the incomes have been adjusted to ...
2 votes
2 answers
498 views

Is there a robust test for stochastic dominance between two random variables?

I am trying to compare the errors from two statistical models in order to give evidence to one being "better" in terms of lower prediction error than the other. To formalize this, I thought that a ...
32 votes
3 answers
5k views

Why does the Kolmogorov-Smirnov test work?

In reading about the 2-sample KS test, I understand exactly what it is doing but I don't understand why it works. In other words, I can follow all the steps to compute the empirical distribution ...
1 vote
0 answers
48 views

Doubt on non-parametric ANCOVA with two groups and pre-post scores and pre scores (baseline) as covariate

I have used a non parametric ANCOVA to analyze scores of a questionnaire (BSCS) with factors: Type of intervention(A and B) and timepoint (pre- and post) as well as baseline (same distribution as pre-)...
0 votes
0 answers
28 views

What test should I perform given repeated measures of one subject in three time periods?

I have data that represents the measurements of the concentration of PM particles in the air at different times (every hour of every day from 2018 onwards), and I am supposed to test whether the rules ...
0 votes
0 answers
61 views

Statistical significance test on 2-sample percentages

In the context of my thesis, i have created a corpus in order to compare the use of "z" vs "s" in specific words like organisation, organised, recognise, authorise etc. I have ...
1 vote
1 answer
183 views

What do these Wilcoxon values tell me?

I did a pre and post-test with a small number of students ($n=12$).These values came after a science intervention that took $4$ weeks. I used a Wilcoxon test for 2 related samples as there was not a ...
1 vote
2 answers
351 views

SIgnificant ANOVA but not significant post hoc ... what can I do?

I am analyzing some IHC data on the density of cells in two brain regions(factor 1) in two closely related species(factor 2). My data is composed of an n of 6 for each species and is not normally ...
2 votes
1 answer
80 views

What non-parametric test for multivariate binary data should I use?

I have two different groups of participants ("g" and "b") answering the same set of questions. Group "g" answered questions in the same order. Group "b" ...
0 votes
1 answer
56 views

Non-Parametric Test for Regression Significance

I have created a plot of the regression slope of sea surface temperatures (x) and an atmospheric variable (y). Although, I need to test the statistical significance of these trends using a non-...
2 votes
3 answers
478 views

When is a hypothesis test appropriate? [closed]

For example, when would a hypothesis test bed used?

15 30 50 per page
1
2 3 4 5
8