Questions tagged [equivalence]
An equivalence study is designed to test whether one treatment is nearly equal, or 'equivalent' to another.
182
questions
4
votes
1
answer
83
views
Why do I get smaller degrees of freedom for the Scalar invariance model than the Metric one while testing measurement invariance?
I am trying to test the measurement invariance in my bi-factor model with CFA tests. I have 23 binary questions coded "correct" and "incorrect" and 3 different groups in my data. ...
1
vote
0
answers
36
views
Establishing the Smallest Effect Size of Interest (SESOI)
In my experiment design, I will be testing subjects multiple times under two conditions: in a controlled lab setting and in real-life situations. Testing subjects repeatedly is necessary as ...
0
votes
0
answers
75
views
Questions about equivalence hypothesis testing
The setup for the current question is the same as a previous question of mine, with one important difference: I have decided to go for a paired test, by always performing two consecutive experiments ...
- 89
0
votes
0
answers
30
views
Adapting two-sample $t$-test of a ratio for log transformation
I have some data, belonging to paired groups $A,B$. From each group I get a non-negative statistic $d^A,d^B$ which is averaged on all samples in group. My interest is in the ratio $\frac{d^A}{d^B}$, i....
- 4,032
0
votes
0
answers
44
views
What hypothesis test can test for *equivalent* variance, rather than different variance?
There exist many "variance equality tests", like the F-test and its more robust cousins: Levene's, Bartlett's, the Brown-Forsythe.
Given two samples A and B with variances $\sigma_A^2$ and $\...
- 857
2
votes
0
answers
50
views
TOST procedure + power analysis: how to interpret t-value inside bounds
I conducted a TOST procedure according to the guidelines by Lakens [1] and received the results from the table below. For "discontinuity", "fragmentation" and "...
1
vote
0
answers
44
views
Controlling type II error with multiple comparisons
I am confused about how to perform correction for multiple comparisons in the case where I do not want to reject the null hypothesis.
I am doing multiple ANOVAs where I would like to show that there ...
- 11
2
votes
0
answers
94
views
Equivalence test with random effects
I am designing an experiment where I will test different subjects’ multiple times under two different conditions (lab and real life)
My hypothesis Is that that the subject will perform equivalent in ...
1
vote
1
answer
53
views
What to do when my sample size is small to demonstrate an equivalence study
I'm analyzing data from a study comparing 5 treatment arms. Women receiving ovarian stimulation for in vitro fertilization at different phases of the ovarian cycle.
The treatment efficacy endpoint was ...
- 919
4
votes
1
answer
76
views
Bayesian ROPE (region of practical equivalence) for simultaneous comparison of multiple parameters?
I very much like the idea of the ROPE (region of practical equivalence) (e.g. see here), where you compute the posterior probability that a given parameter is in a previous range that counts as "...
- 44.5k
1
vote
1
answer
68
views
Lower limit p-value is significant but not the NHST p value in Equivalence testing, what's the interpretation? [closed]
I'm testing two groups for equivalence in exercise self-efficacy using the TOSTER package in R. I ran a Mann-Whitney U test (...
- 41
2
votes
1
answer
99
views
Power of a test for equivalency
I want to know the power of a test I am conducting. Data was collected from three drugs to investigate equivalency of these three drugs for treating a disease. The data has already been collected so I ...
- 43
0
votes
0
answers
30
views
Comparing to see if two functions are the same
I need help with something.
I need to see if two "sides" of data have/come from the same functional format. Consider a large sample with values from, let's say, 1 to 10. What I want to know ...
- 1
0
votes
0
answers
27
views
Standard deviation and mean changes between two conditions: how to test both changes within one statistical model?
I have two experimental conditions called rest and task. The conditions include 13 subjects, respectively.
I computed the mean and standard deviation (SD) for each subject’s data. Consequently, I have ...
- 307
2
votes
1
answer
101
views
Best method to compare measurement techniques
I am wishing to test the equivalence, or not of two measurement methods. Some background, we have two test instruments (old and new) that measure radiation dose distributions compared to what was ...
- 23