Questions tagged [validity]
An instrument is valid if it measures what it purports to measure. This is different from reliability, which means that an instrument measures (whatever it measures) in a way that is repeatable. DO NOT use this tag for `validation` model purposes.
135
questions
0
votes
0
answers
17
views
My questions are related to the outputs of model built with npmlt function [closed]
I fitted (using npmlt function) a mixte multinomial regression model which ran without errors.
I expecting that the outputs of the model includes p-values that I didn't find.
My need now is that ...
5
votes
1
answer
37
views
Validating binary prediction model
Suppose we have a model that predicts for binary event $e$ ($0$ or $1$) with a single output $p$ (the expected probability $e$ occurs).
If we are able to compare $p$ with the true value of $e$ ($0$ or ...
- 151
0
votes
0
answers
8
views
Can you build up statistical validity with multiple month's worth of the same survey questions?
The company I work for conduct consulting where we analyse company survey responses for statistical validity against the general company population.
To prevent survey fatigue, the company sends out ...
- 1
2
votes
2
answers
57
views
In a regression, is an independent variable still useful if it is the same for each subject between observations?
I was not able to find an answer to this question, as I feel it is rather specific and awkward to ask. But, here goes. This is a simplified version of my data:
As you can see, I have various subjects ...
- 21
0
votes
0
answers
10
views
Validity, reliability and repeatability
I want to validate an anemometer in a wind tunnel VS gold standard.
Thinking in validity, reliability and repeatability.
The dependent variable is wind speed. I can test 3 different units of the same ...
- 91
0
votes
1
answer
35
views
Validation Checklist Passing Score
I have a mixed-method thesis ongoing. I'm currently on the validation stage of my survey and interview questions. I have adopted a validation checklist from the internet composing of 15 items with a 4-...
- 41
3
votes
3
answers
163
views
What is the (logical) relationship between an measurement instrument's validity and responsiveness?
The three major criteria for the quality of a measurement instrument are validity, reliability, and responsiveness. I understand validity and reliability, but I have trouble understanding the need to ...
- 131
1
vote
3
answers
1k
views
What is meant by practical significance and statistical significance? How do we distinguish these concepts? [duplicate]
I am unable to understand content reported in :
Practical vs Statistical significance
Statistical significance-testing implies whether a sample-statistic matches with population estimate of effect-...
0
votes
0
answers
10
views
Validating a new definition for detection
I am having some trouble understanding what approach I would use to validate a new set of definitions versus the "gold standard" to detect disease positivity. For example, if I wanted to say ...
- 75
3
votes
0
answers
51
views
Difference between kappa statistics
I am currently developing an instrument and have some questions on the use of kappa statistics for interrater agreement used for content validity. I have gone through previous literature and I still ...
- 31
0
votes
0
answers
22
views
Estimate the threohold of reject region by Bootstrap
I am studying the Bootstrap method and encountered a question about how to estimate the reject region. Suppose we have observed a sample $\{(X_i, Y_i)\}_{i=1}^n$, I aim to investigate the linear ...
- 43
1
vote
1
answer
19
views
Approach of a Golden Standard Measurement with questionnaire data
I am a bit lost on the correct approach to this Statistical problem. Let me explain the context of this problem: I have a cohort population with longitudinal measurements during a period of several ...
- 11
0
votes
1
answer
140
views
Is it appropriate to use log-rank test in a study having multiple cases with expected values less than 5?
My goal is to show independency of factors related to survival of a small size sample (26 patients) for a period of time, this sample was divided in 2 groups (16 vs 10 patients), the events were ...
- 37
3
votes
1
answer
282
views
Can I check the reliability of my test after collecting my data?
I have performed a study where I tested 2 groups, before and after two different types of manipulations. The main outcome of my study were the group differences at time point 2.
Now someone asks what ...
- 299
1
vote
0
answers
10
views
Gender Differences in Validity
I need to demonstrate discriminant validity for two subscales (subscales have 6 and 7 items) that should differ between males and females. There is a theoretical basis that there should be a ...
- 11