Questions tagged [model-comparison]
Comparing two or more models fit to a common data set. It can be part of the process of "model selection".
603
questions
0
votes
0
answers
27
views
Comparing Models with Unequal Sample Sizes
I have performed an association analysis where I have associatiated several different perdictor variables to a dependent variable. For each predictor, I run two models and compare them via the ...
- 75
0
votes
1
answer
27
views
ML V REML for Hypothesis Testing
I am curious about doing hypothesis testing with REML values via a likelihood ratio test, or whatever test would make sense for REML values, but these two highly upvoted answers to existing cross ...
- 385
2
votes
2
answers
194
views
How to compare two PMF generating functions?
I have two functions $f$ and $g$ that map an input vector $x_i$ to a probability mass function.
For example:
$$
x_i = [0,1,2] \\\\
f(x_i) \rightarrow [0.1, 0.3, 0.2, 0.2, 0.2] \\\\
g(x_i) \...
- 21
1
vote
0
answers
22
views
Calculate weight for GLM-quasi poisson model
I am running several models with the quasi-Poisson family. I am looking at data from vulture restaurants. Vulture count was modelled at each site as a function of either a linear or quadratic effect ...
- 11
0
votes
0
answers
39
views
Likelihood ratios not distributed as a chi2 distribution with the correct dof (Wilks' theorem)
I perform Bayesian inference on a mixture model such that $\mu$ is the mixture weight for a feature in the mixture
$p(x | \mu, \theta) = \mu p_{f}(x|\theta) + (1-\mu)p_{nf}(x|\theta)$
I have prior $p(\...
4
votes
1
answer
42
views
Measurement invariance and latent mean comparison between 3 groups
I performed an Exploratory Factor Analysis (EFA) followed by a Confirmatory Factor Analysis (CFA) in R, successfully assessing the model fit using indices such as TLI, CFI, RMSEA for a two-factor ...
- 43
0
votes
0
answers
21
views
Testing difference between two models using WAIC and degrees of freedom of WAIC
I am conducting Bayesian penalised regression, horseshoe specifically, in R using the bayesreg package see here. One model is nested within the other, i.e. to the second model I have simply used all ...
- 2,043
1
vote
0
answers
20
views
GAMLSS - How to adjust AIC for log-transformation of variables [duplicate]
I have one GAMLSS model in which the independent and dependent variable are on the natural scale, and a second model in which both variables have been log-transformed. How do I adjust the AIC of the ...
- 333
0
votes
0
answers
33
views
Comparison of two different models with different variables
How to compare two models at two levels? For example, I want to model crime events at two levels (streets and census tracts). The models are logistic regression for the streets (occurrence of crime) ...
- 43
0
votes
0
answers
10
views
Interpretation Comparison Bayesian Models with Leave-One-Out Cross Validation
I'm currently working on comparing two Bayesian linear models using the brms package in R, with a dataset of 400 participants. The models differ in that one ...
- 21
1
vote
0
answers
26
views
Comparing Adjusted $R^2$ Between Totally Different Models
I'm curious as to what extent adjusted $R^2$ can be used to compare models. If I had two different data sets and completely different models for both data sets, could I say something like the the ...
0
votes
0
answers
24
views
Computing Bayesian model averaged posteriors
The Bayesian model averaged posterior predictive distribution for new data $\tilde{y}$ given training data $y$, across a set of $M$ models $\mathcal{D} = \{D_{1}, ..., D_{M}\}$, is defined as:
\begin{...
- 185
0
votes
0
answers
18
views
Linear mixed models with and without interactions
Here is the context: I asked two types of questions 8 times (8 "sessions" with 2 questions, each question has a "number" i.e. whether it is the first or second question asked, and ...
- 15
0
votes
0
answers
38
views
Compatibility of two atom spectra
I've measured in laboratory the wavelength of the emission lines of an unknown element.
I now have these values in a set (called x) along with their relative errors.
Now I need to compare my ...
- 1
1
vote
0
answers
58
views
Is comparing the AIC of a Bayesian and a frequentist model right?
I’m trying to fit a general linear model where the dependant variable is a probability. It is zero-inflated and continuous, then following the advice here blog of Ben Bolker, I separated my data pool ...
