| Model | Deviance | AIC | BIC | df | ΔΧ² | p | McFadden R² | Nagelkerke R² | Tjur R² | Cox & Snell R² | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| M₀ | 271.957 | 273.957 | 277.240 | 196 | 0.000 | 0.000 | |||||||||||||||
| M₁ | 46.778 | 52.778 | 62.627 | 194 | 225.179 | < .001 | 0.828 | 0.910 | 0.866 | 0.681 | |||||||||||
| Note. M₁ includes extroversion, agreeableness | |||||||||||||||||||||
The first line of the Model Summary table tells us about the model when only the constant is included (i.e., all predictor variables are omitted). The Deviance of this baseline model is 271.957, which represents the fit of the model when including only the constant. At this point, the model predicts that every participant is a singer, because this results in more correct classifications than if the model predicted that everyone was a guitarist. You can see this because the intercept is negative and 'Singer' is coded as 0.
The second line of the Model Summary table describes the model fit after these predictors have been added to the model. The overall fit of the new models is assessed using the Deviance. Remember that large values of the Deviance statistic indicate poorly fitting statistical models. The value of the Deviance for a new model should, therefore, be smaller than the value for the previous model if the fit is improving (the same goes for the BIC and AIC). When only the constant was included, Deviance = 271.96, but with the two predictors added it has reduced to 46.78 (i.e.,
The table labelled Coefficients tells us the estimates for the coefficients for the predictors included in the model. These coefficients represents the change in the logit (log odds) of the outcome variable associated with a one-unit change in the predictor variable. The Wald statistics suggest that both extroversion, Wald(1) = 22.90, p < .001, and agreeableness, Wald(1) = 15.30, p < .001, significantly predict the instrument played. The corresponding odds ratio (labelled Odds Ratio) tells us the change in odds associated with a unit change in the predictor. The odds ratio for extroversion is 0.238, which is less than 1 meaning that as the predictor (extroversion) increases, the odds of the outcome decrease, that is, the odds of being a guitarist (compared to a singer) decrease. In other words, more extroverted participants are more likely to be singers. The odds ratio for agreeableness is 1.429, which is greater than 1 meaning that as agreeableness increases, the odds of the outcome increase, that is, the odds of being a guitarist (compared to a singer) increase. In other words, more agreeable people are more likely to be guitarists. Note that the odds ratio for the constant is insanely large, which brings us neatly onto the next task …
Wald Test
|
95% Confidence interval
|
||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Estimate | Standard Error | Odds Ratio | z | Wald Statistic | df | p | Lower bound | Upper bound | ||||||||||||
| M₀ | (Intercept) | -0.153 | 0.143 | 0.858 | -1.068 | 1.140 | 1 | 0.286 | -0.433 | 0.128 | |||||||||||
| M₁ | (Intercept) | 31.301 | 7.691 | 3.925×10+13 | 4.070 | 16.565 | 1 | < .001 | 16.228 | 46.374 | |||||||||||
| extroversion | -1.436 | 0.300 | 0.238 | -4.785 | 22.900 | 1 | < .001 | -2.024 | -0.848 | ||||||||||||
| agreeableness | 0.357 | 0.091 | 1.429 | 3.912 | 15.303 | 1 | < .001 | 0.178 | 0.536 | ||||||||||||
| Note. instrument level 'Guitar' coded as class 1. | |||||||||||||||||||||
The Confusion matrix how well the model predicts group membership. Overall it correctly classifies 103 of the 106 singers and 87 of the 91 guitarists. Overall then, it correctly classifies 96.4% of cases. A huge number, which might turn out to be problematic...
| Predicted | |||||||
|---|---|---|---|---|---|---|---|
| Observed | Singer | Guitar | % Correct | ||||
| Singer | 103 | 3 | 97.170 | ||||
| Guitar | 4 | 87 | 95.604 | ||||
| Overall % Correct | 96.447 | ||||||
| Note. The cut-off value is set to 0.5 | |||||||
Looking at the confusion matrix, it looks as though we might have complete separation. The model almost perfectly predicts group membership (notice how the conditional estimates plot almost shows a cut-off in extroversion that determines whether someone will be a guitar player), which sounds good but can be curse in disguise.. Complete separation can lead to inflated regression estimates or standard errors, which makes it very hard to properly quantify the uncertainty in our inference.

