How to Determine Which Model Has a Better Fit — Through One Example

 











1. Deviance Residuals

These are the differences between observed and predicted values, adjusted for the model's distribution. The summary shows:

  • Min: -6.5037
  • 1Q (1st Quartile): -1.5778
  • Median: -0.1833
  • 3Q (3rd Quartile): 1.3519
  • Max: 6.3167

These values help assess the symmetry and spread of residuals. Ideally, they should be symmetrically distributed around zero.

🔹 2. Dispersion Parameter

  • Value: 6.437133
  • For a Gaussian (normal) model, this is the estimated variance of the residuals. It reflects how much the data points deviate from the model's predictions.

🔹 3. Null Deviance

  • Value: 917.69 (on 107 degrees of freedom)
  • This measures the deviance (lack of fit) of a model with no predictors (only the intercept). It serves as a baseline for comparison.

🔹 4. Residual Deviance

  • Value: 682.34 (on 106 degrees of freedom)
  • This is the deviance of the fitted model (with predictors). A large reduction from the null deviance indicates that the predictor(s) (in this case, age) improve the model fit.

🔹 5. AIC (Akaike Information Criterion)

  • Value: 511.58
  • AIC balances model fit and complexity. Lower AIC values indicate a better model, penalizing for adding too many predictors.



MetricModel AModel BInterpretation
Residual Deviance682.34541.87Lower is better — Model B fits better.
AIC511.58488.68Lower AIC suggests Model B is preferred.
Null Deviance917.69917.69Same for both — baseline model.
Dispersion6.445.16Slightly lower in Model B — better variance explanation.

Comments

Post a Comment

Popular posts from this blog

Analysis of Repeated Measures Data using SAS (1)

Image
 1. Basic Concepts of Repeated Measures: In this basic setup of a completely randomized design with repeated measures, there are two factors, treatments and time. Treatment is called the between-subjects factor because levels of treatment can change only between subjects; all measurements on the same subject will represent the same treatment. Time is called a within-subjects factor because different measurements on the same subject are taken at different times.  In repeated measures experiments, interest centers on (1) how treatment means differ, (2) how treatment means change over time, and (3) how differences between treatment means change over time. 2. Four-step procedure for mixed model analysis: Step 1: Model the mean structure, usually by specification of the fixed effects. Step 2: Specify the covariance structure, between subjects as well as within subjects. Step 3: Fit the mean model accounting for the covariance structure. Step 4: Make statistical inference bas...
Read more

Understanding Binding vs. Non-Binding Futility Analysis in Clinical Trials

Image
  1.What is the difference between binding futility and non-binding futility analysis ? In clinical trials,   futility analysis   is a type of interim analysis used to determine whether it is unlikely that a study will achieve its objectives if it continues as planned. This helps avoid wasting resources and exposing participants to ineffective treatments. Futility analyses can be   binding   or   non-binding , and the distinction is important for trial design and interpretation. 🔹 Binding Futility Analysis Definition : If the futility boundary is crossed, the trial  must be stopped . Implication : It is part of the formal decision-making process and is enforced by the protocol or statistical analysis plan. Use Case : Often used when ethical or resource concerns demand early termination if the treatment is clearly not effective. 🔹 Non-Binding Futility Analysis Definition : If the futility boundary is crossed, the trial  may continue ...
Read more

Medical information for Melanoma, Merkel cell carcinoma and tumor mutation burden

  Background: Melanoma Also called: malignant melanoma The most serious type of skin cancer. Melanoma occurs when the pigment-producing cells that give color to the skin become cancerous. Symptoms might include a new, unusual growth or a change in an existing mole. Melanomas can occur anywhere on the body. Treatment may involve surgery, radiation, medications, or in some cases chemotherapy. Merkel cell carcinoma  (MCC) it is a very rare ,  highly aggressive, neuroendocrine carcinoma of the skin ;  it has a worse survival probability compared with more common cutaneous malignancies, including metastatic melanoma, and has been termed the “most lethal” skin cancer  as   p atients with metastatic MCC have a historical 5-year overall survival (OS) rate of 18% What Is Tumor Mutational Burden? TMB is defined as the frequency of certain mutations within a tumor’s genes.  To be counted towards TMB, mutations have to alter the protein that is made from a gene. ...
Read more