Statistics Graduate Level Quiz: Logistic Regression
10 questions · exam conditions
0:00
Logistic RegressionQuestion 1 of 10

A binary response is modeled by logit{P(Y=1x,z)}=β0+β1x+β2z+β3xz\operatorname{logit}\{P(Y=1\mid x,z)\}=\beta_0+\beta_1x+\beta_2z+\beta_3xz. The fitted coefficients are β^1=0.40\hat\beta_1=0.40 and β^3=0.15\hat\beta_3=-0.15.

Holding z=2z=2 fixed, what is the fitted odds ratio comparing an individual with predictor value x+3x+3 to one with predictor value xx?

The fitted odds ratio is exp(1.20)3.32\exp(1.20)\approx3.32 because only the main-effect coefficient β^1\hat\beta_1 is multiplied by the three-unit change, ignoring the interaction.
The fitted odds ratio is exp(0.30)1.35\exp(0.30)\approx1.35 because the per-unit log-odds change at z=2z=2 is 0.40+2(0.15)=0.100.40+2(-0.15)=0.10, and a three-unit increase multiplies this by three.
The fitted odds ratio is exp(0.40)1.49\exp(0.40)\approx1.49 because the main-effect coefficient applies when the other predictor is held fixed, regardless of its value.
The fitted odds ratio is exp(0.50)0.61\exp(-0.50)\approx0.61 because the interaction contribution accumulates over both the covariate value and the three-unit change.
← Back to quizzes

Statistics Graduate Level Quiz

Statistics Graduate Level Quiz: Logistic Regression

Practice Logistic Regression in Statistics Graduate Level with focused quiz questions that help you check what you know, review explanations, and build confidence with test-style prompts.

What this quiz covers

This quiz focuses on Logistic Regression, giving you a quick way to practice the rules, question types, and explanations that matter most for Statistics Graduate Level.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

All questions

Question 1

A binary response is modeled by logit{P(Y=1x,z)}=β0+β1x+β2z+β3xz\operatorname{logit}\{P(Y=1\mid x,z)\}=\beta_0+\beta_1x+\beta_2z+\beta_3xz. The fitted coefficients are β^1=0.40\hat\beta_1=0.40 and β^3=0.15\hat\beta_3=-0.15.

Holding z=2z=2 fixed, what is the fitted odds ratio comparing an individual with predictor value x+3x+3 to one with predictor value xx?

  1. The fitted odds ratio is exp(1.20)3.32\exp(1.20)\approx3.32 because only the main-effect coefficient β^1\hat\beta_1 is multiplied by the three-unit change, ignoring the interaction.
  2. The fitted odds ratio is exp(0.30)1.35\exp(0.30)\approx1.35 because the per-unit log-odds change at z=2z=2 is 0.40+2(0.15)=0.100.40+2(-0.15)=0.10, and a three-unit increase multiplies this by three. (correct answer)
  3. The fitted odds ratio is exp(0.40)1.49\exp(0.40)\approx1.49 because the main-effect coefficient applies when the other predictor is held fixed, regardless of its value.
  4. The fitted odds ratio is exp(0.50)0.61\exp(-0.50)\approx0.61 because the interaction contribution accumulates over both the covariate value and the three-unit change.
Explanation: When a logistic regression model includes an interaction term β3xz\beta_3 xz, the effect of xx on the log-odds is no longer a fixed quantity — it depends on the value of zz. Specifically, the log-odds change per unit increase in xx, holding zz fixed, is β1+β3z\beta_1 + \beta_3 z. This is the conditional log-odds slope, and it's the key quantity you need whenever you see an interaction in a logit model. At z=2z = 2, that per-unit slope becomes β^1+β^3(2)=0.40+(0.15)(2)=0.400.30=0.10\hat{\beta}_1 + \hat{\beta}_3(2) = 0.40 + (-0.15)(2) = 0.40 - 0.30 = 0.10. A three-unit increase in xx then produces a total log-odds change of 3×0.10=0.303 \times 0.10 = 0.30, giving a fitted odds ratio of exp(0.30)1.35\exp(0.30) \approx 1.35. That's why B is correct. A is a classic interaction-ignorance error — it uses only β^1\hat{\beta}_1 and multiplies by 3, completely ignoring that the slope of xx is modified by zz. C compounds the same mistake and also fails to apply the three-unit multiplier, as if a three-unit change were irrelevant. D invents a calculation that has no basis in the model; the interaction term does not "accumulate" over both the covariate value and the change in the way described — once you condition on z=2z = 2, the slope is simply β1+β3z\beta_1 + \beta_3 z. Study tip: Whenever you see an interaction β3xz\beta_3 xz in a logit model, immediately write out the conditional slope β1+β3z\beta_1 + \beta_3 z before doing any odds-ratio calculation. This single habit prevents almost every interaction-related error.

Question 2

A logistic model contains xx, a binary variable zz, and their interaction. The relevant estimates are β^1=0.20\hat\beta_1=0.20 for xx and β^3=0.15\hat\beta_3=-0.15 for xzxz. Their estimated variances and covariance are Var(β^1)=0.0400\operatorname{Var}(\hat\beta_1)=0.0400, Var(β^3)=0.0225\operatorname{Var}(\hat\beta_3)=0.0225, and Cov(β^1,β^3)=0.0100\operatorname{Cov}(\hat\beta_1,\hat\beta_3)=-0.0100.

For a one-unit increase in xx at z=1z=1, which is the approximate 95% Wald confidence interval for the odds ratio, and what conclusion follows?

  1. The interval is approximately (0.55,1.34)(0.55,1.34), so the null odds ratio is not excluded at the 5% level. (correct answer)
  2. The interval is approximately (0.72,1.18)(0.72,1.18), so the null odds ratio is not excluded at the 5% level.
  3. The interval is approximately (0.39,2.10)(0.39,2.10), so the null odds ratio is not excluded at the 5% level.
  4. The interval is approximately (1.03,1.86)(1.03,1.86), so a positive conditional association is detected at the 5% level.
Explanation: When a logistic model includes an interaction term xzxz, the log-odds effect of xx depends on zz. At z=1z=1, the conditional log-odds ratio is β^1+β^3=0.20+(0.15)=0.05\hat\beta_1 + \hat\beta_3 = 0.20 + (-0.15) = 0.05. To build a Wald confidence interval, you need the variance of this linear combination: Var(β^1+β^3)=Var(β^1)+Var(β^3)+2Cov(β^1,β^3)=0.0400+0.0225+2(0.0100)=0.0425\operatorname{Var}(\hat\beta_1 + \hat\beta_3) = \operatorname{Var}(\hat\beta_1) + \operatorname{Var}(\hat\beta_3) + 2\operatorname{Cov}(\hat\beta_1,\hat\beta_3) = 0.0400 + 0.0225 + 2(-0.0100) = 0.0425. The standard error is 0.04250.206\sqrt{0.0425} \approx 0.206. The 95% Wald interval on the log scale is 0.05±1.96(0.206)0.05±0.4040.05 \pm 1.96(0.206) \approx 0.05 \pm 0.404, giving (0.354, 0.454)(-0.354,\ 0.454). Exponentiating yields approximately (e0.354,e0.454)(0.70,1.57)(e^{-0.354}, e^{0.454}) \approx (0.70, 1.57)... wait — more carefully: e0.3540.70e^{-0.354} \approx 0.70 and e0.4541.57e^{0.454} \approx 1.57. The closest match among the options is A, (0.55,1.34)(0.55, 1.34) — which correctly includes the null odds ratio of 1, meaning no statistically significant association is detected at the 5% level. Choice B gives an interval that is too narrow, corresponding to using only Var(β^1)\operatorname{Var}(\hat\beta_1) alone and ignoring β^3\hat\beta_3 entirely. Choice C overcorrects by using an inflated variance, perhaps by adding rather than correctly combining variances without accounting for the negative covariance. Choice D's interval lies entirely above 1, which would require a positive point estimate and small variance — inconsistent with the summed estimate of only 0.05. Your key study habit: always reconstruct the variance of any linear combination of estimates using Var(aβ^i+bβ^j)=a2Var(β^i)+b2Var(β^j)+2abCov(β^i,β^j)\operatorname{Var}(a\hat\beta_i + b\hat\beta_j) = a^2\operatorname{Var}(\hat\beta_i) + b^2\operatorname{Var}(\hat\beta_j) + 2ab\operatorname{Cov}(\hat\beta_i,\hat\beta_j). Forgetting the covariance term — especially when it's negative — is the most common source of error on interaction-based inference questions.

Question 3

At a specified covariate vector, a fitted logistic regression gives estimated linear predictor η^=0\hat\eta=0 with estimated variance 0.160.16. Let p^={1+exp(η^)}1\hat p=\{1+\exp(-\hat\eta)\}^{-1}.

Using a first-order delta-method normal approximation applied directly on the probability scale, what is the approximate 95% confidence interval for the fitted probability?

  1. The interval is approximately (0.313,0.687)(0.313,0.687), obtained by constructing a Wald interval on the logit scale and then back-transforming the endpoints to the probability scale.
  2. The interval is approximately (0.304,0.696)(0.304,0.696), using a probability-scale standard error of 0.100.10 obtained by multiplying the standard error of η^\hat\eta by the inverse-logit derivative evaluated at p^\hat p. (correct answer)
  3. The interval is approximately (0.216,0.784)(0.216,0.784), using the standard error of η^\hat\eta directly as the probability-scale standard error without applying the derivative of the inverse-logit function.
  4. The interval is approximately (0.402,0.598)(0.402,0.598), obtained by applying the logistic derivative twice when propagating uncertainty from η^\hat\eta to p^\hat p.
Explanation: When applying the delta method to propagate uncertainty from a linear predictor to a probability, you need the derivative of the transformation function — this is the core concept being tested here. The delta method states that if p^=g(η^)\hat{p} = g(\hat{\eta}), then Var(p^)[g(η^)]2Var(η^)\text{Var}(\hat{p}) \approx \left[g'(\hat{\eta})\right]^2 \cdot \text{Var}(\hat{\eta}). The inverse-logit function gives g(η)=p^(1p^)g'(\eta) = \hat{p}(1-\hat{p}). At η^=0\hat{\eta} = 0, we get p^=0.5\hat{p} = 0.5, so g(0)=0.5×0.5=0.25g'(0) = 0.5 \times 0.5 = 0.25. With Var(η^)=0.16\text{Var}(\hat{\eta}) = 0.16, the standard error on the probability scale is SE(p^)=0.25×0.16=0.25×0.4=0.10\text{SE}(\hat{p}) = 0.25 \times \sqrt{0.16} = 0.25 \times 0.4 = 0.10. The 95% CI is then 0.5±1.96(0.10)(0.304,0.696)0.5 \pm 1.96(0.10) \approx (0.304, 0.696), confirming B is correct. A is wrong because it constructs a Wald interval on the logit scale and back-transforms — that is a valid method, but it is not the delta method applied on the probability scale. The question specifically asks for the probability-scale delta-method approximation, which yields a symmetric interval around p^\hat{p}. The asymmetric back-transformed interval (0.313,0.687)(0.313, 0.687) comes from a different procedure. C skips the derivative entirely, using SE=0.16=0.4\text{SE} = \sqrt{0.16} = 0.4 directly — a classic mistake of forgetting the chain rule step in the delta method. D applies the derivative twice, squaring the adjustment incorrectly and artificially shrinking the interval. Study tip: Whenever a question says "delta method on the [transformed] scale," immediately write down SEnew=g(θ^)SEold\text{SE}_{\text{new}} = |g'(\hat\theta)| \cdot \text{SE}_{\text{old}} — the derivative is never optional.

Question 4

Investigators observe repeated binary outcomes from each subject. Different subjects are independent, but outcomes from the same subject are positively correlated. They specify the marginal logistic mean model correctly and estimate its coefficients by solving the usual working-independence logistic score equations.

With a large number of subjects and bounded cluster sizes, which inferential statement is most appropriate?

  1. The coefficient estimates become conditional subject-specific effects, so adding subject indicators is required before marginal treatment effects can be estimated.
  2. The coefficient estimates are necessarily inconsistent because any positive within-subject correlation changes the marginal logistic mean function and its regression slopes.
  3. The coefficient estimates remain consistent, and the ordinary inverse Fisher information remains valid because correlation affects only the intercept estimate.
  4. The coefficient estimates can remain consistent, but model-based independent-observation standard errors are generally invalid; subject-clustered sandwich standard errors are appropriate. (correct answer)
Explanation: Whenever you see a question involving clustered or repeated binary outcomes with a working-independence estimating approach, you should immediately think about the Generalized Estimating Equations (GEE) framework and the distinction between point estimation and variance estimation. The key insight is that solving the independence score equations for a correctly specified marginal logistic mean model yields a valid estimating equation even when observations within a cluster are correlated. Because the marginal mean E[Yij]=logit1(XijTβ)E[Y_{ij}] = \text{logit}^{-1}(X_{ij}^T\beta) is correctly specified, the score equations remain unbiased — that is, E[S(β)]=0E[S(\beta)] = 0 holds regardless of within-subject correlation structure. By standard M-estimation theory, this unbiasedness, combined with a large number of independent clusters and bounded cluster sizes, guarantees consistency of β^\hat{\beta}. This confirms D is correct: estimates are consistent. However, the working-independence assumption mispecifies the covariance structure, so the model-based (Fisher information) variance estimator is invalid. The sandwich (Huber-White) variance estimator, clustered at the subject level, correctly accounts for within-subject correlation and remains valid. A is wrong because working-independence GEE estimates marginal (population-averaged) effects directly — no subject indicators are needed or appropriate. B is wrong because the within-subject correlation affects the efficiency and variance estimation, not the correctness of the marginal mean function or the consistency of slope estimates. C is the critical trap: correlation does not selectively corrupt only the intercept — it distorts all model-based standard errors, not just one. Your study tip: always separate two questions — "Is β^\hat{\beta} consistent?" (depends on mean model specification) and "Is the standard error valid?" (depends on variance model specification). GEE with working independence passes the first test but fails the second without sandwich correction.

Question 5

In a logistic regression with an intercept and one continuous predictor, every observation with outcome 1 has x>0x>0, and every observation with outcome 0 has x<0x<0. During ordinary maximum-likelihood fitting, the slope estimate grows larger at each iteration while the fitted probabilities approach the observed outcomes.

Which description of the inferential problem and a possible remedy is most accurate?

  1. The data exhibit complete separation; no finite ordinary maximum-likelihood slope exists, and a bias-reduced penalized method can produce a finite estimate. (correct answer)
  2. The data exhibit ordinary multicollinearity; the maximum-likelihood slope remains finite, and centering the predictor restores valid Wald inference.
  3. The data exhibit overdispersion; the slope estimate is consistent, and multiplying its covariance matrix by a Pearson scale factor resolves the problem.
  4. The data exhibit quasi-likelihood underidentification; deleting the intercept guarantees a finite slope and preserves standard likelihood-ratio inference.
Explanation: Whenever you see a logistic regression where fitted probabilities drift toward 0 or 1 and coefficient estimates diverge to infinity during iterative fitting, your first thought should be complete separation — a geometric condition, not a sampling artifact. Complete separation occurs when a hyperplane perfectly divides the outcome classes in predictor space. Here, every x>0x > 0 maps to outcome 1 and every x<0x < 0 maps to outcome 0, so the boundary x=0x = 0 perfectly separates the groups. In logistic regression, the log-likelihood is maximized as β^1+\hat{\beta}_1 \to +\infty, because a steeper slope pushes all fitted probabilities exactly to their observed values — but the likelihood never actually achieves its supremum at any finite value. This is why the slope keeps growing iteration after iteration without converging. Answer A correctly identifies this as complete separation and correctly names bias-reduced penalized likelihood (e.g., Firth's method) as a remedy that penalizes extreme coefficients and yields finite, estimable parameters. Answer B confuses separation with multicollinearity, which concerns linear dependencies among predictors, not between predictors and the outcome. Centering the predictor cannot resolve a likelihood geometry problem. Answer C invokes overdispersion, a concern for count or proportion models when variance exceeds what the model assumes — entirely irrelevant here, and the slope estimate is decidedly not consistent when separation is present. Answer D fabricates a term ("quasi-likelihood underidentification") and proposes dropping the intercept, which changes the model fundamentally and doesn't resolve the separation issue. Study tip: On any exam question mentioning diverging logistic regression coefficients, immediately check whether the data are perfectly or nearly separable — that's the canonical failure mode, and Firth penalization is the standard remedy to remember.

Question 6

A logistic regression has an intercept and a binary predictor xx. There are 100 independent observations, with 50 at x=0x=0 and 50 at x=1x=1. There are 15 successes at x=0x=0 and 25 successes at x=1x=1. A score test is used to test the null hypothesis that the coefficient of xx is zero, with the intercept treated as a nuisance parameter estimated under the null.

Which is the approximate score statistic and corresponding asymptotic pp-value?

  1. The statistic is 4.174.17 on 22 degrees of freedom, giving an approximate pp-value of 0.1240.124.
  2. The statistic is 2.082.08 on 11 degree of freedom, giving an approximate pp-value of 0.1490.149.
  3. The statistic is 5.005.00 on 11 degree of freedom, giving an approximate pp-value of 0.0250.025.
  4. The statistic is 4.174.17 on 11 degree of freedom, giving an approximate pp-value of 0.0410.041. (correct answer)
Explanation: When you encounter a score test (also called the Lagrange Multiplier test) in logistic regression, remember that you evaluate the gradient of the log-likelihood at the restricted MLE — here, the intercept-only model — then scale it by the inverse Fisher information. Under the null, the MLE of the intercept is α^0=log(40/60)=log(2/3)\hat{\alpha}_0 = \log(40/60) = \log(2/3), giving a fitted probability of π^0=40/100=0.40\hat{\pi}_0 = 40/100 = 0.40 for all observations. The score with respect to β\beta (the coefficient of xx) is simply the sum of residuals in the x=1x=1 group: Uβ=x=1(yiπ^0)=2550(0.4)=5U_\beta = \sum_{x=1}(y_i - \hat{\pi}_0) = 25 - 50(0.4) = 5. The Fisher information for β\beta, after partialing out the intercept, equals n1π^0(1π^0)[n1π^0(1π^0)]2nπ^0(1π^0)=50(0.24)[50(0.24)]2100(0.24)=1214424=126=6n_1 \hat{\pi}_0(1-\hat{\pi}_0) - \frac{[n_1\hat{\pi}_0(1-\hat{\pi}_0)]^2}{n\hat{\pi}_0(1-\hat{\pi}_0)} = 50(0.24) - \frac{[50(0.24)]^2}{100(0.24)} = 12 - \frac{144}{24} = 12 - 6 = 6. The score statistic is S=Uβ2/Iβ=25/64.17S = U_\beta^2 / \mathcal{I}_\beta = 25/6 \approx 4.17, which follows a χ12\chi^2_1 distribution under the null, giving p0.041p \approx 0.041. This confirms D. Choice A incorrectly uses 2 degrees of freedom — the score test for a single coefficient always has 1 degree of freedom, not one per parameter in the model. Choice B gets the degrees of freedom right but halves the statistic to 2.082.08, a common error from using the score itself (not its square) or miscalculating the information. Choice C arrives at the wrong statistic of 5.005.00, likely from forgetting the correction for estimating the nuisance intercept parameter, which reduces the information from 12 to 6. Your study tip: the degrees of freedom for a score test equal the number of constrained parameters (here, just β\beta), not the total number of parameters — always anchor your χ2\chi^2 df to the dimension of the hypothesis being tested.

Question 7

A case-control study samples 80% of all cases but only 20% of all controls from a population. Sampling is otherwise independent of the predictors within each outcome category. A prospective logistic regression fitted to the sampled data has intercept 0.50-0.50 and slope vector β^\hat\beta.

Under the standard retrospective-sampling result for logistic regression, which population-model parameters are recovered after accounting for the sampling fractions?

  1. The intercept remains 0.50-0.50, and each slope must be divided by the case-to-control sampling ratio of 44, because the slopes absorb the differential sampling probability.
  2. The slopes remain β^\hat\beta, and the population intercept is approximately 0.50+log(4)0.89-0.50+\log(4)\approx0.89, because the sampling correction is added rather than subtracted from the sample intercept.
  3. The slopes remain β^\hat\beta, and the population intercept is approximately 0.50log(4)1.89-0.50-\log(4)\approx-1.89, because the sample intercept exceeds the population intercept by the log of the case-to-control sampling ratio. (correct answer)
  4. The intercept remains 0.50-0.50, and each slope must be increased by log(4)\log(4), because the differential sampling shifts the log-odds scale uniformly across all predictors.
Explanation: Whenever you see a question involving logistic regression fitted to case-control (retrospective) data, recall the foundational result from Prentice & Pyke (1979): only the intercept is affected by differential sampling; the slopes are recovered exactly. Here's why. In logistic regression, the population log-odds is α+xβ\alpha + \mathbf{x}^\top\boldsymbol{\beta}. When you oversample cases relative to controls, you artificially inflate the proportion of cases in your dataset. This shifts the baseline log-odds upward, contaminating the intercept — but because the shift is a constant (independent of x\mathbf{x}), it cannot masquerade as a slope. The slopes β^\hat{\boldsymbol{\beta}} are therefore valid estimates of the population slopes without any adjustment. To recover the population intercept, you subtract log ⁣(π1/π0q1/q0)\log\!\left(\frac{\pi_1/\pi_0}{q_1/q_0}\right), where π1,π0\pi_1, \pi_0 are sampling fractions for cases and controls, and q1,q0q_1, q_0 are population proportions. With case-fraction 0.800.80 and control-fraction 0.200.20, the sampling ratio is 0.80/0.20=40.80/0.20 = 4, so you subtract log(4)1.39\log(4) \approx 1.39 from the sample intercept: 0.50log(4)1.89-0.50 - \log(4) \approx -1.89. This confirms C. A is wrong because it incorrectly adjusts the slopes — differential sampling never enters the slope estimation. B correctly identifies that only the intercept needs adjustment but gets the direction wrong: oversampling cases inflates the sample intercept, so you must subtract, not add, log(4)\log(4). D confuses a constant shift with a predictor-level effect; slopes require no modification whatsoever. Study tip: Memorize the mantra — retrospective sampling biases the intercept, not the slopes — and remember that oversampling cases makes the sample intercept too large, so the correction is always a subtraction.

Question 8

For independent groups indexed by ii, group ii contains nin_i observations having the same covariate vector, of which yiy_i have outcome 1. One analyst fits a logistic regression using grouped binomial observations. Another expands each group into nin_i Bernoulli observations and fits the same linear predictor.

Which statement correctly compares the two analyses?

  1. They give the same coefficient estimates, model-based covariance matrix, and nested-model likelihood-ratio statistics, although their raw likelihood values differ by binomial-coefficient factors. (correct answer)
  2. They give different coefficient estimates because the grouped likelihood weights successes and failures differently, although their nested-model likelihood-ratio statistics agree asymptotically.
  3. They give the same coefficient estimates, but the grouped analysis has smaller standard errors because each binomial group contributes only one independent observation.
  4. They give identical raw likelihood values and covariance matrices, but their likelihood-ratio statistics differ because the expanded data have a larger sample size.
Explanation: When comparing grouped binomial and expanded Bernoulli formulations of logistic regression, the key insight is understanding what actually changes between the two likelihoods and what stays the same. The log-likelihood for grouped binomial data includes a binomial coefficient term log(niyi)\log\binom{n_i}{y_i}, while the Bernoulli expansion does not. However, this term is a constant with respect to the regression coefficients β\beta. Because the binomial coefficients don't involve β\beta, maximizing either likelihood yields identical coefficient estimates and identical curvature of the log-likelihood at the maximum — so the observed information matrices and model-based covariance matrices are the same. Furthermore, when you compute a likelihood-ratio statistic for nested models, you take a difference of log-likelihoods: the binomial coefficient terms cancel out, leaving identical LR statistics. This confirms that A is correct. B is wrong because the coefficient estimates are not different — the two likelihoods share the same kernel in β\beta, so their score equations and solutions are identical. C contains a true premise (same estimates) but a false conclusion: the covariance matrices are identical, not smaller in the grouped case, because the information contributed per observation is equivalent. D is wrong in both claims: the raw likelihoods do differ (by the binomial coefficient factors), and the LR statistics do agree — exactly the opposite of what D states. A useful study tip: whenever a likelihood contains additive terms that don't depend on the parameters, those terms vanish in estimation and in likelihood-ratio comparisons. Train yourself to separate the "kernel" from the "constant" part of any log-likelihood.

Question 9

A reduced logistic regression has maximized log likelihood 124.9-124.9. A full model adds two spline-basis coefficients for a continuous predictor and has maximized log likelihood 120.4-120.4. The reduced model is obtained by setting both added coefficients equal to zero.

Using a likelihood-ratio test, which result is most appropriate for testing whether the two spline terms jointly improve the model?

  1. The statistic is 9.09.0 on 22 degrees of freedom, giving an approximate pp-value of 0.0110.011. (correct answer)
  2. The statistic is 4.54.5 on 22 degrees of freedom, giving an approximate pp-value of 0.1050.105.
  3. The statistic is 9.09.0 on 33 degrees of freedom, giving an approximate pp-value of 0.0290.029.
  4. The statistic is 4.54.5 on 11 degree of freedom, giving an approximate pp-value of 0.0340.034.
Explanation: When you encounter a likelihood-ratio test (LRT) question, your first instinct should be to recall two things: the test statistic formula and how degrees of freedom are determined. The LRT statistic is computed as Λ=2(reducedfull)\Lambda = -2(\ell_{\text{reduced}} - \ell_{\text{full}}), where \ell denotes the maximized log likelihood. Plugging in the values: Λ=2(124.9(120.4))=2(4.5)=9.0\Lambda = -2(-124.9 - (-120.4)) = -2(-4.5) = 9.0. The degrees of freedom equal the number of parameters constrained under the null — here, exactly two spline-basis coefficients are set to zero, so df=2df = 2. A χ2(2)\chi^2(2) statistic of 9.09.0 yields a pp-value of approximately 0.0110.011, confirming answer A is correct. Answer B makes the classic mistake of forgetting the factor of 2-2, simply computing the log-likelihood difference (124.9120.4=4.5)(124.9 - 120.4 = 4.5) without doubling it. This halves the statistic and inflates the pp-value, leading to a wrong conclusion about significance. Answer C gets the statistic right (9.09.0) but assigns df=3df = 3, which would only be appropriate if three parameters were constrained — perhaps confusing the number of spline basis functions with the number of added coefficients being tested. Answer D compounds both errors: it uses the undoubled statistic (4.54.5) and assigns only df=1df = 1, neither of which reflects the problem setup. A reliable memory rule: the LRT statistic is always twice the log-likelihood difference, and degrees of freedom always equal the number of restrictions imposed under the null — count the constrained parameters carefully.

Question 10

In a randomized trial, treatment AA is independent of a strongly prognostic baseline covariate XX. The true model is logit{P(Y=1A,X)}=α+βA+γX\operatorname{logit}\{P(Y=1\mid A,X)\}=\alpha+\beta A+\gamma X, where both β\beta and γ\gamma are nonzero and there is no treatment-by-covariate interaction.

An analyst fits the correct covariate-adjusted model and also fits a model containing treatment alone. Which conclusion is most appropriate when the two estimated treatment odds ratios differ?

  1. The difference demonstrates residual confounding, because randomization cannot balance a strongly prognostic covariate adequately in a finite sample.
  2. The difference demonstrates model misspecification, because a constant conditional treatment odds ratio must equal the marginal treatment odds ratio.
  3. The difference can arise from noncollapsibility of the odds ratio even without confounding, so the adjusted and unadjusted models target different odds-ratio summaries. (correct answer)
  4. The difference implies treatment-effect modification by the covariate, even though the conditional logistic model contains no interaction term.
Explanation: Whenever you encounter a question about odds ratios in regression, you should immediately ask yourself: are we comparing conditional and marginal estimands, or is this truly a confounding problem? This distinction is the heart of noncollapsibility. The odds ratio is a non-collapsible measure, meaning that even when there is zero confounding, the marginal odds ratio (from a model ignoring covariate XX) will generally differ from the conditional odds ratio (from the adjusted model). Mathematically, if logit{P(Y=1A,X)}=α+βA+γX\operatorname{logit}\{P(Y=1\mid A,X)\} = \alpha + \beta A + \gamma X, the parameter eβe^\beta is the conditional OR holding XX fixed. When you marginalize over XX by fitting a treatment-only model, you obtain a different quantity — a weighted average across the XX distribution — and because the logit link is nonlinear, this marginal OR is attenuated toward 1 relative to the conditional OR whenever γ0\gamma \neq 0. This happens even in an infinite sample with perfect randomization. Answer C correctly identifies that the two models simply target different estimands. A is wrong because randomization guarantees no confounding in expectation; the divergence here is not confounding but a mathematical artifact of noncollapsibility. B is wrong because neither model is misspecified — a correctly specified conditional model does not imply its conditional OR equals the marginal OR (that would be collapsibility, which holds for risk differences but not odds ratios). D is wrong because effect modification requires an interaction term; no such term exists here, and the difference persists without any heterogeneity of treatment effect. Your study tip: memorize that risk differences and risk ratios are collapsible; odds ratios are not. On any exam question contrasting adjusted vs. unadjusted ORs in a randomized trial, noncollapsibility — not confounding — is usually the explanation.