Statistics Graduate Level Quiz: Fisher Information And Cramer Rao Bound
10 questions · exam conditions
0:00
Fisher Information And Cramer Rao BoundQuestion 1 of 10

Let X1,,XnX_1,\ldots,X_n be independent with density f(x;θ)=1/θf(x;\theta)=1/\theta for 0<x<θ0<x<\theta, where θ>0\theta>0 and n2n\ge 2. The estimator T=(n+1)X(n)/nT=(n+1)X_{(n)}/n is unbiased for θ\theta and has variance θ2/[n(n+2)]\theta^2/[n(n+2)]. Squaring the formal score n/θ-n/\theta would instead suggest information n2/θ2n^2/\theta^2 and a lower bound θ2/n2\theta^2/n^2, which is larger than Varθ(T)\operatorname{Var}_\theta(T). Which statement best resolves this apparent contradiction?

The formal bound applies only to estimators based on the sample mean, whereas TT depends on an order statistic.
The support depends on θ\theta, so differentiation under the integral fails and the usual Cramér–Rao argument is invalid.
The estimator is unbiased only asymptotically, so the finite-sample unbiased Cramér–Rao bound does not apply.
The correct information is n(n+2)/θ2n(n+2)/\theta^2, which makes the estimator attain the ordinary Cramér–Rao bound.
← Back to quizzes

Statistics Graduate Level Quiz

Statistics Graduate Level Quiz: Fisher Information And Cramer Rao Bound

Practice Fisher Information And Cramer Rao Bound in Statistics Graduate Level with focused quiz questions that help you check what you know, review explanations, and build confidence with test-style prompts.

What this quiz covers

This quiz focuses on Fisher Information And Cramer Rao Bound, giving you a quick way to practice the rules, question types, and explanations that matter most for Statistics Graduate Level.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

All questions

Question 1

Let X1,,XnX_1,\ldots,X_n be independent with density f(x;θ)=1/θf(x;\theta)=1/\theta for 0<x<θ0<x<\theta, where θ>0\theta>0 and n2n\ge 2. The estimator T=(n+1)X(n)/nT=(n+1)X_{(n)}/n is unbiased for θ\theta and has variance θ2/[n(n+2)]\theta^2/[n(n+2)]. Squaring the formal score n/θ-n/\theta would instead suggest information n2/θ2n^2/\theta^2 and a lower bound θ2/n2\theta^2/n^2, which is larger than Varθ(T)\operatorname{Var}_\theta(T). Which statement best resolves this apparent contradiction?

  1. The formal bound applies only to estimators based on the sample mean, whereas TT depends on an order statistic.
  2. The support depends on θ\theta, so differentiation under the integral fails and the usual Cramér–Rao argument is invalid. (correct answer)
  3. The estimator is unbiased only asymptotically, so the finite-sample unbiased Cramér–Rao bound does not apply.
  4. The correct information is n(n+2)/θ2n(n+2)/\theta^2, which makes the estimator attain the ordinary Cramér–Rao bound.
Explanation: Whenever you encounter a Cramér–Rao lower bound (CRLB) problem, your first instinct should be to check whether the regularity conditions are satisfied — before doing any algebra with the score function. The CRLB derivation relies on differentiating under an integral sign: ddθf(x;θ)dx=θf(x;θ)dx\frac{d}{d\theta}\int f(x;\theta)\,dx = \int \frac{\partial}{\partial\theta}f(x;\theta)\,dx. This interchange is only valid when the support of ff does not depend on the parameter. Here, f(x;θ)=1/θf(x;\theta) = 1/\theta on (0,θ)(0,\theta), so the upper limit of integration moves with θ\theta. The differentiation-under-the-integral step breaks down entirely, making the standard CRLB machinery inapplicable. That is why B is correct: the "information" n2/θ2n^2/\theta^2 computed from the score is a meaningless artifact of applying a formula outside its domain of validity. The fact that Var(T)=θ2/[n(n+2)]\text{Var}(T) = \theta^2/[n(n+2)] is smaller than the spurious "bound" θ2/n2\theta^2/n^2 is not a contradiction — the bound simply never applied. Choice A is wrong because the CRLB, when valid, applies to any unbiased estimator regardless of whether it uses order statistics or the sample mean. Choice C is wrong because T=(n+1)X(n)/nT = (n+1)X_{(n)}/n is exactly unbiased in finite samples, not just asymptotically — you can verify this from the known distribution of X(n)X_{(n)}. Choice D is wrong because there is no corrected "true" Fisher information that salvages the standard CRLB here; the entire framework collapses when support depends on θ\theta. Your study tip: always list the CRLB regularity conditions before applying the bound. "Support depends on θ\theta" is the single most common condition that fails on exam problems — flag it immediately when you see truncated or bounded distributions like Uniform(0,θ)(0,\theta), Exponential shifted by θ\theta, or similar families.

Question 2

A regular two-parameter model has parameter vector (θ,λ)(\theta,\lambda) and per-observation Fisher information matrix I(θ,λ)=(4223).I(\theta,\lambda)=\begin{pmatrix}4&2\\2&3\end{pmatrix}. For a sample of nn independent observations, λ\lambda is unknown and is treated as a nuisance parameter. What is the Cramér–Rao lower bound for the variance of an unbiased estimator of θ\theta?

  1. 14n\frac{1}{4n}, obtained by using only the θθ\theta\theta information entry
  2. 38n\frac{3}{8n}, obtained from the corresponding entry of the inverse matrix (correct answer)
  3. 12n\frac{1}{2n}, obtained after subtracting the cross-information once
  4. 34n\frac{3}{4n}, obtained by inverting the diagonal information entries
Explanation: When nuisance parameters are present, the Cramér–Rao lower bound (CRLB) for a parameter of interest is not simply the reciprocal of that parameter's diagonal entry in the Fisher information matrix. Instead, you must work with the full inverse of the information matrix, because nuisance parameters introduce correlations that inflate the bound. For a two-parameter model with Fisher information I(θ,λ)=(4223)I(\theta,\lambda) = \begin{pmatrix}4&2\\2&3\end{pmatrix} , the CRLB for θ\theta when λ\lambda is unknown is the (1,1)(1,1) entry of [nI(θ,λ)]1[nI(\theta,\lambda)]^{-1}. First, invert the per-observation matrix: det(I)=(4)(3)(2)(2)=8\det(I) = (4)(3)-(2)(2) = 8, so I1=18(3224)I^{-1} = \frac{1}{8}\begin{pmatrix}3&-2\\-2&4\end{pmatrix} . The (1,1)(1,1) entry is 38\frac{3}{8}, giving a CRLB of 38n\frac{3}{8n}. This confirms answer B. Answer A is the most common trap: inverting only the θθ\theta\theta entry gives 14n\frac{1}{4n}, which would be correct only if λ\lambda were known. Treating a nuisance parameter as known ignores the estimation uncertainty it introduces, artificially deflating the bound. Answer C, 12n\frac{1}{2n}, doesn't correspond to any standard formula — it appears to subtract cross-information once rather than applying the full matrix inversion, which has no theoretical justification. Answer D, 34n\frac{3}{4n}, comes from inverting diagonal entries separately (e.g., 1413\frac{1}{4} \cdot \frac{1}{3}), ignoring off-diagonal terms entirely — another incorrect shortcut. Key strategy: Whenever a nuisance parameter is present, always compute the full matrix inverse first, then read off the relevant diagonal entry. The phrase "nuisance parameter" on an exam is your signal to invert the complete Fisher information matrix.

Question 3

Independent observations have exponential density f(x;θ)=θeθxf(x;\theta)=\theta e^{-\theta x} for x>0x>0, where θ>0\theta>0 is the rate. The model is reparameterized by the mean η=1/θ\eta=1/\theta. What are the Fisher information for η\eta in a sample of size nn and the corresponding Cramér–Rao bound for unbiased estimation of η\eta?

  1. In(η)=nη2I_n(\eta)=n\eta^2 and the bound is 1/(nη2)1/(n\eta^2)
  2. In(η)=n/η4I_n(\eta)=n/\eta^4 and the bound is η4/n\eta^4/n
  3. In(η)=n/η2I_n(\eta)=n/\eta^2 and the bound is η2/n\eta^2/n (correct answer)
  4. In(η)=nI_n(\eta)=n and the bound is 1/n1/n
Explanation: Reparameterization questions test your ability to transform Fisher information under a change of parameters using the delta method identity: if η=g(θ)\eta = g(\theta), then In(η)=In(θ)/[g(θ)]2I_n(\eta) = I_n(\theta) / [g'(\theta)]^2. Start by computing Fisher information in the original parameterization. For the exponential with rate θ\theta, the log-likelihood is (θ)=nlogθθxi\ell(\theta) = n\log\theta - \theta\sum x_i, giving 2/θ2=n/θ2\partial^2\ell/\partial\theta^2 = -n/\theta^2, so In(θ)=n/θ2I_n(\theta) = n/\theta^2. Now reparameterize: η=1/θ\eta = 1/\theta, so θ=1/η\theta = 1/\eta and dθ/dη=1/η2d\theta/d\eta = -1/\eta^2. Applying the transformation rule: In(η)=In(θ)(dθdη)2=nθ21η4=nη21η4=nη2I_n(\eta) = I_n(\theta)\left(\frac{d\theta}{d\eta}\right)^2 = \frac{n}{\theta^2}\cdot\frac{1}{\eta^4} = n\eta^2 \cdot \frac{1}{\eta^4} = \frac{n}{\eta^2} The Cramér–Rao lower bound for any unbiased estimator of η\eta is 1/In(η)=η2/n1/I_n(\eta) = \eta^2/n. This confirms C. Choice A inverts the information itself (nη2n\eta^2) rather than correctly applying the chain rule squared, and the bound 1/(nη2)1/(n\eta^2) follows from that flawed information. Choice B gives n/η4n/\eta^4, which corresponds to using dη/dθ=1/θ2d\eta/d\theta = -1/\theta^2 in the wrong direction without accounting for the correct substitution — essentially applying the inverse transform incorrectly. Choice D suggests In(η)=nI_n(\eta) = n, which would only hold if η\eta and θ\theta had a linear relationship (unit Jacobian), ignoring the nonlinear reparameterization entirely. When you see a reparameterization problem, always write out the derivative of the old parameter with respect to the new one, square it, and multiply by the original Fisher information — direction matters.

Question 4

Let X1,,XnX_1,\ldots,X_n be independent N(θ,σ2)N(\theta,\sigma^2) observations with known σ2\sigma^2. The estimator T=Xˉ2σ2/nT=\bar X^2-\sigma^2/n is unbiased for θ2\theta^2. Which statement correctly compares its variance with the Cramér–Rao lower bound for unbiased estimation of θ2\theta^2?

  1. It attains the bound for every θ\theta because it is an unbiased function of a complete sufficient statistic.
  2. It exceeds the bound by 4θ2σ2/n4\theta^2\sigma^2/n because the information must also estimate θ2\theta^2.
  3. It falls below the bound at θ=0\theta=0 because the derivative of θ2\theta^2 vanishes there.
  4. It exceeds the bound by 2σ4/n22\sigma^4/n^2, and no unbiased estimator attains the bound for every θ\theta. (correct answer)
Explanation: When comparing an estimator's variance to the Cramér–Rao lower bound (CRLB), your first move should be to compute the actual variance and the CRLB separately, then compare. Computing the actual variance of T=Xˉ2σ2/nT = \bar{X}^2 - \sigma^2/n: Since XˉN(θ,σ2/n)\bar{X} \sim N(\theta, \sigma^2/n), we know Xˉ2\bar{X}^2 follows a scaled noncentral chi-squared distribution. Using the formula Var(Xˉ2)=4θ2σ2/n+2σ4/n2\text{Var}(\bar{X}^2) = 4\theta^2\sigma^2/n + 2\sigma^4/n^2, and since σ2/n\sigma^2/n is a constant, Var(T)=4θ2σ2/n+2σ4/n2\text{Var}(T) = 4\theta^2\sigma^2/n + 2\sigma^4/n^2. Computing the CRLB for estimating g(θ)=θ2g(\theta) = \theta^2: The Fisher information for θ\theta from nn normal observations is I(θ)=n/σ2I(\theta) = n/\sigma^2. The CRLB is [g(θ)]2/I(θ)=(2θ)2σ2/n=4θ2σ2/n[g'(\theta)]^2/I(\theta) = (2\theta)^2 \cdot \sigma^2/n = 4\theta^2\sigma^2/n. Subtracting: Var(T)CRLB=2σ4/n2>0\text{Var}(T) - \text{CRLB} = 2\sigma^4/n^2 > 0 for all θ\theta. This confirms D — the variance exceeds the bound by exactly 2σ4/n22\sigma^4/n^2, and no unbiased estimator can attain it everywhere. A is tempting because TT is indeed a function of the complete sufficient statistic Xˉ\bar{X}, making it the UMVUE. But being UMVUE means minimum variance among unbiased estimators — it doesn't guarantee the CRLB is attained. B incorrectly identifies the excess as 4θ2σ2/n4\theta^2\sigma^2/n, confusing the full variance with the gap. C is backwards: the CRLB vanishes at θ=0\theta=0 (since g(0)=0g'(0)=0), but the estimator's variance there equals 2σ4/n2>02\sigma^4/n^2 > 0, so the bound is exceeded most severely at θ=0\theta=0, not beaten. Remember: UMVUE ≠ CRLB-achieving. Always compute both sides explicitly before drawing conclusions.

Question 5

Suppose X1,,XnX_1,\ldots,X_n are independent and XiN(θ,θ2)X_i\sim N(\theta,\theta^2), where θ>0\theta>0. Both the mean and variance therefore depend on the same parameter. What are the sample Fisher information for θ\theta and the Cramér–Rao lower bound for an unbiased estimator of θ\theta?

  1. In(θ)=n/θ2I_n(\theta)=n/\theta^2 and the bound is θ2/n\theta^2/n
  2. In(θ)=2n/θ2I_n(\theta)=2n/\theta^2 and the bound is θ2/(2n)\theta^2/(2n)
  3. In(θ)=3n/θ2I_n(\theta)=3n/\theta^2 and the bound is θ2/(3n)\theta^2/(3n) (correct answer)
  4. In(θ)=4n/θ2I_n(\theta)=4n/\theta^2 and the bound is θ2/(4n)\theta^2/(4n)
Explanation: When the same parameter controls both the mean and variance, you must account for both sources of information when computing Fisher information — a detail that trips up many students. For XiN(θ,θ2)X_i \sim N(\theta, \theta^2), the log-likelihood for a single observation is: (θ;x)=logθ(xθ)22θ2\ell(\theta; x) = -\log\theta - \frac{(x-\theta)^2}{2\theta^2} To find I1(θ)=E[2θ2]I_1(\theta) = -E\left[\frac{\partial^2 \ell}{\partial \theta^2}\right], differentiate \ell with respect to θ\theta. The score function is: θ=1θ+(xθ)θ2+(xθ)2θ3\frac{\partial \ell}{\partial \theta} = -\frac{1}{\theta} + \frac{(x-\theta)}{\theta^2} + \frac{(x-\theta)^2}{\theta^3} After computing the second derivative and taking the expectation (using E[(Xθ)2]=θ2E[(X-\theta)^2] = \theta^2 and E[(Xθ)]=0E[(X-\theta)] = 0), you obtain: I1(θ)=1θ2+2θ2=3θ2I_1(\theta) = \frac{1}{\theta^2} + \frac{2}{\theta^2} = \frac{3}{\theta^2} The "1" comes from the mean carrying information, and the "2" comes from the variance carrying information (standard result for a normal with only variance unknown). Together they sum to 3. For nn observations, In(θ)=3n/θ2I_n(\theta) = 3n/\theta^2, and the Cramér–Rao lower bound is 1/In(θ)=θ2/(3n)1/I_n(\theta) = \theta^2/(3n), confirming C. Choice A corresponds to ignoring both the mean's and variance's joint contribution — it matches a case where only a scale parameter is estimated with one unit of information. Choice B captures only the variance contribution (the "2"), forgetting the mean contributes an additional unit. Choice D overcounts, perhaps by doubling the variance term. Study tip: Whenever μ\mu and σ2\sigma^2 are tied to the same parameter, always differentiate the full log-likelihood — don't treat them separately. The information adds across both dependencies.

Question 6

For each of nn subjects, let XiBernoulli(p)X_i\sim\operatorname{Bernoulli}(p). Independently of XiX_i, an indicator RiBernoulli(q)R_i\sim\operatorname{Bernoulli}(q) determines whether XiX_i is observed; the value of every RiR_i is recorded, and qq is known. What is the expected Fisher information for pp in the observed data, and what scalar Cramér–Rao bound does it imply?

  1. I(p)=np(1p)I(p)=\frac{n}{p(1-p)} and the bound is p(1p)n\frac{p(1-p)}{n}
  2. I(p)=nqp(1p)I(p)=\frac{n}{q p(1-p)} and the bound is qp(1p)n\frac{q p(1-p)}{n}
  3. I(p)=nq2p(1p)I(p)=\frac{nq^2}{p(1-p)} and the bound is p(1p)nq2\frac{p(1-p)}{nq^2}
  4. I(p)=nqp(1p)I(p)=\frac{nq}{p(1-p)} and the bound is p(1p)nq\frac{p(1-p)}{nq} (correct answer)
Explanation: When you encounter missing data problems in Fisher information, the key is carefully identifying what your observed data actually consists of — not just the complete-case observations, but the full observed structure including the missingness indicators. Here, for each subject ii, you observe the pair (Ri,RiXi)(R_i, R_i X_i): you always see whether the subject responded, and you see XiX_i only when Ri=1R_i = 1. The log-likelihood contribution from subject ii comes from two cases. When Ri=0R_i = 0 (probability 1q1-q), you learn nothing about pp, contributing zero Fisher information. When Ri=1R_i = 1 (probability qq), you observe a Bernoulli(p)(p) draw, which contributes 1p(1p)\frac{1}{p(1-p)} to Fisher information — the standard single-observation Fisher information for a Bernoulli. Weighting by the probability of being observed, each subject contributes q1p(1p)q \cdot \frac{1}{p(1-p)}, and summing over nn independent subjects gives I(p)=nqp(1p)I(p) = \frac{nq}{p(1-p)}. The Cramér–Rao bound is the reciprocal: p(1p)nq\frac{p(1-p)}{nq}. This confirms D. Choice A ignores missingness entirely — it's the information you'd have with complete data, as if every subject were always observed. Choice B divides by qq instead of multiplying, which would imply more information under higher missingness — the exact opposite of reality. Choice C uses q2q^2, which has no statistical basis here; squaring qq would arise only under a very different data structure. The key study tip: always ask "what is the full observed data?" in missing-data problems. The missingness indicators themselves carry structure, and Fisher information must reflect the actual observation mechanism — never assume complete data unless the problem guarantees it.

Question 7

Let X1,,XnX_1,\ldots,X_n be independent N(θ,σ2)N(\theta,\sigma^2) observations, where σ2\sigma^2 is known. Consider the class of estimators TT satisfying Eθ(T)=ρθE_\theta(T)=\rho\theta for every θ\theta, where ρ\rho is a fixed constant. What lower bound on Eθ[(Tθ)2]E_\theta[(T-\theta)^2] follows from the biased Cramér–Rao inequality?

  1. σ2n+(ρ1)2θ2\frac{\sigma^2}{n}+(\rho-1)^2\theta^2
  2. ρ2σ2n+(ρ1)2θ2\frac{\rho^2\sigma^2}{n}+(\rho-1)^2\theta^2 (correct answer)
  3. (ρ1)2σ2n+ρ2θ2\frac{(\rho-1)^2\sigma^2}{n}+\rho^2\theta^2
  4. ρσ2n+ρ1θ2\frac{\rho\sigma^2}{n}+|\rho-1|\theta^2
Explanation: When you see a question invoking the Cramér–Rao lower bound for a biased estimator, your first move should be to recall the biased CRB formula: for an estimator with Eθ(T)=ψ(θ)E_\theta(T) = \psi(\theta), the MSE satisfies Eθ[(Tθ)2][ψ(θ)]2In(θ)+[ψ(θ)θ]2,E_\theta[(T-\theta)^2] \geq \frac{[\psi'(\theta)]^2}{I_n(\theta)} + [\psi(\theta)-\theta]^2, where the second term is the squared bias and the first term bounds the variance via the Fisher information. Here, ψ(θ)=ρθ\psi(\theta) = \rho\theta, so ψ(θ)=ρ\psi'(\theta) = \rho. For nn i.i.d. N(θ,σ2)N(\theta,\sigma^2) observations with known σ2\sigma^2, the total Fisher information is In(θ)=n/σ2I_n(\theta) = n/\sigma^2. The squared bias is (ρθθ)2=(ρ1)2θ2(\rho\theta - \theta)^2 = (\rho-1)^2\theta^2. Plugging in: Eθ[(Tθ)2]ρ2n/σ2+(ρ1)2θ2=ρ2σ2n+(ρ1)2θ2.E_\theta[(T-\theta)^2] \geq \frac{\rho^2}{n/\sigma^2} + (\rho-1)^2\theta^2 = \frac{\rho^2\sigma^2}{n} + (\rho-1)^2\theta^2. This confirms B is correct. Now for the distractors: A uses ρ2=1\rho^2 = 1 in the variance term, effectively ignoring the ρ\rho scaling from ψ(θ)\psi'(\theta) — a common error of treating the estimator as unbiased in the CRB numerator. C swaps the roles of ρ\rho and (ρ1)(\rho-1), placing (ρ1)2(\rho-1)^2 in the variance term and ρ2\rho^2 in the bias term — a clean reversal of the correct formula. D takes a square root of the bias term prematurely, writing ρ1θ2|\rho-1|\theta^2 instead of (ρ1)2θ2(\rho-1)^2\theta^2, and also drops the ρ2\rho^2 from the variance. Study tip: Always write out ψ(θ)\psi(\theta) and ψ(θ)\psi'(\theta) explicitly before applying the biased CRB — the derivative goes in the variance bound, and the function itself determines the bias term.

Question 8

In a regular scalar-parameter model, let U(X;θ)U(X;\theta) denote the full-data score and let T=T(X)T=T(X) be a statistic. At a specified parameter value, suppose Varθ[U(X;θ)]=10\operatorname{Var}_\theta[U(X;\theta)]=10 and Eθ{Varθ[U(X;θ)T]}=3E_\theta\{\operatorname{Var}_\theta[U(X;\theta)\mid T]\}=3. What is the Fisher information about θ\theta contained in the distribution of TT?

  1. 77, because the statistic's score is the conditional mean of the full score (correct answer)
  2. 33, because it is the average score variation remaining after conditioning
  3. 1010, because deterministic statistics preserve all full-sample information
  4. 1313, because conditional and marginal score variations must be added
Explanation: Whenever you see a question linking full-data Fisher information to a statistic's information, reach for the variance decomposition of the score. The law of total variance tells you that for any random variable and conditioning statistic: Var[U]=Var[E(UT)]+E[Var(UT)]\operatorname{Var}[U] = \operatorname{Var}[E(U \mid T)] + E[\operatorname{Var}(U \mid T)] The key insight is that the Fisher information in TT equals Varθ[Eθ(UT)]\operatorname{Var}_\theta[E_\theta(U \mid T)], because the score of the marginal likelihood for TT is precisely Eθ[U(X;θ)T]E_\theta[U(X;\theta) \mid T]. This is a fundamental result: conditioning the full score on a statistic yields that statistic's score. Plugging in the given values: Var[E(UT)]=Var[U]E[Var(UT)]=103=7\operatorname{Var}[E(U \mid T)] = \operatorname{Var}[U] - E[\operatorname{Var}(U \mid T)] = 10 - 3 = 7. So the Fisher information in TT is 7, confirming choice A is correct. Choice B (answer 3) confuses the two components — E[Var(UT)]=3E[\operatorname{Var}(U \mid T)] = 3 represents the within-TT score variation, which is the information lost by reducing to TT, not the information retained. Choice C (answer 10) would only be correct if TT were sufficient, preserving all information; a general statistic loses some. Choice D (answer 13) incorrectly adds the two variance components rather than recognizing they partition the total variance. Study tip: Memorize the identity IT(θ)=I(θ)E[Var(UT)]I_T(\theta) = I(\theta) - E[\operatorname{Var}(U \mid T)]. On exam questions about partial sufficiency or information loss, the "leftover" conditional variance is always the missing information, not the retained information.

Question 9

Suppose X1,,XnX_1,\ldots,X_n are independent Bernoulli random variables with success probability pp, where 0<p<10<p<1. An unbiased estimator is sought for the log-odds parameter g(p)=log{p/(1p)}g(p)=\log\{p/(1-p)\}. Assuming the regular scalar Cramér–Rao inequality applies, what is the resulting lower bound on its variance?

  1. p(1p)n\frac{p(1-p)}{n}
  2. 1np(1p)\frac{1}{n p(1-p)} (correct answer)
  3. 1n[p(1p)]2\frac{1}{n[p(1-p)]^2}
  4. [12p]2np(1p)\frac{[1-2p]^2}{n p(1-p)}
Explanation: Whenever you see a question asking for a Cramér–Rao lower bound (CRLB) on an estimator of a transformed parameter, your strategy is clear: compute the Fisher information for the original model, then apply the delta method to adjust for the transformation. For XiBernoulli(p)X_i \sim \text{Bernoulli}(p), the Fisher information in a single observation is I1(p)=1p(1p)I_1(p) = \frac{1}{p(1-p)}, so for nn independent observations, In(p)=np(1p)I_n(p) = \frac{n}{p(1-p)}. The CRLB for estimating g(p)g(p) is: CRLB=[g(p)]2In(p)\text{CRLB} = \frac{[g'(p)]^2}{I_n(p)} Now compute the derivative of g(p)=log ⁣(p1p)g(p) = \log\!\left(\frac{p}{1-p}\right). Using the chain rule: g(p)=1p+11p=1p(1p)g'(p) = \frac{1}{p} + \frac{1}{1-p} = \frac{1}{p(1-p)} Plugging in: CRLB=[1p(1p)]2np(1p)=1[p(1p)]2p(1p)n=1np(1p)\text{CRLB} = \frac{\left[\frac{1}{p(1-p)}\right]^2}{\frac{n}{p(1-p)}} = \frac{1}{[p(1-p)]^2} \cdot \frac{p(1-p)}{n} = \frac{1}{n\, p(1-p)} This confirms B is correct. Now for the distractors: A, p(1p)n\frac{p(1-p)}{n}, is the CRLB for estimating pp itself (where g(p)=1g'(p)=1), completely ignoring the log-odds transformation. C, 1n[p(1p)]2\frac{1}{n[p(1-p)]^2}, uses [g(p)]2[g'(p)]^2 in the numerator but forgets to divide by Fisher information correctly — it omits cancellation of one power of p(1p)p(1-p). D, (12p)2np(1p)\frac{(1-2p)^2}{np(1-p)}, uses the derivative of p(1p)p(1-p) rather than log{p/(1p)}\log\{p/(1-p)\}, a classic mix-up between transformations. Your study tip: always differentiate g(p)g(p) carefully before applying the CRLB formula — most distractors on this type of question exploit an incorrect g(p)g'(p).

Question 10

An experiment compares two independent treatment means. Each response in treatment 1 is N(μ1,1)N(\mu_1,1), and each response in treatment 2 is N(μ2,4)N(\mu_2,4). With a fixed total of NN observations, let n1+n2=Nn_1+n_2=N and suppose both sample sizes may be treated as continuous for design purposes. Which allocation minimizes the Cramér–Rao bound for unbiased estimation of μ1μ2\mu_1-\mu_2, and what is the minimized bound?

  1. n1:n2=1:2n_1:n_2=1:2, with minimized bound 9/N9/N (correct answer)
  2. n1:n2=1:1n_1:n_2=1:1, with minimized bound 10/N10/N
  3. n1:n2=1:4n_1:n_2=1:4, with minimized bound 10/N10/N
  4. n1:n2=1:3n_1:n_2=1:3, with minimized bound 16/N16/N
Explanation: When comparing two independent normal means with unequal variances, the Cramér–Rao bound for any unbiased estimator of μ1μ2\mu_1 - \mu_2 equals the variance of the best linear unbiased estimator, which is σ12n1+σ22n2\frac{\sigma_1^2}{n_1} + \frac{\sigma_2^2}{n_2}. Here σ12=1\sigma_1^2 = 1 and σ22=4\sigma_2^2 = 4, so you want to minimize f(n1)=1n1+4Nn1f(n_1) = \frac{1}{n_1} + \frac{4}{N - n_1} subject to n1+n2=Nn_1 + n_2 = N. Taking the derivative and setting it to zero: 1n12+4(Nn1)2=0-\frac{1}{n_1^2} + \frac{4}{(N-n_1)^2} = 0, which gives n2/n1=2n_2/n_1 = 2, or n1:n2=1:2n_1:n_2 = 1:2. This confirms answer A is correct. With n1=N/3n_1 = N/3 and n2=2N/3n_2 = 2N/3, the minimized bound is 1N/3+42N/3=3N+6N=9N\frac{1}{N/3} + \frac{4}{2N/3} = \frac{3}{N} + \frac{6}{N} = \frac{9}{N}. The key insight is that the optimal allocation is proportional to the standard deviations, not the variances: niσin_i \propto \sigma_i, so n1:n2=1:2n_1:n_2 = 1:2. B uses equal allocation (1:1), which gives 5N/2+5N/2\frac{5}{N/2} + \frac{5}{N/2} — wait, more precisely 2N+8N=10N\frac{2}{N} + \frac{8}{N} = \frac{10}{N}, which is suboptimal. C uses ratio 1:4 (proportional to variances, a common trap), yielding 5N+5N=10N\frac{5}{N} + \frac{5}{N} = \frac{10}{N}, also suboptimal. D uses 1:3, giving 4N+6N=10N\frac{4}{N} + \frac{6}{N} = \frac{10}{N} — not 16/N16/N as stated, making it doubly wrong. Remember: optimal allocation in unequal-variance designs scales with σi\sigma_i, not σi2\sigma_i^2. Confusing standard deviations with variances is the most common trap on design-of-experiments questions like this.