Biased & Unbiased
Point Estimates
Learn how sample statistics estimate population parameters, and discover when an estimator hits the target on average versus when it systematically misses.
What is a Point Estimate?
A point estimate is a single value computed from sample data that serves as our best guess for an unknown population parameter. We use a statistic (from the sample) to estimate a parameter (of the population).
Parameters vs Statistics
| Parameter | Statistic | |
|---|---|---|
| Source | Population | Sample |
| Nature | Fixed (unknown) | Varies by sample |
| Mean | \(\mu\) | \(\bar{x}\) |
| Proportion | \(p\) | \(\hat{p}\) |
| Std Dev | \(\sigma\) | \(s\) |
| Notation | Greek letters | Latin letters / hats |
Why Do Point Estimates Matter?
In the real world, we almost never have access to the entire population. Instead, we draw a sample and use it to make inferences. The quality of our inference depends on whether our estimator is reliable and accurate.
The Unbiased Estimator
An estimator \(\hat{\theta}\) is unbiased for a parameter \(\theta\) if the mean of its sampling distribution equals the parameter:
This means that if we repeated our sampling process infinitely many times, the average of all our estimates would equal the true parameter. Any single estimate might be too high or too low, but on average we hit the target.
The Biased Estimator
An estimator is biased if its expected value does not equal the parameter it estimates:
A biased estimator systematically overestimates or underestimates the true parameter, no matter how many samples you take.
Visualizing Bias vs Unbiased
Bessel's Correction: Why \(n-1\)?
When computing sample variance, dividing by \(n\) produces a biased estimator that underestimates \(\sigma^2\). Dividing by \(n-1\) corrects this:
Bias vs Variability
Bias and variability are two different problems with estimators. A good estimator should have low bias and low variability.
Common Unbiased Estimators
How to Check for Bias
Example 1: Sample Mean
A researcher measures the heights of 25 randomly selected students and gets \(\bar{x} = 67.3\) inches. The true mean height of all students is \(\mu\).
Example 2: Sample Proportion
In a poll of 500 voters, 280 say they support Candidate A. What is the point estimate of the true proportion \(p\) who support Candidate A?
Example 3: Biased Variance Estimator
Suppose we have \(n = 5\) data points and we compute variance using \(\frac{1}{n}\) instead of \(\frac{1}{n-1}\). How large is the bias?
Common Mistakes
Summary of Key Estimators
| Estimator | Target Parameter | Unbiased? |
|---|---|---|
| \(\bar{x}\) | \(\mu\) | ✓ Yes |
| \(\hat{p}\) | \(p\) | ✓ Yes |
| \(s^2\) with \(n-1\) | \(\sigma^2\) | ✓ Yes |
| \(\tilde{s}^2\) with \(n\) | \(\sigma^2\) | ✕ No (underestimates) |
| \(s\) | \(\sigma\) | ✕ No (slightly biased) |
| \(b_1\) (regression slope) | \(\beta_1\) | ✓ Yes |
Question 1 of 5
An estimator \(\hat{\theta}\) is unbiased if:
Question 2 of 5
Which of the following is a biased estimator of its corresponding parameter?
Question 3 of 5
A sample of \(n = 10\) observations is used to compute variance with \(\frac{1}{n}\). The expected value of this estimator equals:
Question 4 of 5
In a survey, 120 out of 400 respondents prefer Brand X. The point estimate of the true proportion \(p\) who prefer Brand X is:
Question 5 of 5
If an estimator has low bias but high variability, what does this mean?