Historical Context & Motivation
The systematic study of how data values cluster, spread, and deviate from typical patterns has roots stretching back to the earliest days of probability theory. Before researchers could test hypotheses or build regression models, they first needed a language for describing what a batch of numbers actually looked like — whether the values massed symmetrically around a center, trailed off in one direction, or contained anomalous observations that seemed to belong to an entirely different population. In the biomedical sciences, this descriptive step is not merely preliminary: the shape of a distribution determines which inferential tools are valid, while the presence of outliers can inflate error rates, bias parameter estimates, and even reverse the direction of an apparent effect.
The central question this lesson addresses is deceptively simple: given a set of biomedical measurements — blood-glucose levels, hospital length-of-stay data, gene expression counts — how do we characterize the shape of the distribution, and how do we decide whether extreme observations are genuine outliers that warrant special treatment? Mastering this skill is prerequisite to virtually every inferential procedure you will encounter in biostatistics.
Core Principles & Definitions
Distribution shape and outlier identification rest on a small number of foundational concepts. Understanding these ideas provides the vocabulary and conceptual framework for everything that follows, from choosing the right summary statistics to selecting an appropriate hypothesis test.
Symmetry vs. Skewness
Kurtosis & Tail Weight
Modality
Outliers
The Normal Benchmark
Visual Explanation — Distribution Shapes
The most immediate way to assess distribution shape is through graphical displays. Histograms, density plots, and Q-Q plots each reveal different aspects of the data's geometry. The following diagram illustrates the three canonical distribution shapes — left-skewed, symmetric, and right-skewed — alongside markers indicating where the mean and median fall relative to one another.
Notice the relationship between the mean and median in each panel. Because the mean is sensitive to extreme values while the median is not, a large gap between the two statistics is itself a diagnostic indicator of skewness. In biomedical data, right-skewed distributions are extremely common — hospital length-of-stay, serum biomarker concentrations, and health-care costs all tend to have a mass of typical values near the left with a long tail of rare, high values stretching to the right. Left-skewed distributions, while less frequent, appear in contexts such as age-at-onset data for diseases that primarily affect older adults.
Mathematical Framework
While visual inspection is the first step, quantifying distribution shape and identifying outliers formally requires a small set of summary statistics and decision rules. We begin with the moment-based measures of skewness and kurtosis, then introduce the interquartile-range (IQR) rule that underpins Tukey's boxplot method for flagging outliers.
Detailed Breakdown — Outlier Detection with Box Plots
The box-and-whisker plot, introduced by John Tukey in 1977, remains the single most effective visual tool for simultaneously displaying distribution shape and flagging outliers. The box spans the interquartile range from Q₁ to Q₃, a horizontal line marks the median, and the whiskers extend to the most extreme data points that fall within the fences. Any point beyond the whiskers is plotted individually and considered a potential outlier. The following diagram shows a box plot for a hypothetical dataset of serum C-reactive protein (CRP) concentrations measured in a clinical cohort.
Several additional features of this box plot are worth noting. First, the median is positioned closer to Q₁ than to Q₃, which visually confirms the right skew already suggested by the skewness coefficient. Second, the upper whisker is considerably longer than the lower whisker, reinforcing the presence of a stretched right tail. Third, the two points at 20.0 and 22.0 mg/L are plotted as individual circles beyond the upper fence, identifying them as potential outliers that warrant clinical investigation — perhaps these patients had acute infections or underlying inflammatory conditions that elevated CRP well beyond the cohort norm.
Worked Example — Assessing Shape & Outliers in Clinical Data
Consider the following dataset of fasting blood-glucose levels (mg/dL) measured in 15 adult participants enrolled in a diabetes-screening study: 78, 82, 85, 88, 89, 91, 93, 95, 97, 100, 103, 108, 115, 142, 210. We wish to determine the distribution shape, compute skewness, and identify any outliers using Tukey's IQR rule.
Strengths, Limitations & Comparisons of Shape-Assessment Methods
No single technique for assessing distribution shape or identifying outliers is universally superior. Each method has tradeoffs in terms of robustness, sensitivity, and the assumptions it requires. The table below compares the most commonly used approaches in biostatistical practice.
| Method | Strengths | Limitations |
|---|---|---|
| Histogram | Shows full shape, modality, and gaps; intuitive for all audiences | Sensitive to bin width choice; appearance can change dramatically with different binning |
| Box Plot (Tukey) | Robust outlier flagging via IQR; compact comparison across groups; invariant to bin choice | Cannot reveal bimodality or other fine-grained distributional features |
| Q-Q Plot | Directly compares empirical quantiles to a theoretical distribution; sensitive to tail deviations | Requires familiarity with interpretation; less intuitive for non-statisticians |
| Skewness / Kurtosis | Provides a single numeric summary; easily incorporated into automated screening pipelines | Sensitive to outliers themselves; sample skewness can be misleading in small samples (n < 30) |
| Z-Score Rule | Straightforward calculation; relates directly to standard deviations from the mean | Assumes approximate normality; prone to masking effect in small or contaminated samples |
Connections to Formal Normality Tests & Robust Statistics
The descriptive techniques covered so far — visual inspection, skewness, kurtosis, and IQR-based outlier rules — provide the groundwork for more formal approaches. Once you progress to inferential biostatistics, you will encounter formal normality tests that convert shape information into a hypothesis-testing framework, as well as robust statistical methods that accommodate non-normal distributions and outliers by design rather than by post-hoc correction.
| Descriptive Approach (This Lesson) | Advanced Extension |
|---|---|
| Visual inspection via histogram / Q-Q plot | Shapiro-Wilk test, Kolmogorov-Smirnov test, Anderson-Darling test — formal hypothesis tests for normality |
| Sample skewness and kurtosis coefficients | D'Agostino-Pearson omnibus test — combines skewness and kurtosis into a single chi-squared statistic |
| IQR-based outlier flagging (Tukey fences) | Grubbs' test, Dixon's Q-test, Rosner's test — formal tests for single or multiple outliers |
| Reporting mean ± SD for symmetric data | M-estimators, trimmed means, Winsorized means — robust location estimators less influenced by outliers |
| Choosing parametric vs. nonparametric tests by shape | Generalized linear models (GLMs) — directly model non-normal response distributions (e.g., Poisson, gamma) |
As you advance in biostatistics, you will find that distribution shape assessment never truly goes away — it simply becomes embedded in more sophisticated frameworks. Generalized linear models, for instance, allow you to specify a non-normal error distribution (Poisson for counts, gamma for right-skewed continuous outcomes) rather than forcing a normality assumption. Bayesian methods incorporate prior distributions whose shapes must also be evaluated. In every case, the intuition you develop here — reading histograms, interpreting skewness, recognizing when outliers distort summary statistics — will remain the foundation upon which more advanced analyses rest.
Practice Problems
Lesson Summary
Characterizing distribution shape involves assessing three properties: symmetry vs. skewness (whether the tails are balanced or one extends farther), kurtosis (the heaviness of the tails relative to the normal distribution), and modality (the number of distinct peaks). The relationship between the mean and median provides a quick diagnostic: when the mean exceeds the median, the distribution is right-skewed; when the mean falls below the median, it is left-skewed; and when they coincide, the distribution is approximately symmetric.
Outliers are observations that lie far from the bulk of the data and can be detected visually through box plots or numerically via the IQR fence rule (Q₁ − 1.5 × IQR, Q₃ + 1.5 × IQR) or the z-score method (|z| > 3). The IQR approach is preferred for skewed data because it is robust to the very outliers it seeks to detect. In biostatistics, the decision to retain, transform, or exclude an outlier must always be guided by domain knowledge, transparent documentation, and sensitivity analysis — never by the desire to achieve a convenient statistical result.