Historical Context & Motivation
The evolution of statistical methods is deeply intertwined with the growth of the behavioral and social sciences. Early researchers in psychology and public health recognized that raw observations alone—case studies, anecdotal reports, and unstructured clinical impressions—were insufficient for drawing reliable conclusions about human behavior and mental health outcomes. The challenge was twofold: first, how to organize and summarize large bodies of data in meaningful ways, and second, how to generalize findings from small samples to broader populations. This dual need gave rise to the two great branches of statistics—descriptive and inferential—and the subsequent distinction between parametric and nonparametric approaches emerged as researchers confronted the reality that not all data conform to the neat assumptions of classical probability theory.
The central question that this lesson addresses is one that every behavioral health practitioner and researcher must answer repeatedly: Given a particular research question, data type, and set of assumptions, which statistical method is appropriate? Choosing incorrectly can lead to invalid conclusions, Type I or Type II errors, and ultimately, clinical decisions that fail to serve clients. By understanding the distinctions among descriptive, inferential, parametric, and nonparametric statistics, you will be equipped to evaluate the quality of published research and to select appropriate analytic strategies in your own work.
Core Principles & Definitions
Statistical methods can be classified along two independent dimensions. The first dimension concerns purpose—whether the goal is to describe the data at hand or to make inferences beyond them. The second dimension concerns assumptions—whether the method requires that data follow a specific probability distribution (parametric) or makes no such requirement (nonparametric). Understanding these two dimensions as independent axes is crucial because they combine to produce four categories, each with distinct applications in behavioral health research.
Descriptive Statistics
Inferential Statistics
Parametric Statistics
Nonparametric Statistics
Visual Explanation — The Statistical Decision Framework
The flowchart above captures the essential logic of statistical method selection that you will encounter repeatedly on the EPPP and in clinical research. Notice that the descriptive–inferential distinction is about purpose (are you summarizing or generalizing?), whereas the parametric–nonparametric distinction is about assumptions and data characteristics (does your data meet the requirements of classical probability models?). A common error among students is to conflate these two dimensions—for instance, treating 'descriptive' as synonymous with 'nonparametric.' In reality, descriptive statistics precede any inferential analysis and are applied regardless of whether a parametric or nonparametric test will follow.
Mathematical Framework — Key Formulas Across Categories
While the EPPP does not require extensive hand computation, understanding the formulas underlying each category clarifies what each statistic actually measures and why certain assumptions matter. Below are representative formulas from each category, with annotations explaining the behavioral health relevance of each.
Descriptive Statistics
Parametric Inferential Statistics
Nonparametric Inferential Statistics
Detailed Classification — Matching Tests to Research Scenarios
A critical skill for the EPPP is the ability to match specific statistical tests to the research scenarios that call for them. The classification below organizes the most commonly tested parametric and nonparametric methods by the number of groups being compared and the level of measurement of the dependent variable. For each parametric test, there is typically a nonparametric equivalent that serves a similar purpose but relaxes distributional assumptions.
When deciding between a parametric test and its nonparametric counterpart, the primary consideration is whether the assumptions of the parametric test are met. In behavioral health research, these assumptions are frequently violated—clinical outcome measures may be skewed (e.g., symptom severity scores that cluster near zero in a well-functioning population), samples may be small (e.g., rare diagnoses), and data may be ordinal rather than truly interval-level (e.g., Likert-scale ratings). In such circumstances, nonparametric tests provide valid alternatives, though they generally offer less statistical power—meaning they are less likely to detect a true effect when one exists.
Worked Example — Selecting the Appropriate Test
Consider the following scenario, which represents a typical EPPP-style question: A clinical psychologist wants to compare depression scores (measured by the BDI-II, a continuous scale) between a CBT group and a psychodynamic therapy group. Each group has 15 participants, and preliminary analysis suggests the depression scores in the psychodynamic group are substantially skewed. Which statistical test should be used?
Strengths, Limitations, and Common Pitfalls
| Category | Strengths | Limitations |
|---|---|---|
| Descriptive Statistics | Easy to compute and interpret; always applicable; provide essential data summaries; foundation for all subsequent analysis | Cannot test hypotheses or establish significance; can be misleading without context (e.g., mean of a bimodal distribution); do not support causal inference |
| Inferential Statistics (general) | Allow generalization from sample to population; provide probabilistic framework for hypothesis testing; support evidence-based clinical decisions | Susceptible to Type I and Type II errors; conclusions depend on sampling quality; require careful assumption checking |
| Parametric Tests | Greater statistical power when assumptions are met; more precise parameter estimates; wide range of complex models available (e.g., factorial ANOVA, multiple regression) | Require normality, interval/ratio data, and homogeneity of variance; results can be unreliable when assumptions are violated, particularly with small samples |
| Nonparametric Tests | No distributional assumptions; can handle ordinal and nominal data; robust to outliers; appropriate for small samples and skewed distributions | Lower statistical power than parametric equivalents when assumptions are actually met; fewer complex modeling options; may discard information by converting scores to ranks |
Connection to Advanced Theory — Effect Sizes, Power, and Modern Approaches
While the EPPP primarily tests your ability to distinguish among the four categories and select appropriate tests, it is also important to understand how these categories connect to broader statistical concepts. Contemporary behavioral health research increasingly emphasizes effect sizes (e.g., Cohen's d, eta-squared, odds ratios) alongside p-values, recognizing that statistical significance does not equate to clinical significance. Similarly, statistical power analysis has become a standard component of research design, requiring investigators to estimate necessary sample sizes before data collection. Understanding parametric vs. nonparametric distinctions feeds directly into power considerations, since nonparametric tests typically require larger samples to achieve the same power as their parametric counterparts.
| Concept | Basic Level (This Lesson) | Advanced Extension |
|---|---|---|
| Descriptive → Exploratory Data Analysis | Mean, SD, frequency tables | Boxplots, stem-and-leaf, kernel density estimation; identifying distributional shape before choosing inferential tests |
| Inferential → Bayesian Statistics | Null hypothesis significance testing (NHST) using p-values | Bayesian inference provides posterior probabilities rather than p-values; growing adoption in clinical trials and meta-analysis |
| Parametric → Generalized Linear Models | t-test, ANOVA, Pearson r as standalone tests | All parametric tests are special cases of the General Linear Model (GLM); logistic regression extends to binary outcomes |
| Nonparametric → Bootstrap Methods | Rank-based tests (Mann-Whitney, Kruskal-Wallis) | Bootstrap and permutation tests use resampling to build empirical sampling distributions without any parametric assumptions |
As you advance in your career, you will encounter sophisticated modeling techniques—multilevel models, structural equation modeling, and machine learning approaches—that blur the traditional parametric/nonparametric boundary. However, the foundational distinctions taught in this lesson remain essential for critically evaluating the vast majority of behavioral health literature and for answering EPPP items correctly. Mastery of when and why to apply each category is a prerequisite for understanding these more complex methods.
Practice Problems
Lesson Summary
Statistical methods in behavioral health research are organized along two independent dimensions. The first—descriptive versus inferential—distinguishes methods that summarize data (mean, median, standard deviation, frequency distributions) from those that generalize from samples to populations (hypothesis tests, confidence intervals). The second dimension—parametric versus nonparametric—classifies inferential methods by their assumptions. Parametric tests (t-test, ANOVA, Pearson r) assume normal distributions, interval/ratio data, and homogeneity of variance; nonparametric tests (Mann-Whitney U, Kruskal-Wallis H, chi-square, Spearman ρ) make no distributional assumptions and can handle ordinal or nominal data.
For the EPPP, the essential skills are: (1) recognizing which category a given test belongs to, (2) selecting the appropriate test based on research question, level of measurement, and assumption satisfaction, (3) understanding the trade-off between statistical power (favoring parametric when assumptions are met) and robustness (favoring nonparametric when assumptions are violated), and (4) pairing each parametric test with its nonparametric equivalent (e.g., independent t-test ↔ Mann-Whitney U; one-way ANOVA ↔ Kruskal-Wallis H; Pearson r ↔ Spearman ρ). Descriptive statistics always come first, providing the foundation on which inferential analyses are built.