Source Evaluation — Conduct basic source evaluation and credibility assessment

Historical Context & Motivation

The practice of systematically evaluating sources has deep roots in the development of modern scholarship. Long before the emergence of political science as a distinct discipline, historians and philosophers grappled with the question of how to distinguish reliable accounts from fabrication, propaganda, or mere rumor. The challenge of source evaluation — the disciplined assessment of a source's credibility, accuracy, and potential biases — became especially pressing as the volume of available information expanded with the printing press, mass media, and eventually the internet. For political scientists, whose research frequently depends on government documents, polling data, journalistic reports, and partisan publications, the ability to evaluate sources rigorously is not merely an academic skill but a methodological necessity.

The evolution of source criticism reflects broader intellectual shifts in how scholars understand knowledge production. From Renaissance humanism through the Enlightenment and into the twentieth-century professionalization of political science, each era introduced new frameworks and new challenges for determining what counts as credible evidence. Understanding this history helps contextualize why contemporary researchers deploy specific evaluative criteria and why the stakes of source evaluation have intensified in the current information environment.

This historical trajectory reveals a persistent tension: as the tools for producing and disseminating information have grown more powerful, so too have the techniques required to assess that information critically. The central question that source evaluation addresses remains remarkably consistent across centuries — how can we determine whether a particular piece of evidence is trustworthy enough to support scholarly claims? The frameworks explored in the following sections provide a structured answer to this enduring question.

Core Principles of Source Evaluation

Effective source evaluation in political science rests on a set of interconnected principles that together form a comprehensive assessment framework. While various mnemonic devices exist — the CRAAP test (Currency, Relevance, Authority, Accuracy, Purpose) developed at California State University, Chico, being among the most widely taught — the underlying logic can be distilled into core evaluative dimensions. These principles apply whether you are examining a peer-reviewed journal article, a government white paper, a think tank report, or a dataset from an international organization.

Visual Framework: The Source Evaluation Hierarchy

Understanding the relative reliability of different source types is essential for building a defensible research foundation. The following diagram presents a source credibility hierarchy commonly used in political science research methods. This hierarchy is not absolute — a well-researched investigative journalism piece may contain more reliable information than a poorly executed peer-reviewed study — but it provides a useful default framework for prioritizing sources during the literature review process.

This hierarchy serves as a starting heuristic rather than a rigid rule. A Tier 3 source — such as a Brookings Institution policy brief authored by a leading expert — might carry more weight in a particular research context than a Tier 1 peer-reviewed article published in a low-impact journal with questionable methodology. The key insight is that source type establishes a baseline expectation of credibility, but the individual assessment criteria from the CRAAP framework must still be applied to each source. Researchers should aim to anchor their arguments primarily in Tiers 1 and 2, drawing on lower tiers for context, illustration, or data that higher-tier sources have not yet addressed.

How Source Evaluation Works: The CRAAP Framework in Depth

The CRAAP test provides a structured, repeatable protocol for evaluating any source you encounter during research. Each of its five dimensions — Currency, Relevance, Authority, Accuracy, and Purpose — addresses a distinct threat to credibility. Applied together, they form a multi-dimensional assessment that moves beyond gut instinct toward disciplined judgment. While no quantitative scoring system is universally standardized, many researchers find it useful to assign a simple rating (e.g., strong, acceptable, weak) to each dimension and then synthesize an overall credibility assessment.

Currency

Currency asks when the source was published or last updated and whether that timing matters for your research question. In political science, currency requirements vary dramatically by subfield. A study of the 2020 U.S. presidential election demands sources from the last few years, while a comparative analysis of Cold War alliance structures might reasonably cite foundational works from the 1960s and 1970s. The critical question is whether the source reflects the most current state of knowledge, data, or events relevant to your inquiry. Even seminal theoretical works should be supplemented by recent scholarship that tests, refines, or critiques their claims.

Relevance

Relevance concerns the fit between the source and your specific research question. A highly credible source that addresses a tangential topic adds little to your argument. Evaluating relevance requires clarity about your own research parameters: What is your dependent variable? What geographic and temporal scope have you defined? What theoretical tradition are you working within? Sources should speak directly to your variables, cases, or theoretical framework. In practice, relevance filtering often occurs during the literature search phase, but it remains important to reassess relevance as your argument develops and narrows.

Authority

Authority examines who created the source and whether they possess the expertise to make credible claims on the subject. In academic contexts, authority is typically established through advanced degrees, institutional affiliation, publication record, and citation counts. For non-academic sources, authority might derive from professional experience, organizational mandate, or proximity to the events being analyzed. It is important to distinguish between domain-specific authority and general celebrity or media presence; a Nobel laureate in physics does not automatically possess authority on questions of constitutional law.

Accuracy

Accuracy evaluates whether the source's claims are supported by evidence, logically consistent, and verifiable. Key indicators include proper citation of data sources, transparent methodology, internal logical coherence, and consistency with findings from other credible sources. Obvious factual errors, unsupported generalizations, or the absence of citations are significant red flags. In quantitative political science, accuracy extends to the technical soundness of statistical analyses — whether appropriate models were used, whether assumptions were tested, and whether results are replicable.

Purpose

Purpose asks why the source exists. Is it designed to inform, persuade, entertain, sell, or advocate? Sources produced to advance a political agenda or organizational interest are not necessarily unusable, but their persuasive intent must be recognized and accounted for. A Heritage Foundation report and a Center for American Progress report may address the same policy question but from different ideological starting points; a rigorous researcher acknowledges these orientations, cross-references their claims, and avoids relying on either as an unbiased arbiter. Understanding purpose also helps researchers identify conflicts of interest — financial, political, or institutional — that might shape a source's conclusions.

Classifying Source Types in Political Science Research

Political scientists work with a remarkably diverse range of source materials, and the evaluative criteria shift depending on the type of source under examination. A foundational distinction in research methods is between primary sources — original documents, datasets, or firsthand accounts — and secondary sources — scholarly analyses, interpretations, and syntheses of primary material. Beyond this binary, political scientists also utilize tertiary sources such as encyclopedias and textbooks for background information, though these rarely serve as primary evidence in advanced research.

Worked Example: Evaluating a Source Using CRAAP

Let us walk through a complete source evaluation using the CRAAP framework. Imagine you are writing a research paper on the effects of voter identification laws on voter turnout in the United States, and you encounter the following source during your literature search:

Strengths and Limitations of Evaluation Frameworks

No evaluation framework is perfect, and understanding the strengths and limitations of the tools available helps researchers apply them more judiciously. The CRAAP test, lateral reading strategies, and source hierarchy models each bring different advantages and blind spots to the evaluation process. Recognizing these trade-offs is itself a marker of methodological sophistication.

Connection to Advanced Research Design

Basic source evaluation is a foundational skill, but it connects directly to more advanced methodological concerns that you will encounter as you progress in political science research. Concepts like systematic literature reviews, meta-analysis, and research design transparency all build upon the evaluative principles discussed in this lesson. Understanding these connections prepares you for the transition from evaluating individual sources to constructing rigorous, defensible research designs of your own.

The skills you are developing now — questioning authority, scrutinizing methodology, identifying bias, and triangulating across sources — are not merely preliminary exercises. They are the cognitive habits that undergird every stage of advanced research, from formulating a research question through defending a dissertation. As the replication crisis in the social sciences has demonstrated, even established scholars can produce flawed findings when evaluative rigor falters. The discipline's growing emphasis on transparency, open data, and pre-registration represents an institutional response to the same fundamental problem that source evaluation addresses at the individual level: how do we ensure that the evidence supporting our claims is actually reliable?

Practice Problems

Lesson Summary