- A person believes that they always have bad luck on Friday the 13th. They vividly remember spilling coffee on their shirt and missing a bus on a past Friday the 13th, but they do not take note of the many Friday the 13ths that have passed without incident. This person's belief is most likely being maintained by:
Answer: an illusory correlation.
An illusory correlation is the perception of a relationship between two variables when none actually exists. This cognitive bias is often fueled by confirmation bias, where we pay special attention to and remember instances that confirm our beliefs (bad luck on Friday the 13th) while ignoring disconfirming evidence (uneventful Friday the 13ths). This perfectly describes the scenario. The third variable problem (A) and negative correlation (B) are statistical concepts not relevant here, and the Hawthorne effect (D) relates to being observed.
- A researcher surveys people on diet and wellness. One question asks for the number of vegetable servings consumed daily, and another asks for a self-rating of overall health. The researcher finds a positive correlation but is concerned that more health-conscious individuals might be more likely to both eat vegetables and report being healthy. This concern exemplifies the ____. A separate concern, that people might overstate their vegetable intake to sound healthy, exemplifies the ____.
Answer: third variable problem; social desirability bias
When evaluating correlational research, you need to distinguish between different types of validity threats that can compromise your ability to draw meaningful conclusions from the data.
The first concern describes a third variable problem - when an unmeasured variable (health consciousness) might be causing both measured variables (vegetable consumption and health ratings) to correlate. Health-conscious people naturally both eat more vegetables AND rate themselves as healthier, creating a spurious correlation that doesn't reflect a direct causal relationship between vegetables and health.
The second concern illustrates social desirability bias - when participants alter their responses to appear more favorable or socially acceptable. People might inflate their vegetable intake because they know it's "the right answer" for healthy living.
Looking at the wrong answers: Choice B incorrectly identifies the first issue as a directionality problem, which would involve uncertainty about whether vegetables cause health or health causes vegetable consumption - not the issue here. Choice C reverses the concepts entirely. Choice D introduces sampling bias (problems with who's selected for the study) and observer bias (researcher influence on data collection), neither of which matches the described concerns.
Study tip: Remember that third variable problems involve hidden causes affecting both measured variables, while social desirability bias involves participants consciously or unconsciously modifying responses to look good. In correlational studies, always ask yourself: "What else could explain this relationship?" and "Might people be answering dishonestly?"
- A university is surveying students about academic integrity. One question asks, "Have you ever engaged in plagiarism or other forms of academic dishonesty during your time at this university?" The survey is administered anonymously online. Despite the guarantee of anonymity, the administration is concerned that the results might still underestimate the true prevalence of academic dishonesty. This concern is most directly related to the potential for:
Answer: social desirability bias influencing student responses.
Social desirability bias is the tendency for respondents to answer questions in a manner that will be viewed favorably by others, even if the survey is anonymous. Students may be hesitant to admit to undesirable behaviors like plagiarism, even with no personal consequences, because it conflicts with their self-image or societal norms. This would lead to an underestimation of the behavior. Wording effects (A) are not the primary issue with this straightforward question. Sampling bias (C) is a different problem related to who takes the survey, not how they answer. Observer bias (D) is irrelevant as there are no observers.
- A researcher calculates the Pearson correlation coefficient between two variables, X and Y, and obtains a value of r=+1.20. What is the most appropriate interpretation of this result?
Answer: A calculation error has occurred, as the correlation coefficient must be between –1.00 and +1.00.
When you encounter correlation coefficient questions, remember that the Pearson correlation coefficient (r) has strict mathematical boundaries that cannot be violated. This statistic measures the strength and direction of linear relationships between two variables, and it is mathematically constrained to fall between -1.00 and +1.00, inclusive.
A correlation of r=+1.20 is mathematically impossible. The correlation coefficient is derived from standardized values (z-scores), and the formula ensures that the result cannot exceed these bounds. An r-value of +1.00 represents a perfect positive linear relationship, while -1.00 represents a perfect negative linear relationship. No correlation can be "more perfect" than perfect, making any value outside this range invalid.
Looking at the incorrect options: Answer A assumes the result is valid and incorrectly implies causation, but correlation never establishes causation regardless of strength. Answer B also treats the impossible value as legitimate, suggesting a perfect relationship exists. Answer C attempts to explain the invalid result through curvilinearity, but curvilinear relationships typically reduce correlation coefficients rather than inflate them beyond possible bounds, and regardless, no computational error could produce values outside the theoretical limits.
Answer D correctly identifies that a calculation error must have occurred, since correlation coefficients are mathematically bound between -1.00 and +1.00.
Study tip: Always check whether statistical values fall within their possible ranges. If you see correlation coefficients outside -1.00 to +1.00, or percentages outside 0% to 100%, immediately consider calculation error as the explanation. - A researcher studies the relationship between parenting style and child aggression. They measure both variables in families when children are age 6 and again at age 8. They find that authoritarian parenting at age 6 significantly predicts child aggression at age 8, but child aggression at age 6 does not significantly predict authoritarian parenting at age 8. This pattern of results from a cross-lagged panel design provides the strongest evidence against which specific interpretational issue?
Answer: The directionality problem
A cross-lagged panel design is a specific type of longitudinal correlational study used to explore the direction of causality between two variables. By testing the predictive power of each variable on the other over time, it can help untangle the directionality problem. In this case, the results suggest that the influence runs from parenting to aggression, and not the other way around. This design cannot rule out the third variable problem (A), as another variable could be causing both parenting style and aggression over time. C and D are measurement issues, not the primary interpretational issue addressed by this specific research design.
- A developmental psychologist finds a significant positive correlation between the number of books in a child's home and their vocabulary size. The psychologist wishes to conclude that having more books at home causes children to develop larger vocabularies. Which of the following represents the most critical challenge to this causal inference?
Answer: The correlation might be spurious because parents who buy many books may also be more educated and spend more time reading to their children.
The most critical challenge to the causal claim is the third variable problem. Option A describes this perfectly: a third variable (parental education/behavior) is likely influencing both the number of books in the home and the child's vocabulary size. While B (directionality) is a possible issue in correlational studies, the influence of parents on young children is a more prominent and likely confound in this specific scenario. C and D describe general research limitations (generalizability and reliability) but do not address the core flaw in the specific causal inference being made.
- The discrepancy in responses between the two samples most likely illustrates which of the following phenomena in survey research?
Answer: Wording effects
This scenario is a classic example of wording effects. Even though 'not forbidding' a speech is logically similar to 'allowing' it, the negative connotation of the word 'forbid' prompts more people to disagree with it. The different phrasing of the question leads to different responses, demonstrating how subtle changes in wording can significantly impact survey results. Social desirability bias (A) might play a role, but the core issue demonstrated by comparing the two phrasings is the effect of the words themselves. Non-response bias (B) and sampling error (D) are not directly illustrated by this systematic difference based on question phrasing.
- Dr. Evans believes that boys are more physically aggressive than girls. He conducts a naturalistic observation on a preschool playground, recording instances of hitting and pushing. He is the sole observer. A colleague notes that Dr. Evans's results show a much larger gender difference than studies that use multiple observers who are unaware of the study's hypothesis. Dr. Evans's findings may have been compromised by which of the following?
Answer: Observer bias
When you encounter research methodology questions, focus on identifying what could systematically distort the data collection process. This question tests your understanding of different types of bias and confounding factors in psychological research.
Dr. Evans's study shows classic signs of observer bias. Since he believes boys are more aggressive and is the sole observer who knows the hypothesis, he's likely unconsciously noticing, recording, or interpreting ambiguous behaviors differently for boys versus girls. The key clue is that studies using multiple observers who don't know the hypothesis show much smaller gender differences—this suggests Dr. Evans's expectations influenced his observations.
Looking at the wrong answers: (B) The Hawthorne effect occurs when participants change their behavior because they know they're being observed, but there's no indication the children knew they were part of a study. (C) Social desirability bias happens when participants alter their responses to appear more favorable, which doesn't apply to naturalistic observation of young children who aren't reporting anything. (D) Sampling bias involves problems with how participants are selected for the study, but the issue here is with data collection, not participant selection.
The comparison to studies with "blind" observers (who don't know the hypothesis) is the critical detail that points to observer bias rather than other methodological problems.
Study tip: When you see research questions mentioning that the researcher has strong expectations and is the sole data collector, immediately consider observer bias. Multiple blind observers are a key control for this problem.
- A primatologist spends two years living with a specific troop of chimpanzees in a remote national park, carefully documenting their social behaviors. Her findings provide an unprecedented, rich account of this troop's life. A primary limitation of this type of in-depth naturalistic observation is that:
Answer: the detailed findings from this single troop may not be generalizable to other chimpanzee troops.
When you encounter questions about research methods, focus on the fundamental trade-offs between different study designs. Naturalistic observation offers rich, authentic data but comes with inherent limitations regarding scope and application.
The correct answer is A because this study exemplifies a classic limitation of single-case naturalistic observation: limited generalizability. While the researcher gathered incredibly detailed data about one specific troop, these findings may reflect unique characteristics of that particular group, their specific environment, or local conditions. Without studying multiple troops across different locations and contexts, you cannot confidently apply these behavioral patterns to chimpanzees generally. This is a sample size and representativeness issue—one case, no matter how thoroughly studied, cannot represent an entire species.
Answer B incorrectly assumes researcher presence automatically alters behavior significantly. While this can happen, many naturalistic studies successfully minimize this through careful methodology, and it's not the primary limitation described here. Answer C overstates the observer bias problem—while bias is always a concern, skilled researchers use various techniques to maintain objectivity, and bias doesn't automatically "invalidate" data. Answer D reflects a misconception that qualitative data is inherently unscientific. Both qualitative and quantitative approaches have scientific value; the issue isn't the type of data but the scope of the study.
Remember: on psychology research questions, distinguish between methodological concerns that can be managed (like bias or researcher effects) versus fundamental structural limitations (like generalizability from small samples). The latter are typically more significant constraints.
- A sociologist wants to understand national attitudes towards a new environmental policy. The goal is to gather data from thousands of individuals across different states, age groups, and socioeconomic backgrounds to create a descriptive overview. Which research method is uniquely suited to achieve this scope efficiently?
Answer: A survey, as it can be administered to large, representative samples over a wide geographic area relatively quickly and inexpensively.
The primary strength of the survey method is its ability to gather data from large and geographically dispersed samples efficiently. For a research goal that requires data from thousands of people across a country to describe national attitudes, a survey is the most practical and effective method. Naturalistic observation (A) is not feasible on this scale for measuring attitudes. Case studies (B) are too small-scale and in-depth. A correlational study (C) describes a statistical approach, not a data collection method, and it cannot determine causes.
- A researcher measures conscientiousness and the number of job promotions in 100 young adults at age 25. The researcher then measures job promotions again for the same group at age 35. They find that conscientiousness at age 25 is positively correlated with the total number of promotions received by age 35. What is the primary advantage of this longitudinal correlational design over a cross-sectional design?
Answer: It establishes the temporal precedence of conscientiousness, strengthening the case for a potential causal link.
One of the criteria for inferring causality is temporal precedence, meaning the cause must come before the effect. A cross-sectional study measures both variables at the same time, making it impossible to know which came first. This longitudinal design measures the predictor (conscientiousness) long before the final outcome (promotions at 35), establishing temporal precedence. This addresses the directionality problem and strengthens a potential causal argument, though it does not prove causation (D) or eliminate third variables (A). Longitudinal designs are notoriously susceptible to attrition (C).
- A school psychologist wants to determine if a new anti-bullying program causes a reduction in aggressive incidents. Which of the following non-experimental designs represents the most significant compromise in trying to establish this causal link?
Answer: A correlational study using national data to find the relationship between school funding for such programs and rates of bullying.
When evaluating research designs for establishing causation, you need to consider how well each design controls for confounding variables and allows for valid causal inferences. The key question here is which design creates the most significant compromise in establishing that the anti-bullying program actually causes reduced aggression.
Option D represents the most significant compromise because correlational studies using broad national data cannot establish causation at all—they can only show relationships. This design suffers from numerous confounding variables (school size, demographics, other programs, reporting differences) and lacks the specificity needed to isolate the program's effects. The correlation between funding and bullying rates could be explained by countless other factors.
Option A, while lacking a control group, at least measures the same population before and after the intervention, providing some basis for causal inference. Option B compares similar schools with and without the program, offering a quasi-experimental control condition that's stronger than pure correlation. Option C uses detailed case studies that can track individual changes over time, providing rich qualitative evidence of program effects.
Each of these designs (A, B, C) has limitations compared to a true randomized controlled trial, but they maintain some ability to suggest causal relationships. Option D abandons this entirely by using correlational data that's too removed from the actual intervention to support causal claims.
Remember: correlational designs are the weakest for establishing causation, especially when using broad aggregate data rather than studying specific interventions directly.
- A public health researcher is interested in the relationship between lifelong smoking habits and the incidence of a rare form of lung cancer. An experimental design where participants are randomly assigned to 'smoking' and 'non-smoking' groups is not ethically feasible. Which non-experimental design would be most appropriate for this research question, and what is its primary strength in this context?
Answer: A correlational study, because it allows for the examination of relationships between variables that cannot be ethically manipulated.
The most appropriate design is a correlational study (often a retrospective or prospective cohort study in epidemiology). Its key strength in this context is that it allows researchers to investigate relationships between variables, like smoking and cancer, when it would be unethical or impossible to manipulate the independent variable (smoking). While a survey (B) might be used to collect data for the correlational study, the core design is correlational, and its ethical feasibility is the key strength. Naturalistic observation (A) would not be effective for linking behavior to a long-term health outcome, and a case study (D) could not establish a relationship across a population.
- Based on these findings, what is the most plausible and methodologically sound interpretation of the relationship between screen time and life satisfaction?
Answer: The relationship may be mediated by depression, where screen time contributes to depression, which in turn reduces life satisfaction.
This question requires synthesizing multiple correlational findings. A causal claim (A) cannot be made from correlational data. While a third variable (B) is always possible, the data provided points to a specific pathway. Option C describes mediation, a concept where the relationship between two variables is explained by a third variable. The given correlations (screen time -> depression -> lower life satisfaction) fit this model perfectly. While self-report measures have limits (D), this doesn't render the findings meaningless; it's a limitation, not an interpretation of the pattern.
- A researcher wants to compare the helping behaviors of people in bustling urban environments versus quiet rural environments. The researcher has a confederate drop a pile of books in a city street and later in a small-town square, counting the number of times the confederate receives help in each location. This field study's primary limitation, when compared to a laboratory experiment on helping behavior, is:
Answer: the inability to control for numerous confounding variables, such as the specific individuals present or the weather.
The key trade-off between a field study (or field experiment) and a laboratory experiment is control versus ecological validity. While this design has good ecological validity because it's in a real-world setting, its primary limitation compared to a lab study is the lack of control. The researcher cannot control who walks by, what time of day it is, the weather, ambient noise, or other factors that could influence helping behavior. These uncontrolled factors are confounding variables. Reactivity (A) is a concern, but less so than in a lab. Ecological validity (B) is actually a strength, not a weakness, of this design. Defining 'helping' (D) is a challenge in any study of the topic, not one specific to the field setting.
- A study investigating the relationship between weekly hours of video gaming and grade point average (GPA) in college students finds a correlation of r=−0.04 with a p-value of p=0.82. What is the most appropriate conclusion for the researchers to draw from these results?
Answer: The study provides evidence that there is no linear relationship between video gaming and GPA in this sample.
A correlation coefficient (r) of -0.04 is extremely close to zero, indicating virtually no linear association. Furthermore, the p-value of 0.82 is much greater than the conventional alpha level of 0.05, meaning the result is not statistically significant. Therefore, the most direct and appropriate conclusion is that the study found no evidence of a linear relationship. Option A is incorrect because the result is not significant. Options C and D are speculative; while possible in theory, there is no information in the results to support these claims over the more straightforward conclusion in B.
- A political polling organization attempts to predict a mayoral election outcome by conducting a survey. They draw their sample from publicly available residential landline phone directories. The poll's prediction differs significantly from the actual election results. The poll's inaccuracy is most likely a consequence of which specific limitation?
Answer: Sampling bias, because the sample excluded voters who only use cell phones or have unlisted numbers.
When evaluating research validity, you need to distinguish between different types of methodological problems. This question tests your understanding of sampling bias versus other research limitations.
The correct answer is D because the polling method created a systematic exclusion of certain voter groups. By only using residential landline directories, the sample missed people who rely solely on cell phones (often younger voters) and those with unlisted numbers (who may have different demographic characteristics). This sampling bias means the sample wasn't representative of the actual voting population, leading to inaccurate predictions.
Option A (wording effects) would cause systematic bias in how people respond to questions, but the question doesn't indicate problematic phrasing was involved. Option B (social desirability bias) occurs when people give socially acceptable rather than honest answers, but there's no evidence voters were lying about preferences rather than being excluded entirely. Option C (directionality problem) refers to uncertainty about cause-and-effect relationships in correlational research, which isn't relevant to a straightforward polling scenario where researchers are simply measuring existing voter preferences.
The key distinction is that sampling bias affects who gets included in your study, while the other options affect how included participants respond. Since the poll's methodology systematically excluded entire groups of voters, the fundamental problem was with sample representativeness.
Remember: When research results don't match reality, first ask whether the sample actually represented the target population. Sampling problems often explain why studies fail to generalize to real-world outcomes.
- A team of researchers wants to study the social dynamics of preschoolers during free play. To minimize disruption, they install unobtrusive video cameras in the corners of the classroom after informing the children and parents that the cameras are 'newly upgraded smoke detectors.' The researchers' strategy of disguising the cameras is primarily an attempt to mitigate which limitation of observational research?
Answer: Reactivity, which is the tendency for individuals to alter their behavior when they are aware of being watched.
Reactivity (also known as the Hawthorne effect) occurs when participants change their behavior because they know they are being observed. By disguising the cameras, the researchers are attempting to make the children unaware of the observation, thereby ensuring that their behavior is natural and not a reaction to being watched. Observer bias (A), lack of control (C), and inter-rater reliability (D) are all potential issues in this type of research, but the specific strategy of disguising the cameras is designed to combat reactivity.
