- A social worker evaluating a parenting program wants to ensure that outcome measures are sensitive to change over time. Which measurement consideration is MOST important?
Answer: The measures should have adequate sensitivity to detect meaningful changes in parenting behaviors throughout the intervention period.
Sensitivity to change is the measure's ability to detect meaningful improvements or deterioration over time, which is crucial for program evaluation. A measure could be reliable and valid but still miss important changes if it's not sensitive to the types of changes the intervention produces. Internal consistency (A), test-retest reliability (B), and inter-rater reliability (D) are important psychometric properties but don't specifically address sensitivity to change over time.
- A social worker uses a standardized depression inventory that has a clinical cutoff score of 16 or higher indicating probable depression. The worker finds that 30% of clients score above this threshold. What does this represent?
Answer: The prevalence of probable depression in the worker's client population based on the standardized cutoff criteria.
This represents prevalence - the proportion of clients who meet the screening criteria for probable depression at a given point in time (30%). Incidence (B) refers to new cases developing over time. Sensitivity (C) and specificity (D) are measures of diagnostic accuracy that would require comparison with a gold standard diagnosis, which is not provided in this scenario.
- A social worker wants to establish inter-rater reliability for a new behavioral observation coding system used to assess family interactions. What procedure should the worker implement?
Answer: Have multiple trained observers independently code the same family interaction sessions and calculate agreement statistics between raters.
Inter-rater reliability is established by having multiple trained observers independently code the same sessions and calculating agreement statistics (such as kappa coefficients or intraclass correlations) between raters. Option B describes test-retest reliability. Option C describes concurrent validity testing. Option D describes internal consistency reliability, which applies to multi-item scales rather than observational coding systems.
- A social worker reviewing research literature finds a study reporting Cohen's d = 0.8 for an intervention's effect on reducing child behavioral problems. How should the worker interpret this effect size?
Answer: This represents a large effect size, indicating the intervention produced substantial improvements in child behavioral problems.
Cohen's d = 0.8 represents a large effect size according to Cohen's conventions (small = 0.2, medium = 0.5, large = 0.8). This indicates the intervention produced substantial improvements, with the average participant in the intervention group scoring 0.8 standard deviations better than the average participant in the control group. This is considered a clinically meaningful and substantial effect.
- What can the social worker conclude about the intervention's effectiveness?
Answer: The results suggest the intervention may be effective, but causal conclusions are limited due to lack of random assignment.
Quasi-experimental designs can suggest intervention effectiveness, especially when combined with a comparison group showing no change, but causal conclusions are limited due to lack of random assignment. Other factors could still explain the differences between schools. The results don't definitively prove causation (A), and quasi-experimental designs can provide useful evidence even if not as strong as RCTs (C). The logic in option D is flawed since only the intervention school received the treatment.
- A social worker wants to evaluate whether a new assessment tool accurately identifies clients at risk for suicide. The worker compares the tool's results with clinical interviews conducted by experienced psychiatrists. What type of validity is being examined?
Answer: Criterion validity, which examines how well the tool's results correlate with an established standard measure of suicide risk.
Criterion validity is being examined because the new tool's results are being compared with an established standard (clinical interviews by experienced psychiatrists) to determine how well they correlate. Content validity (A) would involve examining whether all relevant suicide risk factors are included. Construct validity (B) involves broader theoretical considerations. Face validity (D) is a superficial assessment of whether the tool appears to measure what it claims.
- When conducting a needs assessment for mental health services in a community, a social worker wants to ensure the survey results represent the entire target population. Which sampling method would BEST achieve this goal?
Answer: Random sampling, which ensures every member of the target population has an equal chance of being selected for survey participation.
Random sampling gives every member of the target population an equal chance of selection, which best ensures representativeness and allows for generalization to the entire population. Convenience sampling (A) may introduce bias by only including easily accessible individuals. Snowball sampling (B) can create bias through social networks. Purposive sampling (D) deliberately selects specific participants and is not designed for population representativeness.
- A social worker is reviewing research literature to select an evidence-based intervention for adolescent anxiety. Which type of research design would provide the STRONGEST evidence for intervention effectiveness?
Answer: A randomized controlled trial that compares the intervention group to a control group using random assignment procedures and standardized measures.
Randomized controlled trials (RCTs) provide the strongest evidence for intervention effectiveness because random assignment helps control for confounding variables and establishes causal relationships. Case studies (A) provide rich detail but lack generalizability and control. Correlational studies (C) cannot establish causation. Quasi-experimental designs (D) are stronger than correlational studies but weaker than RCTs due to lack of random assignment.
- A researcher develops a new depression screening tool for adolescents and compares its results with an established diagnostic interview. The researcher is primarily testing which aspect of the new tool?
Answer: Criterion validity to determine how well the new tool correlates with an established standard measure of depression.
Criterion validity is tested when comparing a new tool's results with an established standard (criterion measure). By comparing the new depression screening tool with an established diagnostic interview, the researcher is testing criterion validity. Test-retest reliability (A) involves administering the same tool multiple times. Internal consistency (C) examines whether items within the tool measure the same construct. Inter-rater reliability (D) tests consistency between different administrators.
- A social worker conducts a systematic review of interventions for adolescent depression and finds that studies using self-report measures show larger effect sizes than studies using clinician-rated measures. What does this pattern suggest?
Answer: The difference may reflect measurement bias, with self-report measures potentially being more sensitive to participants' expectations.
The pattern suggests potential measurement bias, as self-report measures may be more susceptible to participant expectations, social desirability, or placebo effects, leading to inflated effect sizes. This doesn't necessarily mean self-report measures are more valid (A) or that adolescents are better assessors than clinicians (D). While clinician measures might be less influenced by certain biases, the pattern doesn't prove they're more reliable (C) - it suggests different types of measurement bias may affect different assessment methods.
- A social worker conducts a program evaluation using a pre-post design without a control group. What is the PRIMARY limitation of this evaluation design?
Answer: The design cannot account for external factors that might influence outcomes, such as historical events or participant maturation effects.
A pre-post design without a control group cannot account for external factors (threats to internal validity) such as history, maturation, or other events that might cause changes independent of the intervention. While lack of random assignment (A) is a limitation, the primary issue is the absence of a control group to rule out alternative explanations. Sample size (C) is a separate consideration not inherent to the design. Ethical concerns (D) don't apply since there is no control group being denied treatment.
- A social worker is evaluating a substance abuse treatment program and wants to ensure that the assessment tool consistently measures addiction severity across different administrations. Which research principle is the social worker MOST concerned with?
Answer: Reliability, which refers to the consistency and stability of measurement results over time and across different conditions.
Reliability refers to the consistency and stability of measurement results. When a social worker wants to ensure an assessment tool consistently measures addiction severity across different administrations, they are concerned with reliability. Validity (B) refers to whether the tool measures what it claims to measure, not consistency. Generalizability (C) relates to applying findings to other populations. Statistical significance (D) relates to determining if results are due to chance.
- What additional information would be MOST important for determining the practical significance of these results?
Answer: The effect size calculation to determine the magnitude of change and whether the difference is clinically meaningful in practice.
Effect size measures the magnitude of change and helps determine practical or clinical significance beyond statistical significance. A statistically significant result may not be practically meaningful if the effect size is small. While confidence intervals (B), power analysis (C), and correlations (D) provide useful information, effect size is most directly relevant to determining whether the statistically significant difference represents a meaningful change in family functioning.
- When reviewing research studies to inform practice decisions, a social worker should be MOST concerned about which aspect of statistical significance testing?
Answer: Statistical significance does not indicate the practical importance or clinical meaningfulness of the research findings in real-world practice.
The most important concern is that statistical significance only indicates that results are unlikely due to chance, not that they are practically important or clinically meaningful. A statistically significant result may represent a very small, clinically irrelevant change. Sample size requirements (B) vary by study design and effect size. Statistical calculations (C) are handled by researchers and software. Statistical significance (D) can be calculated for various study designs, not just experimental ones.
- In designing an evaluation study, a social worker decides to use both quantitative outcome measures and qualitative interviews with participants. What is the PRIMARY benefit of this mixed-methods approach?
Answer: Mixed methods provide complementary perspectives that can enhance understanding of intervention outcomes and participant experiences.
The primary benefit of mixed methods is that quantitative and qualitative approaches provide complementary perspectives, with quantitative data showing what happened and qualitative data helping explain how and why. This comprehensive approach enhances understanding beyond what either method could provide alone. Mixed methods don't necessarily reduce costs (A), eliminate the need for randomization (C), or ensure cultural representation (D).
- A social worker is conducting a meta-analysis of studies examining the effectiveness of mindfulness-based interventions for anxiety. What is the PRIMARY advantage of this research approach?
Answer: Meta-analysis combines results from multiple studies to increase statistical power and provide more robust effect size estimates.
The primary advantage of meta-analysis is that it combines results from multiple studies, increasing statistical power and providing more robust estimates of effect sizes by pooling data across studies. This approach provides stronger evidence than individual studies alone. Meta-analysis doesn't examine individual participant experiences (A) or conduct new experiments (C). While it may provide insights into intervention effects, it doesn't typically provide qualitative insights into mechanisms (D).
- A social worker evaluating a group intervention finds that participants' depression scores improved significantly from pre-test to post-test. However, 40% of participants dropped out during the study. What threat to validity does this represent?
Answer: Attrition bias, which occurs when participants who drop out of the study differ systematically from those who complete the evaluation process.
Attrition bias occurs when participants who drop out of a study differ systematically from those who remain, potentially skewing results. High dropout rates (40%) raise concerns that those who stayed may have been more motivated, had better outcomes, or differed in other ways. Selection bias (A) relates to non-random assignment. Instrumentation bias (C) involves changes in measurement tools. Maturation bias (D) involves natural change over time.
- A social worker wants to evaluate client progress using Goal Attainment Scaling (GAS), where clients set individualized goals and rate their achievement on a standardized scale. What is the PRIMARY advantage of this evaluation approach?
Answer: GAS incorporates client perspectives and individualized goals while maintaining a structured framework for measuring progress.
The primary advantage of Goal Attainment Scaling is that it incorporates client perspectives and individualized goals while maintaining a structured, standardized framework for measuring progress. This balances individualization with systematic evaluation. While GAS uses a standardized scale format, the goals themselves are individualized, making direct comparison across clients less straightforward (A). GAS typically involves baseline goal-setting (C), and inter-rater reliability can be challenging with individualized goals (D).
- In conducting a single-subject design evaluation of a client's progress, a social worker establishes a baseline phase (A), implements an intervention phase (B), then withdraws the intervention (A), and reintroduces it (B). What type of design is this?
Answer: An ABAB design that demonstrates experimental control through systematic intervention withdrawal and reintroduction patterns across multiple phases.
An ABAB design (also called reversal design) involves baseline (A), intervention (B), withdrawal of intervention (A), and reintroduction of intervention (B). This design demonstrates experimental control by showing that changes occur when intervention is present and reverse when withdrawn. An AB design (A) has only two phases. Multiple baseline design (C) involves staggered implementation across different targets. Changing criterion design (D) involves systematic adjustment of performance criteria.
- A social worker wants to measure treatment outcomes using a standardized scale but discovers the scale was developed and validated primarily with white, middle-class adults. The worker's clients are primarily low-income Latino immigrants. What is the worker's PRIMARY concern regarding this scale?
Answer: The scale may lack cultural validity and may not accurately measure the construct in the worker's specific client population.
Cultural validity is the primary concern when using a scale developed with one population (white, middle-class adults) with a different population (low-income Latino immigrants). The scale may not accurately measure the intended construct in the new population due to cultural differences in symptom expression, values, or interpretation. While reliability issues (B, C, D) could occur, the fundamental question is whether the scale validly measures what it claims to measure in this different cultural context.
