Test Bias - Eppp Knowledge

1. Which response style bias involves preferring middle categories on rating scales?

   Moderacy (midpoint) response style. This cultural preference can compress score distributions, masking true variability and biasing comparisons across groups.

2. What is scalar (strong) invariance across cultural groups?

   Equal item intercepts across groups. This permits valid mean score comparisons by ensuring that observed differences reflect true latent trait variations, not measurement artifacts.

3. Identify the fairness problem when norms are based mainly on one cultural group.

   Inappropriate norms (nonrepresentative standardization sample). Nonrepresentative samples lead to norms that misinterpret scores for underrepresented groups, perpetuating cultural unfairness.

4. Which response style bias involves choosing extreme categories on rating scales?

   Extreme response style. Cultural differences in this style can lead to artificial variance in scores, as some groups avoid moderate responses more than others.

5. What is item bias (differential item functioning) in an assessment?

   An item functions differently for groups at the same trait level. This indicates unfairness as the item does not measure the trait equivalently, leading to biased scores despite equal ability levels.

6. Identify the bias when administration conditions differ systematically by group.

   Administration bias (a form of method bias). Systematic differences in testing conditions can introduce extraneous variance, compromising score equivalence across groups.

7. What is linguistic bias in assessment instruments?

   Score differences due to language proficiency or translation problems. Variations in language skills or inaccurate translations can confound true ability measurements, leading to inequitable assessments.

8. What is configural invariance across cultural groups?

   Same factor pattern across groups. This level confirms that the underlying factor structure is consistent, with items loading on the same factors in all groups.

9. What is stereotype threat as a fairness issue in testing?

   Performance decrement from fear of confirming a negative stereotype. This situational factor can unfairly lower scores for minority groups, introducing bias unrelated to actual ability.

10. What is strict invariance across cultural groups?

    Equal residual variances across groups. This most stringent level verifies that measurement error is equivalent, supporting unbiased comparisons of variances across groups.

11. Which option best indicates item bias: groups differ on an item after matching on total score?

    Differential item functioning (item bias). Matching on total score controls for ability, so group differences on the item suggest bias in how it functions culturally.

12. What is the key fairness concern when using translated tests without adaptation?

    Lack of linguistic and cultural equivalence. Without proper adaptation, translated tests may not capture equivalent meanings, leading to invalid cross-cultural comparisons.

13. Which translation procedure best supports cross-language equivalence of a test?

    Back-translation with committee review. This method iteratively refines translations to ensure semantic and conceptual equivalence, minimizing linguistic bias.

14. Identify the fairness issue when a test measures language skill more than intended ability.

    Construct-irrelevant variance due to language demands. Excessive language requirements can confound results by assessing unintended skills, disadvantaging non-native speakers unfairly.

15. What is predictive bias (differential prediction) in test fairness?

    A test predicts outcomes differently across groups. This fairness issue arises when the test's predictive validity varies, resulting in unequal accuracy of outcome forecasts for different groups.

16. What is construct bias in psychological testing across cultural groups?

    The construct has different meaning or relevance across cultures. This bias undermines validity because the underlying psychological concept may not be universally applicable or interpreted identically in diverse cultural contexts.

17. What is measurement invariance in multicultural assessment?

    The measure has equivalent structure and meaning across groups. This ensures that comparisons of scores across groups are valid, as the instrument operates equivalently in structure and interpretation.

18. In fairness terms, what does it mean if regression intercepts differ by group?

    Differential prediction due to intercept bias. Differing intercepts suggest systematic over- or under-prediction of outcomes for specific groups, indicating bias in test application.

19. What is method bias in cross-cultural assessment instruments?

    Bias from sampling, administration, response styles, or instrument format. This occurs when procedural aspects of testing introduce systematic errors that affect score comparability across cultural groups.

20. In fairness terms, what does it mean if regression slopes differ by group?

    Differential prediction due to slope bias. Differing slopes indicate that the strength of the relationship between test scores and criterion varies by group, compromising fairness.

21. What is metric (weak) invariance across cultural groups?

    Equal factor loadings across groups. This establishes that the strength of item-factor relationships is comparable, allowing for meaningful covariance comparisons across groups.

22. Which response style bias involves agreeing regardless of item content?

    Acquiescence response style. This cultural tendency can inflate agreement scores, distorting true attitudes and reducing cross-cultural comparability of measures.

23. What is cultural loading in a test item?

    Item requires culture-specific knowledge unrelated to the construct. Such items introduce extraneous cultural demands that unfairly disadvantage test-takers from other backgrounds.

24. What is social desirability bias in self-report measures?

    Responding to appear favorable rather than answering accurately. Cultural variations in this bias can lead to inaccurate self-reports, as individuals adjust answers to align with perceived social norms.

25. Which type of bias occurs when the test content is unfamiliar to a cultural group?

    Content bias. Unfamiliarity with content can disadvantage certain groups, introducing irrelevant variance unrelated to the measured construct.

Study these flashcards