Evidence Interpretation - Nbcot Certified Occupational Therapy Assistant Cota

  1. A COTA is working with an OTR to evaluate a new sensory-based feeding protocol for children with tactile defensiveness. The OTR shares a summary of a recent randomized controlled trial (RCT) which found a statistically significant improvement in food acceptance (p < 0.05) for the new protocol. However, the summary also notes a small effect size. How should the COTA interpret these findings when preparing for a discussion with the OTR?
    Answer: The results suggest the protocol has a consistent, positive effect, but the practical impact on a child's feeding may be limited. The correct answer is C. This choice accurately interprets the two key pieces of information. A p-value less than 0.05 indicates that the observed result is unlikely due to chance (statistically significant). However, the effect size indicates the magnitude or practical importance of the result. A small effect size suggests that while the effect is real, its clinical impact might be minor. This nuanced understanding is crucial for evidence-based practice and discussion with the supervising OTR. A is incorrect because statistical significance does not automatically equate to high effectiveness or justify immediate, widespread implementation without considering the magnitude of the effect. B is incorrect because a small effect size does not invalidate statistical significance; it provides a different, complementary piece of information about the practical importance of the findings. D is incorrect because an RCT is considered a high level of evidence, and a small effect size is a valid finding, not an indicator of a low-quality study.
  2. While attending a continuing education course, a COTA learns about a novel therapeutic taping technique for shoulder subluxation from an instructor who presents a single, detailed case study as evidence. The COTA is working with a client who might benefit from this technique. What is the COTA's MOST appropriate next action?
    Answer: Inform the supervising OTR about the technique and the level of evidence presented to collaboratively determine its appropriateness. The correct answer is B. This action respects the COTA's scope of practice, which involves collaborating with the OTR on intervention planning. The COTA's role is to bring new information to the OTR and contribute to the clinical reasoning process. It correctly identifies that a case study is a specific (and lower) level of evidence that requires careful consideration. A is incorrect as it constitutes implementing a new intervention without OTR consultation, which is outside the COTA's scope of practice. C is incorrect because while a case study is low on the evidence hierarchy, it may still provide valuable insight or suggest an area for further exploration; it should not be dismissed outright without discussion. D is incorrect because while researching is a good professional habit, the primary action should be collaboration with the OTR, who is ultimately responsible for the intervention plan. The COTA contributes to, but does not independently direct, changes to the plan based on their own research.
  3. A COTA is part of a Continuous Quality Improvement (CQI) team at a skilled nursing facility. The team analyzes data showing an increase in falls among residents. What is the COTA's primary role in using this evidence?
    Answer: To contribute to discussions on potential causes and suggest intervention modifications to the supervising OTR. Within a CQI team, the COTA's role is to use their clinical perspective to help interpret data, problem-solve, and contribute ideas for improving care. These ideas must then be discussed and implemented in collaboration with the supervising OTR and the rest of the team. A is outside the COTA's scope, C is unprofessional, and D underutilizes the COTA's skills as a valuable team member.
  4. A research study uses in-depth interviews and focus groups to understand the lived experience of teenagers with chronic pain participating in school activities. The COTA who reads this study should recognize it as which type of research?
    Answer: Qualitative research. Qualitative research aims to understand experiences, perspectives, and meanings. Methods like interviews and focus groups are hallmarks of this approach. Quantitative research (B) deals with numerical data. A randomized controlled trial (C) and a meta-analysis (D) are specific types of quantitative research.
  5. What is the correct interpretation of the 95% confidence interval that the COTA should understand?
    Answer: It provides a range of plausible values for the true average improvement in the wider population. A confidence interval provides an estimated range of values which is likely to include the unknown population parameter. In this case, it suggests we can be 95% confident that the true average improvement for the entire population of similar clients falls between 4.2 and 7.8 points. A is a common misinterpretation; a CI applies to the population mean, not to individual outcomes. C and D are also incorrect interpretations of a confidence interval.
  6. Meta-analysis: significant but small effect for cognitive retraining. What does this mean for adoption?
    Answer: Small gain; weigh cost and fit A significant small effect means the treatment is better than nothing, but the benefit is modest. Statistical significance does not guarantee clinical importance, so you should weigh the cost, time, and fit for each client before adopting it. The tempting mistake is thinking significance proves it works strongly, but significance only shows the effect is unlikely due to chance, not that it is large or worthwhile.
  7. A landmark randomized controlled trial on stroke rehabilitation was conducted at a large, well-funded, urban research hospital. A COTA working in a rural home health agency with limited resources is considering its findings. What is the primary concern when applying this evidence to the COTA's practice setting?
    Answer: The generalizability of the findings to a setting with different resources and environmental factors. This question addresses the concept of external validity, or generalizability. An intervention that is effective in a highly controlled, well-resourced setting may not be feasible or as effective in a different context, such as a client's home in a rural area. The COTA's ability to understand statistics (B) is a separate issue. C is an unfounded assumption. D is false; RCTs are a high level of evidence.
  8. A COTA works in an early intervention program. The facility uses a non-standardized, play-based assessment to observe developmental skills. To better understand the evidence supporting this tool, what should the COTA search for?
    Answer: Published literature describing the tool's development, purpose, and preliminary validity. Even non-standardized tools should have an evidence base. This evidence is typically found in published literature describing the tool's theoretical foundation, development process, intended use, and studies on its reliability and validity. A describes features of a standardized test. C relates to billing, not clinical evidence. D is anecdotal and does not constitute formal evidence.
  9. A single case report supports a new splinting method. What does this evidence best provide?
    Answer: A hypothesis to test further A single case report describes one person's outcome, so it can suggest an idea but cannot establish generalizable proof or strong causation. It gives you a hypothesis to test in larger studies. The tempting wrong answer is proof of generalizable benefit because a dramatic result feels convincing, but one case can't show benefit across a population.
  10. Which evidence should you seek when choosing a protocol to honor client values?
    Answer: Client-experience studies Client-experience studies directly capture what matters to your client, so they are the evidence to use when honoring client values. Effect-size meta-analyses are tempting because they summarize treatment effectiveness, but they do not tell you whether an intervention fits this client's priorities. RCTs similarly establish efficacy, not personal meaning; expert opinions lack the client's voice.
  11. A COTA finds a research summary on a manufacturer's website for a new adaptive keyboard. The summary describes a company-funded study showing that users with arthritis typed 30% faster with their keyboard. The study details reveal that there was no control group and the research has not been peer-reviewed. When discussing this product with the supervising OTR, which aspect of the evidence is the MOST significant concern?
    Answer: The lack of a control group and potential funding bias make the results difficult to interpret. The correct answer is B. This choice identifies the most critical methodological flaws in the described research. The absence of a control group means there is no baseline for comparison, making it impossible to determine if the improvement was due to the keyboard or other factors (e.g., practice effect, placebo). Funding by the manufacturer introduces a significant conflict of interest, or funding bias, which can influence the study's design, conduct, and reporting. These are fundamental threats to the validity of the research. A is a valid clinical point but is a concern with any intervention, not the primary flaw of the research evidence itself. C is an assumption that may or may not be true; the primary issues are with the study's design, not its age. D is incorrect because while meta-analyses are a very high level of evidence, many other study types (e.g., RCTs, cohort studies) are valuable and necessary for making informed clinical decisions.
  12. A COTA reads a case study in a professional magazine detailing a novel sensory integration technique used with a single child who has sensory processing disorder. What is the PRIMARY limitation of using this article as evidence to guide intervention for other clients?
    Answer: The results from a single individual may not be generalizable to other clients. The key limitation of a case study is its low generalizability. Findings from a single subject (N=1) cannot be reliably applied to the broader population. The other options are assumptions; the publication venue does not invalidate the technique (B), equipment availability is a practical issue not a research limitation (C), and the author's status is unknown and irrelevant to the limitation of the study design (D).
  13. Which statement BEST describes the COTA's role in evidence-based practice (EBP)?
    Answer: To collaborate with the OTR by helping to find, interpret, and apply evidence to intervention implementation. The COTA is an active participant in the EBP process. This includes being a knowledgeable consumer of research and working collaboratively with the OTR to ensure interventions are evidence-based. A describes a passive role inconsistent with professional standards. B describes the role of a researcher, which is beyond the entry-level COTA scope. D describes actions that are outside the COTA's scope of practice.
  14. An OTR frames a clinical question using the PICO format: '(P) For older adults in long-term care, (I) does participation in a daily walking group (C) compared to no organized exercise (O) reduce the rate of falls?' The OTR asks the COTA to help find a relevant article. Which part of a research article should the COTA review first to quickly determine its relevance?
    Answer: The abstract to get a summary of the population, intervention, and outcomes. The abstract provides a concise summary of the entire study, including the population (P), intervention (I), comparison (C), and outcome (O). Reading the abstract is the most efficient first step to determine if the article is relevant to the PICO question before investing time in reading the full text. The other sections are important for a deeper analysis but are not the first place to check for basic relevance.
  15. An RCT excluded dementia; your home clients have dementia. How should you apply it?
    Answer: Use cautiously if it fits Because the RCT excluded dementia, its results may not directly transfer to your clients. You should weigh the intervention against clinical reasoning and client-specific factors, using it cautiously when the populations and contexts align. The tempting mistake is rejecting it outright, but differing samples alone don't erase potential benefit; you judge fit first.
  16. The supervising OTR asks a COTA to find the highest level of evidence available regarding the effectiveness of a specific intervention for carpal tunnel syndrome. Which of the following would represent the highest level of evidence?
    Answer: A meta-analysis of multiple randomized controlled trials on the intervention. According to the hierarchy of evidence, a meta-analysis or systematic review of multiple RCTs provides the highest level of evidence for intervention effectiveness because it synthesizes findings from many studies. A single RCT (B) is strong evidence but is considered lower than a synthesis of multiple RCTs. Expert opinion (D) and textbook chapters (A) are at the bottom of the evidence pyramid.
  17. The COTA should understand that a systematic review represents what kind of evidence?
    Answer: A summary and synthesis of multiple high-quality research studies on a specific topic. A systematic review is a high level of evidence that involves identifying, appraising, and synthesizing all relevant, high-quality research on a particular question. A single case is a case study (A). An expert opinion (B) is a lower level of evidence. A feasibility study is a pilot study (D).
  18. RCT: splint A vs B; outcome favors A, p = .06, odds ratio 1.4, 95% CI 0.9-2.2. What does evidence support?
    Answer: Possible gain; weigh risk The confidence interval includes 1 and p=.06 does not reach statistical significance, so A is not proven superior or clearly beneficial. However the odds ratio of 1.4 favors A, so a benefit is possible but uncertain; you should weigh potential gain against risks before adopting. The most tempting error is reading the nonsignificant p value as proof of no benefit, but p>.05 only means insufficient evidence, not no effect.
  19. What is the COTA's MOST appropriate next step based on this information?
    Answer: Discuss the study with the supervising OTR to determine if the intervention is appropriate for the client's plan of care. The COTA's role is to implement interventions under OTR supervision. Finding relevant evidence is an important part of practice, but any potential modification to the intervention plan must be discussed with the supervising OTR. It is outside the COTA's scope to unilaterally change the plan (A) or guarantee outcomes (C). While D is a true statement, dismissing the evidence without discussion is not the best course of action.
  20. How should the COTA interpret this finding when discussing it with the OTR?
    Answer: The observed improvement was unlikely due to chance, but its practical importance for the client may be small. This question assesses the ability to differentiate between statistical significance and clinical significance. A p-value less than 0.05 (p=0.04) means the result is statistically significant (unlikely due to random chance). However, a 1.5-point change on a 100-point scale is a very small effect size, suggesting it may not be clinically or meaningfully important for a client's daily function. A is an overstatement. B is incorrect; a result is either significant at a given level or it is not. D is a common misinterpretation of a p-value.

Start this quiz