All questions
Question 1
Tornadoes can destroy homes and hurt people. A community built 50 underground storm shelters made of concrete near homes. After 2 years and 5 tornadoes, all 50 shelters were undamaged; 347 people used them with 0 injuries or deaths, even when 23 homes above shelters were destroyed. Two people died because they did not reach a shelter in time. Based on the evidence, is the claim supported that underground shelters are effective at protecting people?
- No, because the shelters only hold 6–8 people and cannot fit the whole town.
- Yes, because 347 shelter users had 0 injuries or deaths, and the shelters stayed safe in 5 tornadoes. (correct answer)
- Yes, because the shelters make tornadoes weaker and stop them from forming.
- No, because tornadoes still destroyed 23 homes above the shelters.
Explanation: In 3rd grade science, students learn to make claims about the effectiveness of design solutions that reduce the impacts of weather-related hazards, using evidence as outlined in NGSS 3-ESS3-1. Making claims about solution effectiveness means asserting if a solution mitigates hazard impacts, backed by evidence like data showing reductions, not just opinions; strong evidence includes control comparisons, multiple events, quantitative drops (e.g., 90% fewer injuries), and acknowledging limitations such as accessibility issues while affirming overall success. In this scenario, the problem is tornadoes destroying homes and hurting people; the solution is building 50 underground concrete storm shelters near homes; evidence includes all 50 shelters undamaged after 5 tornadoes over 2 years, 347 users with 0 injuries or deaths, even when 23 homes above were destroyed, though 2 died not reaching shelters. Choice B is correct because it claims effectiveness supported by evidence like 347 users having 0 injuries and shelters safe in 5 tornadoes, accurately reflecting complete protection for users and multiple-trial consistency while implying the limitation of access. Choice A is incorrect because it denies effectiveness due to 23 homes destroyed above, which ignores the evidence of zero user injuries and focuses on property damage not relevant to people protection, a common error of misaligning metrics with the solution's goal. Teach claim-evidence: 'Claim: Shelters are effective at protecting people. Evidence: 347 users had 0 injuries in 5 tornadoes, though access is needed.' Emphasize checklists for matching claims to data, citing specifics, using comparisons, and recognizing limitations without negating success.
Question 2
Before the retention pond, flood damage averaged $200,000 each year; after it, damage averaged $25,000, and the pond cost $150,000 to build. Using the data provided, which claim about the pond is supported?
- The pond is not worth it because it costs $150,000 and money should not be spent.
- The pond is effective and saves money because yearly damage dropped by about $175,000. (correct answer)
- The pond caused the rainstorms to be smaller each year.
- The pond only works if no one likes it, so surveys do not matter.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence including cost-benefit analysis. Evidence shows the pond prevents $175,000 in damage yearly while costing 150,000tobuild,demonstratingbotheffectivenessandeconomicvalue.Inthisscenario,theproblemisfloodingcausingexpensivedamage(200,000 per year before pond). The solution implemented is a retention pond costing $150,000 to build. Evidence collected after implementation shows: damage dropped from $200,000 to $25,000 per year (saving $175,000 annually), the pond cost $150,000 to build (one-time cost), savings exceed construction cost in first year alone. The claim to evaluate is which claim about the pond is supported. Choice B correct because it makes evidence-supported claim about solution effectiveness by citing specific financial data. The answer states the pond is effective and saves money because yearly damage dropped by about $175,000. This accurately calculates the evidence: $200,000 - $25,000 = $175,000 saved each year, which exceeds the $150,000 construction cost in just the first year. By year two, the community saves $350,000 total, making this highly cost-effective. Shows understanding that effective solutions both reduce hazard impacts AND can save money long-term. Choice A incorrect because it ignores evidence and uses faulty reasoning—claiming 'not worth it because it costs $150,000' fails to consider that it saves $175,000 every year. Common error where students see any cost as bad without comparing to benefits. The pond pays for itself in less than one year and continues saving money indefinitely. Spending $150,000 to save $175,000 annually is excellent value—like buying a $20 umbrella that prevents 100inweatherdamageyearly.Helpstudentsmakeevidence−basedclaimsaboutsolutions:Teachcost−benefitanalysis:Compareone−timecost(150,000 to build) vs ongoing savings ($175,000/year prevented damage). When savings > cost, solution provides value. Calculate payback time: $150,000 cost ÷ $175,000 annual savings = 0.86 years to pay back. Less than 1 year is excellent. Practice complete economic picture: Year 1: Save $175,000 - $150,000 cost = $25,000 net benefit. Year 2: Save another $175,000 = 200,000totalbenefit.Savingscontinueeveryyear.Showlong−termthinking:One−timecostsvsrecurringbenefits—spendingmoneyonprevention(pond)savesmuchmoreinavoideddamageovertime.Emphasize:Effectivesolutionsoftensavemoneybypreventinglargerlosses—150,000 investment preventing $175,000 in damage annually is both effective at reducing flooding AND financially smart. Question 3
In Farm County's 2018 drought, 95% of farms with drip irrigation kept 75–95% of normal crops, but 78% of farms without irrigation lost crops; county losses fell from $30 million (2012) to $8 million (2018). Based on the evidence, is drip irrigation effective at reducing drought crop loss?
- No, because some wells ran low, so irrigation never helps.
- Yes, because most irrigated farms kept crops while many non-irrigated farms lost crops. (correct answer)
- Yes, because irrigation made it rain more during the drought.
- No, because the county still lost exactly $30 million in 2018.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence comparing outcomes with and without the solution. Evidence includes dramatic differences between irrigated farms (95% kept 75-95% of crops) and non-irrigated farms (78% lost crops), plus county-wide loss reduction. In this scenario, the problem is drought causing crop loss and economic damage (2012 drought: $30 million county losses). The solution implemented is drip irrigation. Evidence collected after implementation includes: 95% of farms with drip irrigation kept 75-95% of normal crops, 78% of farms without irrigation lost crops (showing clear contrast), county losses fell from $30 million (2012) to 8million(2018)—7330M→8Mlosses).Showlimitationacknowledgment:′Somewellsranlow′doesn′tnegatethat9522M reduction in losses). Emphasize: Evidence comparing with vs without in same conditions provides strongest proof—same drought, dramatically different outcomes based on irrigation use. Question 4
After new snowplows were added, business closures during a blizzard fell from 4 days (2018) to 1 day (2021), and snow crashes fell from 89 to 45. Based on the evidence, is the claim "more snowplows reduce blizzard impacts" supported?
- No, because blizzards are natural and people cannot plan for them.
- Yes, because roads reopened sooner and crashes dropped from 89 to 45. (correct answer)
- No, because 1 day of closures is still a problem, so it failed.
- Yes, because snowplows made the wind slower in 2021.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence of multiple improved outcomes. Evidence shows snowplows reduced both business closures (75% reduction) and crashes (49% reduction), supporting the effectiveness claim. In this scenario, the problem is blizzards causing extended business closures and vehicle crashes (2018: 4 days closures, 89 crashes). The solution implemented is more snowplows. Evidence collected after implementation includes: business closures fell from 4 days to 1 day (75% reduction), snow crashes fell from 89 to 45 (49% reduction), improvements seen in 2021 blizzard similar to 2018. The claim to evaluate is whether 'more snowplows reduce blizzard impacts' is supported. Choice B correct because it makes evidence-supported claim about solution effectiveness by citing specific data from the stimulus. The answer states yes, the claim is supported because roads reopened sooner and crashes dropped from 89 to 45. This accurately represents what the evidence shows—75% reduction in closure time (4 days to 1) means roads reopened 3 days sooner, allowing businesses to operate, and 49% reduction in crashes (89 to 45) means 44 fewer accidents. Both metrics show substantial improvement, supporting that more snowplows reduce multiple blizzard impacts. Choice C incorrect because it uses all-or-nothing thinking—claiming failure because '1 day of closures is still a problem' ignores the 75% improvement. Common error where students require perfect elimination rather than significant reduction. Reducing closures from 4 days to 1 day is highly effective—businesses lose 75% less operating time, employees can work sooner, and economic impact is greatly reduced. One day closure in a blizzard is reasonable; four days is severe impact. Valid claims recognize major improvements as success. Help students make evidence-based claims about solutions: Teach reasonable expectations: Reducing impacts 75% (4 days→1) is excellent, not failure. Blizzards will always cause some disruption; goal is minimizing it. Practice multiple metrics: Business closures reduced 75% AND crashes reduced 49%—two different impacts both improved, strengthening evidence for effectiveness. Show practical impact: 3 fewer closure days means businesses open sooner, workers earn wages, services available—real benefits even if not perfect. Use percentage thinking: 75% reduction in closures and 49% reduction in crashes are major improvements worthy of 'effective' claim. Emphasize: Solutions that significantly reduce (not eliminate) impacts are effective—saving 3 business days and preventing 44 crashes demonstrates clear success in reducing blizzard impacts.
Question 5
Oak Street flooded 28 homes in 2018; after a retention pond was built, 8 heavy storms in 2020–2022 flooded about 3 homes per year and damage costs dropped from $200,000 to $25,000 per year. Based on the data provided, which conclusion about the pond is most accurate?
- The pond is effective because flooded homes dropped about 90% and damage costs dropped about 88%. (correct answer)
- The pond is not effective because some homes still flooded in a few storms.
- The pond eliminated all flooding forever, so no more rainwater will collect.
- The pond made flooding worse because it filled up during storms.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence (data, observations, measurements) not just opinions. Evidence includes quantitative data showing significant reductions in negative outcomes, before-after comparisons showing improvement, and consistent results over multiple events. In this scenario, the problem is street flooding damaging homes (before pond: 28 homes flooded in 2018, $200,000 damage per year). The solution implemented is a retention pond. Evidence collected after implementation includes: 8 heavy storms in 2020-2022 flooded only about 3 homes per year (89% reduction from 28 to 3), damage costs dropped from $200,000 to $25,000 per year (87.5% reduction), solution worked consistently across 8 storms. The claim to evaluate is which conclusion about the pond is most accurate. Choice A correct because it makes evidence-supported claim about solution effectiveness by citing specific data from the stimulus. The answer states the pond is effective and supports it with evidence: flooded homes dropped about 90% (from 28 to approximately 3, which is 89% reduction) and damage costs dropped about 88% (from $200,000 to $25,000, which is 87.5% reduction). This accurately represents what the evidence shows—major reductions demonstrate effectiveness, multiple trials (8 storms) show consistency, and both metrics (homes flooded and costs) show similar dramatic improvements. Shows understanding that claims require evidence support with specific percentages matching the data. Choice B incorrect because it contradicts evidence by focusing on remaining problem while ignoring major improvement. Common error where students require perfect elimination of all risk rather than significant reduction—claiming 'not effective because some homes still flooded' ignores that flooding dropped 89%. For example, reducing flooded homes from 28 to 3 is highly effective even though not 100% perfect. Valid claims must accurately represent magnitude of effect (89% reduction = highly effective, not 'not effective'). Help students make evidence-based claims about solutions: Teach magnitude interpretation: 10-30% reduction = partially effective, 50-80% = effective, 85-95% = highly effective. With 89% reduction in homes and 87.5% reduction in costs, this pond is highly effective. Practice identifying strong evidence: Multiple trials (8 storms), consistent results (about 3 homes each time), two metrics showing similar improvement (homes and costs both ~88-90% reduction). Show examples of understating: 'Not effective' when evidence shows 89% reduction—that's highly effective even if not perfect. Emphasize: Solutions that reduce impacts by 85-95% are highly effective and valuable—saving 25 of 28 homes from flooding (89%) is excellent performance.
Question 6
During Hurricane Ike in 2008, storm surge flooded 200 buildings and caused 12 deaths in a coastal town. After a 14-foot seawall was built, Hurricane Harvey in 2017 had a 13-foot surge. Behind the wall, 15 buildings flooded and 0 people died; north of the wall without protection, 85 buildings flooded and 3 people died. Residents said the wall protected them, but it would not stop water higher than 14 feet. Based on the evidence, which statement about the seawall is supported by the data?
- The seawall worked well in 2017 because flooding and deaths were much lower behind it than in 2008 and north of it. (correct answer)
- The seawall did nothing because there were still 15 flooded buildings behind it.
- The seawall is only effective when storm surge is higher than 14 feet.
- The seawall caused the 13-foot storm surge because it is made of concrete.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence including before-after comparisons (2008 without wall: 200 buildings flooded, 12 deaths vs 2017 with wall: 15 buildings, 0 deaths) and protected vs unprotected area comparisons (behind wall: 15 buildings, 0 deaths vs north of wall: 85 buildings, 3 deaths). In this scenario, the problem is hurricane storm surge causing flooding and deaths—Hurricane Ike (2008) flooded 200 buildings and caused 12 deaths. The solution implemented is a 14-foot concrete seawall built by 2012. Evidence collected after implementation includes: during Hurricane Harvey (2017) with 13-foot surge, behind the wall 15 buildings flooded and 0 people died while north of the wall without protection 85 buildings flooded and 3 people died. The claim to evaluate is about the seawall's effectiveness. Choice A correct because it makes an evidence-supported claim about solution effectiveness by citing specific comparative data. The answer states "The seawall worked well in 2017" and supports it with evidence: flooding was "much lower behind it than in 2008" (15 vs 200 buildings = 92.5% reduction) and "north of it" (15 vs 85 buildings shows protected area had 82% less flooding than unprotected area), plus deaths dropped from 12 to 0 behind the wall. This uses both temporal comparison (2008 vs 2017) and spatial comparison (behind wall vs north of wall) to prove effectiveness. Shows understanding that multiple comparisons strengthen evidence for causation. Choice B incorrect because it contradicts data using all-or-nothing thinking. Common error where students conclude "did nothing" if any problem remains, ignoring massive improvements. For example, stating the seawall "did nothing because there were still 15 flooded buildings" ignores evidence showing 92.5% reduction from 200 buildings and comparison showing 82% less flooding than unprotected area. This represents highly effective protection even though not 100% perfect. Valid claims must recognize that 92.5% reduction in flooding and 100% reduction in deaths represents engineering success. Help students make evidence-based claims about solutions: Teach multiple comparison methods: Temporal comparison (before/after): 2008 no wall = 200 buildings flooded, 12 deaths. 2017 with wall = 15 buildings, 0 deaths. Shows 92.5% improvement. Spatial comparison (with/without): Behind wall = 15 buildings, 0 deaths. North of wall = 85 buildings, 3 deaths. Shows wall area had 82% less flooding. Both comparisons together prove seawall effectiveness. Practice calculating effectiveness: Buildings: 200 → 15 = 92.5% reduction over time, 85 → 15 = 82% reduction vs unprotected. Deaths: 12 → 0 = 100% reduction over time, 3 → 0 = 100% protection vs unprotected. All metrics show high effectiveness. Address all-or-nothing thinking: "Still 15 flooded" ≠ "didn't work." 15 flooded vs 200 before = worked very well. Perfect protection rare—excellent protection valuable. Context matters: 13-foot surge vs 14-foot wall = within design limits. Emphasize: Engineering effectiveness means major risk reduction, not perfection—reducing flooding by 92.5% and eliminating deaths saves lives and property, making the seawall highly successful even with some remaining flooding.
Question 7
Before a 14-foot seawall, Hurricane Ike flooded 200 buildings and caused 12 deaths; after the wall, a 13-foot surge flooded 15 buildings and caused 0 deaths, while a nearby area without a wall had 85 flooded buildings and 3 deaths. Based on the evidence, is the seawall effective at reducing hurricane flood damage?
- No, the seawall did not work because hurricanes still happened.
- Yes, it reduced flooding and deaths: 200 to 15 flooded buildings and 12 to 0 deaths behind the wall. (correct answer)
- Yes, it stopped all damage everywhere, even in the area without a wall.
- No, it made flooding worse because 85 buildings flooded north of the wall.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence (data, observations, measurements) not just opinions. Evidence includes quantitative data (numbers showing outcomes—deaths before and after, damage costs, percentage reductions) and qualitative data (surveys, observations, user experiences). In this scenario, the problem is hurricane flooding causing deaths and building damage (before seawall: 200 flooded buildings, 12 deaths). The solution implemented is a 14-foot seawall. Evidence collected after implementation includes: 13-foot surge flooded only 15 buildings with 0 deaths behind the wall (92.5% reduction in flooded buildings, 100% reduction in deaths), while nearby area without wall had 85 flooded buildings and 3 deaths. The claim to evaluate is whether the seawall is effective at reducing hurricane flood damage. Choice B correct because it makes evidence-supported claim about solution effectiveness by citing specific data from the stimulus. The answer states the seawall reduced flooding and deaths and supports it with evidence: flooded buildings reduced from 200 to 15 (92.5% reduction) and deaths reduced from 12 to 0 (100% reduction) behind the wall. This accurately represents what the evidence shows—significant reductions demonstrate effectiveness, and comparison to area without wall (85 flooded buildings, 3 deaths) proves it's the seawall causing improvement not other factors. Shows understanding that claims require evidence support and should accurately represent data without overstating or understating. Choice A incorrect because it ignores evidence and uses faulty logic—claiming 'did not work because hurricanes still happened' contradicts data showing 92.5% reduction in flooded buildings and 100% reduction in deaths. Common error where students think solutions must prevent the hazard itself (stop hurricanes) rather than reduce its impacts (flooding, deaths). The seawall doesn't stop hurricanes from occurring but dramatically reduces their harmful effects, which is the goal. Help students make evidence-based claims about solutions: Teach claim-evidence structure: 'Claim: Seawall is highly effective at reducing hurricane flood damage. Evidence: Before seawall: 200 flooded buildings, 12 deaths. After seawall: 15 flooded buildings, 0 deaths. This is 92.5% reduction in flooding and 100% reduction in deaths, showing significant improvement.' Practice identifying strong evidence: Strong = specific numbers (200→15 buildings), clear comparisons (before/after, with/without wall), dramatic reductions. Use evidence evaluation checklist: Does claim match evidence? ✓ (92.5% reduction = highly effective). Cites specific data? ✓ (building and death numbers). Uses comparison? ✓ (before/after and with/without wall). Emphasize: Solutions that significantly reduce (not necessarily eliminate) hazard impacts are effective and valuable—reducing flooded buildings by 92.5% is highly effective even though 15 still flooded.
Question 8
A farm county had a severe drought in 2012, and 85% of farms lost crops. From 2013–2015, 120 farms installed drip irrigation. In a similar 2018 drought, 95% of farms with irrigation kept 75–95% of their normal crops, but 78% of farms without irrigation lost crops. Based on the evidence, what does the data show about drip irrigation?
- Drip irrigation is effective because most irrigated farms kept crops, while most non-irrigated farms lost crops. (correct answer)
- Drip irrigation is not effective because 15 farms had wells run low.
- Drip irrigation stops droughts, so the county will always get normal rain.
- Drip irrigation is effective because it uses more water than sprinklers.
Explanation: In 3rd grade science, students learn to make claims about the effectiveness of design solutions that reduce the impacts of weather-related hazards, using evidence as outlined in NGSS 3-ESS3-1. Making claims about solution effectiveness involves stating if a solution lessens hazard effects, supported by evidence such as comparisons and percentages, not vague statements; strong evidence shows significant differences like higher success rates with the solution versus without, over similar events, accurately claiming effectiveness for major improvements. In this scenario, the problem is a 2012 drought causing 85% of farms to lose crops; the solution is installing drip irrigation on 120 farms from 2013-2015; evidence from a similar 2018 drought shows 95% of irrigated farms keeping 75-95% of crops, versus 78% of non-irrigated farms losing crops. Choice A is correct because it claims effectiveness using control comparison evidence, noting most irrigated farms kept crops while most non-irrigated lost them, accurately demonstrating the solution's impact through with-versus-without data. Choice B is incorrect because it claims ineffectiveness due to 15 farms' wells running low, cherry-picking a limitation while ignoring the overall evidence of 95% success rate, a common mistake of understating major benefits. Use teaching strategies like claim-evidence: 'Claim: Drip irrigation is effective at reducing drought impacts. Evidence: 95% irrigated farms kept crops vs. 78% non-irrigated lost them.' Practice evaluating evidence strength, interpreting 75-95% as effective, and avoiding overemphasis on minor flaws.
Question 9
In 2018, cooling centers helped during a heat wave: 2,847 visits happened, and heat hospital visits dropped from 89 (2015) to 47 (2018). Based on the evidence, which statement about cooling centers is supported by the data?
- Cooling centers reduced heat sickness because hospital visits dropped from 89 to 47. (correct answer)
- Cooling centers did nothing because 47 is the same as 89.
- Cooling centers stopped all heat problems, so no one got sick at all.
- Cooling centers are harmful because they make people drink too much water.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence of reduced hospital visits. Evidence shows cooling centers reduced heat-related hospital visits by 47% while serving nearly 3,000 people. In this scenario, the problem is heat waves causing heat sickness requiring hospital treatment (2015: 89 hospital visits). The solution implemented is cooling centers. Evidence collected after implementation includes: 2,847 people visited cooling centers showing high usage, heat-related hospital visits dropped from 89 (2015) to 47 (2018)—a 47% reduction, comparison of similar heat waves provides before/after evidence. The claim to evaluate is which statement about cooling centers is supported by data. Choice A correct because it makes evidence-supported claim about solution effectiveness by citing specific data from the stimulus. The answer states cooling centers reduced heat sickness because hospital visits dropped from 89 to 47. This accurately represents what the evidence shows—47% reduction in hospital visits demonstrates effectiveness at preventing heat sickness, and the specific numbers (89 to 47) support the claim with data. High usage (2,847 visits) shows people accessed the solution, contributing to reduced hospitalizations. Choice B incorrect because it misrepresents data by claiming '47 is the same as 89.' Common error where students misread or misreport numbers. 47 is clearly different from 89—it's a reduction of 42 visits or 47% decrease. This represents 42 fewer people suffering heat sickness severe enough for hospitalization. Claiming these numbers are 'the same' contradicts basic math and the clear improvement shown in the data. Help students make evidence-based claims about solutions: Teach accurate data reporting: 89 to 47 is a reduction of 42 visits (47% decrease), not 'the same.' Always double-check numbers match the data provided. Practice calculating reductions: 89 - 47 = 42 fewer visits. 42 ÷ 89 = 0.47 = 47% reduction. This substantial decrease shows effectiveness. Show impact meaning: 42 fewer hospital visits means 42 people avoided serious heat sickness—real human benefit beyond just numbers. Connect usage to outcomes: 2,847 cooling center visits helped achieve 47% reduction in hospitalizations—shows solution was accessible and used. Emphasize: Accurate data representation is crucial—reducing hospital visits from 89 to 47 (47% reduction) demonstrates significant effectiveness at preventing heat sickness. Watch for: number errors, claiming different values are 'the same,' failing to calculate percentage changes that show impact magnitude.
Question 10
A city opened 10 cooling centers to help during heat waves. In 2015 (before centers), 24 people died and 89 went to the hospital for heat illness. In 2018 (with centers open), 2,847 people used the centers; 3 people died and 47 went to the hospital, and the 3 deaths were people who did not use centers. Based on the evidence, what does the evidence reveal about how well cooling centers work?
- Cooling centers are not useful because people still felt hot outside.
- Cooling centers are effective because deaths dropped from 24 to 3 and hospital visits dropped from 89 to 47, but they cannot help people who do not come. (correct answer)
- Cooling centers caused the heat wave because they used air conditioners.
- Cooling centers completely ended all heat illness, so nobody got sick in 2018.
Explanation: This question assesses the 3rd grade science skill of making claims about the effectiveness of a design solution that reduces the impacts of a weather-related hazard, aligned with NGSS 3-ESS3-1, by evaluating what the evidence reveals about how well cooling centers work. Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence such as data, observations, or measurements, not just opinions; strong evidence includes quantitative reductions in deaths and visits, before-and-after comparisons, and user-specific data like deaths only among non-users. Claims should accurately show significant reductions (e.g., 87.5% in deaths) as effective, acknowledging limitations like needing to attend without overstating to complete ending of all illness or misattributing causes. In this scenario, the problem is heat waves causing illness and deaths, with baseline data from 2015 showing 24 deaths and 89 hospital visits; the solution implemented is 10 cooling centers; evidence collected after implementation includes 2018 where 2,847 used centers, deaths dropped to 3 (all non-users, 87.5% reduction), and visits to 47 (47% reduction); the claim to evaluate is what the evidence reveals about cooling centers. Choice B is correct because it makes an evidence-supported claim about the solution's effectiveness by citing specific data from the stimulus, stating cooling centers are effective because deaths dropped from 24 to 3 and hospital visits from 89 to 47, using before-after comparisons to show significant reductions, and acknowledges they cannot help non-users, accurately matching the evidence without overstating. Choice D is incorrect because it overstates that centers completely ended all heat illness with nobody sick, contradicting data of 3 deaths and 47 visits, a common error where students exaggerate major reductions (87.5%) as total elimination, ignoring actual numbers and limitations in the evidence. To help students make evidence-based claims about solutions, teach the claim-evidence structure: 'Claim: Cooling centers are effective at reducing heat illness; Evidence: Deaths dropped 87.5% from 24 to 3 and visits 47% from 89 to 47, with deaths only among non-users.' Practice identifying strong evidence using a checklist: does the claim cite specifics like percentages, use comparisons, acknowledge limitations, avoid miscausation like blaming the solution for the hazard, and interpret magnitude correctly without all-or-nothing overstatements.
Question 11
Coastal Town built a 14-foot seawall to reduce hurricane storm surge flooding. In 2008 (before the wall), a storm surge flooded 200 buildings and 12 people died. In 2017 (after the wall), a 13-foot surge happened; behind the wall, 15 buildings flooded and 0 people died, but north of the wall (no wall) 85 buildings flooded and 3 people died. Using the data provided, which claim is best supported about the seawall?
- The seawall is not helpful because some buildings still flooded behind it.
- The seawall is effective because flooding and deaths were much lower behind it than before, and lower than areas without the wall. (correct answer)
- The seawall stopped the hurricane from reaching the town at all.
- The seawall is only for making the beach look nicer, not for safety.
Explanation: This question assesses the 3rd grade science skill of making claims about the effectiveness of a design solution that reduces the impacts of a weather-related hazard, aligned with NGSS 3-ESS3-1, by evaluating which claim is best supported about the seawall using the provided data. Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence such as data, observations, or measurements, not just opinions; evidence includes quantitative data like reductions in flooded buildings and deaths, before-and-after comparisons, and with-without comparisons to areas north of the wall. Strong claims accurately reflect significant reductions, such as much lower flooding behind the wall, and use data to show effectiveness without overstating to complete stoppage of the hurricane or understating remaining issues. In this scenario, the problem is hurricane storm surge flooding causing damage and deaths, with baseline data from 2008 showing 200 buildings flooded and 12 deaths; the solution implemented is a 14-foot seawall; evidence collected after implementation includes a 2017 13-foot surge where behind the wall 15 buildings flooded and 0 deaths, compared to north (no wall) with 85 flooded and 3 deaths, showing over 90% reduction in flooding and 100% in deaths behind the wall; the claim to evaluate is the best supported about the seawall. Choice B is correct because it makes an evidence-supported claim about the solution's effectiveness by citing specific data from the stimulus, stating the seawall is effective because flooding and deaths were much lower behind it than before (200 to 15 flooded, 12 to 0 deaths) and lower than areas without the wall (85 flooded, 3 deaths), using before-after and with-without comparisons to demonstrate significant reductions, accurately representing the data without overstating complete protection. Choice A is incorrect because it claims the seawall is not helpful due to some buildings still flooding, which understates the evidence of 92.5% reduction in flooded buildings and 100% in deaths, a common error where students ignore major improvements and comparisons, focusing on any remaining flooding with all-or-nothing thinking instead of recognizing significant reduction as effective. To help students make evidence-based claims about solutions, teach the claim-evidence structure: 'Claim: The seawall is effective at reducing flooding; Evidence: Flooded buildings dropped from 200 to 15 (92.5% reduction) behind the wall vs 85 without it.' Practice identifying strong evidence using a checklist: does the claim cite specific numbers and comparisons, acknowledge reductions without requiring zero issues, avoid unrelated distractors like appearance, and interpret data accurately without overstatement like 'stopped the hurricane'.
Question 12
In 2015, a heat wave caused 24 heat deaths; after 10 cooling centers opened, a similar 2018 heat wave had 3 deaths, and 2,847 people used centers. Using the evidence, what claim about cooling centers is supported?
- Cooling centers are not helpful because it still got hot outside.
- Cooling centers are effective because deaths dropped from 24 to 3 and many people used them. (correct answer)
- Cooling centers caused the heat wave to end sooner than usual.
- Cooling centers only help children, since adults do not need cool air.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence (data, observations, measurements) not just opinions. Evidence includes quantitative data (deaths before and after, usage numbers) showing significant reductions in negative outcomes and high utilization rates. In this scenario, the problem is heat waves causing deaths (2015 heat wave: 24 deaths). The solution implemented is 10 cooling centers. Evidence collected after implementation includes: similar 2018 heat wave had only 3 deaths (87.5% reduction from 24 to 3), 2,847 people used the centers showing high utilization, comparison of similar heat waves provides strong before/after evidence. The claim to evaluate is what claim about cooling centers is supported. Choice B correct because it makes evidence-supported claim about solution effectiveness by citing specific data from the stimulus. The answer states cooling centers are effective and supports it with evidence: deaths dropped from 24 to 3 (87.5% reduction) and many people used them (2,847 visits). This accurately represents what the evidence shows—major reduction in deaths demonstrates effectiveness, high usage shows people accessed the solution, and comparison of similar heat waves proves it's the cooling centers causing improvement. Shows understanding that 87.5% reduction in deaths is highly effective even though 3 deaths still occurred. Choice A incorrect because it ignores evidence and uses faulty logic—claiming 'not helpful because it still got hot outside' contradicts data showing 87.5% reduction in deaths. Common error where students think solutions must eliminate the hazard itself (stop heat) rather than reduce its impacts (prevent heat deaths). Cooling centers don't stop heat waves from occurring but dramatically reduce deaths by providing relief, which is the goal. The evidence clearly shows they helped save 21 lives. Help students make evidence-based claims about solutions: Teach claim-evidence structure: 'Claim: Cooling centers are effective at reducing heat deaths. Evidence: Deaths dropped from 24 to 3 (87.5% reduction), and 2,847 people used centers, showing both effectiveness and accessibility.' Practice recognizing solution purpose: Solutions reduce impacts of hazards, not eliminate hazards themselves—cooling centers reduce heat deaths, not stop heat; seawalls reduce flood damage, not stop hurricanes. Use evidence evaluation checklist: Does claim match evidence? ✓ (87.5% reduction = effective). Cites specific data? ✓ (death numbers and usage). Uses comparison? ✓ (2015 vs 2018 similar heat waves). Watch for: confusing hazard reduction (impossible—can't stop heat) with impact reduction (possible—can prevent deaths), all-or-nothing thinking (3 deaths means failure vs 21 lives saved means success).
Question 13
After the seawall was built, the storm surge was 13 feet, which is below the 14-foot wall, and flooding behind it dropped from 200 buildings to 15. Based on the evidence, what does the evidence reveal about how well the seawall works?
- It works well for surges lower than 14 feet, since flooding dropped a lot behind the wall. (correct answer)
- It works only if the surge is higher than the wall.
- It always stops all flooding, even if the surge is higher than 14 feet.
- It cannot help because it cost money to build.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence about performance under specific conditions. Evidence shows the seawall dramatically reduced flooding (200 to 15 buildings) when surge was below wall height, demonstrating effectiveness within design parameters. In this scenario, the problem is hurricane storm surge causing flooding (before seawall: 200 buildings flooded). The solution implemented is a 14-foot seawall. Evidence collected shows: storm surge was 13 feet (below the 14-foot wall height), flooding behind wall dropped from 200 buildings to 15 (92.5% reduction), the wall performed as designed when surge was lower than wall height. The claim to evaluate is what the evidence reveals about how well the seawall works. Choice A correct because it makes evidence-supported claim about solution effectiveness by accurately describing performance conditions. The answer states it works well for surges lower than 14 feet and supports this with evidence: flooding dropped significantly (92.5% reduction from 200 to 15 buildings) when the 13-foot surge was below the 14-foot wall. This accurately represents what the evidence shows—the seawall is highly effective within its design limits (surges below 14 feet), and acknowledging this condition shows understanding of how engineered solutions have specific operating parameters. The answer avoids overstating (works for all surges) or understating (doesn't work) the evidence. Choice C incorrect because it overstates effectiveness by claiming 'always stops all flooding, even if surge is higher than 14 feet.' Common error where students assume if something works once, it works in all conditions. The evidence only shows effectiveness for a 13-foot surge below the 14-foot wall—we cannot claim it would stop flooding from surges higher than the wall. Water higher than 14 feet would overtop the wall. Valid claims must match what evidence actually shows, not extend beyond tested conditions. Help students make evidence-based claims about solutions: Teach design parameters: Solutions work within specific conditions—14-foot wall protects against surges up to 14 feet, not unlimited heights. Evidence shows effectiveness at 13 feet, cannot claim effectiveness at 15+ feet. Practice accurate claims: 'Works well for surges below wall height' matches evidence. 'Works for all surges' exceeds evidence. 'Doesn't work' contradicts evidence. Claims must fit data precisely. Show conditional effectiveness: Seawall is highly effective (92.5% reduction) under tested condition (13-foot surge < 14-foot wall). This doesn't mean ineffective, means effective within design limits. Use engineering thinking: All solutions have operating ranges—umbrellas work in rain but not hurricanes, seawalls work up to their height. Recognizing conditions is sophisticated thinking. Emphasize: Effective solutions work well within their design parameters—14-foot seawall stopping 92.5% of flooding from 13-foot surge shows excellent performance within limits.
Question 14
Oak Street flooded in heavy rain: 28 homes flooded in 2018. The city built a 2-acre retention pond in 2019 to hold 2 million gallons. From 2020–2022, during 8 heavy storms, the pond filled and did not overflow onto streets. After the pond, an average of 3 homes flooded per year (about 90% fewer than 28). Flood damage costs dropped from about $200,000 per year to $25,000 per year (about 88% less). The pond cost $150,000 to build and saved about $175,000 each year. Some neighbors worried about mosquitoes, but the city treated the water. Based on the evidence, what claim about the retention pond is supported?
- The pond is not effective because a few homes still flooded after it was built.
- The pond is effective because flooded homes dropped from 28 to about 3 per year and costs fell to $25,000. (correct answer)
- The pond eliminated all flooding forever, so no homes will ever flood again.
- The pond works only because neighbors liked it, not because it held stormwater.
Explanation: This question tests 3rd grade ability to make claims about design solution effectiveness using evidence (NGSS 3-ESS3-1: make claim about merit of design solution that reduces impacts of weather-related hazard). Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence (data, observations, measurements) not just opinions. Evidence includes quantitative data (numbers showing outcomes—deaths before and after, damage costs, percentage reductions) and qualitative data (surveys, observations, user experiences). In this scenario, the problem is flooding on Oak Street causing 28 homes to flood in 2018 with $200,000 in damage costs. The solution implemented is a 2-acre retention pond built in 2019 to hold 2 million gallons of stormwater. Evidence collected after implementation includes: the pond filled but did not overflow in 8 heavy storms from 2020-2022, flooded homes dropped from 28 to an average of 3 per year (90% reduction), and damage costs dropped from $200,000 to $25,000 per year (88% reduction). The claim to evaluate is whether the retention pond is effective. Choice B correct because it makes an evidence-supported claim about solution effectiveness by citing specific data from the stimulus. The answer states the pond is effective and supports it with evidence: "flooded homes dropped from 28 to about 3 per year" (90% reduction) and "costs fell to $25,000" (88% reduction from $200,000). This accurately represents what the evidence shows—significant reductions demonstrate effectiveness, and the before/after comparison proves it's the solution causing improvement not other factors. Shows understanding that claims require evidence support and should accurately represent data without overstating or understating. Choice A incorrect because it ignores evidence and contradicts data. Common error where students focus on any remaining problem while ignoring major improvement, requiring perfect elimination of all risk rather than significant reduction. For example, claiming "not effective" contradicts evidence showing 90% reduction in flooded homes and 88% reduction in costs—this is highly effective even though not 100% perfect. Valid claims must: (1) Be supported by provided evidence (cite specific data), (2) Accurately represent magnitude of effect (major reduction vs minor improvement), (3) Use comparisons to demonstrate effectiveness (before vs after). Help students make evidence-based claims about solutions: Teach claim-evidence structure: "Claim: The retention pond is effective at reducing flooding. Evidence: Before solution: 28 homes flooded, $200,000 damage. After solution: 3 homes flooded, $25,000 damage. This is 90% reduction in homes and 88% reduction in costs, showing significant improvement." Practice identifying strong evidence: Strong = specific numbers (28→3 homes), clear comparisons (before/after), multiple trials (worked in 8 storms), cost-benefit (saved $175,000/year vs $150,000 cost). Use evidence evaluation checklist: Does claim match evidence? ✓ (90% reduction = "effective"). Cites specific data? ✓ (28→3 homes, 200,000→25,000). Uses comparison? ✓ (before/after pond). Emphasize: Solutions that significantly reduce (not necessarily eliminate) hazard impacts are effective and valuable—saving 25 of 28 homes from flooding (90%) is highly effective even though 3 homes still flooded. Question 15
Oak Street built a retention pond to reduce flooding. Before the pond (2018), 28 homes flooded and damage was about $200,000. After the pond (2020–2022), there were 8 heavy storms and the pond filled without overflowing; the neighborhood averaged 3 flooded homes per year and $25,000 damage per year. Based on the evidence, is the retention pond effective at reducing flooding problems?
- Yes, because it made flooding disappear forever and no homes ever flooded again.
- Yes, because the data shows about a 90% drop in flooded homes (28 to about 3 per year) and much less damage ($200,000 to $25,000). (correct answer)
- No, because the pond cannot stop rain from falling in the first place.
- No, because the pond filled up during storms, so it must be failing.
Explanation: This question assesses the 3rd grade science skill of making claims about the effectiveness of a design solution that reduces the impacts of a weather-related hazard, aligned with NGSS 3-ESS3-1, by evaluating if the retention pond is effective based on the evidence. Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence such as data, observations, or measurements, not just opinions; strong evidence includes quantitative data like percentage drops in flooded homes and damage, before-and-after comparisons over multiple storms, and observations like the pond filling without overflowing. Claims should accurately match the data, such as 'effective' for about 90% reduction, acknowledging significant improvement without overstating to complete elimination, and using comparisons to show the solution's impact. In this scenario, the problem is flooding in Oak Street, with baseline data from 2018 showing 28 homes flooded and $200,000 damage; the solution implemented is a retention pond; evidence collected after implementation from 2020–2022 includes the pond filling without overflowing during 8 heavy storms, with average 3 flooded homes per year (89% reduction) and 25,000damageperyear(87.5200,000 to $25,000), using before-after comparisons and multiple-event consistency to demonstrate significant reductions, accurately representing the magnitude without overstating to no flooding ever. Choice D is incorrect because it overstates that the pond made flooding disappear forever with no homes ever flooded again, which contradicts evidence of averaging 3 flooded homes per year, a common error where students exaggerate major reductions (89%) as complete elimination instead of citing actual data and acknowledging limitations. To help students make evidence-based claims about solutions, teach the claim-evidence structure: 'Claim: The retention pond is effective at reducing flooding; Evidence: Flooded homes dropped 89% from 28 to 3 per year over 8 storms, damage 87.5% from $200,000 to $25,000.' Practice identifying strong evidence using a checklist: does the claim match evidence with percentages, use comparisons, avoid understating by misinterpreting normal function like filling up as failure, and distinguish reducing impacts from preventing the weather event itself. Question 16
A seawall is 14 feet tall. In 2017, a hurricane storm surge was measured at 13 feet, and behind the wall only 15 buildings flooded and 0 people died. The city notes the wall would not stop a surge higher than 14 feet. Based on the evidence, what does this show about how well the seawall works?
- The seawall works in all storms, even if the surge is much higher than 14 feet.
- The seawall does not work because some erosion happened on the wall.
- The seawall works well for surges below 14 feet, but it may fail if water rises higher. (correct answer)
- The seawall is not needed because hurricanes will not return to the town.
Explanation: In 3rd grade science, students learn to make claims about the effectiveness of design solutions that reduce the impacts of weather-related hazards, using evidence as outlined in NGSS 3-ESS3-1. Making claims about solution effectiveness requires evidence-supported statements on impact reduction, including limitations; strong evidence uses specific outcomes, comparisons, and notes boundaries like design specs, claiming conditional effectiveness accurately. In this scenario, the problem is hurricane storm surges; the solution is a 14-foot seawall; evidence shows during a 13-foot surge in 2017, only 15 buildings flooded and 0 deaths behind the wall, but the city notes it won't stop surges over 14 feet. Choice A is correct because it claims the seawall works well for surges below 14 feet but may fail higher, supported by evidence of success at 13 feet and the explicit limitation, accurately acknowledging boundaries without overstating. Choice B is incorrect because it overstates that it works in all storms even above 14 feet, contradicting the evidence of the wall's height limit, a common error of ignoring limitations. Help with claim-evidence: 'Claim: Seawall is effective for surges under 14 feet. Evidence: At 13 feet, 15 floods and 0 deaths, but noted limit above 14 feet.' Teach checklists for citing data, matching magnitude, and balancing successes with limits to avoid overstatements.
Question 17
A city opened 10 cooling centers during heat advisories. During a later heat wave, 2,847 people used the centers, and 94% said the centers helped prevent heat sickness. Heat-related deaths dropped from 24 (in 2015) to 3 (in 2018), and all 3 deaths were people who did not use the centers. Based on the evidence, which statement is supported?
- Cooling centers are effective at reducing heat deaths, but people must use them to be protected. (correct answer)
- Cooling centers are not effective because 3 people still died during the heat wave.
- Cooling centers are effective because they make outdoor temperatures drop to 75°F.
- Cooling centers are effective only because the city had 10 buildings, not because of the results.
Explanation: In 3rd grade science, students learn to make claims about the effectiveness of design solutions that reduce the impacts of weather-related hazards, using evidence as outlined in NGSS 3-ESS3-1. Making claims about solution effectiveness involves evidence-based statements on reductions, noting requirements like usage; strong evidence includes usage data, reductions, surveys, and limitations, claiming conditional success accurately. In this scenario, the problem is heat waves causing deaths like 24 in 2015; the solution is opening 10 cooling centers; evidence shows 2,847 users in 2018 with 94% reporting help, deaths dropping to 3 (all non-users), from 24 before. Choice A is correct because it claims centers reduce deaths but require use, supported by evidence of 88% death reduction and non-user deaths, accurately acknowledging the limitation. Choice B is incorrect because it denies effectiveness due to 3 deaths, ignoring the evidence that all deaths were non-users and major overall drop, understating via all-or-nothing thinking. Use claim-evidence: 'Claim: Centers are effective but require use. Evidence: Deaths from 24 to 3 (88% drop), all 3 non-users, 94% users helped.' Teach balancing successes with limitations and interpreting high reductions as effective.
Question 18
Farm County had a severe drought in 2012: only 2 inches of rain in 4 months (normal is 20 inches). About 85% of farms lost crops and losses were $30 million. From 2013–2015, 120 farms installed drip irrigation. In a similar 2018 drought (3 inches of rain in 5 months), 95% of farms with irrigation kept 75–95% of normal crop yield, but 78% of farms without irrigation lost crops. County losses were $8 million. Based on the evidence, which statement about drip irrigation is supported by the data?
- Drip irrigation is effective because most irrigated farms kept crops while many non-irrigated farms lost crops, and county losses dropped from $30 million to $8 million. (correct answer)
- Drip irrigation is not effective because it uses water during a drought.
- Drip irrigation made the drought end sooner, so it caused more rain.
- Drip irrigation always works perfectly, so no farm ever had any problems.
Explanation: This question assesses the 3rd grade science skill of making claims about the effectiveness of a design solution that reduces the impacts of a weather-related hazard, aligned with NGSS 3-ESS3-1, by evaluating which statement about drip irrigation is supported by the data. Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence such as data, observations, or measurements, not just opinions; strong evidence includes quantitative data like crop yield percentages and loss reductions, comparisons between farms with and without the solution, and before-and-after county-wide data for similar droughts. Claims should accurately represent the evidence, such as 'effective' for major improvements in yields during drought, using comparisons to show the solution's impact, and avoiding overstatements like perfect performance or unrelated effects like ending the drought. In this scenario, the problem is severe droughts causing crop losses, with baseline data from 2012 showing 2 inches of rain in 4 months, 85% of farms losing crops, and $30 million in losses; the solution implemented is drip irrigation installed on 120 farms from 2013–2015; evidence collected after implementation includes a similar 2018 drought where 95% of irrigated farms kept 75–95% of normal yield versus 78% of non-irrigated farms losing crops, and county losses dropped to $8 million (73% reduction); the claim to evaluate is the supported statement about drip irrigation. Choice A is correct because it makes an evidence-supported claim about the solution's effectiveness by citing specific data from the stimulus, stating drip irrigation is effective because most irrigated farms kept crops while many non-irrigated lost them, and county losses dropped from $30 million to $8 million, using with-without comparisons and before-after data to demonstrate significant reductions (73% in losses) and high yields (75–95%), accurately showing it reduces drought impacts. Choice D is incorrect because it overstates that drip irrigation always works perfectly with no problems, which contradicts evidence that irrigated farms kept 75–95% (not 100%) of yield, a common error where students exaggerate minor or partial successes as complete solutions without citing actual data, ignoring limitations shown in the percentages. To help students make evidence-based claims about solutions, teach the claim-evidence structure: 'Claim: Drip irrigation is effective at reducing drought impacts; Evidence: 95% of irrigated farms kept 75–95% yield vs 78% non-irrigated lost crops, losses from $30M to $8M (73% reduction).' Practice identifying strong evidence using a checklist: does the claim use comparisons like with-without, cite specific percentages and reductions, match magnitude without overstating (e.g., 73% as effective, not 'perfect'), avoid misattributing effects like causing rain, and watch for understating by focusing on water use instead of outcomes.
Question 19
Tornadoes can destroy homes and hurt people. A community built 50 underground storm shelters made of strong concrete that can handle 250+ mph winds and hold 6–8 people. Over 2 years, 5 tornadoes hit the area: all 50 shelters stayed undamaged, and 347 people used shelters with 0 injuries or deaths among shelter users. During those tornadoes, 23 homes above shelters were destroyed, but the people in shelters survived; 2 deaths happened when people did not reach a shelter in time. Based on the evidence, is the claim "Underground storm shelters are effective at protecting people from tornadoes" supported?
- No, because tornadoes still destroyed 23 homes, so shelters did nothing.
- Yes, because all shelters survived 5 tornadoes and 347 users had 0 injuries or deaths, but people must reach the shelter in time. (correct answer)
- Yes, because shelters stop tornadoes from forming in the sky.
- No, because 2 people died, so shelters never work.
Explanation: This question assesses the 3rd grade science skill of making claims about the effectiveness of a design solution that reduces the impacts of a weather-related hazard, aligned with NGSS 3-ESS3-1, by evaluating if evidence supports the claim that underground storm shelters are effective. Making claims about solution effectiveness means stating whether a solution works well at reducing hazard impacts, supported by evidence such as data, observations, or measurements, not just opinions; evidence includes quantitative data like zero injuries among users and survival rates, comparisons over multiple events like 5 tornadoes, and outcomes showing protection when used. Strong claims accurately reflect significant protections even with limitations like needing to reach the shelter, using data to show reductions in injuries rather than requiring no deaths at all, and consistent results to demonstrate reliability. In this scenario, the problem is tornadoes destroying homes and causing injuries or deaths; the solution implemented is 50 underground storm shelters built of strong concrete to handle 250+ mph winds, each holding 6–8 people; evidence collected after implementation over 2 years includes all 50 shelters surviving 5 tornadoes undamaged, 347 users with 0 injuries or deaths, though 23 homes above were destroyed and 2 deaths occurred among non-users who didn't reach shelters; the claim to evaluate is whether underground storm shelters are effective at protecting people from tornadoes. Choice B is correct because it makes an evidence-supported claim about the solution's effectiveness by citing specific data from the stimulus, stating yes because all shelters survived 5 tornadoes and 347 users had 0 injuries or deaths, using multiple-event consistency and user outcomes to show 100% protection when used, and appropriately acknowledges the limitation that people must reach the shelter in time, accurately matching the evidence of zero harm to users despite some external deaths. Choice D is incorrect because it claims shelters never work due to 2 deaths, which cherry-picks unfavorable evidence and ignores data showing 0 injuries among 347 users across 5 events, a common error of all-or-nothing thinking where students require perfect elimination of all deaths rather than recognizing significant protection for those who use it, and failing to distinguish between users and non-users. To help students make evidence-based claims about solutions, teach the claim-evidence structure: 'Claim: Storm shelters are effective at protecting people from tornadoes; Evidence: All 50 survived 5 tornadoes with 0 injuries among 347 users, though 2 non-users died.' Practice identifying strong evidence using a checklist: does the claim cite specific data like user numbers and multiple trials, acknowledge limitations like access needs, avoid overstating to 'stops tornadoes' or understating by focusing only on failures, and use comparisons to show the solution's role in safety.
Question 20
In a county blizzard in 2018, 22 inches of snow made roads impassable; major roads took 48 hours to clear and 2 people died waiting for an ambulance. The county bought 15 more snowplows and 10 salt trucks. In a similar 2021 blizzard, major roads were cleared in 8 hours, emergency services answered all 31 calls, and there were 0 deaths from delayed response. Based on the evidence, which statement is supported by the data?
- The new snowplows were effective because 82% of people were satisfied, even without time data. (correct answer)
- The new snowplows were effective because clearing time improved from 48 hours to 8 hours and delayed-response deaths went from 2 to 0.
- The new snowplows made it stop snowing, so blizzards will not happen again.
- The new snowplows were not effective because snow-related crashes still happened in 2021.
Explanation: In 3rd grade science, students learn to make claims about the effectiveness of design solutions that reduce the impacts of weather-related hazards, using evidence as outlined in NGSS 3-ESS3-1. Making claims about solution effectiveness involves stating if a solution reduces hazard impacts well, supported by evidence such as measurements or data, not opinions; strong evidence features significant outcome reductions, before-after comparisons, multiple trials, and cost benefits, with claims accurately reflecting data like 'effective' for 50-80% improvements. In this scenario, the problem is a 2018 blizzard with 22 inches of snow making roads impassable for 48 hours and causing 2 deaths from delayed responses; the solution is buying 15 more snowplows and 10 salt trucks; evidence after includes major roads cleared in 8 hours during a similar 2021 blizzard, all 31 emergency calls answered, and 0 delayed-response deaths. Choice A is correct because it supports the claim of effectiveness with specific evidence like clearing time improving from 48 to 8 hours and deaths from 2 to 0, accurately showing significant reductions through before-after comparison. Choice B is incorrect because it claims ineffectiveness due to remaining snow-related crashes, ignoring the evidence of major improvements in clearing time and zero delayed deaths, a common flaw of focusing on unrelated or minor issues while understating key data. Help students with claim-evidence: 'Claim: Snowplows are effective at reducing blizzard impacts. Evidence: Clearing time dropped from 48 to 8 hours (83% faster) and delayed deaths from 2 to 0.' Teach magnitude: 80%+ improvements are effective, and warn against cherry-picking negative evidence or ignoring comparisons.