Use test results to evaluate how well the device meets...

SECTION 1

Historical Context & Motivation

Have you ever built something and wondered, "Does this actually work?" Engineers ask this question every single day. They don't just guess — they test their designs and use the results to make decisions. This process of testing and evaluating has a long history.

Throughout history, people have improved designs by trying them out and learning from results. Early engineers didn't always keep careful records. Over time, scientists and engineers developed better ways to collect and compare data. Today, design criteria (the specific goals a device must meet) guide every engineering project.

~3000 BCE

Ancient Egyptian Construction

Builders tested ramp designs and stone-cutting tools to construct pyramids. They kept records of which methods moved blocks most efficiently.

1769

James Watt's Steam Engine

Watt measured how much energy his steam engine produced compared to horses. He used test results to improve the engine design over many versions.

1903

Wright Brothers' Flight Tests

The Wright brothers tested hundreds of wing shapes in a small wind tunnel. They compared lift data to decide which design would fly best.

2012

NGSS Engineering Practices

The Next Generation Science Standards brought engineering design into every science classroom. Students now learn to test, evaluate, and improve devices using evidence.

The big question engineers always face is: How do you know if your device actually meets the goals you set? You need test data — and you need a clear way to compare that data to your design criteria.

SECTION 2

Core Principles of Evaluating Designs

Before you can evaluate a device, you need to understand a few key ideas. These principles help you connect your test results back to the goals of your design.

Design Criteria

Design criteria are the specific goals your device must meet. For example, "The solar oven must heat water to at least 50 °C in 20 minutes." Criteria tell you what success looks like.

Design Constraints

Design constraints are the limits you must work within. These include budget, available materials, size, and time. Constraints shape what solutions are possible.

Test Results (Data)

Test results are the measurements you collect when you try your device. Good tests are fair — you only change one variable at a time. You record numbers, not just opinions.

Evaluation

Evaluation means comparing your test results to your design criteria. Did the device meet the goal? By how much did it succeed or fall short? Evaluation uses evidence, not feelings.

Iteration

Iteration means improving your design based on what you learned. After evaluating, you redesign, rebuild, and retest. Engineers often go through many iterations before a design works well.

✦ KEY TAKEAWAY

Think of design criteria like a recipe's directions. If the recipe says "bake until golden brown," you check the color of your food — you don't just guess. In engineering, your test results are like checking the color. You compare what you measured to what the criteria said should happen. If it matches, great! If not, you adjust and try again.

SECTION 3

The Engineering Design Cycle — A Visual Guide

The diagram below shows how testing and evaluation fit into the engineering design process. Notice that the process is a cycle, not a straight line. After you evaluate, you go back and improve your design.

The engineering design process is a cycle with five main stages. The Evaluate Results stage (green) is where you compare your test data to design criteria. If the device falls short, you loop back through the cycle.

The cycle shows that evaluation is not the end. It's a turning point. When test results don't meet criteria, you go back and redesign. When results do meet criteria, you can be confident your device works. This is how the Crosscutting Concept of Cause and Effect shows up in engineering — every design change (cause) produces a measurable result (effect).

SECTION 4

How to Compare Test Data to Design Criteria

Let's walk through the steps of evaluating a device. Imagine your class is designing a solar-powered water heater. Your design criteria say the device must heat 200 mL of water by at least 15 °C in 30 minutes, using only sunlight and costing less than $5 in materials.

Step-by-Step Evaluation Process

Step 1 — Identify your criteria. Write down every goal the device must meet. Include numbers whenever possible.
Step 2 — Conduct a fair test. Keep all variables the same except the one you are testing. Record measurements carefully.
Step 3 — Organize your data. Use a data table or graph. Make it easy to read and compare.
Step 4 — Compare data to criteria. For each criterion, ask: Did the device meet the goal? By how much did it pass or fail?
Step 5 — Decide and explain. Use evidence to state whether the device met each criterion. If it didn't, explain what could be changed.

TEMPERATURE CHANGE

ΔT = T_final − T_initial

ΔT = change in temperature (°C). T_final = ending temperature. T_initial = starting temperature. If ΔT ≥ 15 °C, the device meets the temperature criterion.

PERCENT OF GOAL ACHIEVED

Percent of Goal = (Measured Value ÷ Target Value) × 100

This formula helps you see how close you got. If the target is 15 °C and you measured 12 °C, then (12 ÷ 15) × 100 = 80%. You reached 80% of your goal.

🔬 Science & Engineering Practice

When you use test data to evaluate a design, you are using the SEP called Constructing Explanations and Designing Solutions. You explain your conclusions using evidence from your data, not just opinions.

SECTION 5

Reading Test Results — A Solar Heater Example

Let's look at real test data from three different solar heater prototypes. Each team used the same amount of water and tested on the same sunny day. The design criteria were: heat water by at least 15 °C in 30 minutes and cost under $5.

Solar Heater Prototype Test Results

Prototype	Start Temp (°C)	End Temp (°C)	ΔT (°C)	Cost ($)	Met Criteria?
Team A — Black Box	22	40	18	$3.50	Yes ✓
Team B — Foil Funnel	21	33	12	$2.00	No ✗ (temp)
Team C — Glass Lid	22	39	17	$6.25	No ✗ (cost)

This bar chart shows each team's temperature change (ΔT). The dashed red line marks the 15 °C criterion. Team A (green) exceeded the goal. Team B (orange) fell short. Team C (cyan) passed the temperature goal but went over budget.

Notice the pattern in this data. Only Team A met both criteria. Team B's heater did not absorb enough energy from sunlight. Team C's heater worked well, but it cost too much. Using the Crosscutting Concept of Patterns, you can see that meeting all criteria at once is the real challenge in engineering.

SECTION 6

Worked Example — Evaluating a Wind-Powered Car

A student builds a wind-powered car for a classroom challenge. The design criteria are: (1) travel at least 3 meters in a straight line, (2) use only wind energy from a single fan, and (3) weigh no more than 200 grams. Let's evaluate the test results.

Evaluating the Wind-Powered Car

Step 1 — List the Design CriteriaCriterion 1: Distance ≥ 3 meters. Criterion 2: Only wind energy from one fan. Criterion 3: Mass ≤ 200 grams.

Step 2 — Record the Test ResultsThe student ran three trials. Trial 1: 2.8 m. Trial 2: 3.2 m. Trial 3: 3.0 m. The car used only one fan. The car's mass was 185 grams.

Step 3 — Calculate the Average DistanceAverage = (2.8 + 3.2 + 3.0) ÷ 3 = 9.0 ÷ 3 = 3.0 meters.

Average distance = 3.0 m

Step 4 — Compare Each CriterionCriterion 1: 3.0 m ≥ 3.0 m → Met ✓ (just barely). Criterion 2: Only one fan used → Met ✓. Criterion 3: 185 g ≤ 200 g → Met ✓.

Step 5 — State Your Conclusion with EvidenceThe wind-powered car met all three design criteria. However, the average distance was exactly at the minimum. One trial (2.8 m) actually fell short. The student could improve the design by adding a larger sail to capture more wind energy. This would increase the distance and give a bigger safety margin.

Conclusion: Device meets criteria, but iteration is recommended.

⚡ Energy Connection

In this example, kinetic energy from moving air (wind) transferred to the car, giving it kinetic energy of motion. The DCI for Energy says that energy can be transferred between objects. The design criteria measured how well the car captured and used that transferred energy.

SECTION 7

Strengths and Limitations of Different Evaluation Methods

There are several ways to evaluate a device. Some methods are more useful than others depending on the situation. The table below compares common evaluation strategies you might use in a classroom investigation.

Comparing Evaluation Methods

Evaluation Method	Strengths	Limitations
Single Trial Test	Quick to complete; gives an immediate result	One trial may not represent typical performance; results could be an outlier
Multiple Trials with Averages	More reliable; unusual results are balanced out; shows consistency	Takes more time; requires careful record-keeping
Criteria Checklist (Pass/Fail)	Simple and clear; easy to communicate results	Doesn't show how close you were to meeting a goal — just yes or no
Scoring Rubric (Points)	Shows degree of success; allows comparison across many designs	Can be subjective if categories are not clearly defined
Graph or Visual Display	Makes patterns and trends easy to spot; great for presentations	Can be misleading if scales are not chosen carefully

✦ KEY TAKEAWAY

Choosing an evaluation method is like choosing the right tool for a job. A hammer is great for nails, but terrible for screws. Similarly, a pass/fail checklist is great for quick decisions, but a scoring rubric is better when you need to compare many designs in detail. The best evaluation uses multiple types of evidence — numbers, graphs, and clear explanations.

SECTION 8

Connecting to Advanced Engineering and Energy Concepts

The evaluation skills you learn now are the same ones used by professional engineers. As you move into high school and beyond, the criteria get more complex and the data gets more detailed. Here is how middle school evaluation connects to more advanced ideas.

Middle School vs. Advanced Engineering Evaluation

Middle School Level	Advanced Level
Compare one test result to one criterion	Use statistical analysis (mean, range, standard deviation) across many trials
Pass/fail evaluation	Weighted scoring matrices that rank criteria by importance
Measure temperature change (ΔT)	Calculate thermal energy transfer: Q = m × c × ΔT
One design iteration	Many iterations with computer simulations before building
Evaluate within classroom constraints	Evaluate for safety, environmental impact, and long-term reliability

The Crosscutting Concept of Energy and Matter connects all of these levels. Whether you are measuring how warm water gets or calculating the joules of thermal energy, you are always tracking how energy moves through a system. That tracking is exactly what evaluation is all about — checking if the energy transfer did what you needed it to do.

🚀 Looking Ahead

In high school physics, you will learn the equation Q = m × c × ΔT to calculate exactly how much thermal energy was absorbed by water. That equation puts a precise number on what you are already evaluating in middle school — did the device transfer enough energy?

SECTION 9

Practice Problems

PROBLEM 1 — CONCEPTUAL

What is the purpose of comparing test results to design criteria? A) To prove that your design is the best one in the class B) To determine, using evidence, whether the device meets its goals C) To make your device look good for a presentation D) To find out who built the most expensive device

PROBLEM 2 — BASIC CALCULATION

A student tests an insulated cup. The criterion says the water temperature must stay above 60 °C after 15 minutes. The starting temperature is 80 °C. After 15 minutes the temperature is 58 °C. What is the temperature change, and did the device meet the criterion? A) ΔT = 22 °C; Yes, it met the criterion B) ΔT = 22 °C; No, it did not meet the criterion C) ΔT = 58 °C; Yes, it met the criterion D) ΔT = 138 °C; No, it did not meet the criterion

PROBLEM 3 — INTERMEDIATE

Three teams build egg-drop devices. Criteria: The egg must survive a 3-meter drop, and the device must weigh under 100 g. Team X: egg survived, device = 95 g. Team Y: egg cracked, device = 72 g. Team Z: egg survived, device = 110 g. Which team fully met all criteria? A) Team X only B) Team Y only C) Team Z only D) Teams X and Z both met all criteria

PROBLEM 4 — APPLIED

You design a solar cooker with the criterion: heat water by at least 20 °C in 30 minutes. In your test, the starting temperature is 24 °C and the ending temperature is 38 °C. What percentage of the temperature goal did you achieve, and what is one design improvement you could suggest? A) 70%; add more reflective material to concentrate sunlight B) 53%; paint the container white C) 70%; remove the lid so heat escapes D) 190%; the device exceeded the goal

PROBLEM 5 — CRITICAL THINKING

A student runs three trials of a wind-powered car. Distances: Trial 1 = 4.5 m, Trial 2 = 1.2 m, Trial 3 = 4.3 m. The criterion is to travel at least 3 meters. The student says, "My average is 3.3 m, so I met the criterion." A classmate argues the data is unreliable. Who is making the stronger argument, and why? A) The student, because the average meets the criterion B) The classmate, because Trial 2 is very different from the others and suggests the device is inconsistent C) The student, because two out of three trials passed D) The classmate, because the car should travel exactly the same distance every time

SUMMARY

Lesson Summary

Engineers use test results to evaluate how well a device meets design criteria — the specific goals set before building. Evaluation means comparing measured data (like temperature change or distance traveled) to each criterion. A device must meet all criteria and constraints to be considered successful. Running multiple trials and calculating averages makes your evaluation more reliable.

The engineering design process is a cycle: define, set criteria, build, test, and evaluate. When test data shows a device falls short, engineers use iteration to redesign and improve. The Crosscutting Concepts of Cause and Effect and Patterns help you connect design changes to measurable outcomes. Whether you are building a solar heater or a wind-powered car, evidence-based evaluation is the key to successful engineering.