Use test results to modify and optimize the device's performance - Middle School Physical Science

SECTION 1

Why Testing and Improving Matters

Have you ever built something that didn't work the first time? Maybe a paper airplane that nose-dived, or a bridge made of spaghetti that collapsed. You probably changed something and tried again. That process of testing, modifying, and retesting is exactly what engineers and scientists have done for centuries.

Throughout history, people have improved devices by studying how materials behave. They tested different materials and designs. Then they used those results to make things work better. This is the heart of the engineering design process (a step-by-step method engineers use to solve problems).

1760s • James Watt Improves the Steam Engine

Watt tested early steam engines and found they wasted a lot of heat energy. He added a separate condenser to keep the cylinder hot. This simple change made the engine much more efficient.

1903 • The Wright Brothers' First Flight

The Wright brothers tested over 200 wing shapes in a wind tunnel they built. They used the data to pick the best wing design. Their careful testing led to the first powered airplane flight.

1960s • NASA Develops Heat Shield Materials

Engineers tested many materials to protect spacecraft during re-entry. They measured how each material handled extreme heat. The best-performing material was chosen for the Apollo capsules.

2010s • Modern 3D-Printed Prosthetics

Engineers now 3D-print artificial hands and test them with real users. They collect feedback and data, then redesign the parts. Each new version works better than the last.

Notice a pattern? In every case, engineers did not guess. They collected test data, studied it, and then made changes based on what the data showed. The big question is: How do you use test results to figure out what to change?

SECTION 2

Core Principles of Testing and Optimization

Before you can improve a device, you need to understand a few key ideas. These principles guide every engineer and scientist when they work to make something better. Let's explore them one at a time.

Define Success with Criteria

Criteria (requirements a device must meet) tell you what 'good enough' looks like. For example, a water filter must remove at least 90% of particles.

Identify Constraints

Constraints (limits you must work within) include things like cost, time, and available materials. You can't spend a million dollars on a school project!

Test with Fair Comparisons

Change only one variable (a factor you can change) at a time. This way, you know exactly what caused any difference in results.

Use Data to Make Decisions

Record your measurements carefully. Look for patterns (repeating trends in data) that show which design works best.

Iterate to Optimize

Optimization (making something as good as possible) means repeating the test-change-retest cycle. Each round gets you closer to the best design.

✦

KEY TAKEAWAY

Think of optimizing a device like leveling up in a video game. Each time you play a level, you learn what works and what doesn't. You use that information to change your strategy. After several tries, you beat the level. Engineers do the same thing — each test is a 'round' that teaches them how to improve.

SECTION 3

The Engineering Design Cycle

The diagram below shows the engineering design cycle. This is the repeating loop that engineers follow when they build, test, and improve a device. Notice that it is a circle, not a straight line. That's because you often go around more than once!

The six steps of the engineering design cycle. After Step 6 (Improve), the arrow loops back to Step 1 (Define). Each loop is called an iteration (one complete round of testing and improving).

Look at how Step 4 (Test) leads directly into Step 5 (Analyze). This is where you study your data. Then Step 6 (Improve) is where you actually change something based on what you learned. The cycle then loops back to Step 1, where you check whether the improved design meets your criteria. If it does, you're done. If not, you go around again!

SECTION 4

How to Analyze Test Results

Collecting data is only the first step. You also need to understand what the data is telling you. Let's look at how scientists and engineers turn numbers into useful decisions.

Comparing Results to Criteria

Imagine you designed a thermal cup to keep hot chocolate warm. Your criterion is: the liquid must stay above 50°C for at least 30 minutes. You test three different insulating materials and record the temperature every 5 minutes. Now you compare each material's data to the 50°C target.

TEMPERATURE CHANGE

ΔT = T_final − T_initial

ΔT ("delta T") = the change in temperature. T_final = temperature at the end. T_initial = temperature at the start. A smaller |ΔT| means less heat was lost, which is better for our cup.

Calculating Percent Change

Sometimes you want to express improvement as a percentage. This helps you compare different rounds of testing, even if the starting values were different.

PERCENT IMPROVEMENT

Percent Improvement = ((New Value − Old Value) ÷ Old Value) × 100%

If Version 1 of your cup kept liquid warm for 20 minutes, and Version 2 kept it warm for 30 minutes: ((30 − 20) ÷ 20) × 100% = 50% improvement.

Looking for Patterns in Data

When you test a device multiple times, look for patterns in the numbers. Does one material always perform better? Does the device fail at the same spot each time? Patterns help you figure out cause and effect — what is causing the problem, and what change might fix it.

ℹ

NGSS Connection: Crosscutting Concept

Cause and Effect: When you change one variable (like the insulating material) and see a change in the result (temperature stays higher), you have identified a cause-and-effect relationship. This is a key thinking tool in all of science!

SECTION 5

Reading Test Data to Choose the Best Material

Let's look at a real example. Suppose a team of students is designing a thermal cup. They test three insulation materials — foam, cotton, and aluminum foil. They start with hot water at 80°C and measure the temperature every 10 minutes for 30 minutes.

Time (min)	Foam (°C)	Cotton (°C)	Aluminum Foil (°C)
0	80	80	80
10	72	65	60
20	65	55	48
30	58	46	38

Temperature readings for three insulation materials over 30 minutes

This line graph shows how quickly each material lost heat. The dashed red line marks the 50°C criterion. Foam (green line) stayed above 50°C the longest, making it the best insulator in this test.

The graph makes the pattern very clear. Foam lost the least heat, cotton lost more, and aluminum foil lost the most. But none of the materials kept the water above 50°C for the full 30 minutes. That means the team needs to go back and modify their design — perhaps by using a thicker layer of foam, or combining foam with a lid.

SECTION 6

Worked Example: Improving a Thermal Cup

Let's walk through how a student team would use their test data to improve the thermal cup design. Follow each step carefully.

Optimizing a Thermal Cup Using Test Data

1
Step 1 — Review the Criteria and Constraints

The criterion is: liquid stays above 50°C for at least 30 minutes. The constraints are: total cost under $5, only classroom materials allowed, and the cup must be small enough to hold in one hand.
2
Step 2 — Analyze the Test Results

From the data table, foam performed the best. After 30 minutes, the foam cup temperature was 58°C. That is above 50°C — great! But let's also calculate the temperature change: ΔT = 58 − 80 = −22°C. The cup lost 22 degrees.

Foam: ΔT = −22°C (best performer, meets 50°C criterion at 30 min)
3
Step 3 — Identify What to Modify

Even though foam passed, the team wants to do even better. They notice most heat escapes from the top of the cup. They decide to add a foam lid. They also consider doubling the foam thickness on the sides.
4
Step 4 — Predict, Then Test the New Design

The team predicts the lid will reduce heat loss by about 30%. They build Version 2 (foam + lid) and repeat the same test. After 30 minutes, the temperature is 64°C.

Version 2: ΔT = 64 − 80 = −16°C (only 16 degrees lost!)
5
Step 5 — Calculate the Improvement

How much better is Version 2? We can find the percent improvement in heat retention. Old heat loss = 22°C. New heat loss = 16°C. Percent improvement = ((22 − 16) ÷ 22) × 100% ≈ 27% improvement.

Adding a lid reduced heat loss by about 27%. The device now exceeds the 50°C criterion.
6
Step 6 — Decide: Optimize Further or Finalize?

Version 2 meets the criterion and stays within the constraints ($3.50 total cost). The team could try Version 3 with thicker foam, but the cost might go over $5. They decide Version 2 is their optimized final design.

Final Answer: Version 2 (foam + lid) is the optimized design. It keeps liquid at 64°C after 30 minutes, above the 50°C criterion, for $3.50.

SECTION 7

Trade-offs in Design Optimization

In the real world, making one thing better sometimes makes something else worse. This is called a trade-off (giving up one benefit to gain another). For example, thicker insulation keeps the cup warmer, but it also makes the cup heavier and more expensive. Engineers must balance competing factors.

Design Change	Benefit ✅	Trade-off ⚠️
Use thicker foam	Better insulation, less heat loss	Heavier cup, higher cost
Add a lid	Blocks heat from escaping the top	Harder to drink from, adds a part
Use a vacuum layer	Excellent insulation	Very expensive, difficult to build
Switch to metal lining	More durable	Metal conducts heat quickly, poor insulator

Common design changes and their trade-offs for a thermal cup

⚖️

KEY TAKEAWAY

Optimization doesn't mean making everything perfect — it means finding the best balance. Think of building a character in a video game. You have limited skill points. If you put all your points into speed, your defense drops. Engineers face the same choices: they optimize by finding the best combination within their constraints.

SECTION 8

From Classroom Devices to Real-World Engineering

The same process you use to improve a thermal cup is used in professional engineering. The difference is just the scale and complexity. Let's compare what you do in class to what happens in industry.

Feature	Classroom Design Challenge	Professional Engineering
Number of iterations	2–4 rounds of testing	Dozens to hundreds of rounds
Data collection	Thermometers, rulers, stopwatches	Sensors, computer simulations, lab instruments
Variables tested	1–2 at a time	Many variables, sometimes simultaneously
Constraints	Budget, time, classroom materials	Budget, safety regulations, environmental laws, mass production
Core process	Same! Test → Analyze → Improve → Retest	Same! Test → Analyze → Improve → Retest

Classroom vs. professional engineering comparison

Notice the last row: the core process is identical! Whether you're improving a paper airplane or designing a spacecraft heat shield, you always follow the same test → analyze → improve cycle. In high school and beyond, you'll learn to use computer models and advanced math to predict results before building. But the thinking stays the same.

💡

NGSS Practice: Constructing Explanations and Designing Solutions

When you explain why you chose a particular design change based on evidence from your tests, you are doing what real scientists and engineers do every day. This is the Science and Engineering Practice of constructing explanations and designing solutions. Your evidence is your data!

SECTION 9

Practice Problems

Test your understanding with these five problems. They get more challenging as you go. Take your time and think about the data before choosing an answer.

Question 1: CONCEPTUAL

A student builds a small boat and tests how much weight it can hold before sinking. The first version holds 50 grams. The student adds wider sides and tests again. The second version holds 80 grams. What is the most accurate conclusion? A) The wider sides made the boat heavier. B) The wider sides increased the boat's ability to hold weight. C) The boat sank both times, so neither design works. D) The student should not have changed the design.

Show answer

Correct answer: B. The data shows that the boat with wider sides held 30 more grams before sinking. This means the modification improved performance. Option A is incorrect because while wider sides might add some mass, the question focuses on carrying capacity, which increased. Option C is wrong because both boats floated until the weight limit was exceeded — that's the test, not a failure. Option D contradicts the whole point of the engineering design process, which is to test and improve.

Question 2: BASIC CALCULATION

A team tests a water filter. Version 1 removes 60% of dirt particles. After modifying the filter mesh, Version 2 removes 78% of dirt particles. What is the percent improvement from Version 1 to Version 2? A) 18% B) 30% C) 78% D) 138%

Show answer

Correct answer: B. Percent improvement = ((78 − 60) ÷ 60) × 100% = (18 ÷ 60) × 100% = 30%. Option A (18%) is just the difference in the two percentages, not the percent improvement relative to the original. Option C (78%) is simply the new value, not the improvement. Option D (138%) would mean you added the original and the difference incorrectly.

Question 3: INTERMEDIATE

A student designs a solar oven to melt chocolate. They test three reflector shapes and record the highest temperature reached inside each oven: • Flat reflector: 45°C • Curved reflector: 62°C • No reflector: 38°C The student's criterion is reaching at least 55°C. Which statement best describes what the student should do next? A) Choose the flat reflector because it is the simplest to build. B) Choose the curved reflector and look for ways to boost temperature even higher. C) Remove reflectors entirely since 38°C still melts some chocolate. D) Stop testing because one design already meets the criterion.

Show answer

Correct answer: B. The curved reflector is the only design that met the 55°C criterion (62°C > 55°C). However, an engineer should still look for ways to optimize — perhaps adjusting the curve angle or adding insulation. Option A is wrong because the flat reflector only reached 45°C, which does not meet the criterion. Option C is wrong because 38°C is well below the criterion, and chocolate typically needs higher heat to melt fully. Option D is not the best choice because optimization means continuing to improve, not stopping at 'good enough' if there's room to do better within constraints.

Question 4: APPLIED

A team designs a device to keep an ice cube from melting for as long as possible. They test four materials wrapped around the ice cube and record how many minutes each ice cube lasts: • Bubble wrap: 35 minutes • Newspaper: 28 minutes • Aluminum foil: 18 minutes • Wool fabric: 40 minutes The budget constraint is $2.00 per device. Wool costs $1.80, bubble wrap costs $0.50, newspaper costs $0.10, and aluminum foil costs $0.30. The team wants to combine two materials. Which combination best balances performance and cost? A) Wool + bubble wrap ($2.30) B) Bubble wrap + newspaper ($0.60) C) Wool + aluminum foil ($2.10) D) Bubble wrap + aluminum foil ($0.80)

Show answer

Correct answer: B. The budget constraint is $2.00. Options A ($2.30) and C ($2.10) both exceed the budget, so they are eliminated by the constraint — no matter how well they perform. Between B ($0.60) and D ($0.80), both are under budget. However, bubble wrap (35 min) and newspaper (28 min) were the second and third best insulators, so combining them is likely to give better insulation than combining bubble wrap with aluminum foil (only 18 min), which actually conducts heat. Option D uses aluminum foil, which performed worst at slowing melting, so it would likely not help as much.

Question 5: CRITICAL THINKING

Two teams test different thermal cup designs. Team A runs 1 test per design and picks the material with the highest single reading. Team B runs 3 tests per design and uses the average temperature. Which approach is more scientifically reliable, and why? A) Team A, because one test is enough if you measure carefully. B) Team B, because averaging multiple trials reduces the effect of random errors. C) Both approaches are equally reliable since they used the same materials. D) Neither approach is reliable because temperature always changes.

Show answer

Correct answer: B. Running multiple trials and averaging the results is a key practice in science. A single test might have an unusual result due to random error — maybe a draft of air cooled one cup unexpectedly. Averaging three trials smooths out these random variations and gives a more trustworthy picture. Option A is incorrect because even careful measurement cannot prevent random variations between trials. Option C is wrong because the number of trials matters for reliability, not just the materials. Option D is wrong because the fact that temperature changes is precisely what we're measuring — it doesn't make the data unreliable.

SUMMARY

Lesson Summary

Summary

In this lesson, you learned how engineers use test results to modify and optimize a device's performance. The engineering design cycle (Define → Design → Build → Test → Analyze → Improve) is a repeating loop. Each round is called an iteration. You compare data against criteria (what the device must do) and constraints (limits like cost and materials) to decide what to change.

Key skills include looking for patterns in your data, understanding cause and effect relationships, calculating percent improvement, and evaluating trade-offs between competing design goals. Remember: optimization is not about being perfect — it's about finding the best balance. Whether you're building a thermal cup in class or a spacecraft at NASA, the process is the same: test, analyze, improve, repeat.