Analyzing Decisions and Strategies with Probability - Statistics and Probability

1. A manufacturer is choosing between two sampling plans to decide whether to hold a batch for rework. Historically, 10% of batches are truly defective. Plan A: - If a batch is defective, the sample triggers a hold 80% of the time. - If a batch is not defective, the sample still triggers a hold 5% of the time. Plan B: - If a batch is defective, the sample triggers a hold 60% of the time. - If a batch is not defective, the sample triggers a hold 1% of the time. The manager's goal is to minimize the probability that a batch released (not held) is actually defective. Which strategy is most reasonable given the probabilities?
   Answer: Plan A, because it catches a larger fraction of defective batches, so fewer defective batches will be released. This problem involves analyzing decisions using probability to choose a sampling plan for batches. The decision goal is to minimize the probability that a released batch is actually defective. The key probabilities are the 10% base defective rate, Plan A's 80% true positive and 5% false positive rates, and Plan B's 60% true positive and 1% false positive rates. Plan A best aligns with the goal because its higher detection rate results in a lower conditional probability of defect given release (about 2.3% versus 4.3% for B). One incorrect option is D, which downplays the detection difference due to low base rate, committing a base rate fallacy without calculating risks. Remember, probabilities guide minimizing release risks but do not guarantee no defective batches are released. To transfer this strategy, identify the goal, then compare conditional probabilities like P(defective | released) that matter most.
2. A company screens incoming shipments for a rare defect. Historically, about $2\%$ of shipments contain the defect. The company can choose one of two screening methods: - Method 1: If a shipment truly has the defect, it flags it $90\%$ of the time; if a shipment is defect-free, it still flags it $8\%$ of the time. - Method 2: If a shipment truly has the defect, it flags it $70\%$ of the time; if a shipment is defect-free, it flags it $2\%$ of the time. Every flagged shipment is pulled for manual inspection, and the company's goal is to minimize unnecessary manual inspections while still catching at least half of all defective shipments. Which strategy is most reasonable given the probabilities?
   Answer: Use Method 2, because the defect is rare and Method 2 has a much lower false-flag rate while still catching more than half of defective shipments. This problem requires analyzing decisions using probability to choose a screening method. The company's goal is to minimize unnecessary manual inspections while still catching at least half of defective shipments. Method 1 catches 90% of defects but flags 8% of defect-free shipments, while Method 2 catches 70% of defects but flags only 2% of defect-free shipments. Since defects are rare (2%), Method 2 meets the requirement of catching at least 70% of defects while dramatically reducing false flags from 8% to 2% on the 98% of shipments that are defect-free. Choice A incorrectly focuses only on the detection rate without considering false flags. Remember that probabilities inform decisions but don't guarantee specific outcomes. The key strategy is to identify the goal (minimize false flags while meeting detection threshold) and compare the probabilities that matter most for that goal.
3. A clinic uses a screening test for a condition in a low-risk population. In this population, about $3\%$ of people actually have the condition. The test has: - Sensitivity $80\%$ - Specificity $90\%$ A patient tests positive. The clinic must decide what to do next. Options: A) Start treatment immediately. B) Order a more accurate confirmatory test before treatment. C) Ignore the result because the patient is low-risk. The clinic's goal is to minimize unnecessary treatment while still taking positives seriously. Which strategy is most reasonable given the probabilities?
   Answer: Order a confirmatory test, because with a low base rate ($3\%$) and imperfect specificity, many positives can be false positives, so confirmation reduces unnecessary treatment. This question involves the skill of analyzing decisions using probability. The clinic's goal is to minimize unnecessary treatment while still taking positive results seriously. The relevant probabilities include a 3% base rate of the condition, 80% sensitivity, and 90% specificity, meaning a positive test indicates only about a 20% chance of the condition due to false positives. Ordering a confirmatory test best aligns with this goal because it verifies the initial positive, reducing the risk of treating false positives while addressing true cases. One incorrect option is to start treatment immediately, which commits the flaw of base rate neglect by assuming the 80% sensitivity means an 80% chance of the condition given a positive. Remember that probabilities inform decisions by quantifying diagnostic accuracy, but they do not guarantee outcomes for any patient. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities that matter most, such as the positive predictive value in low-prevalence settings.
4. A warehouse is choosing between two barcode scanners for order picking. Each scanned item is either correct (right product) or incorrect (wrong product). Based on trials: - Scanner 1: correctly identifies the right product $98\%$ of the time, but when it misreads, it fails to alert the worker $70\%$ of the time. - Scanner 2: correctly identifies the right product $96\%$ of the time, but when it misreads, it fails to alert the worker only $20\%$ of the time. The warehouse's goal is to minimize the chance that a wrong product is shipped (a wrong shipment happens when the scanner misreads and fails to alert). Which strategy is most reasonable given the probabilities?
   Answer: Choose Scanner 2, because even though it misreads slightly more often, its much lower fail-to-alert rate makes a wrong shipment less likely overall. This question involves the skill of analyzing decisions using probability. The warehouse's goal is to minimize the chance that a wrong product is shipped, which occurs when the scanner misreads and fails to alert. The relevant probabilities show Scanner 1 misreads 2% of the time and fails to alert 70% of those, versus Scanner 2 misreading 4% but failing to alert only 20%, resulting in a lower wrong shipment rate for Scanner 2 (0.8% vs. 1.4%). Choosing Scanner 2 best aligns with this goal because its better alerting on misreads reduces overall errors, despite the slightly higher misread rate. One incorrect option is choosing Scanner 1 for its higher accuracy, which commits the flaw of incomplete analysis by ignoring the conditional failure-to-alert rate. Remember that probabilities inform decisions by combining error components, but they do not guarantee outcomes for any scan. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities that matter most, such as the joint probability of misread and no alert.
5. A streaming service is testing two recommendation algorithms to reduce user churn. Among new users, about $10\%$ are "high risk" for churn and $90\%$ are "low risk." - Algorithm A reduces churn for high-risk users with probability $0.40$ and for low-risk users with probability $0.05$. - Algorithm B reduces churn for high-risk users with probability $0.30$ and for low-risk users with probability $0.08$. The company's goal is to maximize the probability of reducing churn across all new users (not just within one subgroup). Which conclusion is best supported by the data?
   Answer: Algorithm B is best because low-risk users are the vast majority, and B's higher success rate for low-risk users can outweigh A's advantage among the smaller high-risk group. This problem involves analyzing decisions using probability to maximize churn reduction across all users. The company's goal is to maximize the probability of reducing churn across all new users, not just one subgroup. For Algorithm A: (0.10 × 0.40) + (0.90 × 0.05) = 0.04 + 0.045 = 0.085 or 8.5% overall churn reduction. For Algorithm B: (0.10 × 0.30) + (0.90 × 0.08) = 0.03 + 0.072 = 0.102 or 10.2% overall churn reduction. Algorithm B's 10.2% overall effectiveness exceeds Algorithm A's 8.5% because its higher success rate among the vast majority (90%) of low-risk users outweighs A's advantage in the small high-risk group. Choice A incorrectly compares raw probabilities without considering group sizes. Probabilities guide optimal strategies but don't guarantee outcomes for specific users. The key is weighting performance by the size of each user segment.
6. A streaming service is choosing a recommendation strategy for a new show. Based on prior launches: - Strategy Broad (recommend to many users): 12% of recommended users watch at least one full episode. - Strategy Targeted (recommend to fewer, high-likelihood users): 22% of recommended users watch at least one full episode. But there is uncertainty about whether the show has "wide appeal" or "niche appeal": - There is a 40% chance it has wide appeal, in which case Broad yields 15% watch-through and Targeted yields 18%. - There is a 60% chance it has niche appeal, in which case Broad yields 10% watch-through and Targeted yields 25%. The service's goal is to maximize the probability that a randomly selected recommended user actually watches a full episode (i.e., higher conversion rate, not total viewers). Which strategy is most reasonable given the probabilities?
   Answer: Targeted, because it has a higher watch-through rate in both scenarios (wide and niche). This problem involves analyzing decisions using probability to select a recommendation strategy for a show. The decision goal is to maximize the probability that a recommended user watches a full episode. The relevant probabilities are a 40% chance of wide appeal (Broad 15%, Targeted 18%) and 60% chance of niche appeal (Broad 10%, Targeted 25%). The Targeted strategy best aligns with the goal because it yields higher conversion rates in both scenarios, leading to a higher expected rate (22.2% versus 12% for Broad). One incorrect option is C, which overweights the probability of wide appeal without comparing rates across scenarios, a flaw in partial analysis. Remember, probabilities inform the best strategy but do not guarantee high watch-through for every recommendation. To transfer this strategy, identify the goal, then compare the expected conversion rates that matter most.
7. A subscription app is deciding whether to show a retention offer to users who look likely to cancel. Their model produces a 'high-risk' flag. Based on past users: - $10\%$ of users would cancel within 30 days without any offer. - Of those who would cancel, the model flags $70\%$ as high-risk. - Of those who would not cancel, the model still flags $15\%$ as high-risk. The company can choose one policy: 1) Show the offer to all users. 2) Show the offer only to high-risk users. 3) Show the offer to no one. The company's goal is to target the offer so that most recipients are genuinely at risk of canceling (i.e., reduce wasted offers), while still reaching many would-be cancellers. Which strategy is most reasonable given the probabilities?
   Answer: Policy 2, because the high-risk flag concentrates would-be cancellers more than the overall $10\%$ base rate, even though some flagged users would not cancel. This question involves the skill of analyzing decisions using probability. The company's goal is to target the retention offer so that most recipients are genuinely at risk of canceling, while still reaching many would-be cancellers. The relevant probabilities include a 10% base cancellation rate, 70% flagging of cancellers, and 15% false flags on non-cancellers, making flagged users about 34% likely to cancel versus 10% overall. Policy 2 best aligns with this goal because it concentrates offers on the higher-risk group (34% cancellation rate), reducing waste while covering 70% of potential cancellers. One incorrect option is Policy 1, which commits the flaw of not targeting by offering to all, resulting in only 10% of recipients being at risk and more wasted offers. Remember that probabilities inform decisions by assessing targeting efficiency, but they do not guarantee outcomes for any user. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities that matter most, such as the positive predictive value of the flag for cancellation risk.
8. A factory makes two types of phone chargers: Standard (80% of daily output) and Fast (20%). A quick screening test flags a charger as "likely defective." The test correctly flags 90% of truly defective chargers (sensitivity 90%) and incorrectly flags 5% of non-defective chargers (false positive rate 5%). Historical defect rates differ by type: 1% of Standard chargers are defective, and 4% of Fast chargers are defective. A shipment is flagged by the screening test, and the label shows it is a Standard charger. The quality manager must choose a policy for what to do next for flagged Standard chargers. The goal is to minimize unnecessary destructive teardown while still catching most truly defective units. Which strategy is most reasonable given the probabilities? Policy options: - Policy 1: Immediately tear down every flagged Standard charger. - Policy 2: Do a slower confirmatory test on flagged Standard chargers; only tear down if the confirmatory test is also positive. (Confirmatory test has sensitivity 95% and false positive rate 1%.) - Policy 3: Ignore the screening result for Standard chargers and only do random teardowns. - Policy 4: Tear down only flagged Fast chargers, not flagged Standard chargers.
   Answer: Policy 2, because with a low base defect rate in Standard chargers and a nonzero false positive rate, many flagged units will be fine; a confirmatory test sharply reduces unnecessary teardowns while still catching most true defects. This question involves the skill of analyzing decisions using probability to choose the best policy for handling flagged Standard chargers. The decision goal is to minimize unnecessary destructive teardowns while still catching most truly defective units. The relevant probabilities show that for Standard chargers with a 1% defect rate, the screening test has a 90% sensitivity and 5% false positive rate, leading to a positive predictive value of about 15%, meaning most flagged units are not defective. Policy 2 best aligns with these probabilities by using a confirmatory test with 95% sensitivity and 1% false positive rate, which reduces unnecessary teardowns on false positives while catching nearly all true defects through the two-step process. In contrast, Policy 1 involves tearing down every flagged charger, which ignores the low positive predictive value and results in many unnecessary teardowns, a flaw known as base rate neglect. Remember that probabilities inform the likelihood of defects but do not guarantee any specific outcome for an individual charger. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities of true positives versus false positives across options to balance risks effectively.
9. A small publisher is deciding how to print a new book when demand is uncertain. Based on past launches: - There is a $30\%$ chance demand is High. - There is a $70\%$ chance demand is Low. Two printing strategies: - Strategy Large: If demand is High, there is a $0.90$ chance they avoid stockouts; if demand is Low, there is a $0.35$ chance they end up with large unsold inventory. - Strategy Small: If demand is High, there is a $0.55$ chance they avoid stockouts; if demand is Low, there is a $0.10$ chance they end up with large unsold inventory. The publisher's goal is to minimize the chance of large unsold inventory while still keeping the chance of avoiding stockouts at at least $60\%$ overall. Which strategy is most reasonable given the probabilities?
   Answer: Choose Strategy Small, because it greatly lowers the chance of large unsold inventory and can still meet the overall $60\%$ avoid-stockouts requirement when weighted by how often High demand occurs. This problem involves analyzing decisions using probability to balance inventory risks. The publisher's goal is to minimize large unsold inventory while keeping the chance of avoiding stockouts at least 60% overall. For Strategy Large: avoid stockouts (0.30 × 0.90) + (0.70 × 1) = 0.27 + 0.70 = 0.97; large unsold inventory 0.70 × 0.35 = 0.245 or 24.5%. For Strategy Small: avoid stockouts (0.30 × 0.55) + (0.70 × 1) = 0.165 + 0.70 = 0.865 or 86.5%; large unsold inventory 0.70 × 0.10 = 0.07 or 7%. Strategy Small meets the 60% stockout-avoidance requirement (86.5% > 60%) while dramatically reducing unsold inventory risk from 24.5% to 7%. Choice A incorrectly prioritizes emotional concerns over the stated goal of minimizing unsold inventory. Probabilities guide decisions but don't guarantee specific demand outcomes. The key is calculating weighted probabilities across all demand scenarios to balance competing objectives.
10. A factory uses a quick test to decide whether to rework a batch. About $15\%$ of batches are actually out of spec. - Test X: detects an out-of-spec batch $85\%$ of the time; incorrectly flags an in-spec batch $12\%$ of the time. - Test Y: detects an out-of-spec batch $70\%$ of the time; incorrectly flags an in-spec batch $4\%$ of the time. Reworking a batch is expensive, so the factory wants to minimize unnecessary rework while still ensuring that most out-of-spec batches get reworked (at least $70\%$). Which strategy is most reasonable given the probabilities?
    Answer: Use Test Y, because it meets the $70\%$ detection requirement and has a much lower false-flag rate, reducing unnecessary rework. This problem involves analyzing decisions using probability to minimize unnecessary rework in manufacturing. The factory's goal is to minimize unnecessary rework while ensuring at least 70% of out-of-spec batches get reworked. Test X detects 85% of out-of-spec batches but falsely flags 12% of in-spec batches, while Test Y detects 70% of out-of-spec batches but falsely flags only 4% of in-spec batches. Since Test Y meets the 70% detection requirement exactly and reduces false flags from 12% to 4% on the 85% of batches that are in-spec, it significantly reduces costly unnecessary rework. Choice A incorrectly prioritizes maximum detection without considering the cost of false positives. Probabilities inform decisions but don't determine what happens with any particular batch. The key is identifying the goal (minimize false flags while meeting detection threshold) and comparing the relevant probabilities.
11. A city is planning snow response for a weekend. Forecast data for the region: - $20\%$ chance of heavy snow - $50\%$ chance of light snow - $30\%$ chance of no snow If the city pre-treats roads Friday night, it reduces the chance of major traffic disruption to: - $15\%$ if heavy snow occurs - $5\%$ if light snow occurs - $1\%$ if no snow occurs If the city does not pre-treat, the chance of major traffic disruption is: - $40\%$ if heavy snow occurs - $12\%$ if light snow occurs - $1\%$ if no snow occurs The city's goal is to minimize the overall probability of major traffic disruption. Which strategy is most reasonable given the probabilities?
    Answer: Pre-treat, because it lowers the disruption probability in both heavy and light snow scenarios while not increasing it when there is no snow. This question involves the skill of analyzing decisions using probability. The city's goal is to minimize the overall probability of major traffic disruption across possible snow scenarios. The relevant probabilities include 20% heavy snow, 50% light, and 30% none, with pre-treatment reducing disruption to 15%, 5%, and 1% respectively, versus 40%, 12%, and 1% without, yielding a lower expected disruption (5.8% vs. 14.3%). Pre-treating best aligns with this goal because it substantially lowers disruption risks in heavy and light snow without increasing it in no-snow cases. One incorrect option is not pre-treating because heavy snow is unlikely, which commits the flaw of ignoring weighted probabilities by dismissing the impact of the 20% chance. Remember that probabilities inform decisions by calculating expected risks, but they do not guarantee outcomes for any weather event. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities that matter most, such as the expected value of disruption under each option.
12. An airline is deciding how to schedule a spare aircraft to reduce cancellations caused by mechanical issues. Historical data: - On any given day, Route A has a $6\%$ chance of a mechanical issue that would cancel the flight unless a spare is available. - Route B has a $3\%$ chance of such an issue. - If the spare is positioned for a route that has an issue, it prevents cancellation $90\%$ of the time (sometimes the spare can't be swapped fast enough). The airline can position the spare for Route A or Route B each day. The goal is to maximize the probability of preventing at least one cancellation (not to minimize costs). Which strategy is most reasonable given the probabilities?
    Answer: Position the spare at Route A, because the higher issue probability makes it more likely the spare will be needed and able to prevent a cancellation. This question involves the skill of analyzing decisions using probability. The airline's goal is to maximize the probability of preventing at least one cancellation using the spare aircraft. The relevant probabilities include a 6% issue rate for Route A and 3% for Route B, with the spare preventing a cancellation 90% of the time if positioned where an issue occurs. Positioning the spare at Route A best aligns with this goal because it yields a higher chance of successful prevention (5.4%) compared to Route B (2.7%), due to A's higher issue likelihood. One incorrect option is positioning at Route B based on an anecdote, which commits the flaw of anecdotal reasoning by prioritizing a single past event over probabilistic data. Remember that probabilities inform decisions by estimating expected benefits, but they do not guarantee outcomes on any given day. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities that matter most, such as the product of issue rates and prevention success.
13. An electronics retailer is deciding how to handle fraud screening for online orders. The fraud model flags an order as "high risk." - Among truly fraudulent orders, 80% are flagged. - Among legitimate orders, 6% are flagged. Only 0.8% of all orders are truly fraudulent. For flagged orders, the retailer can choose: 1) Automatically cancel (no fraud loss, but cancels some legitimate orders). 2) Hold for manual review (catches most fraud, but some fraud slips through; assume manual review misses 10% of fraudulent flagged orders and incorrectly rejects 2% of legitimate flagged orders). 3) Ship immediately (no delay, but fraud loss occurs on fraudulent orders). The retailer's goal is to minimize the chance of wrongly canceling legitimate orders while still reducing fraud relative to shipping immediately. Which strategy is most reasonable given the probabilities?
    Answer: Hold for manual review, because the low base rate means many flags will be legitimate orders; review reduces wrongful cancellations compared with auto-cancel while still catching most fraud compared with shipping immediately. This question involves the skill of analyzing decisions using probability to handle flagged online orders for fraud. The decision goal is to minimize wrongly canceling legitimate orders while reducing fraud compared to shipping immediately, with a 0.8% base fraud rate, 80% sensitivity, and 6% false positive rate. These probabilities give a positive predictive value of about 10%, indicating most flags are legitimate orders. Holding for manual review best aligns with this by catching most fraud (assuming 90% detection in review) while incorrectly rejecting only 2% of legitimate flagged orders, balancing minimal wrongful cancellations with fraud reduction. In contrast, automatically canceling (option A) treats any fraud chance as unacceptable, but overlooks the low positive predictive value leading to many wrongful cancellations, a flaw of overreacting to sensitivity without base rate consideration. Remember that probabilities inform fraud likelihood but do not guarantee any order's legitimacy. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities of true fraud versus false flags to select a verification approach.
14. A coffee shop uses a rapid test strip to check whether a batch of milk is spoiled. - If milk is spoiled, the strip shows positive 97% of the time. - If milk is not spoiled, the strip still shows positive 8% of the time. Only about 1% of incoming milk batches are actually spoiled. If a batch tests positive, the manager can either discard it immediately or send it to a lab test that is slower but very accurate (assume lab errors are negligible). The manager's goal is to avoid discarding good milk unnecessarily while still preventing spoiled milk from being served. Which strategy is most reasonable given the probabilities?
    Answer: Send positives to the lab, because with a 1% base rate and an 8% false positive rate, many positive strip results are likely false; confirming reduces unnecessary discards while still catching true spoilage. This question involves the skill of analyzing decisions using probability to manage positive test results for milk spoilage. The decision goal is to avoid discarding good milk unnecessarily while preventing spoiled milk from being served, with a 1% base spoilage rate, 97% sensitivity, and 8% false positive rate. These probabilities result in a positive predictive value of about 11%, meaning most positives are false. Sending positives to the lab best aligns with this by confirming results accurately, reducing unnecessary discards of false positives while catching true spoilage with high reliability. In contrast, discarding immediately (option A) treats the 97% sensitivity as proof of spoilage, ignoring the low positive predictive value due to the rare base rate, a flaw of base rate neglect. Remember that probabilities inform the chance of actual spoilage but do not guarantee the quality of any batch. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities of true positives versus false positives to decide on confirmation steps.
15. A basketball team is down by 2 points with 10 seconds left and must decide between two plays. Play 1 (Quick 2): probability of making the 2-point shot is $0.55$. If they miss, probability of getting an offensive rebound is $0.25$; if they get the rebound, probability of scoring on the follow-up is $0.50$. Play 2 (Go for 3): probability of making the 3-point shot is $0.38$. If they miss, probability of getting an offensive rebound is $0.18$; if they get the rebound, probability of scoring a 2-point follow-up is $0.55$. The team's goal is to maximize the probability of taking the lead or tying before time expires. Which strategy is most reasonable given the probabilities?
    Answer: Choose Play 1, because it has a higher initial make probability and also provides a reasonable second chance through rebounds. This problem requires analyzing decisions using probability to maximize the chance of tying or taking the lead in basketball. The team's goal is to maximize the probability of scoring at least 2 points to tie or lead. For Play 1: 0.55 + (1-0.55) × 0.25 × 0.50 = 0.55 + 0.05625 = 0.60625 probability of scoring 2+ points. For Play 2: 0.38 + (1-0.38) × 0.18 × 0.55 = 0.38 + 0.06138 = 0.44138 probability of scoring 2+ points. Play 1 offers a 60.6% chance of at least tying, while Play 2 offers only 44.1%, making Play 1 the better choice. Choice B incorrectly assumes 3-pointers are always better when behind, ignoring the actual probabilities. Remember that probabilities inform strategy but don't guarantee the outcome. The transfer strategy is to calculate total success probability through all possible paths, not just focus on point values.
16. A factory uses an automated scanner to flag defective parts before shipping. Historically, about $2\%$ of parts are truly defective. The scanner has: - Sensitivity: $90\%$ (it flags $90\%$ of truly defective parts) - Specificity: $95\%$ (it correctly clears $95\%$ of truly good parts) If a part is flagged, the factory can choose one of these strategies: 1) Ship it anyway. 2) Do a manual inspection on flagged parts only. 3) Scrap all flagged parts with no further checks. The factory's goal is to minimize the chance that a defective part gets shipped, even if that means extra inspections or scrapping some good parts. Which strategy is most reasonable given the probabilities?
    Answer: Do a manual inspection on flagged parts only, because the scanner will miss about $10\%$ of defects and also falsely flag some good parts. This question involves the skill of analyzing decisions using probability. The factory's goal is to minimize the chance that a defective part gets shipped, even if it means extra inspections or scrapping some good parts. The relevant probabilities include a 2% base defect rate, 90% sensitivity (flagging 90% of defects), and 95% specificity (clearing 95% of good parts), meaning flagged parts have about a 27% chance of being defective due to false positives. Manually inspecting flagged parts best aligns with this goal because it allows verification of the suspicious parts, catching true defects while potentially shipping good flagged ones, and unflagged parts are very unlikely to be defective (about 0.2% chance). One incorrect option is to scrap all flagged parts, which commits the flaw of base rate neglect by assuming the 90% sensitivity means flagged parts are defective 90% of the time, when it's actually much lower. Remember that probabilities inform decisions by quantifying risks, but they do not guarantee outcomes for any single part. To apply this strategy elsewhere, first identify the decision goal, then compare the probabilities that directly impact that goal, such as the posterior probability of defect given a flag.
17. A school is deciding whether to use a quick screening quiz to place students into an advanced workshop. Historically, 15% of students would truly benefit from the advanced workshop. The screening quiz has these properties: - Among students who would benefit, it recommends "advanced" 80% of the time. - Among students who would not benefit, it still recommends "advanced" 20% of the time. The school can either: - Use the quiz recommendation directly, or - Require that a student be recommended "advanced" twice by taking two independent versions of the quiz (same accuracy each time) before placing them. Goal: increase the likelihood that a placed student truly benefits, even if fewer students are placed. Which strategy is most reasonable given the probabilities?
    Answer: Require two recommendations, because it reduces false placements by making it less likely a non-benefiting student is recommended twice. This problem involves analyzing decisions using probability to decide on workshop placement criteria. The decision goal is to increase the likelihood that a placed student truly benefits. The key probabilities are the 15% base benefit rate and the quiz's 80% true positive and 20% false positive rates, with two quizzes being independent. Requiring two recommendations best aligns with the goal because it raises the positive predictive value to about 74% versus 41% for one quiz by reducing false positives. One incorrect option is D, which overstates the certainty, assuming two positives guarantee benefit, a flaw in misunderstanding conditional probability. Remember, probabilities inform better placement but do not guarantee every placed student benefits. To transfer this strategy, identify the goal, then compare predictive values for different thresholds.
18. A company uses a non-diagnostic email filter to flag potentially malicious emails. Only 1% of incoming emails are truly malicious. Filter X: - Flags 95% of malicious emails. - Incorrectly flags 4% of non-malicious emails. Filter Y: - Flags 85% of malicious emails. - Incorrectly flags 1% of non-malicious emails. Flagged emails are quarantined for review, and the IT team's goal is to maximize the chance that a quarantined email is actually malicious (so reviewers aren't overwhelmed by false alarms). Which conclusion is best supported by the data?
    Answer: Filter Y, because with a 1% base rate, reducing false positives greatly increases the fraction of quarantined emails that are truly malicious. This problem involves analyzing decisions using probability to select an email filter. The decision goal is to maximize the probability that a quarantined email is actually malicious. The key probabilities are the 1% base rate of malicious emails, Filter X's 95% true positive and 4% false positive rates, and Filter Y's 85% true positive and 1% false positive rates. Filter Y best aligns with the goal because its lower false positive rate leads to higher precision (about 46% versus 19% for X), making quarantined emails more likely malicious despite catching fewer overall. One incorrect option is C, which confuses sensitivity with positive predictive value, a common misinterpretation of conditional probabilities. Remember, probabilities guide the decision to optimize review efficiency but do not guarantee all flagged emails are malicious. To transfer this strategy, identify the goal, then compare the positive predictive values that directly impact it.
19. A warehouse is deciding how to screen incoming shipments for damaged items. Historically, 4% of items arrive damaged. Two screening strategies are available: - Strategy 1 (Quick Scan): correctly flags 70% of damaged items, but also incorrectly flags 8% of undamaged items. - Strategy 2 (Thorough Scan): correctly flags 90% of damaged items, but also incorrectly flags 18% of undamaged items. Each flagged item is pulled for manual inspection, and the warehouse wants to minimize the chance that an item released without manual inspection is actually damaged, even if that means inspecting more items overall. Which strategy is most reasonable given the probabilities?
    Answer: Strategy 2, because it catches a higher fraction of damaged items, reducing the chance damaged items slip through uninspected. This problem involves analyzing decisions using probability to select the optimal screening strategy for damaged items. The decision goal is to minimize the probability that an item released without inspection is actually damaged. The key probabilities include a 4% base rate of damage, Strategy 1's 70% detection rate and 8% false positive rate, and Strategy 2's 90% detection rate and 18% false positive rate. Strategy 2 best aligns with the goal because its higher detection rate results in a lower conditional probability of damage given release (about 0.5% versus 1.34% for Strategy 1), prioritizing fewer missed damages over more inspections. One incorrect option is C, which commits the base rate fallacy by downplaying the detection difference due to rarity without calculating the actual impact on released items. Remember, these probabilities guide the decision to minimize risk but do not guarantee that no damaged items will ever be released. To transfer this strategy, identify the goal, then compare the conditional probabilities like P(damaged | released) that matter most.
20. A soccer coach must choose a penalty-kick strategy for a player. Data from the player's last 200 penalties: - If the player shoots to the left: 78% score rate. - If the player shoots to the right: 74% score rate. However, the goalkeeper studies tendencies: - If the player shoots left more than half the time, the keeper dives left more often, reducing the player's left score rate to 70%. - If the player mixes left/right about evenly, the keeper cannot predict well, and the above score rates (78% left, 74% right) apply. The coach's goal is to maximize the chance of scoring on this kick. Which strategy is most reasonable given the probabilities?
    Answer: Mix left and right roughly evenly, because it preserves the higher left success rate without triggering the keeper's adjustment. This problem involves analyzing decisions using probability to choose a penalty-kick strategy. The decision goal is to maximize the chance of scoring on this kick. The relevant probabilities are the 78% success rate for left shots and 74% for right when mixed evenly, with a reduction to 70% for left if left is chosen more than half the time due to predictability. Mixing left and right roughly evenly best aligns with the goal because it avoids triggering the keeper's adjustment, allowing access to the higher 78% rate by choosing left without predictability. One incorrect option is A, which overlooks the predictability adjustment, a flaw in ignoring conditional probabilities based on strategy. Remember, probabilities inform the likely best strategy but do not guarantee a score on any given kick. To transfer this strategy, identify the goal, then compare the effective success probabilities under different behavioral adjustments.

Start this quiz