Operant Conditioning - Psychology

1. A key difference between operant and classical conditioning is that in operant conditioning, the learner's behavior:
   Answer: is primarily influenced by the consequences that follow the behavior. This question tests a fundamental distinction. In operant conditioning, voluntary behaviors ('operants') are modified by their consequences (reinforcement or punishment). The association is between a behavior and its consequence. In classical conditioning, an involuntary, reflexive response becomes associated with a new stimulus. Therefore, the consequences that follow behavior are the key driver in operant conditioning. A describes classical conditioning. B describes classical conditioning, where the conditioned stimulus precedes the conditioned response. D is not necessarily true; resistance to extinction in both types of conditioning depends on factors like the schedule of reinforcement or the strength of the association.
2. A child is terrified of the dentist. While in the waiting room, they begin to cry. The parent immediately allows the child to leave the office and go home. In the future, the child is now more likely to cry when taken to the dentist. The child's crying behavior has been influenced by:
   Answer: Negative reinforcement, because the child's crying was followed by the removal of an aversive stimulus (the dentist's office). The question asks about the effect on the child's crying behavior. The behavior (crying) increased because it resulted in the removal of an aversive stimulus (the dentist's office). This is the definition of negative reinforcement. A is plausible but less precise; while going home is desirable, the key mechanism is escaping the feared situation. C is incorrect because it focuses on the parent's experience, not the child's behavior, and punishment decreases behavior. D is incorrect because the child likely does not view having their teeth checked as a desirable stimulus, so its removal is not a punishment.
3. Which of the following scenarios provides the clearest example of a behavior maintained by a variable-ratio schedule of reinforcement?
   Answer: A fisherman casts and recasts his line into the water, knowing that a fish could bite on any given cast. A variable-ratio (VR) schedule provides reinforcement after an unpredictable number of responses. Fishing is a classic example; the response is casting the line, and the reinforcement (catching a fish) occurs after an unpredictable number of casts. This creates a high, steady rate of responding. A describes a variable-interval or fixed-interval schedule, as the reinforcement is time-based. C describes a fixed-ratio schedule (10 widgets = 1 reward). D describes a fixed-interval schedule (reinforcement is available once per week).
4. To encourage her son to read more, a mother tells him that for every 30 minutes he reads, he gets to play 15 minutes of video games. The son enjoys video games far more than reading. This arrangement best illustrates the application of:
   Answer: The Premack principle, where a high-probability behavior is used to reinforce a low-probability behavior. The Premack principle states that a more preferred activity (a high-probability behavior) can be used to reinforce a less preferred activity (a low-probability behavior). Here, playing video games (high-probability) is contingent upon, and thus reinforces, reading (low-probability). B is incorrect because shaping involves rewarding steps toward a new behavior, not simply making one existing activity contingent on another. C is incorrect as the learning is explicitly and immediately reinforced. D is a subtle distractor; while time is involved (30 minutes), the schedule is actually a fixed-ratio schedule where the 'response' is a 30-minute block of reading. More importantly, the core concept being applied is the principle of using a preferred activity as a reinforcer.
5. A person with a fear of flying feels intense anxiety during takeoff. They find that gripping the armrests tightly reduces their feeling of anxiety. As a result, they now grip the armrests tightly during every takeoff. The behavior of gripping the armrests is maintained through:
   Answer: Escape learning, because the action reduces or removes an already present aversive stimulus. This question tests the subtle distinction between two types of negative reinforcement. The aversive stimulus (anxiety) is already present when the behavior (gripping the armrests) occurs. The behavior leads to a reduction in this aversive stimulus. This is escape learning. Avoidance learning (A) involves a behavior that prevents the aversive stimulus from occurring in the first place (e.g., taking medication before the flight to prevent anxiety). C is incorrect because punishment decreases behavior, and this behavior is being maintained (reinforced). D describes how the fear may have developed but does not explain why the specific behavior of gripping the armrests is maintained via operant conditioning.
6. An animal trainer uses a small, handheld clicker. Whenever the animal performs a correct behavior, the trainer makes a 'click' sound and then immediately gives the animal a piece of fish. Over time, the 'click' sound itself begins to function as a reward. The clicker is best described as a(n):
   Answer: Secondary reinforcer, because it has acquired its reinforcing properties through association with a primary reinforcer. This question tests your understanding of different types of reinforcers in operant conditioning. When you encounter scenarios involving learning through rewards, focus on whether the reward is naturally reinforcing or has learned its value through association. The clicker perfectly demonstrates a secondary reinforcer in action. Initially, the click sound has no inherent value to the animal—it's just a neutral noise. However, through repeated pairing with fish (a primary reinforcer that naturally satisfies hunger), the click acquires reinforcing properties. Eventually, the animal finds the click itself rewarding because it has learned to associate it with something good. This learned association is the hallmark of secondary reinforcement. Let's examine why the other options miss the mark. Choice A incorrectly labels the clicker as a primary reinforcer, but primary reinforcers satisfy basic biological needs without learning—like food, water, or shelter. The click doesn't naturally satisfy any biological drive. Choice B calls it an unconditioned stimulus, but unconditioned stimuli automatically trigger reflexive responses without training (like food causing salivation). The click only becomes meaningful through conditioning. Choice C suggests it's a discriminative stimulus signaling incorrect behavior, but the scenario clearly states the click follows correct behaviors and functions as a reward, not an error signal. Remember this key distinction: primary reinforcers work naturally (food, warmth), while secondary reinforcers gain their power through learning (money, praise, tokens). Look for that association process to identify secondary reinforcement in conditioning scenarios.
7. A rat is first placed in a chamber where a loud, unpleasant tone is sounded, followed by an electric shock. The rat learns to press a lever as soon as the tone sounds to prevent the shock from occurring. This is an example of:
   Answer: Avoidance learning, a type of negative reinforcement. When you encounter learning scenarios involving aversive stimuli, focus on the timing and purpose of the behavior being learned. This question tests your understanding of operant conditioning principles, specifically different types of learning that involve escaping or avoiding negative consequences. The rat learns to press the lever before the shock occurs, preventing it entirely. This is avoidance learning—the animal learns to perform a behavior that prevents an aversive stimulus from happening. Since pressing the lever removes the threat of shock (eliminates something negative), this represents negative reinforcement. The behavior is strengthened because it successfully avoids the unpleasant consequence. Let's examine why the other options miss the mark. Choice A incorrectly identifies this as shaping, which involves gradually reinforcing behaviors that approximate a target response—that's not what's happening here. Choice B suggests learned helplessness, but this occurs when an animal stops trying to escape because previous attempts were unsuccessful; here, the rat successfully learns an effective response. Choice C calls this escape learning with positive reinforcement, but escape learning involves responding after the aversive stimulus begins (escaping ongoing shock), and positive reinforcement adds something pleasant rather than removing something unpleasant. Remember this key distinction: avoidance learning prevents the bad thing from starting, while escape learning stops the bad thing once it's already begun. Both involve negative reinforcement because they strengthen behavior by removing or preventing aversive stimuli. Watch for timing cues in learning scenarios—they're crucial for identifying the correct mechanism.
8. A teacher wants to decrease the number of times a student shouts out answers in class. She decides that every time the student shouts, he will lose five minutes of recess. This is an example of:
   Answer: Negative punishment, because an appetitive stimulus is removed following an undesirable behavior. When you encounter operant conditioning scenarios, focus on two key distinctions: reinforcement vs. punishment (does the behavior increase or decrease?), and positive vs. negative (is something added or removed?). This question describes a behavior that should decrease, so you're looking at punishment. In this scenario, the student loses recess time (something desirable) after shouting out. Since an appetitive stimulus (something the student wants) is being removed to decrease the unwanted behavior, this is negative punishment. The "negative" refers to subtraction, and "punishment" means the consequence aims to reduce the behavior's frequency. Let's examine why the other options miss the mark. Choice A incorrectly identifies this as positive punishment, which would involve adding an unpleasant stimulus (like extra homework) rather than removing something desirable. The teacher's disapproval isn't the main consequence here—losing recess is. Choice B confuses this with negative reinforcement, which removes something unpleasant to increase a desired behavior. Here, we're trying to decrease shouting, not reinforce it. Choice C suggests extinction, which involves withholding the reinforcement that previously maintained the behavior. But the teacher isn't just ignoring the shouting—she's actively implementing a consequence. Remember this pattern: negative punishment = taking away something good to reduce bad behavior. Think of it as "subtracting the positive" (recess, privileges, etc.). This is one of the most common classroom management strategies and frequently appears on psychology exams.
9. The graph below shows cumulative responses over time for four different partial reinforcement schedules. A person who compulsively checks their social media feed for new 'likes' on a photo they posted is exhibiting a response pattern most similar to which schedule?
   Answer: Schedule D Checking for 'likes' is reinforced at unpredictable time intervals. You don't know when the next 'like' will appear, so you check periodically. This is a variable-interval (VI) schedule. In the provided graph, Schedule D represents a VI schedule, characterized by a steady, but moderate, response rate without significant pauses. A represents a fixed-ratio (FR) schedule with its characteristic 'stair-step' pattern. B represents a variable-ratio (VR) schedule with its very high, steep, and steady rate of response. C represents a fixed-interval (FI) schedule with its characteristic 'scalloping' pattern. The behavior of checking social media is better modeled by time (interval) than by the number of checks (ratio).
10. A child who receives praise for cleaning their room begins to help with other chores, such as washing dishes and taking out the trash, in hopes of receiving more praise. This phenomenon, where a reinforced behavior spreads to other similar behaviors, is known as:
    Answer: Response generalization. Response generalization occurs when a behavior that has been reinforced begins to occur in slightly different forms, or when other functionally similar behaviors begin to occur. The child is generalizing their successful 'helping' behavior to new contexts. Stimulus discrimination (B) is the opposite; it would involve the child learning to clean their room only under specific circumstances (e.g., only when their mom is home). Chaining (C) involves linking specific, discrete behaviors into a sequence. Spontaneous recovery (D) is the reappearance of an extinguished behavior after a rest period.
11. A dog learns that when its owner says "Sit" in a cheerful tone, it will receive a treat if it sits. However, if the owner says "Sit" in a stern tone, it does not receive a treat. The dog learns to sit only when it hears the cheerful tone. The cheerful tone of voice is functioning as a(n):
    Answer: Discriminative stimulus. A discriminative stimulus is a cue that signals that reinforcement is available if a specific response is made. In this case, the cheerful tone signals that the behavior of sitting will be rewarded. The stern tone signals that it will not. The dog therefore learns to discriminate between the two stimuli. A is a classical conditioning term. B is incorrect; the treat is the primary reinforcer, and while the tone might become a secondary reinforcer, its primary function here is as a cue. D is incorrect as nothing is being removed to decrease behavior.
12. In order to train a dog to fetch slippers, a trainer first gives the dog a treat for looking at the slippers, then for walking toward them, then for touching them with its nose, and finally only for picking them up and bringing them over. This technique is known as:
    Answer: Shaping, because the trainer is reinforcing successive approximations of the final desired behavior. Shaping involves reinforcing behaviors that are progressively closer to the target behavior until the full, complex behavior is achieved. The scenario describes this process perfectly. A, chaining, is a plausible distractor but is incorrect. Chaining involves linking together a sequence of already learned behaviors to perform a more complex task. Shaping is the process of teaching a novel behavior in the first place. C is incorrect as generalization would involve the dog trying to fetch other objects, like shoes or toys. D describes a part of the process (praise can be a secondary reinforcer) but does not describe the overall technique of teaching the complex behavior step-by-step.
13. A manager wants to reduce the number of employees who arrive late. She institutes a policy where any employee who is late must stay 15 minutes after their shift ends, without pay, to complete extra paperwork. A month later, tardiness has significantly decreased. The manager's policy is an example of:
    Answer: Positive punishment, because the addition of an aversive task (paperwork) leads to a decrease in the target behavior (tardiness). The correct answer is positive punishment. The procedure involves adding an unpleasant stimulus (the paperwork) to decrease a behavior (tardiness). A is incorrect because reinforcement increases behavior, and the goal here is to decrease it. B is incorrect because negative reinforcement also increases behavior by removing an aversive stimulus; while employees might be motivated by avoidance, the manager's action itself is adding something unpleasant. D is a very plausible distractor; one could frame this as losing free time. However, the core of the procedure is the addition of a required, unpleasant task, which is the classic definition of positive punishment.
14. Biofeedback is a technique where a person is given information about their physiological processes (e.g., heart rate, muscle tension) and learns to control them. From an operant conditioning perspective, the information provided by the biofeedback monitor primarily serves as a:
    Answer: Reinforcer, because it signals that a desired change in physiology has been achieved. In biofeedback, the goal is to change a physiological state. The monitor provides feedback; when the person successfully makes a change in the desired direction (e.g., lowers their heart rate), the monitor indicates this success. This information acts as a reinforcer, making the subtle internal behaviors that led to the change more likely to occur in the future. It is a form of reinforcement. A is incorrect because the goal is to increase, not decrease, a behavior (control). B is a classical conditioning term. D is incorrect because information is not an inherently satisfying primary reinforcer like food or water; it is a secondary, or conditioned, reinforcer.
15. An employee at a call center receives a $50 bonus for every 100 calls they handle. This bonus structure is most likely to produce which pattern of behavior?
    Answer: A flurry of calls as the 100-call mark approaches, followed by a brief decline in productivity after the bonus is received. Receiving a bonus for a set number of responses (100 calls) is a fixed-ratio (FR) schedule. A key characteristic of FR schedules is a high rate of responding until the reward is delivered, followed by a 'post-reinforcement pause.' Therefore, the employee would work hard to reach the 100-call mark and then likely take a short break before starting the next set. B best describes this 'stop-and-go' pattern. A describes a variable-ratio schedule. C describes a variable-interval schedule. D describes a fixed-interval schedule.
16. In an experiment, rats in Group A are shocked but can terminate the shock by pressing a lever. Rats in Group B are 'yoked' to Group A, meaning they receive a shock of the same intensity and duration as Group A, but have no control over it. Later, both groups are placed in a new situation where they can avoid shocks by jumping over a barrier. What is the most likely result?
    Answer: Group A will learn the new avoidance task faster than Group B, which may show signs of learned helplessness. This is a classic experimental design for demonstrating learned helplessness. Group B, having learned that their actions have no effect on the aversive stimulus (the shock), is likely to generalize this perception of helplessness to the new situation and fail to learn the avoidance response. Group A, which had control, will learn the new task normally. B is incorrect; lack of control, not sensitization, is the key factor. C is incorrect because the element of control, not just exposure, is crucial for future learning. D is incorrect; the shock functions as a motivator for avoidance learning in animals that perceive they have control.
17. A supervisor visits a factory floor to check on workers at 10:00 AM, 11:30 AM, and 3:00 PM. Workers who are performing their tasks correctly during these checks receive praise. What schedule of reinforcement is being used, and what is its primary limitation in this context?
    Answer: Fixed-interval; its predictability may lead to workers only increasing effort right before the known inspection times. The supervisor is checking at predictable, set times. This is a fixed-interval (FI) schedule. The main problem with FI schedules is that organisms learn when reinforcement is available and tend to increase their response rate only as the time for reinforcement approaches (the 'FI scallop'). Therefore, workers might slack off after a check and only ramp up their efforts just before the next scheduled visit. B is incorrect because the times are predictable, not variable. C and D are incorrect because the reinforcement is based on the passage of time, not the number of responses (ratio).
18. A researcher is training a rat to press a lever for a food pellet. Initially, the rat is rewarded for every lever press. After the behavior is established, the researcher switches to rewarding only the first lever press that occurs after a 5-minute period has elapsed. Which of the following describes the change in reinforcement schedule and the most likely corresponding change in the rat's behavior?
    Answer: From a continuous to a fixed-interval schedule, which will result in a scalloping pattern of responding, with increased activity near the end of each interval. This is a two-step reasoning question. First, the student must identify the initial and final schedules. Rewarding every press is continuous reinforcement. Rewarding the first press after a set time (5 minutes) is a fixed-interval (FI) schedule. Second, the student must recall the behavioral pattern associated with an FI schedule. The FI schedule produces a 'scalloping' effect, where the response rate is low immediately after reinforcement and gradually increases as the end of the interval approaches. B correctly identifies both the schedule change and the resulting behavior. A and D misidentify the schedules or the resulting behavior. C misidentifies the second schedule as variable-interval.
19. A high school institutes a new policy: for every semester a student has perfect attendance, their name is entered into a lottery to win a new tablet. This policy is designed to increase attendance by using which type of operant conditioning procedure?
    Answer: Fixed-interval with positive reinforcement This is a multi-step question. First, the goal is to increase attendance, so it must be reinforcement. The reward is a chance to win a tablet, which is adding a desirable stimulus, so it is positive reinforcement. Second, the reinforcement is available after a set period of time (one semester). This makes it a fixed-interval schedule. Therefore, the procedure is fixed-interval with positive reinforcement. B is incorrect because the schedule is based on time, not the number of responses. C is incorrect because it's positive reinforcement, not negative. D is incorrect because it's reinforcement, not punishment, and the interval is fixed.
20. A pigeon is placed in a Skinner box and trained on a variable-ratio (VR) schedule of reinforcement. A second pigeon is trained on a fixed-ratio (FR) schedule with the same average reinforcement density (e.g., VR-10 and FR-10). If both pigeons are then put on an extinction schedule (reinforcement is completely stopped), what is the most likely outcome?
    Answer: The pigeon on the FR schedule will exhibit a more pronounced extinction burst, but the pigeon on the VR schedule will continue responding for a longer period. Variable-ratio schedules are known to produce the highest resistance to extinction. The unpredictability means the organism doesn't easily 'know' when reinforcement has stopped. The FR schedule, being predictable, makes the absence of reinforcement after the set number of responses very obvious, leading to faster extinction. An extinction burst (a temporary increase in the previously reinforced behavior) is common when extinction begins. Therefore, the VR pigeon will respond longer, and the FR pigeon's extinction will be more abrupt, likely following a burst. B is partially correct but less precise than D, which accurately describes both phenomena. A is incorrect. C is incorrect because the schedule type, not just the reinforcement density, critically affects extinction.

Start this quiz