Operant Conditioning and Reinforcement Schedules (7C) - Psych & Soc

1. What is a discriminative stimulus ($S^D$) in operant conditioning?

   Cue signaling that a response will be reinforced. Indicates when a behavior will produce reinforcement.

2. What is a variable-interval (VI) reinforcement schedule?

   First response after a variable time interval is reinforced. Like fishing: unpredictable timing keeps steady response rate.

3. What is negative reinforcement?

   Removing an aversive stimulus to increase a behavior. Eliminating an unpleasant stimulus after a behavior encourages its repetition to avoid discomfort.

4. What is spontaneous recovery in operant conditioning?

   Reappearance of an extinguished behavior after a rest period. Shows that extinction doesn't erase learning, just suppresses it.

5. What is a continuous reinforcement schedule (CRF)?

   Reinforcement is delivered after every correct response. This schedule builds strong initial associations by consistently rewarding each instance of the target behavior.

6. What is positive punishment?

   Adding a stimulus to decrease a behavior. "Positive" means adding; aversive consequences weaken behavior.

7. What is continuous reinforcement (CRF)?

   Reinforcing every instance of the desired behavior. Best for initial learning but prone to extinction.

8. What is negative reinforcement?

   Removing an aversive stimulus to increase the probability of a behavior. "Negative" means removing; taking away bad things strengthens behavior.

9. What is shaping?

   Reinforcing successive approximations toward a target behavior. Gradually reinforces closer approximations to desired behavior.

10. What is a fixed interval (FI) schedule of reinforcement?

    First response after a fixed time interval is reinforced. Like checking mail at specific delivery times.

11. Which reinforcement schedule delivers reinforcement after a fixed number of responses?

    Fixed ratio (FR). Like piece-rate pay - reinforcement after set number of responses.

12. What is extinction in operant conditioning?

    Decrease of behavior when reinforcement is withheld. Behavior fades without reinforcement, reversing learning.

13. Identify whether this is reinforcement or punishment: A behavior becomes more frequent.

    Reinforcement. Increased frequency indicates the consequence strengthened the behavior.

14. Identify the correct consequence type: taking away phone privileges to reduce texting in class.

    Negative punishment. Removing desired item (phone) decreases unwanted behavior (texting).

15. Which schedule produces the greatest resistance to extinction: FR, VR, FI, or VI?

    Variable ratio (VR). Unpredictability creates persistent responding, like gambling.

16. Identify the schedule: reinforcement is given for the first response after $30$ seconds.

    Fixed interval (FI) schedule. Time-based with predictable intervals between reinforcements.

17. What is operant conditioning?

    Learning in which behavior changes due to its consequences. Behaviors are shaped by rewards and punishments.

18. What is a conditioned (secondary) reinforcer?

    Learned reinforcer paired with a primary reinforcer (e.g., money). Gains value through association with primary reinforcers.

19. What is negative punishment in operant conditioning?

    Removing a desired stimulus to decrease a behavior. "Negative" means removing; taking away privileges punishes.

20. What is shaping in operant conditioning?

    Reinforcing successive approximations toward a target behavior. This technique gradually builds complex behaviors by rewarding closer approximations, facilitating learning step-by-step.

21. What is a fixed ratio (FR) reinforcement schedule?

    Reinforcement after a set number of responses. Predictable rewards create post-reinforcement pauses.

22. Identify the term for a learned association between a behavior and its consequence.

    Operant conditioning contingency. The if-then relationship between behavior and its outcome.

23. What is primary reinforcement?

    Reinforcement that is inherently rewarding (for example, food, water). Satisfies biological needs without prior learning.

24. Which schedule produces the greatest resistance to extinction?

    Variable ratio (VR) schedule. Unpredictability makes it hardest to extinguish (like slot machines).

25. What is negative punishment?

    Removing a desired stimulus to decrease a behavior. Like taking away phone privileges for misbehavior.

26. What is a variable ratio (VR) reinforcement schedule?

    Reinforcement after an unpredictable number of responses. Unpredictability creates high, steady response rates.

27. Identify the concept: learning a behavior by observing the consequences for someone else.

    Vicarious reinforcement (observational learning of consequences). Seeing others rewarded or punished influences our behavior.

28. What is negative punishment?

    Removing a desired stimulus to decrease the probability of a behavior. "Negative" means removing; taking away rewards weakens behavior.

29. What is positive reinforcement?

    Adding a stimulus to increase a behavior. "Positive" means adding; the added stimulus strengthens behavior.

30. What is a fixed-interval (FI) reinforcement schedule?

    Reinforcement for the first response after a set time has passed. Produces "scalloped" pattern with increased responding near interval end.

31. What is a primary reinforcer?

    Inherently rewarding stimulus (e.g., food, water, warmth). Satisfies biological needs without prior learning.

32. What is a primary reinforcer?

    A reinforcer that is inherently rewarding (meets biological needs). Food, water, and warmth naturally satisfy survival needs.

33. What is a variable ratio (VR) reinforcement schedule?

    Reinforcement after an unpredictable number of responses, around an average. Unpredictability creates steady, high response rates.

34. What is an extinction burst?

    Temporary increase in behavior intensity/frequency during extinction. Like a vending machine being hit harder before giving up.

35. What is stimulus generalization in operant conditioning?

    Responding similarly to stimuli resembling the $S^D$. Behaviors transfer to similar cues because of shared characteristics with the original discriminative stimulus.

36. What is a discriminative stimulus?

    A cue signaling that a response will be reinforced. Signals when behavior will be rewarded.

37. What is a fixed ratio (FR) reinforcement schedule?

    Reinforcement after a set number of responses. Predictable pattern (e.g., every 5th response).

38. What is negative reinforcement?

    Removing an aversive stimulus to increase a behavior. "Negative" means removing; relief from discomfort strengthens behavior.

39. What is positive punishment in operant conditioning?

    Adding an aversive stimulus to decrease a behavior. "Positive" means adding; punishment decreases behavior.

40. What is a discriminative stimulus ($S^D$)?

    Cue signaling that a response will be reinforced in that context. Environmental signal that reinforcement is available for a response.

41. What is spontaneous recovery after extinction?

    Reappearance of an extinguished behavior after a time delay. Rest periods can temporarily restore extinguished responses.

42. What is a primary reinforcer?

    Innately reinforcing stimulus (for example, food or water). Satisfies biological needs without prior learning.

43. What is operant conditioning?

    Learning in which behavior is shaped by its consequences. Unlike classical conditioning, behaviors are modified by their outcomes.

44. Which reinforcement schedule produces the highest response rate and greatest extinction resistance?

    Variable-ratio (VR) schedule. Unpredictability creates persistent responding (like gambling).

45. What is positive reinforcement?

    Adding a stimulus to increase a behavior. Like giving praise or rewards to encourage behavior.

46. What is spontaneous recovery after extinction?

    Reappearance of an extinguished behavior after a time delay. Rest period allows temporary return of extinguished response.

47. What is a fixed-ratio (FR) reinforcement schedule?

    Reinforcement after a set number of responses. Predictable schedule creates steady response rate with pauses after reinforcement.

48. Which reinforcement schedule typically produces the highest response rate and greatest resistance to extinction?

    Variable-ratio (VR) schedule. Unpredictability creates persistence even without reinforcement.

49. What is a variable ratio (VR) schedule of reinforcement?

    Reinforcement after an unpredictable number of responses. Unpredictability sustains high, steady responding as each action could yield reward, akin to gambling.

50. What is operant conditioning in behavioral psychology?

    Learning in which consequences shape the probability of behavior. Behavior is modified by its outcomes, unlike classical conditioning.

51. Which reinforcement schedule is variable ratio (VR)?

    Reinforcement after an unpredictable number of responses. Unpredictability maintains high, steady response rates (like gambling).

52. What is a fixed interval (FI) schedule of reinforcement?

    Reinforcement for the first response after a fixed time period. Time-based predictability leads to scalloped patterns with increased responding near the interval's end.

53. What is a secondary (conditioned) reinforcer?

    Learned reinforcer paired with a primary reinforcer (e.g., money). Gains reinforcing value through association with primary reinforcers.

54. Which reinforcement schedule typically produces a scalloped response pattern (post-reinforcement pause then rising rate)?

    Fixed interval (FI). Low responding after reinforcement, then acceleration.

55. What is operant conditioning?

    Learning in which behavior changes due to consequences. Unlike classical conditioning, behaviors are modified by their outcomes.

56. What is a secondary (conditioned) reinforcer?

    Learned reinforcer paired with a primary reinforcer (e.g., money). Gains value through association with primary reinforcers.

57. What is a discriminative stimulus in operant conditioning?

    Cue signaling that a response will be reinforced or punished. Indicates when behavior will produce consequences.

58. What is a variable ratio (VR) reinforcement schedule?

    Reinforcement after an unpredictable number of responses. Unpredictable pattern maintains high response rates.

59. What is operant conditioning in behavioral psychology?

    Learning in which consequences shape behavior frequency. Behaviors are modified by their outcomes through reinforcement or punishment.

60. What is a primary reinforcer?

    Innately reinforcing stimulus that satisfies a biological need. These stimuli inherently motivate behavior due to their direct link to survival and basic physiological needs.

61. What is the Premack principle in operant conditioning?

    High-probability behavior reinforces a low-probability behavior. "First eat vegetables, then dessert" uses preferred activities as rewards.

62. What is a discriminative stimulus ($S^D$)?

    Cue signaling that a response will be reinforced in that context. Environmental signal that reinforcement is available for a response.

63. What is positive reinforcement?

    Adding a stimulus to increase a behavior. "Positive" means adding; rewards strengthen the behavior.

64. What is positive reinforcement?

    Adding a stimulus to increase a behavior. Like giving praise or rewards to encourage behavior.

65. What is a variable ratio (VR) schedule of reinforcement?

    Reinforcement after an unpredictable number of responses. Like slot machines; most resistant to extinction.

66. What is stimulus control in operant conditioning?

    Behavior occurs more in presence of $S^D$ than in its absence. The $S^D$ gains control over when the behavior is performed.

67. Which term describes the removal of an expected reinforcer, leading to decreased behavior?

    Extinction. Withholding reinforcement weakens the learned association, causing the behavior to diminish over time.

68. What is a fixed interval (FI) reinforcement schedule?

    Reinforcement for the first response after a fixed time period. Produces scalloped patterns with increased responding near deadline.

69. What is reinforcement in operant conditioning?

    A consequence that increases the future probability of a behavior. Strengthens behavior by making it more likely to occur again.

70. What is a discriminative stimulus ($S^D$)?

    A cue signaling that a response will be reinforced. Like a green light indicating it's safe to proceed.

71. Identify whether this is reinforcement or punishment: Phone privileges removed after curfew violation.

    Negative punishment. Desired privilege removed decreases curfew violations.

72. What is continuous reinforcement (CRF)?

    Reinforcement delivered after every instance of the behavior. Every correct response gets reinforced; fastest learning but quick extinction.

73. What is a reinforcer in operant conditioning?

    A consequence that increases the future frequency of a behavior. It strengthens the association between a behavior and its outcome, making the action more likely to recur.

74. What is a reinforcer in operant conditioning?

    A consequence that increases the future frequency of a behavior. Strengthens behavior through positive outcomes.

75. Which reinforcement schedule is generally most resistant to extinction?

    Variable ratio (VR). Intermittent and unpredictable rewards create strong habits that persist even without consistent reinforcement.

76. Which reinforcement schedule typically produces the highest, steadiest response rate?

    Variable-ratio (VR) schedule. Unpredictability keeps organisms constantly responding.

77. Identify whether this is positive or negative: The consequence involves removing a stimulus.

    Negative. "Negative" means subtraction, not bad—something is taken away.

78. What is a variable-ratio (VR) reinforcement schedule?

    Reinforcement after an unpredictable number of responses. Uncertainty maintains high, steady response rates.

79. What is positive punishment?

    Adding a stimulus to decrease a behavior. Applying an aversive stimulus after a behavior discourages its future occurrence to avoid negative consequences.

80. What is a fixed interval (FI) reinforcement schedule?

    First response after a fixed time interval is reinforced. Time-based schedule produces scalloped response patterns.

81. What is a fixed-interval (FI) reinforcement schedule?

    Reinforcement for first response after a fixed time period. Like checking mail—reward available after predictable time passes.

82. What is punishment in operant conditioning?

    A consequence that decreases the future frequency of a behavior. Weakens behavior by making it less likely to occur again.

83. What is a fixed ratio (FR) schedule of reinforcement?

    Reinforcement after a set number of responses. Like piece-rate pay; predictable reward after specific output.

84. What is extinction in operant conditioning?

    Decreased behavior after reinforcement is withheld. Behavior fades when no longer followed by reinforcement.

85. Which reinforcement schedule produces the highest response rate and greatest resistance to extinction?

    Variable ratio (VR). Unpredictability maintains behavior even without frequent rewards.

86. What is operant conditioning in the context of learning and behavior change?

    Learning in which consequences shape the likelihood of a behavior. This form of learning modifies voluntary behaviors through rewards or punishments that follow them, increasing or decreasing their probability.

87. What is a variable-ratio (VR) reinforcement schedule?

    Reinforcement after an unpredictable number of responses. Unpredictability maintains high, steady responding (like gambling).

88. What is negative punishment?

    Removing a desired stimulus to decrease a behavior. Like taking away privileges to reduce unwanted behaviors.

89. What is a variable ratio (VR) schedule?

    Reinforcement after an unpredictable number of responses. Unpredictability maintains high, steady response rates.

90. What is a secondary (conditioned) reinforcer?

    Learned reinforcer paired with primary reinforcers (e.g., money). Gains value through association with primary reinforcers.

91. What is positive reinforcement?

    Adding a stimulus to increase a behavior. Like giving praise or rewards to strengthen desired behaviors.

92. Identify the term: the learned association between a behavior and its consequence.

    Response-consequence association. The link formed between an action and what follows it.

93. What is spontaneous recovery after extinction?

    Reappearance of an extinguished behavior after a rest period. Shows that extinction doesn't erase the learned association.

94. What is the difference between continuous and partial reinforcement?

    Continuous: every response; partial: only some responses. Continuous is predictable; partial creates uncertainty and persistence.

95. What is a variable-interval (VI) reinforcement schedule?

    Reinforcement for the first response after varying time intervals. Unpredictable timing produces slow, steady response rate.

96. What is a discriminative stimulus ($S^D$) in operant conditioning?

    Cue signaling that a response will be reinforced. Indicates when a behavior will produce reinforcement.

97. What is a discriminative stimulus ($S^D$) in operant conditioning?

    Cue signaling that a response will be reinforced. It indicates the context where a specific response is likely to produce reinforcement, guiding behavior.

98. What is positive punishment?

    Adding an aversive stimulus to decrease a behavior. "Positive" means adding; the aversive stimulus weakens behavior.

99. What is continuous reinforcement (CRF)?

    Reinforcing every instance of the desired behavior. Best for initial learning but prone to rapid extinction.

100. Which reinforcement schedule typically produces a "scalloped" response pattern over time?

     Fixed-interval (FI) schedule. Response rate increases as reinforcement time approaches.

101. Identify the procedure: buckling a seatbelt stops a loud alarm, increasing seatbelt use.

     Negative reinforcement. Alarm removal (aversive gone) increases buckling.

102. Which schedule produces the greatest resistance to extinction: FR, VR, FI, or VI?

     Variable ratio (VR). Unpredictability creates persistent responding.

103. What is positive reinforcement in operant conditioning?

     Adding a stimulus to increase the likelihood of a behavior. "Positive" means adding something pleasant as a reward.

104. What is a fixed-ratio (FR) reinforcement schedule?

     Reinforcement after a set number of responses. Like piece-rate pay—predictable reward after specific output.

105. What is an extinction burst?

     Temporary increase in responding when reinforcement is first removed. Behavior briefly intensifies before extinction, like a "last attempt."

106. Which schedule produces the highest, most persistent response rate: FR, VR, FI, or VI?

     Variable ratio (VR). Unpredictability and response-based rewards resist extinction.

107. What is a fixed ratio (FR) reinforcement schedule?

     Reinforcement after a set number of responses. Produces steady responding with post-reinforcement pauses.

108. What is negative reinforcement?

     Removing an aversive stimulus to increase a behavior. "Negative" means removing; taking away something unpleasant strengthens behavior.

109. What is punishment in operant conditioning?

     A consequence that decreases the future frequency of a behavior. Weakens behavior through aversive consequences or loss of rewards.

110. Which schedule produces the highest, steadiest response rate and greatest extinction resistance?

     Variable ratio (VR). Unpredictability prevents extinction and maintains behavior.

111. What is spontaneous recovery in operant conditioning?

     Reappearance of an extinguished behavior after a time delay. Extinct behaviors can briefly return without reinforcement.

112. What is negative reinforcement?

     Removing an aversive stimulus to increase a behavior. Like stopping nagging when chores are done.

113. What is punishment in operant conditioning?

     A consequence that decreases the future frequency of a behavior. Weakens behavior through aversives or removal of rewards.

114. Which reinforcement schedule delivers reinforcement after a varying time interval (if responding occurs)?

     Variable interval (VI). Like fishing - first response after unpredictable time is reinforced.

115. What is a variable interval (VI) schedule?

     Reinforcement for the first response after varying time intervals. Unpredictable timing produces slow, steady response rates.

116. Identify the consequence type: a teen loses phone privileges to reduce texting in class.

     Negative punishment. Removing something desirable (phone) to reduce behavior.

117. What is a fixed ratio (FR) reinforcement schedule?

     Reinforcement after a set number of responses. Predictable pattern creates steady response rates with pauses.

118. What is operant conditioning in learning theory?

     Learning in which consequences shape the frequency of a behavior. Behaviors are modified by their outcomes, unlike classical conditioning.

119. What is a secondary (conditioned) reinforcer?

     Learned reinforcer paired with primary reinforcers (e.g., money). Gains value through association with primary reinforcers.

120. Identify whether this is positive or negative reinforcement: buckling a seatbelt stops a car alarm.

     Negative reinforcement. Removing the aversive alarm increases buckling behavior.

121. What is a primary reinforcer?

     Inherently reinforcing stimulus (for example, food, water). Satisfies biological needs; naturally reinforcing without learning.

122. What is a primary reinforcer?

     An innately reinforcing stimulus (for example, food or water). Satisfies biological needs without prior learning.

123. What is the discriminative stimulus ($S^D$) in operant conditioning?

     A cue signaling that a response will be reinforced. Indicates when behavior will produce reinforcement.

124. What is negative punishment?

     Removing a desired stimulus to decrease a behavior. "Negative" means removing; taking away something pleasant weakens behavior.

125. What is a fixed-ratio (FR) reinforcement schedule?

     Reinforcement after a set number of responses. Like piece-rate pay: every 5 widgets earns a reward.

126. What is positive punishment?

     Adding a stimulus to decrease a behavior. Like giving a speeding ticket to reduce speeding.

127. What is negative reinforcement?

     Removing an aversive stimulus to increase a behavior. Like stopping nagging when chores are done—relief strengthens behavior.

128. What is a punisher in operant conditioning?

     A consequence that decreases the future frequency of a behavior. Weakens behavior through negative outcomes.

129. Which reinforcement schedule characteristically produces a post-reinforcement pause in responding?

     Fixed-ratio (FR) schedule. Brief rest occurs after earning each reinforcement.

130. What is a fixed-interval (FI) reinforcement schedule?

     First response after a set time interval is reinforced. Like checking mail: only rewarded after postal delivery time.

131. What is negative punishment?

     Removing a desirable stimulus to decrease a behavior. Withdrawing a pleasant stimulus following a behavior reduces its frequency by removing expected rewards.

132. Identify the schedule: reinforcement is delivered after a variable amount of time.

     Variable-interval (VI) schedule. Time-based: first response after varying time periods gets reinforced.

133. What is reinforcement in operant conditioning?

     A consequence that increases the future frequency of a behavior. Strengthens behavior through rewards or removal of aversives.

134. Identify the term: a consequence that follows a behavior and increases it.

     Reinforcer. Any stimulus that strengthens the behavior it follows.

135. Identify whether this is positive or negative punishment: a teen loses phone privileges after breaking curfew.

     Negative punishment. Removing the desired phone decreases curfew-breaking behavior.

136. Which schedule typically produces a "scalloped" response pattern as reinforcement time approaches?

     Fixed interval (FI). Response rate increases as reinforcement time nears.

137. What is extinction in operant conditioning?

     Decrease of a behavior when reinforcement is withheld. Without reinforcement, learned behaviors gradually disappear.

138. Which reinforcement schedule typically produces a scalloped response pattern as reinforcement time approaches?

     Fixed-interval (FI) schedule. Response rate increases as reinforcement time nears, then drops.

139. Identify the schedule: a rat receives food after, on average, every 10 lever presses with unpredictability.

     Variable-ratio (VR) schedule. Unpredictable number averaging 10 defines variable-ratio scheduling.

140. What is operant conditioning in behavioral psychology?

     Learning in which consequences shape the likelihood of a behavior. Behavior is modified by its outcomes, unlike classical conditioning.

141. What is negative reinforcement?

     Removing an aversive stimulus to increase a behavior. Like stopping nagging when chores are done.

142. What is positive reinforcement?

     Adding a stimulus to increase the probability of a behavior. "Positive" means adding; giving rewards strengthens behavior.

143. What is extinction in operant conditioning?

     Decrease in behavior after reinforcement is withheld. Without reinforcement, the learned behavior gradually disappears.

144. What is positive punishment?

     Adding an aversive stimulus to decrease a behavior. Like giving a speeding ticket to reduce speeding.

145. Identify the schedule: reinforcement is delivered after a fixed amount of time.

     Fixed-interval (FI) schedule. Time-based: first response after set time period gets reinforced.

146. What is spontaneous recovery in operant conditioning?

     Reappearance of an extinguished behavior after a rest period. Shows learning wasn't completely erased during extinction.

147. Identify whether this is reinforcement or punishment: Seatbelt buzzer stops when buckled.

     Negative reinforcement. Annoying buzzer removed increases buckling behavior.

148. What is extinction in operant conditioning?

     Decrease in behavior after reinforcement is withheld. Without reinforcement, learned behaviors gradually disappear.

149. What is punishment in operant conditioning?

     A consequence that decreases the future probability of a behavior. Weakens behavior by making it less likely to occur again.

150. What is a variable interval (VI) reinforcement schedule?

     Reinforcement for the first response after varying time intervals. Produces steady, moderate responding without pauses.

151. Which reinforcement schedule produces the highest response rate and greatest persistence?

     Variable ratio (VR) schedule. Unpredictability and response-contingency maximize motivation.

152. Identify the schedule: Checking email is reinforced when messages arrive unpredictably over time.

     Variable interval (VI). Unpredictable time intervals for email arrival reinforce checking behavior at steady rates.

153. What is a variable interval (VI) schedule of reinforcement?

     First response after a variable time interval is reinforced. Like checking email; unpredictable timing maintains steady responding.

154. What is positive reinforcement?

     Adding a stimulus to increase a behavior. Introducing a desirable stimulus following a behavior strengthens it by associating the action with a positive outcome.

155. What is shaping?

     Reinforcing successive approximations toward a target behavior. Gradually builds complex behaviors by rewarding progress steps.

156. What is a punisher in operant conditioning?

     A consequence that decreases the future frequency of a behavior. It weakens the association between a behavior and its outcome, reducing the likelihood of repetition.

157. Which option best describes extinction in operant conditioning?

     Behavior decreases when reinforcement is discontinued. Without reinforcement, the learned behavior gradually disappears.

158. What is reinforcement in operant conditioning?

     A consequence that increases the future frequency of a behavior. Strengthens behavior through rewards or removal of aversives.

159. What is stimulus discrimination in operant conditioning?

     Responding differently to distinct stimuli based on reinforcement. Differential reinforcement trains organisms to distinguish stimuli, responding only when outcomes differ.

160. What is a fixed-interval (FI) reinforcement schedule?

     Reinforcement for the first response after a fixed time period. Time-based schedule produces increased responding near deadline.

161. What is a fixed interval (FI) schedule?

     Reinforcement for the first response after a fixed time period. Time-based schedule shows increased responding near deadline.

162. What is a discriminative stimulus ($S^D$) in operant conditioning?

     Cue signaling that reinforcement is available for a behavior. Like a green light signaling "go" for reinforced behavior.

163. What is secondary (conditioned) reinforcement?

     A learned reinforcer associated with a primary reinforcer (for example, money). Gains value through pairing with primary reinforcers.

164. What is shaping?

     Reinforcing successive approximations toward a target behavior. Gradually builds complex behaviors step-by-step.

165. What is reinforcement in operant conditioning?

     A consequence that increases a behavior's future frequency. Strengthens behavior by making it more likely to occur again.

166. Which reinforcement schedule is fixed ratio (FR)?

     Reinforcement after a set number of responses. Predictable pattern creates steady response rate with post-reinforcement pauses.

167. Which reinforcement schedule is variable interval (VI)?

     First response after variable time intervals is reinforced. Unpredictable timing produces steady, moderate response rates.

168. Which reinforcement schedule produces the highest response rate and greatest extinction resistance?

     Variable-ratio (VR) schedule. Unpredictability creates persistence like gambling behavior.

169. Identify the schedule: A rat gets a pellet after every 10 lever presses.

     Fixed ratio (FR). Consistent response count requirements define this schedule, leading to post-reinforcement pauses.

170. What is a variable-ratio (VR) reinforcement schedule?

     Reinforcement after an unpredictable number of responses (average set). Like slot machines—unpredictable rewards maintain high response rates.

171. What is an extinction burst during operant extinction?

     A temporary increase in responding after reinforcement stops. This phenomenon occurs as an initial reaction to the absence of expected reinforcement before the behavior declines.

172. Identify the procedure: a rat presses a lever and receives food, increasing lever pressing.

     Positive reinforcement. Food (added stimulus) increases lever pressing.

173. Identify the concept: a neutral stimulus becomes reinforcing after pairing with a primary reinforcer.

     Conditioned (secondary) reinforcer. Money becomes reinforcing through association with primary needs.

174. What is a continuous reinforcement schedule (CRF)?

     Reinforcement delivered after every occurrence of the behavior. Every correct response gets reinforced; fastest learning but quick extinction.

175. What is shaping in operant conditioning?

     Reinforcing successive approximations toward a target behavior. Gradually rewarding behaviors closer to the desired goal.

176. What is a fixed interval (FI) reinforcement schedule?

     Reinforcement for the first response after a fixed time period. Like checking mail; causes increased responding near time mark.

177. What is reinforcement in operant conditioning?

     Any consequence that increases the future frequency of a behavior. Strengthens behavior through rewards or removal of aversives.

178. Identify whether this is reinforcement or punishment: Loud noise starts after speeding.

     Positive punishment. Aversive noise is added to decrease speeding behavior.

179. What is a variable-ratio (VR) reinforcement schedule?

     Reinforcement after an unpredictable number of responses (average ratio). Like slot machines: unpredictable wins maintain high response rates.

180. What is shaping (successive approximations)?

     Reinforcing steps that increasingly resemble the target behavior. Complex behaviors are built by rewarding gradual improvements.

181. Which reinforcement schedule is fixed interval (FI)?

     First response after a fixed time interval is reinforced. Creates scalloped pattern with increased responding near interval end.

182. Identify the procedure: a teen breaks curfew and loses car privileges, reducing curfew breaking.

     Negative punishment. Privilege removal decreases rule-breaking.

183. What is operant conditioning in the context of learning and behavior change?

     Learning in which consequences shape the frequency of a behavior. Behaviors followed by rewards increase; those followed by punishments decrease.

184. Which option best describes the partial reinforcement extinction effect (PREE)?

     Behaviors reinforced intermittently extinguish more slowly than continuously reinforced behaviors. Unpredictable reinforcement creates stronger behavioral persistence.

185. What is an operant (in operant conditioning)?

     A behavior that operates on the environment to produce consequences. Voluntary actions that "operate" to change the environment.

186. What is shaping in operant conditioning?

     Reinforcing successive approximations toward a target behavior. Gradually builds complex behaviors by rewarding progress.

187. What is spontaneous recovery after extinction in operant conditioning?

     Reappearance of an extinguished behavior after a rest period. Shows that extinction doesn't erase the original learning.

188. Which reinforcement schedule produces a scalloped response pattern as time to reinforcement approaches?

     Fixed-interval (FI) schedule. Response rate accelerates as reinforcement time nears.

189. What is a variable interval (VI) schedule of reinforcement?

     Reinforcement for the first response after a variable time period. Averaging variable times produces steady, moderate responding due to unpredictable reinforcement timing.

190. What is operant conditioning?

     Learning in which behavior is modified by its consequences. Unlike classical conditioning, behaviors are shaped by their outcomes.

191. What is a fixed ratio (FR) schedule?

     Reinforcement after a set number of responses. Predictable ratio creates steady response rate with brief pauses.

192. What is a variable ratio (VR) reinforcement schedule?

     Reinforcement after an unpredictable number of responses. Like slot machines; creates persistent responding.

193. What is operant conditioning?

     Learning in which consequences shape the probability of behavior. Behaviors are modified by their outcomes, unlike classical conditioning.

194. Which schedule is most resistant to extinction: FR, VR, FI, or VI?

     Variable-ratio (VR). Unpredictable rewards create persistent behavior patterns.

195. What is punishment in operant conditioning?

     A consequence that decreases a behavior's future frequency. Weakens behavior by making it less likely to occur again.

196. What is a primary reinforcer?

     Innately reinforcing stimulus (for example, food or water). Satisfies biological needs without prior learning.

197. What is negative reinforcement in operant conditioning?

     Removing an aversive stimulus to increase a behavior. "Negative" means removing something unpleasant as a reward.

198. What is negative punishment?

     Removing a desirable stimulus to decrease a behavior. "Negative" means removing; loss of privileges weakens behavior.

199. What is a token economy?

     System where tokens are earned and exchanged for reinforcers. Secondary reinforcers that can be saved and traded for rewards.

200. What is shaping?

     Reinforcing successive approximations toward a target behavior. Gradually builds complex behaviors by rewarding progress.

201. What is a secondary (conditioned) reinforcer?

     Learned reinforcer associated with a primary reinforcer. Through pairing with primary reinforcers, these gain value and can strengthen behaviors independently.

202. Identify whether this is reinforcement or punishment: A child gets candy for cleaning a room.

     Positive reinforcement. Candy (pleasant) is added to increase cleaning behavior.

203. What is shaping in operant conditioning?

     Reinforcing successive approximations toward a target behavior. Gradually rewards closer attempts until desired behavior is achieved.

204. What is extinction in operant conditioning?

     Decrease in behavior after reinforcement is withheld. Behavior stops when consequences no longer follow it.

205. What is operant conditioning in behavioral psychology?

     Learning in which consequences shape future behavior frequency. Behaviors are modified by their outcomes through reinforcement or punishment.

206. Which reinforcement schedule produces the highest response rate and greatest resistance to extinction?

     Variable ratio (VR). Unpredictability prevents extinction; like gambling.

207. Identify the schedule: checking email because messages arrive at unpredictable times after checking.

     Variable-interval (VI) schedule. Messages arrive unpredictably after checking behavior.

208. What is a variable interval (VI) reinforcement schedule?

     First response after a variable time interval is reinforced. Unpredictable timing produces slow, steady responding.

209. What is punishment in operant conditioning?

     Any consequence that decreases the future frequency of a behavior. Weakens behavior through aversives or removal of rewards.

210. What is positive punishment?

     Adding an aversive stimulus to decrease the probability of a behavior. "Positive" means adding; giving aversives weakens behavior.

211. What is a primary reinforcer?

     Innately reinforcing stimulus (for example, food or water). Satisfies biological needs without prior learning.

212. What is reinforcement in operant conditioning?

     A consequence that increases the future frequency of a behavior. Strengthens behavior by making it more likely to occur again.

213. Identify the schedule: reinforcement occurs after a fixed number of responses.

     Fixed-ratio (FR) schedule. Predictable pattern: every nth response gets reinforced.

214. Which reinforcement schedule delivers reinforcement after a fixed time interval (if responding occurs)?

     Fixed interval (FI). Like checking mail - first response after set time is reinforced.

215. What is a variable-interval (VI) reinforcement schedule?

     Reinforcement for the first response after varying time intervals. Unpredictable timing produces steady, moderate responding.

216. Which reinforcement schedule typically produces the highest steady response rate?

     Variable ratio (VR). Unpredictable response requirements generate persistent high-rate behaviors resistant to pauses.

217. Identify the procedure: touching a hot stove causes pain, decreasing stove touching.

     Positive punishment. Pain (added aversive) decreases touching behavior.

218. Identify the schedule: reinforcement occurs after a variable number of responses.

     Variable-ratio (VR) schedule. Unpredictable pattern: reinforcement after varying response counts.

219. What is a fixed ratio (FR) reinforcement schedule?

     Reinforcement after a set number of responses. Like piece-rate pay; predictable and produces steady responding.

220. What is a variable ratio (VR) reinforcement schedule?

     Reinforcement after an unpredictable number of responses (average ratio). Creates persistent responding, like gambling behavior.

221. What is an extinction burst?

     A temporary increase in behavior frequency when extinction begins. Last-ditch effort before behavior disappears completely.

222. What is a partial (intermittent) reinforcement schedule?

     Reinforcement is delivered for only some responses. Intermittent rewards maintain behaviors longer and resist extinction compared to continuous schedules.

223. What is a variable interval (VI) reinforcement schedule?

     Reinforcement for first response after a variable time interval. Like pop quizzes; maintains steady, moderate response rates.

224. What is shaping in operant conditioning?

     Reinforcing successive approximations toward a target behavior. Gradually builds complex behaviors by rewarding small steps.

225. What is continuous reinforcement (CRF)?

     Reinforcement delivered after every instance of the behavior. Consistent reinforcement leads to quick learning but fast extinction.

226. Which reinforcement schedule is most resistant to extinction?

     Variable-ratio (VR) schedule. Unpredictability makes it hardest to detect when reinforcement stops.

227. What is a discriminative stimulus ($S^D$) in operant conditioning?

     A cue signaling that a response will be reinforced in that context. Indicates when a behavior will be rewarded.

228. Which reinforcement schedule delivers reinforcement after a varying number of responses?

     Variable ratio (VR). Like slot machines - unpredictable number of responses needed.

229. Identify whether this is reinforcement or punishment: behavior decreases after outcome.

     Punishment. Decreased frequency indicates weakening effect.

230. Identify whether this is reinforcement or punishment: behavior increases after outcome.

     Reinforcement. Increased frequency indicates strengthening effect.

231. Identify the term for the disappearance of a behavior when reinforcement stops.

     Extinction. Without reinforcement, learned behaviors gradually fade away.

232. What is a fixed-ratio (FR) reinforcement schedule?

     Reinforcement after a set number of responses. Predictable ratio creates steady responding with brief pauses.

233. What is a variable-interval (VI) reinforcement schedule?

     Reinforcement for first response after variable time intervals (average set). Like fishing—unpredictable timing maintains steady responding.

234. What is operant conditioning?

     Learning in which consequences shape the frequency of a behavior. Behavior is modified by its outcomes, unlike classical conditioning.

235. Which option best describes a fixed-ratio schedule's typical response pattern?

     High rate with brief post-reinforcement pauses. Workers pause after each reinforcement before resuming steady work.

236. What is a fixed ratio (FR) schedule of reinforcement?

     Reinforcement after a set number of responses. Predictable response requirements produce high rates with pauses after reinforcement, like piecework pay.

237. What is a discriminative stimulus in operant conditioning?

     Cue signaling that a response will be reinforced if performed now. Environmental cue that signals reinforcement availability.

238. What is positive punishment?

     Adding an aversive stimulus to decrease a behavior. Like scolding or spanking to reduce unwanted behaviors.

239. What is negative punishment?

     Removing a desired stimulus to decrease a behavior. Like taking away phone privileges for misbehavior.

240. What is extinction in operant conditioning?

     Decrease of a behavior when reinforcement is withheld. Behavior fades without continued reinforcement.

Study these flashcards