π§ Operant Conditioning β Full Study Guide
PART 1: SIMPLE EXPLANATION OF ALL TOPICS
What is Operant Conditioning?
Operant conditioning is a type of learning where behavior is shaped by its consequences. If a behavior leads to a good outcome, you do it more. If it leads to a bad outcome, you do it less. The key idea: behavior is controlled by what comes after it.
B. F. Skinner
Skinner was the psychologist who developed operant conditioning. He used a device called the Skinner Box β a chamber where an animal (like a rat or pigeon) could press a lever to receive food. This allowed him to study how rewards and punishments change behavior in a controlled setting.
Edward Thorndike & the Law of Effect
Before Skinner, Thorndike studied cats in a Puzzle Box. A hungry cat was placed inside and had to figure out how to escape to get food.
- At first, the cat tried random actions (trial and error).
- Eventually, the cat accidentally triggered the release mechanism.
- Over many trials, the cat got faster and faster at escaping β it learned which action worked.
Law of Effect: Responses followed by pleasurable consequences are strengthened (repeated). Responses followed by unpleasant consequences are weakened (not repeated).
Types of Stimulus
| Stimulus | Effect on Behavior |
|---|
| Reinforcing Stimulus | Increases the likelihood of behavior repeating |
| Punishing Stimulus | Decreases the likelihood of behavior repeating |
Reinforcement
Primary Reinforcers β Meet a basic biological need directly. No learning needed.
- Food (hunger), Water (thirst), Physical comfort (acceptance/warmth)
Secondary Reinforcers β Learned value; they are paired with a primary reinforcer.
- Praise, Tokens, Gold Stars, Money
Positive vs. Negative Reinforcement
Both increase behavior β that is the key similarity. They differ in how:
| Type | What Happens | Example |
|---|
| Positive Reinforcement (+) | Add a pleasurable stimulus | Give candy for cleaning room |
| Negative Reinforcement (β) | Remove an unpleasant stimulus | Take away chores when grades improve |
β οΈ Negative reinforcement is NOT punishment. It still increases behavior.
Punishment
Both types decrease behavior:
| Type | What Happens | Example |
|---|
| Punishment by Application | Add an unpleasant stimulus | Spanking |
| Punishment by Removal | Remove a pleasurable stimulus | No TV |
Four Ways to Modify Behavior (Putting It All Together)
| Method | Effect | Example |
|---|
| Positive Reinforcement | Increase behavior | Reward good grades |
| Negative Reinforcement | Increase behavior | Remove curfew for responsible teen |
| Punishment by Application | Decrease behavior | Detention |
| Punishment by Removal | Decrease behavior | Take away phone |
Continuous vs. Partial Reinforcement
- Continuous Reinforcement β Every correct response is rewarded. Behavior is learned quickly but extinguishes quickly when rewards stop.
- Partial Reinforcement Effect β Only some correct responses are rewarded. Behavior takes longer to learn but is much more resistant to extinction.
Schedules of Reinforcement
| Schedule | Rule | Response Rate | Example |
|---|
| Fixed Ratio (FR) | Reward after set # of responses | High, steady rate | Paid per 10 items assembled |
| Variable Ratio (VR) | Reward after random # of responses | Highest, most persistent | Slot machines, gambling |
| Fixed Interval (FI) | Reward after set time period | Scallop pattern (slow then fast) | Weekly paycheck |
| Variable Interval (VI) | Reward after random time periods | Slow, steady rate | Checking email/social media |
Drawbacks of Severe Punishment
- Causes fear and anxiety
- Encourages lying to avoid punishment
- Leads to avoidance of the punisher
- Models aggression β teaches that aggression is acceptable
Making Punishment More Effective
Punishment should be:
- Immediate β right after the behavior
- Consistent β applied every time
- Paired with reinforcement β reward the correct alternative behavior
Discriminative Stimulus
A cue that signals when a specific behavior will be reinforced.
- Flashing police car lights β pull over
- A door labeled "Open" β push/pull
- A conditioned hand signal β dog sits
This is called Stimulus Control β the behavior is under the control of a specific stimulus.
Shaping & Successive Approximation
Used to teach complex behaviors by rewarding behaviors that are progressively closer to the desired final behavior. Each small step gets closer to the goal.
- Example: Teaching a dog to roll over β first reward lying down, then turning on side, then full roll.
Chaining
Once individual behaviors are shaped, they are linked together in a sequence. Each behavior becomes the cue for the next.
- Example: Teaching a dolphin a series of tricks in order.
Behavior Modification
The use of operant conditioning principles to bring about desired changes in behavior in real-world settings.
Token Economy
A system where desired behaviors are rewarded with tokens (points, chips, stars) that can be exchanged for real rewards. Used in classrooms, hospitals, prisons.
Time-Out
Mild punishment β removing the person from all sources of positive reinforcement and attention. Most effective when the environment being left is reinforcing.
Neurofeedback
Modifying behavior by providing real-time feedback about brain activity (via brain scanning). The person learns to alter their own brain patterns.
Biofeedback
Modifying behavior by providing feedback about bodily functions (heart rate, muscle tension, skin temperature). Used to reduce stress, anxiety, chronic pain.
PART 2: MCQ PRACTICE QUESTIONS
π· SECTION A β Foundational Concepts (Direct Questions)
1. Who is credited with developing operant conditioning?
- A) Ivan Pavlov
- B) John Watson
- C) B. F. Skinner
- D) Edward Thorndike
β
Answer: C) B. F. Skinner
2. What is the "Law of Effect" associated with?
- A) Classical conditioning
- B) Observational learning
- C) Edward Thorndike
- D) B. F. Skinner
β
Answer: C) Edward Thorndike
3. According to the Law of Effect, what happens to a response followed by a pleasurable consequence?
- A) It is weakened
- B) It is eliminated
- C) It is strengthened and repeated
- D) It becomes involuntary
β
Answer: C) It is strengthened and repeated
4. What method did Thorndike's cats use to escape the Puzzle Box?
- A) Insight learning
- B) Classical conditioning
- C) Trial and error
- D) Observational learning
β
Answer: C) Trial and error
5. What is a Skinner Box primarily used for?
- A) Studying classical conditioning in dogs
- B) Studying operant conditioning in animals
- C) Measuring brain waves during sleep
- D) Testing reflexive responses
β
Answer: B) Studying operant conditioning in animals
6. A reinforcing stimulus is defined as:
- A) A stimulus that decreases the likelihood of a behavior
- B) A neutral stimulus paired with an unconditioned stimulus
- C) A consequence that increases the likelihood of a behavior occurring again
- D) Any stimulus that causes pain or discomfort
β
Answer: C) A consequence that increases the likelihood of a behavior occurring again
7. Which of the following is a PRIMARY reinforcer?
- A) Money
- B) Gold stars
- C) Praise
- D) Food
β
Answer: D) Food
8. Which of the following is a SECONDARY reinforcer?
- A) Water
- B) Warmth
- C) Tokens
- D) Sleep
β
Answer: C) Tokens
9. Positive reinforcement involves:
- A) Removing an unpleasant stimulus to increase behavior
- B) Adding a pleasurable stimulus to increase behavior
- C) Adding an unpleasant stimulus to decrease behavior
- D) Removing a pleasurable stimulus to decrease behavior
β
Answer: B) Adding a pleasurable stimulus to increase behavior
10. Negative reinforcement involves:
- A) Adding an unpleasant consequence
- B) Removing a reward to reduce behavior
- C) Removal or avoidance of an aversive stimulus to increase behavior
- D) Punishing unwanted behavior
β
Answer: C) Removal or avoidance of an aversive stimulus to increase behavior
11. A parent spanks a child for misbehaving. This is an example of:
- A) Negative reinforcement
- B) Positive reinforcement
- C) Punishment by removal
- D) Punishment by application
β
Answer: D) Punishment by application
12. A teenager loses their phone privileges after breaking curfew. This is an example of:
- A) Positive reinforcement
- B) Negative reinforcement
- C) Punishment by removal
- D) Punishment by application
β
Answer: C) Punishment by removal
13. Which reinforcement schedule produces the highest and most persistent rate of responding?
- A) Fixed Ratio
- B) Fixed Interval
- C) Variable Interval
- D) Variable Ratio
β
Answer: D) Variable Ratio
14. On a Fixed Interval schedule, when is a reward delivered?
- A) After a set number of responses
- B) After a random number of responses
- C) After a fixed period of time
- D) After a random period of time
β
Answer: C) After a fixed period of time
15. Behaviors learned under partial reinforcement are:
- A) Learned faster and extinguished faster than continuous reinforcement
- B) Learned slower but more resistant to extinction
- C) Never fully learned
- D) Identical in strength to continuously reinforced behaviors
β
Answer: B) Learned slower but more resistant to extinction
π· SECTION B β Scenario-Based Questions
16. Every time Maria finishes her vegetables at dinner, her mom gives her a piece of chocolate. Over time, Maria eats her vegetables consistently. What type of conditioning is this?
- A) Classical conditioning
- B) Observational learning
- C) Operant conditioning via positive reinforcement
- D) Operant conditioning via negative reinforcement
β
Answer: C) Operant conditioning via positive reinforcement
17. James has a terrible headache. He takes aspirin and the headache goes away. He is more likely to take aspirin the next time he has a headache. This is an example of:
- A) Positive reinforcement
- B) Punishment by application
- C) Negative reinforcement
- D) Extinction
β
Answer: C) Negative reinforcement
(The aversive stimulus β headache β is removed, increasing the behavior of taking aspirin.)
18. A rat in a Skinner Box presses a lever and receives a food pellet. The rat presses the lever more frequently afterward. What is the food pellet acting as?
- A) A punishing stimulus
- B) A discriminative stimulus
- C) A reinforcing stimulus
- D) A conditioned stimulus
β
Answer: C) A reinforcing stimulus
19. A dog trainer first rewards the dog for facing the right direction, then for lying down, then for rolling partway, and finally for completing a full roll. What technique is the trainer using?
- A) Classical conditioning
- B) Chaining
- C) Shaping and successive approximation
- D) Token economy
β
Answer: C) Shaping and successive approximation
20. A classroom teacher gives students points for completing homework. At the end of the week, students can trade points for prizes. This system is best described as a:
- A) Fixed ratio schedule
- B) Token economy
- C) Biofeedback program
- D) Continuous reinforcement schedule
β
Answer: B) Token economy
21. Every Friday, employees know they will receive their paycheck. They tend to work hardest just before Friday and slow down right after. What reinforcement schedule explains this pattern?
- A) Variable Ratio
- B) Fixed Ratio
- C) Fixed Interval
- D) Variable Interval
β
Answer: C) Fixed Interval
(The "scallop" pattern β slow performance after reward, increasing before the next scheduled reward.)
22. A gambler keeps playing slot machines even after many losses, because they never know when the next win will come. What schedule of reinforcement is maintaining this behavior?
- A) Fixed Ratio
- B) Fixed Interval
- C) Variable Interval
- D) Variable Ratio
β
Answer: D) Variable Ratio
23. A disruptive student is removed from class and placed in a quiet hallway with nothing to do. The teacher hopes this will reduce the disruptive behavior. What technique is being used?
- A) Punishment by application
- B) Negative reinforcement
- C) Time-out
- D) Shaping
β
Answer: C) Time-out
24. A child misbehaves and is immediately sent to stand in the corner. Later, the parent explains what the child should do instead and praises good behavior. Which principle of effective punishment is being followed?
- A) Punishment should be delayed
- B) Punishment should be random
- C) Punishment should be paired with reinforcement for correct behavior
- D) Punishment should be severe
β
Answer: C) Punishment should be paired with reinforcement for correct behavior
25. A police officer's flashing lights cause drivers to slow down and pull over. The flashing lights function as:
- A) A primary reinforcer
- B) A punishing stimulus
- C) A discriminative stimulus
- D) A secondary reinforcer
β
Answer: C) A discriminative stimulus
26. Lisa's doctor monitors her heart rate on a screen and teaches her to consciously lower it through relaxation techniques. She can see real-time feedback on the monitor. This is an example of:
- A) Neurofeedback
- B) Token economy
- C) Biofeedback
- D) Shaping
β
Answer: C) Biofeedback
27. A patient with ADHD has their brain activity monitored and receives feedback that helps them learn to produce calmer brainwave patterns. This is an example of:
- A) Biofeedback
- B) Token economy
- C) Neurofeedback
- D) Classical conditioning
β
Answer: C) Neurofeedback
28. A cat is placed in Thorndike's Puzzle Box many times. On the first trial it takes 5 minutes to escape. By the 20th trial it escapes in 10 seconds. What best explains this improvement?
- A) The cat received classical conditioning
- B) The cat used insight to solve the problem
- C) Trial and error led to successful responses being reinforced
- D) The cat was negatively reinforced by the addition of food
β
Answer: C) Trial and error led to successful responses being reinforced
29. A child who was spanked for fighting at school begins fighting at home, having seen that the parent uses physical force. This illustrates which drawback of severe punishment?
- A) Avoidance of the punisher
- B) Modeling of aggression
- C) Increased lying
- D) Fear and anxiety
β
Answer: B) Modeling of aggression
30. A worker is paid $1 for every 5 phone calls they make. What schedule of reinforcement is this?
- A) Fixed Interval
- B) Variable Ratio
- C) Variable Interval
- D) Fixed Ratio
β
Answer: D) Fixed Ratio
31. You check your social media randomly throughout the day, sometimes seeing new notifications and sometimes not. This checking behavior is maintained by which schedule?
- A) Fixed Ratio
- B) Fixed Interval
- C) Variable Interval
- D) Variable Ratio
β
Answer: C) Variable Interval
32. A coach trains a gymnast by first rewarding any attempt to jump, then rewarding higher jumps only, and gradually requiring near-perfect form. This is best described as:
- A) Chaining
- B) Behavior modification through shaping
- C) Token economy
- D) Continuous reinforcement
β
Answer: B) Behavior modification through shaping
33. A basketball player always bounces the ball exactly three times before every free throw. This consistent ritual was accidentally reinforced when they made baskets. According to operant conditioning, this ritual is best explained as:
- A) Classical conditioning
- B) A discriminative stimulus
- C) A superstition arising from operant conditioning
- D) Fixed ratio reinforcement
β
Answer: C) A superstition arising from operant conditioning
34. Once a circus seal has been trained (shaped) to balance a ball, then clap flippers, then spin, the entire three-part performance happens in order. What term describes this learned sequence?
- A) Shaping
- B) Chaining
- C) Stimulus generalization
- D) Biofeedback
β
Answer: B) Chaining
35. A child begins to avoid their father after being frequently and harshly punished by him. Which drawback of severe punishment does this illustrate?
- A) Modeling of aggression
- B) Extinction
- C) Avoidance of the punisher
- D) Positive reinforcement
β
Answer: C) Avoidance of the punisher
PART 3: CHEAT SHEET π
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
β OPERANT CONDITIONING β QUICK REFERENCE CHEAT SHEET β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β KEY FIGURES β
β β’ B. F. Skinner β Operant Conditioning, Skinner Box β
β β’ Edward Thorndike β Law of Effect, Puzzle Box, Trial & Error β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β LAW OF EFFECT (Thorndike) β
β Pleasant consequence β behavior REPEATED β
β Unpleasant consequence β behavior NOT REPEATED β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β STIMULUS TYPES β
β Reinforcing Stimulus β INCREASES likelihood of behavior β
β Punishing Stimulus β DECREASES likelihood of behavior β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β REINFORCEMENT (both INCREASE behavior) β
β Positive (+) β ADD pleasant stimulus (give candy for good grades) β
β Negative (β) β REMOVE unpleasant stimulus (remove chores for good grades) β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β PUNISHMENT (both DECREASE behavior) β
β By Application β ADD unpleasant stimulus (spanking) β
β By Removal β REMOVE pleasant stimulus (take away TV) β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β REINFORCERS β
β Primary β Meets biological need (food, water, warmth) β
β Secondary β Learned value, paired with primary (money, praise, tokens) β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β REINFORCEMENT SCHEDULES β
β Fixed Ratio (FR) β After SET # of responses β High, steady β
β Variable Ratio (VR) β After RANDOM # of responses β Highest, most persist β
β Fixed Interval (FI) β After SET time period β Scallop pattern β
β Variable Interval (VI)β After RANDOM time period β Slow, steady β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β PARTIAL vs. CONTINUOUS REINFORCEMENT β
β Continuous β Every response rewarded β Learned fast, extinguished fast β
β Partial β Some responses rewarded β Learned slower, very resistant β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β KEY TECHNIQUES β
β Shaping β Reward successive approximations toward target behavior β
β Chaining β Link shaped behaviors into a sequence β
β Discriminative β Cue that signals when reinforcement is available β
β Stimulus β (police lights, "Open" sign, hand signals) β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β BEHAVIOR MODIFICATION β
β Token Economy β Tokens exchanged for rewards (classroom/hospital) β
β Time-Out β Remove from all positive reinforcement β
β Biofeedback β Real-time body signal feedback (heart rate, muscle) β
β Neurofeedback β Real-time brainwave feedback β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β DRAWBACKS OF SEVERE PUNISHMENT β
β β’ Fear & Anxiety β’ Lying β’ Avoidance β’ Models aggression β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β EFFECTIVE PUNISHMENT MUST BE: β
β β Immediate β Consistent β Paired with reinforcement for correct acts β
β βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£
β MEMORY TRICKS β
β Positive = ADD (+) Negative = REMOVE (β) β
β Reinforcement = INCREASE Punishment = DECREASE β
β "Negative β Bad" β negative reinforcement INCREASES good behavior! β
β VR = Slot machines (hardest to extinguish) β
β FI = Paycheck (scallop pattern β slows after, speeds up before) β
ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Here's a summary of everything created:
Part 1 β Teaching Explanation: All topics covered in plain language β Skinner, Thorndike, Law of Effect, Puzzle Box, Reinforcement types, Punishment types, Schedules of Reinforcement, Shaping, Chaining, Token Economy, Time-Out, Biofeedback, Neurofeedback.
Part 2 β 35 MCQs with Answers:
- Questions 1β15: Direct knowledge questions
- Questions 16β35: Scenario-based and example-style questions (like the ones from class)
- Every answer is placed directly under its question
Part 3 β Cheat Sheet: A compact reference grid covering all key terms, distinctions, schedules, techniques, and memory tricks.
The most commonly confused concepts to watch out for:
- Negative reinforcement β Punishment β negative reinforcement still increases behavior
- Positive/Negative refer to adding/removing β not good/bad
- Variable Ratio (slot machines) = hardest to extinguish
- Fixed Interval (paychecks) = scallop pattern