📘 Lecture 34 — The Stimulus Response Theory of Dollard and Miller
📖 Overview: This lecture introduces the Stimulus-Response (S-R) theory of personality developed by John Dollard and Neal Miller, which centers on the concept of habit as a learned association between a stimulus (cue) and a response. It explains how habits are acquired, extinguished, and replaced, emphasizing the roles of drive, cue, response, and reward in learning. The lecture also covers the structure and dynamics of personality, development, and applications, including conflict and psychotherapy.
🗂️ Topics Covered
The lecture covers the biographical sketches of Dollard and Miller, their core concepts including the structure and dynamics of personality, and the development of personality through innate equipment, learning processes, secondary drives, higher mental processes, critical stages, and social context. It also discusses applications such as unconscious processes and conflict, as well as psychotherapy, research, summary, and evaluation of the theory.
📝 Lecture Summary
The Stimulus Response Theory of Dollard and Miller
The concept of habit, representing a stable Stimulus-Response connection (S-R), is central to this theory. Most of the theory specifies the conditions under which habits form and are dissolved. A habit is a link or association between a stimulus (cue) and a response. Learned associations may form between external stimuli and overt responses, as well as internal ones. The bulk of the theory focuses on conditions for acquiring, extinguishing, or replacing habits, with little attention to classifying habits or listing major varieties.
🔑 Definition — Habit: a link or association between a stimulus (cue) and a response. It is the key concept in the theory by Dollard and Miller. 📐 Formula: S-R connection → Stimulus evokes a specific Response when learned. 📌 Example: A child learns to salivate (response) at the sound of footsteps (stimulus/cue) because footsteps are repeatedly paired with food (reward).
Core Concepts
The core concepts include: 1) The Structure of Personality, 2) The Dynamics of Personality, 3) The Development of Personality (Innate Equipment, The Learning Process, Secondary Drive and the Learning Process, Higher Mental Processes, Critical Stages of Development, The Social Context), 4) Applications of the Model (Unconscious Processes, Conflict), 5) Psychotherapy, 6) Research, 7) Summary, and 8) Evaluation.
Biographical Sketch
John Dollard was born in Menasha, Wisconsin, on August 29, 1900, and received his M.A. (1930) and Ph.D. (1931) in sociology from the University of Chicago. He served as assistant to the president of the University of Chicago (1926-1929) and later became a research associate and professor of psychology at Yale University. Neal E. Miller was born in Milwaukee, Wisconsin, on August 3, 1909, receiving his B.S. from the University of Washington (1931), M.A. from Stanford (1932), and Ph.D. in psychology from Yale (1935). He had training in Psychoanalysis at the Vienna Institute. Despite different backgrounds (Dollard in sociology, Miller in experimental psychology), they collaborated to develop the Stimulus-Response theory or S-R linkage.
I. Pavlov and Classical Conditioning
I. Pavlov (1906-1927) discovered a type of learning known as classical conditioning. Pavlov demonstrated that simultaneous presentation of an Unconditioned Stimulus (US) (meat powder) and a Conditioned Stimulus (CS) (sound of footsteps or a bell) would elicit a Conditioned Response (CR) (salivation), which was originally elicited by the US.
🔑 Definition — Classical Conditioning: a type of learning where a neutral stimulus (CS) becomes associated with an unconditioned stimulus (US) to elicit a conditioned response (CR).
📌 Example: Pavlov’s dog salivates (CR) at the sound of a bell (CS) because the bell was repeatedly paired with meat powder (US).
J. Watson and Behaviorism
J. Watson proposed that psychology should study behavior using the same objective techniques as natural sciences, focusing on the overt behavior of individuals.
E. Thorndike and Learning
E. Thorndike demonstrated the importance of reward and punishment in the learning process. Thorndike, Hull, Spence, and Guthrie focused on learning as involving the associative linkage between stimulus and response. Most cognitive processes are actually Stimulus-Response associations.
Skinner and Operant Conditioning
Skinner rejected Hull’s approach; the goal of Skinner’s science is to control, predict, and interpret behavior. He proposed Operant Conditioning, where organisms can learn complicated behaviors by shaping, using the successive approximations technique.
🔑 Definition — Successive Approximations Technique: a method where we start reinforcing a behavior that is the first step toward the final behavior, then gradually reinforce successively closer approximations to the final behavior. 📌 Example: Learning to drive a car or teaching a retarded child how to feed himself.
What is learning?
According to this theory, learning is the study of circumstances under which a response and a stimulus (cue) become connected. When learning is completed, the S-R are bound together so the appearance of the stimulus (cue) evokes the response. In order to learn, one must:
- Want something (drive)
- Notice something (cue-stimulus)
- Do something (response)
- Get something (reward)
📌 Example: For a child to learn to open a door (response) when they see the doorknob (cue-stimulus), they must want to go outside (drive) and receive praise (reward) for doing so. For a habit to be established, the cue-stimulus and response must occur close together in space and time, and the response must be rewarded.
1- The Structure of Personality
Dollard and Miller showed less interest in the structure of personality than in the process of learning and development. The key concept representing stable and enduring characteristics of the person is habit. A habit is a link or association between a stimulus (cue) and a response. Learned associations may form between external stimuli and overt responses, as well as internal ones. The bulk of their theory specifies conditions under which habits are acquired, extinguished, or replaced, with little attention to classifying habits or listing major varieties.
2- The Dynamics of Personality
Dollard and Miller explicitly define motivation and specify the development of motives, focusing on salient motives such as anxiety. They attempt to illustrate the general process operating for all motives. In growth, a typical individual develops many secondary drives that instigate behavior. These learned drives are acquired based on primary drives, representing elaborations and hiding the functions of underlying innate drives. In modern society, secondary drive stimulation largely replaces the original function of primary drive stimulation. Acquired drives like anxiety, shame, and the desire to please impel most actions. Most reinforcements are not primary rewards but secondary rewards—originally neutral events that acquire reward value through consistent pairing with primary reinforcement.
🔑 Definition — Secondary Drive: a learned drive acquired on the basis of primary drives, representing an elaboration of them (e.g., anxiety, shame, desire to please). 🔑 Definition — Secondary Reward: an originally neutral event that acquires reward value by being consistently experienced in conjunction with primary reinforcement. 📌 Example: A mother’s smile becomes a powerful secondary reward for an infant because it is repeatedly associated with feeding, diapering, and other caretaking activities that bring pleasure or remove physical discomfort. Secondary rewards reinforce behavior but their capacity is not sustained indefinitely unless they continue to occur occasionally with primary reinforcement.
3- The Development of Personality
The transformation of the simple infant into the complex adult is elaborated by Dollard and Miller via: i- Innate Equipment ii- The Learning Process iii- Secondary Drive and the Learning Process iv- Higher Mental Processes v- Critical Stages of Development vi- The Social Context
⭐ Key Takeaways
- Habit is the core concept in Dollard and Miller’s S-R theory, defined as a learned association between a stimulus (cue) and a response, and the theory focuses on how habits are formed, extinguished, or replaced.
- Learning requires four essential elements: drive (wanting something), cue (noticing something), response (doing something), and reward (getting something); all must be present for a habit to be established.
- The successive approximations technique (shaping) is a key method for learning complex behaviors by reinforcing increasingly closer approximations to the final behavior.
- Secondary drives (e.g., anxiety, shame, desire to please) and secondary rewards (e.g., a mother’s smile) are learned through association with primary drives and rewards, and they largely motivate human behavior in modern society.
- The theory emphasizes classical conditioning (Pavlov), operant conditioning (Skinner), and objective observation of overt behavior (Watson) as foundational to understanding habit formation.
🧠 Quick Revision Questions
- According to Dollard and Miller, what are the four essential components required for learning to take place?
- What is the key concept in Dollard and Miller’s theory, and how is it defined?
- How does a secondary reward (e.g., a mother’s smile) acquire its reinforcing value?
- What is the successive approximations technique, and how does it relate to shaping behavior?
- Define classical conditioning and provide an example from Pavlov’s experiments.
📘 Lecture 35 — THE STIMULUS RESPONSE THEORY OF DOLLARD AND MILLER
📖 Overview: This lecture presents Dollard and Miller’s Stimulus Response (S-R) theory of personality, which centers on habit as the key concept—a stable connection between a stimulus (cue) and a response. The theory focuses on specifying the conditions under which habits are formed, maintained, and extinguished, applying learning principles to explain personality development, neurosis, and psychotherapy.
🗂️ Topics Covered
The lecture covers the structure and dynamics of personality, the development of personality including innate equipment, the learning process, secondary drives, higher mental processes, critical stages of development and social context. It then applies the model to unconscious processes and conflict, discusses psychotherapy, characteristic research methods, and concludes with a summary and evaluation of the theory.
📝 Lecture Summary
Core Concepts
The theory introduces the habit as a link or association between a stimulus (cue) and a response. Learned associations may be formed between external stimuli and overt responses as well as internal ones. The bulk of the theory specifies conditions under which habits are acquired, extinguished, or replaced, with little attention given to listing major varieties of habits.
🔑 Definition — Habit: A link or association between a stimulus (cue) and a response.
3- The Development of Personality
Dollard and Miller elaborate the transformation of the simple infant into the complex adult through several key processes.
Innate Equipment
The infant has four categories of innate equipment. First, specific reflexes are responses to specific stimuli, e.g., if dust gets in the nose the baby sneezes. Second, the baby has innate hierarchies of responses—tendencies for certain responses to occur in particular stimulus situations, e.g., loud noise makes the baby cry, hunger makes the baby cry. Third, the baby possesses primary drives linked to physiological processes, such as hunger, rest, and sleep. Fourth, there is the capacity for extinction and elimination of existing associations between stimuli and responses.
💡 Why this matters: These innate foundations provide the starting material upon which all learning and personality development is built.
The Learning Process
Learning, in its simplest form, is the study of circumstances under which a response and a stimulus (cue) become connected. When learning is completed, the SR are bound together so the appearance of a stimulus evokes the response.
Four conditions are necessary for learning to occur:
- One must want something (drive)
- Notice something (cue-stimulus)
- Do something (response)
- Get something (reward)
📐 Formula: Drive + Cue + Response + Reward = Learning
📌 Example: For a desired behavior to take place within a subject, they must want something (drive), notice something (cue), do something (response), and get something (reward).
A crucial stage in learning is the production of the appropriate response. In any given situation, certain responses will be more likely to appear than others. The order of preference or probability of response when the situation is first presented is the initial hierarchy of responses. After experience and learning have influenced behavior, the derived order is labeled the resultant hierarchy.
Secondary Drive and the Learning Process
The infant is born with a limited range of primary drives that develop into a complex system of secondary drives with growth and experience. Strong stimuli, such as shock, may elicit intense internal responses that produce further internal stimuli. These internal stimuli act as cues to guide subsequent responses and serve as a drive that keeps the person active until reinforcement occurs.
A previously neutral cue that has regularly occurred with a drive-producing stimulus may gain the capacity to elicit some part of the internal responses initially elicited only by the drive. These learned internal responses automatically set off drive stimuli, establishing a secondary drive that motivates new learning just as primary drives do.
Higher Mental Processes
The individual’s interactions with the environment are of two varieties: those guided by a single cue (direct) and those mediated by internal processes (cue-producing responses). Following Hull, Dollard and Miller distinguish between instrumental responses (which possess immediate effect upon the environment) and cue-producing responses (whose main function is to mediate or lead the way to another response).
One of the most important cue-producing responses is labeling or naming events and experiences. The individual may generalize between two or more cue situations by identifying them as having the same label, e.g., identifying going to America or taking an examination as “threatening.” The ability to use language and other response-produced cues is greatly influenced by culture and society.
Critical Stages of Development
Dollard and Miller assume that unconscious conflict, learned mostly during infancy and childhood, serves as the basis for most severe emotional problems in later life. They agree with psychoanalytic theorists that experiences of the first half dozen years of life are crucial determinants of adult behavior.
The Social Context
Neurotic conflict is not only learned by the child but learned primarily as a result of conditions created by the parent. Cultural prescriptions concerning the child are often contradictory or discontinuous, and the child during infancy is not well equipped to cope with complex learning demands. Society demands that the child learn to be aggressive in some situations and submissive in others—a difficult discrimination. This may overreach the child’s learning capacity with resultant frustration and emotional upheaval.
4- Applications of the Model
i--Unconscious Processes
Dollard and Miller represent language as playing a crucial role in human development. Determinants of behavior that are unconscious play a key role in behavioral disturbances. The theory is consistent with psychoanalytic formulations in accepting unconscious factors as important, but the account of the origin of these processes differs from the Freudian version.
ii--Conflict
Conflict behavior is represented in terms of five basic assumptions. First, the gradient of approach—the tendency to approach a goal becomes stronger the nearer the individual is to the goal. Second, the gradient of avoidance—the tendency to avoid a negative stimulus becomes stronger the nearer the individual is to the stimulus. Third, the gradient of avoidance is steeper than the gradient of approach. Fourth, an increase in the drive associated with approach or avoidance will raise the general level of the gradient. Fifth, when there are two competing responses, the stronger will occur.
Approach-avoidance conflict occurs when approach and avoidance tendencies are aroused simultaneously by the same object. For example, a young man is strongly attracted to a woman yet feels embarrassed and afraid in her presence. Avoidance-avoidance conflict occurs when faced with two competing avoidance responses. For example, a boy is afraid to climb but also wishes to avoid being called a coward. He shows vacillation, turning first from one goal and then from the other.
How Neurosis is Learned: According to stimulus-response theory, neurotic conflicts are taught by parents and learned by children. Four critical learning situations—feeding, toilet training, sex education, and training to control aggression—are usually mishandled by parents, developing anxiety and guilt in the child that continues into adult life.
5- Psychotherapy
Dollard and Miller are concerned with both the development of neuroses and their treatment. The essence of their approach to psychotherapy is straightforward. The therapist should be a sympathetic, permissive listener who encourages the patient to express all feelings and to free associate. Whatever the patient’s thoughts, the therapist remains non-punitive and helps the patient understand these feelings and how they developed. These are all stimulus-response connections that have taken place and the person must understand them.
6- Characteristic Research and Research Methods
Miller and Dollard have reported considerable investigation illustrating or testing derivations from their theory. In Social Learning and Imitation (1941), studies on human and lower animal subjects are summarized. Miller conducted experimental studies on various aspects of the theory. A large cluster of studies on animals in the laboratory deal with the concept of displacement or stimulus generalization, providing experimental evidence for stimulus-response operations.
7- Summary
Habit is the key concept in the theory. A habit is a link or association between a stimulus (cue) and a response. Learned associations may be formed between external stimuli and overt responses as well as internal ones. A crucial stage in learning is the production of the appropriate response. The order of preference of response when first presented is the initial hierarchy of responses. After experience and learning, the derived order is the resultant hierarchy.
8- Evaluation
This personality theory is described as most elegant, most economical, and showing the closest link to natural science. Stimulus-response (S-R) theory can accurately be labeled a laboratory theory in contrast to other theories where clinical or naturalistic observation has been more important.
⭐ Key Takeaways
The central concept in Dollard and Miller’s theory is habit—a learned association between a stimulus and a response. Learning requires four components: drive, cue, response, and reward. Secondary drives, such as fear, are learned when neutral cues become associated with drive-producing stimuli. The gradient of approach is less steep than the gradient of avoidance, which explains why avoidance often overrides approach in conflict situations. Neurotic conflicts are learned in childhood through mishandling of feeding, toilet training, sex education, and aggression training by parents.
🧠 Quick Revision Questions
- What are the four necessary conditions for learning to occur according to Dollard and Miller?
- What is the difference between the initial hierarchy of responses and the resultant hierarchy?
- How is a secondary drive, such as fear, established according to this theory?
- What are the five assumptions about conflict behavior, and how do they explain approach-avoidance conflict?
- What are the four critical learning situations that, when mishandled, lead to neurotic conflict in adulthood?
📘 Lecture 36 — Skinner’s Theory of Personality
📖 Overview: This lecture introduces B.F. Skinner’s Radical Behaviorism, which rejects inner mental states as explanations for behavior and instead focuses solely on observable actions and environmental consequences. It covers the core concepts of classical and operant conditioning, along with Skinner’s biographical background, making it foundational for understanding how behavior is learned and maintained.
🗂️ Topics Covered
The lecture begins with an introduction to Skinner’s Radical Behaviorism and its rejection of internal causes. It then provides a biographical sketch of Skinner, followed by detailed explanations of Classical Conditioning (including Pavlov’s experiments, extinction, and second-order conditioning) and Operant Conditioning (including Thorndike’s Law of Effect, reinforcement, and punishment). The outline also lists topics such as schedules of reinforcement, techniques of treatment, applications, summary, and evaluation, though these are not elaborated in the provided text.
📝 Lecture Summary
Radical Behaviorism
Skinner’s Radical Behaviorism is the brand of psychology that rejects the use of inner states (e.g., anxiety) as explanations for overt/observable behavior. Instead, behavior changes due to aversive contingencies in the environment, which generate the condition felt as an inner cause like anxiety. For example, avoiding a party is not due to feeling anxious; it is due to the aversive consequences of attending. Similarly, rushing into a burning building is not heroism but a history of reinforcement in similar situations.
💡 Why this matters: This shift from internal to external causes is the core of Skinner’s challenge to traditional personality theories.
Biographical Sketch
B.F. Skinner was born in 1904 in small-town Pennsylvania, in a warm and stable family. He was an avid builder of things (scooters, rafts, slingshots, etc.) from childhood. As an undergraduate at Hamilton College, he majored in English and aspired to be a writer, encouraged by a letter from Robert Frost, but his literary period was unproductive. He gave up writing and turned to Harvard and psychology. At Harvard, he encountered E.G. Boring, Carroll Pratt, and Henry A. Murray. Skinner received his Ph.D. in 1931, spent five postdoctoral years at Harvard’s lab, and moved to the University of Minnesota in 1936, where nine productive years established him as a major experimental psychologist. During this time, he began his novel Walden II (1948), about an experimental society. Skinner received many honors (Distinguished Scientific Award, National Academy of Sciences, Gold Medal Award, President’s Medal of Science). He died of leukemia on August 18, 1990, eight days after receiving the APA’s award for Outstanding Lifetime Contribution to Psychology.
Classical Conditioning
Classical conditioning is credited to I.P. Pavlov and Watson. Pavlov discovered the principle of reinforcement in this context. In Pavlov’s famous experiment, a bell is sounded and immediately followed by meat presented to a hungry dog. The dog salivates at the bell-and-meat combination. At first, the dog only salivates to the meat (the UCS), but the meat’s presentation strengthens the likelihood of salivation (the UCR) when the bell (the CS) is sounded later. The meat is a positive reinforcer because its presentation increases salivation. Conditioning is most effective when the reinforcement follows the conditioned stimulus, regardless of the response.
- Extinction is the decrease in responding when the reinforcement following the response no longer occurs (e.g., the bell is sounded but no meat follows).
Steps of Classical Conditioning:
- UCS (food) → UCR (salivation) – This S-R association exists naturally.
- The UCS (meat) is paired with the CS (bell).
- UCS + CS presented together → salivation occurs.
- CS alone (bell) → CR (conditioned salivation) – The S-R connection between bell and salivation is established.
🔑 Definition — Second-Order Conditioning: The process of building one conditioned S-R association on another.
📐 Process: Once the CS (bell) → CR (salivation) association is established, you can pair a new CS (green light) with the bell. After several pairings, the green light alone will elicit salivation.
📌 Example: You see a spider (stimulus) and jump/run away (response); you see an injured man bleeding (stimulus) and feel faint (response). Many S-R associations influencing preferences for food, clothing, music, and friends operate without your awareness.
Operant Conditioning
Operant conditioning, first systematically investigated by Thorndike, involves responses that are spontaneous and voluntary (e.g., painting a picture, crossing a street). Skinner’s term operant refers to a response that operates on the environment and changes it; the change in the environment affects the subsequent occurrence of the response. For a response to be conditioned, the reinforcer must be presented after the response occurs, which increases the response’s frequency.
Thorndike’s Law of Effect:
- Behaviors more likely to be repeated lead to satisfying consequences (rewarded = reinforced).
- Behaviors less likely to be repeated lead to unsatisfying consequences (punished = not reinforced).
Teachers, judges, and employers rely on this connection between actions and consequences to shape behavior.
- Reinforcement: A consequence that increases the frequency of a behavior.
- Punishment: A consequence that decreases the frequency of a behavior.
📌 Example: If you are hungry, an ice cream can be a reinforcement; but if you have a cold or dislike ice cream, it can be punishment.
Techniques of Treatment, Applications, Summary, Evaluation
(These sections are listed in the outline but are not elaborated in the provided lecture text.)
⭐ Key Takeaways
The most critical concepts from this lecture are: (1) Skinner’s Radical Behaviorism completely rejects inner mental states (like anxiety) as explanations, focusing instead on environmental contingencies and observable behavior. (2) Classical conditioning involves forming associations between a stimulus and a response (S-R), where a neutral stimulus (CS) comes to elicit a response (CR) after being paired with an unconditioned stimulus (UCS). (3) Operant conditioning involves consequences (reinforcement or punishment) that follow a voluntary response, with reinforcement increasing and punishment decreasing the frequency of behavior. (4) Thorndike’s Law of Effect states that rewarded behaviors are more likely to be repeated, while punished behaviors are less likely to be repeated. (5) Second-order conditioning allows one conditioned S-R association to serve as the foundation for building another, extending the reach of learning.
🧠 Quick Revision Questions
- What is the fundamental difference between Radicial Behaviorism and traditional personality theories in explaining behavior (e.g., avoiding a party)?
- In Pavlov’s experiment, what are the UCS, UCR, CS, and CR, and what is the key condition for effective classical conditioning?
- What is the process of second-order conditioning, and how does it expand the range of learned associations?
- According to Thorndike’s Law of Effect, what determines whether a behavior will be repeated or diminished?
- What is the crucial difference in the timing of reinforcement between classical conditioning and operant conditioning?
📘 Lecture 37 — Skinner’s Theory of Personality
📖 Overview: This lecture presents B.F. Skinner’s radical behaviorist approach to personality, which rejects internal mental states as explanations for behavior and instead focuses entirely on observable actions shaped by environmental reinforcement. It explains how personality is simply a collection of learned behaviors controlled by schedules of reinforcement, and describes practical techniques like shaping, token economies, and behavior modification used to change behavior.
🗂️ Topics Covered
This lecture covers Skinner’s radical behaviorism and its rejection of inner states, biographical sketch, classical versus operant conditioning, positive and negative reinforcement, extinction and punishment, generalization and discrimination, schedules of reinforcement (continuous, fixed/variable interval and ratio), and treatment methods including shaping, successive approximations, aversive conditioning, assertion training, behavior modification, and token economy. It ends with applications in education, mental health, prisons, and drug treatment, plus a summary of key principles.
📝 Lecture Summary
Radical Behaviorism
Radical Behaviorism is the brand of psychology synonymous with Skinner’s name. He rejected the use of inner states such as anxiety as explanations for overt/observable behavior.
🔑 Definition — Radical Behaviorism: A psychological approach that focuses entirely on observable behavior and rejects internal mental states (like feelings or thoughts) as causes of behavior.
📌 Example: You feel nervous at parties, so you stay home. You might say you stayed because you were anxious. Skinner says this is incorrect — the behavior changes because of aversive contingencies (unpleasant conditions in the environment), not because of the inner feeling of anxiety.
💡 Why this matters: This shifts explanation from internal causes to external environmental causes — a fundamental reorientation of personality theory.
Behaviorism focuses on the idea that all behavior is learned. Behavior is basically overt and observable. It is an association between stimulus and response. Stimulus and response behavior is respondent (classical) conditioning.
Positive Reinforcement and Negative Reinforcement
Skinner discovered two basic reinforcement strategies for increasing the frequency of behavior:
- Positive reinforcement — behavior increases because it is followed by a reward.
- Negative reinforcement — behavior increases because it removes or lessens an unpleasant stimulus.
🔑 Definition — Positive Reinforcement: The process by which a behavior is strengthened (increases in frequency) because it is followed by a rewarding (pleasurable) stimulus. 📌 Example: A student works hard and gets an “A” on a test — this behavior (working hard) will increase. The hungry rat learns to press a bar to get a food pellet — the frequency of bar-pressing increases.
🔑 Definition — Negative Reinforcement: The process by which a behavior is strengthened because it removes or reduces an aversive (unpleasant) stimulus. 📌 Example: A rat that can turn off an electric shock by pulling a string will quickly learn to pull the string. People with severe headaches learn that resting makes headaches go away — the frequency of resting increases.
📌 Simple operant conditioning example: We can teach a child to ask for candy frequently by giving candy whenever it asks (positive reinforcement). We can extinguish this response by simply not presenting candy when the child asks.
Extinction and Punishment
Skinner discovered two basic reinforcement strategies for decreasing the frequency of undesired behavior:
- Extinction — we stop the reinforcement, and the behavior will be extinguished (stop occurring).
- Punishment — behavior frequency is reduced when it is followed by an aversive stimulus.
🔑 Definition — Extinction: The reduction and eventual elimination of a behavior by withholding the reinforcement that previously maintained it. 📌 Example: A teacher sends a disruptive child out of class into the hall — this removes the reinforcement (attention) and the disruptive behavior decreases.
🔑 Definition — Punishment: The process by which a behavior is weakened (decreases in frequency) because it is followed by an aversive stimulus (something unpleasant). 📌 Example: A student who gets a D grade has to attend summer school and loses his favorite toys.
📌 Critical distinction: A punishing stimulus is not the same as a negative reinforcer. Reinforcement increases the likelihood of behavior; punishment decreases the likelihood of behavior. A behavior can be reinforced by removing an aversive stimulus — that’s negative reinforcement, not punishment.
📌 Example of negative reinforcement (not punishment): A parent reinforces good grades by excusing the child from doing dishes. A person with a phobic fear of snakes reinforces avoidance by turning away whenever a snake is encountered (removing the aversive fear).
Generalization and Discrimination
When behavior is reinforced, it may generalize to other behaviors as well.
🔑 Definition — Generalization: The tendency for a learned response to occur in response to stimuli that are similar to the original conditioned stimulus. 📌 Example 1: A child praised for performing well on a psychology test may generalize this behavior to other subjects. 📌 Example 2: A teacher who learns how to deal with one angry student generalizes that skill to other students with the same angry attitude.
🔑 Definition — Discrimination: The ability to distinguish between different stimuli, situations, events, and persons, and to respond differently to them. 📌 Example: “You look nice today” — you must discriminate based on who said it and in what tone (friend vs. enemy, love vs. sarcasm).
Schedules of Reinforcement
Skinner demonstrated that particular patterns (schedules) of reinforcement lead to changes in both rate of responding and extinction.
-
Continuous reinforcement schedule — reinforcement is presented on every occasion the desired response is made. 📌 Example: Every time a good grade is achieved, it is rewarded.
-
Interval reinforcement — reinforcement is contingent on an interval of time passing.
- Fixed-interval schedule: the interval is unchanging (e.g., every 5 or 10 minutes).
- Variable-interval schedule: reinforcement is available on average every 5 minutes, but the actual interval varies randomly around this average.
-
Ratio reinforcement — reinforcement is determined by the number of responses emitted since the last reinforcement.
- Fixed-ratio schedule: only every 10th (or every 20th, etc.) response is reinforced.
- Variable-ratio schedule: the number of responses required varies randomly (e.g., sometimes after 2 responses, sometimes after 7).
📌 Real-world analogy: Ratio schedules are like a piece worker or person on commission — payoff depends only on efficiency and effort. A variable-ratio schedule is at the heart of all gambling systems and devices (you never know exactly how many plays will win).
Methods of Treatment Based on Operant Conditioning
There are five main methods:
1. Shaping (Successive Approximations Technique)
We start reinforcing a behavior that is the first step toward the final behavior, then gradually reinforce successively closer approximations to the final behavior.
🔑 Definition — Shaping: A procedure in which reinforcers are applied to successively closer approximations of a target behavior. 📌 Example 1: Learning to drive a car — each step is reinforced until the whole skill is learned. 📌 Example 2: Teaching a retarded child to feed himself — each small step toward self-feeding is reinforced. 📌 Example 3: Getting a reluctant psychiatric patient into daily art therapy — first praise for coming near the room, then for entering, then for completing small assignments, until full participation is reinforced.
2. Systematic Desensitization (Joseph Wolpe)
This technique, based on classical conditioning, is used to treat phobias and anxiety.
🔑 Definition — Systematic Desensitization: A behavioral technique where a client is relaxed and then gradually exposed to a hierarchy of fear-producing stimuli, pairing relaxation with each step. 📌 Example: Treating fear of lizards — (1) show pictures of lizards, (2) show movies of lizards, (3) visit someone who has lizards as pets, (4) touch lizards with gloves, (5) touch lizards without gloves. At each step, the client must remain relaxed or the technique fails.
3. Aversive Conditioning
🔑 Definition — Aversive Conditioning: A technique that pairs an undesirable behavior with an unpleasant (aversive) stimulus to decrease the probability of that behavior. 📌 Example 1: With drug addicts, something that causes nausea or vomiting is added to the drug they take, so the drug becomes associated with the unpleasant feeling. 📌 Example 2: A child who uses bad language has soap rubbed on the tongue and mouth taped as punishment.
4. Assertion Training
🔑 Definition — Assertion Training: Teaching an individual to say “no” in a polite manner to unjust demands from colleagues, bosses, or friends.
5. Behavior Modification
🔑 Definition — Behavior Modification: A technique based on Skinner’s work where an undesirable behavior is replaced by a desirable behavior using reinforcement. 📌 Used for: Addictions, shy/timid behavior, autism, schizophrenia, working with retarded children.
6. Token Economy
🔑 Definition — Token Economy: A system used in institutions (mental hospitals, prisons, special children’s institutions) where individuals earn tokens (tickets, money) for desirable behaviors (getting up on time, taking breakfast, taking medicine, bathing, making bed) and lose tokens for failing to perform. Tokens can be exchanged for privileges (candy, cigarettes, games, movies, time out of the institution).
Applications
- Education: Skinner’s ideas have been used in programmed learning and teaching machines. Schools should control behavior positively instead of negatively.
- Modification of personal behavior.
- Treatment and care of mentally retarded children.
- Prison reforms.
- Helping drug addicts.
Summary
- Skinner’s theory specifies the principles by which personality can be changed.
- Behavior is under the control of reinforcement contingencies (schedules of reinforcement) — change the contingencies, change the behavior.
- Skinner focused on overt behavior, not internal mental or physiological behavior.
- Two categories of behavior:
- Classical (respondent) behavior — Pavlov, Watson
- Instrumental (operant) behavior — Thorndike, Skinner
- Happiness is a by-product of operant reinforcement — things that bring happiness (good health, respect, quality work, status, money, power) are those that reinforce us.
- Personality develops from the organism’s behavioral interaction with the environment. A key concept is the principle of reinforcement.
- Skinner’s theory is labeled operant reinforcement theory.
⭐ Key Takeaways
For Skinner, personality is not a set of internal traits or unconscious drives but simply the sum total of an individual’s learned behaviors, shaped entirely by environmental reinforcement contingencies. The critical mechanism is operant conditioning: behaviors that are reinforced (positively or negatively) increase in frequency, while behaviors that are punished or extinguished decrease. Schedules of reinforcement (continuous, fixed/variable interval and ratio) determine how quickly behavior is learned and how resistant it is to extinction. Practical applications like shaping, token economies, aversive conditioning, and behavior modification demonstrate how these principles can change real-world behavior in education, mental health, prisons, and addiction treatment. For the exam, remember that Skinner rejects internal causes and insists all behavior is explained by external reinforcement histories.
🧠 Quick Revision Questions
- What is the difference between positive reinforcement and negative reinforcement? Give one example of each.
- Why does Skinner say it is incorrect to explain staying home from a party as “because I felt anxious”?
- What is the difference between punishment and negative reinforcement?
- List the four main schedules of reinforcement and describe how each one affects the rate of responding and resistance to extinction.
- Describe how shaping (successive approximations) would be used to teach a reluctant patient to participate in daily art therapy sessions.