“Operant conditioning”的意思、由来-开放百科全书

Operant conditioning (also called instrumental conditioning) is a learning process through which the strength of a behavior is modified by reinforcement or punishment. It is also a procedure that is used to bring about such learning.

Although operant and classical conditioning both involve behaviors controlled by environmental stimuli, they differ in nature. In operant conditioning, stimuli present when a behavior is rewarded or punished come to control that behavior. For example, a child may learn to open a box to get the sweets inside, or learn to avoid touching a hot stove; in operant terms, the box and the stove are "discriminative stimuli". Operant behavior is said to be "voluntary": for example, the child may face a choice between opening the box and petting a puppy.

In contrast, classical conditioning involves involuntary behavior based on the pairing of stimuli with biologically significant events. For example, sight of sweets may cause a child to salivate, or the sound of a door slam may signal an angry parent, causing a child to tremble. Salivation and trembling are not operants; they are not reinforced by their consequences, and they are not voluntarily "chosen".

The study of animal learning in the 20th century was dominated by the analysis of these two sorts of learning,^[1] and they are still at the core of behavior analysis.

Historical note

Thorndike's law of effect

Operant conditioning, sometimes called instrumental learning, was first extensively studied by Edward L. Thorndike (1874–1949), who observed the behavior of cats trying to escape from home-made puzzle boxes.^[2] A cat could escape from the box by a simple response such as pulling a cord or pushing a pole, but when first constrained, the cats took a long time to get out. With repeated trials ineffective responses occurred less frequently and successful responses occurred more frequently, so the cats escaped more and more quickly.^[2] Thorndike generalized this finding in his law of effect, which states that behaviors followed by satisfying consequences tend to be repeated and those that produce unpleasant consequences are less likely to be repeated. In short, some consequences strengthen behavior and some consequences weaken behavior. By plotting escape time against trial number Thorndike produced the first known animal learning curves through this procedure.^[3]

Humans appear to learn many simple behaviors through the sort of process studied by Thorndike, now called operant conditioning. That is, responses are retained when they lead to a successful outcome and discarded when they do not, or when they produce aversive effects. This usually happens without being planned by any "teacher", but operant conditioning has been used by parents in teaching their children for thousands of years.^[4]

B. F. Skinner

Skinner believed that classical conditioning was too simplistic to be used to describe something as complex as human behavior. Operant conditioning, in his opinion, better described human behavior as it examined causes and effects of intentional behavior.

To implement his empirical approach, Skinner invented the operant conditioning chamber, or "Skinner Box", in which subjects such as pigeons and rats were isolated and could be exposed to carefully controlled stimuli. Unlike Thorndike's puzzle box, this arrangement allowed the subject to make one or two simple, repeatable responses, and the rate of such responses became Skinner's primary behavioral measure.^[7] Another invention, the cumulative recorder, produced a graphical record from which these response rates could be estimated. These records were the primary data that Skinner and his colleagues used to explore the effects on response rate of various reinforcement schedules.^[8] A reinforcement schedule may be defined as "any procedure that delivers reinforcement to an organism according to some well-defined rule".^[9] The effects of schedules became, in turn, the basic findings from which Skinner developed his account of operant conditioning. He also drew on many less formal observations of human and animal behavior.^[10]

Many of Skinner's writings are devoted to the application of operant conditioning to human behavior.^[11] In 1948 he published Walden Two, a fictional account of a peaceful, happy, productive community organized around his conditioning principles.^[12] In 1957, Skinner published Verbal Behavior,^[13] which extended the principles of operant conditioning to language, a form of human behavior that had previously been analyzed quite differently by linguists and others. Skinner defined new functional relationships such as "mands" and "tacts" to capture some essentials of language, but he introduced no new principles, treating verbal behavior like any other behavior controlled by its consequences, which included the reactions of the speaker's audience.

Concepts and procedures

Origins of operant behavior: operant variability

Operant behavior is said to be "emitted"; that is, initially it is not elicited by any particular stimulus. Thus one may ask why it happens in the first place. The answer to this question is like Darwin's answer to the question of the origin of a "new" bodily structure, namely, variation and selection. Similarly, the behavior of an individual varies from moment to moment, in such aspects as the specific motions involved, the amount of force applied, or the timing of the response. Variations that lead to reinforcement are strengthened, and if reinforcement is consistent, the behavior tends to remain stable. However, behavioral variability can itself be altered through the manipulation of certain variables.^[14]

Modifying operant behavior: reinforcement and punishment

Reinforcement and punishment are the core tools through which operant behavior is modified. These terms are defined by their effect on behavior. Either may be positive or negative.

It is important to note that actors (e.g. a rat) are not spoken of as being reinforced, punished, or extinguished; it is the actions that are reinforced, punished, or extinguished. Reinforcement, punishment, and extinction are not terms whose use is restricted to the laboratory. Naturally-occurring consequences can also reinforce, punish, or extinguish behavior and are not always planned or delivered on purpose.

Schedules of reinforcement

Schedules of reinforcement are rules that control the delivery of reinforcement. The rules specify either the time that reinforcement is to be made available, or the number of responses to be made, or both. Many rules are possible, but the following are the most basic and commonly used^[17]^[8]

Factors that alter the effectiveness of reinforcement and punishment

Shaping

Shaping is a conditioning method much used in animal training and in teaching nonverbal humans. It depends on operant variability and reinforcement, as described above. The trainer starts by identifying the desired final (or "target") behavior. Next, the trainer chooses a behavior that the animal or person already emits with some probability. The form of this behavior is then gradually changed across successive trials by reinforcing behaviors that approximate the target behavior more and more closely. When the target behavior is finally emitted, it may be strengthened and maintained by the use of a schedule of reinforcement.

Noncontingent reinforcement

Noncontingent reinforcement is the delivery of reinforcing stimuli regardless of the organism's behavior. Noncontingent reinforcement may be used in an attempt to reduce an undesired target behavior by reinforcing multiple alternative responses while extinguishing the target response.^[20] As no measured behavior is identified as being strengthened, there is controversy surrounding the use of the term noncontingent "reinforcement".^[21]

Stimulus control of operant behavior

Though initially operant behavior is emitted without an identified reference to a particular stimulus, during operant conditioning operants come under the control of stimuli that are present when behavior is reinforced. Such stimuli are called "discriminative stimuli." A so-called "three-term contingency" is the result. That is, discriminative stimuli set the occasion for responses that produce reward or punishment. Example: a rat may be trained to press a lever only when a light comes on; a dog rushes to the kitchen when it hears the rattle of his/her food bag; a child reaches for candy when s/he sees it on a table.

Discrimination, generalization & context

Most behavior is under stimulus control. Several aspects of this may be distinguished:

Behavioral sequences: conditioned reinforcement and chaining

Most behavior cannot easily be described in terms of individual responses reinforced one by one. The scope of operant analysis is expanded through the idea of behavioral chains, which are sequences of responses bound together by the three-term contingencies defined above. Chaining is based on the fact, experimentally demonstrated, that a discriminative stimulus not only sets the occasion for subsequent behavior, but it can also reinforce a behavior that precedes it. That is, a discriminative stimulus is also a "conditioned reinforcer". For example, the light that sets the occasion for lever pressing may be used to reinforce "turning around" in the presence of a noise. This results in the sequence "noise – turn-around – light – press lever – food". Much longer chains can be built by adding more stimuli and responses.

Escape and avoidance

In escape learning, a behavior terminates an (aversive) stimulus. For example, shielding one's eyes from sunlight terminates the (aversive) stimulation of bright light in one's eyes. (This is an example of negative reinforcement, defined above.) Behavior that is maintained by preventing a stimulus is called "avoidance," as, for example, putting on sun glasses before going outdoors. Avoidance behavior raises the so-called "avoidance paradox", for, it may be asked, how can the non-occurrence of a stimulus serve as a reinforcer? This question is addressed by several theories of avoidance (see below).

Two kinds of experimental settings are commonly used: discriminated and free-operant avoidance learning.

Discriminated avoidance learning

A discriminated avoidance experiment involves a series of trials in which a neutral stimulus such as a light is followed by an aversive stimulus such as a shock. After the neutral stimulus appears an operant response such as a lever press prevents or terminate the aversive stimulus. In early trials, the subject does not make the response until the aversive stimulus has come on, so these early trials are called "escape" trials. As learning progresses, the subject begins to respond during the neutral stimulus and thus prevents the aversive stimulus from occurring. Such trials are called "avoidance trials." This experiment is said to involve classical conditioning because a neutral CS (conditioned stimulus) is paired with the aversive US (unconditioned stimulus); this idea underlies the two-factor theory of avoidance learning described below.

Free-operant avoidance learning

In free-operant avoidance a subject periodically receives an aversive stimulus (often an electric shock) unless an operant response is made; the response delays the onset of the shock. In this situation, unlike discriminated avoidance, no prior stimulus signals the shock. Two crucial time intervals determine the rate of avoidance learning. This first is the S-S (shock-shock) interval. This is time between successive shocks in the absence of a response. The second interval is the R-S (response-shock) interval. This specifies the time by which an operant response delays the onset of the next shock. Note that each time the subject performs the operant response, the R-S interval without shock begins anew.

Two-process theory of avoidance

This theory was originally proposed in order to explain discriminated avoidance learning, in which an organism learns to avoid an aversive stimulus by escaping from a signal for that stimulus. Two processes are involved: classical conditioning of the signal followed by operant conditioning of the escape response:

a) Classical conditioning of fear. Initially the organism experiences the pairing of a CS with an aversive US. The theory assumes that this pairing creates an association between the CS and the US through classical conditioning and, because of the aversive nature of the US, the CS comes to elicit a conditioned emotional reaction (CER) – "fear." b) Reinforcement of the operant response by fear-reduction. As a result of the first process, the CS now signals fear; this unpleasant emotional reaction serves to motivate operant responses, and responses that terminate the CS are reinforced by fear termination. Note that the theory does not say that the organism "avoids" the US in the sense of anticipating it, but rather that the organism "escapes" an aversive internal state that is caused by the CS.

Several experimental findings seem to run counter to two-factor theory. For example, avoidance behavior often extinguishes very slowly even when the initial CS-US pairing never occurs again, so the fear response might be expected to extinguish (see Classical conditioning). Further, animals that have learned to avoid often show little evidence of fear, suggesting that escape from fear is not necessary to maintain avoidance behavior.^[22]

Operant or "one-factor" theory

Some theorists suggest that avoidance behavior may simply be a special case of operant behavior maintained by its consequences. In this view the idea of "consequences" is expanded to include sensitivity to a pattern of events. Thus, in avoidance, the consequence of a response is a reduction in the rate of aversive stimulation. Indeed, experimental evidence suggests that a "missed shock" is detected as a stimulus, and can act as a reinforcer. Cognitive theories of avoidance take this idea a step farther. For example, a rat comes to "expect" shock if it fails to press a lever and to "expect no shock" if it presses it, and avoidance behavior is strengthened if these expectancies are confirmed.^[22]

Operant hoarding

Operant hoarding refers to the observation that rats reinforced in a certain way may allow food pellets to accumulate in a food tray instead of retrieving those pellets. In this procedure, retrieval of the pellets always instituted a one-minute period of extinction during which no additional food pellets were available but those that had been accumulated earlier could be consumed. This finding appears to contradict the usual finding that rats behave impulsively in situations in which there is a choice between a smaller food object right away and a larger food object after some delay. See schedules of reinforcement.^[23]

Neurobiological correlates

The first scientific studies identifying neurons that responded in ways that suggested they encode for conditioned stimuli came from work by Mahlon deLong^[24]^[25] and by R.T. Richardson.^[25] They showed that nucleus basalis neurons, which release acetylcholine broadly throughout the cerebral cortex, are activated shortly after a conditioned stimulus, or after a primary reward if no conditioned stimulus exists. These neurons are equally active for positive and negative reinforcers, and have been shown to be related to neuroplasticity in many cortical regions.^[26] Evidence also exists that dopamine is activated at similar times. There is considerable evidence that dopamine participates in both reinforcement and aversive learning.^[27] Dopamine pathways project much more densely onto frontal cortex regions. Cholinergic projections, in contrast, are dense even in the posterior cortical regions like the primary visual cortex. A study of patients with Parkinson's disease, a condition attributed to the insufficient action of dopamine, further illustrates the role of dopamine in positive reinforcement.^[28] It showed that while off their medication, patients learned more readily with aversive consequences than with positive reinforcement. Patients who were on their medication showed the opposite to be the case, positive reinforcement proving to be the more effective form of learning when dopamine activity is high.

A neurochemical process involving dopamine has been suggested to underlie reinforcement. When an organism experiences a reinforcing stimulus, dopamine pathways in the brain are activated. This network of pathways "releases a short pulse of dopamine onto many dendrites, thus broadcasting a global reinforcement signal to postsynaptic neurons."^[29] This allows recently activated synapses to increase their sensitivity to efferent (conducting outward) signals, thus increasing the probability of occurrence for the recent responses that preceded the reinforcement. These responses are, statistically, the most likely to have been the behavior responsible for successfully achieving reinforcement. But when the application of reinforcement is either less immediate or less contingent (less consistent), the ability of dopamine to act upon the appropriate synapses is reduced.

Questions about the law of effect

A number of observations seem to show that operant behavior can be established without reinforcement in the sense defined above. Most cited is the phenomenon of autoshaping (sometimes called "sign tracking"), in which a stimulus is repeatedly followed by reinforcement, and in consequence the animal begins to respond to the stimulus. For example, a response key is lighted and then food is presented. When this is repeated a few times a pigeon subject begins to peck the key even though food comes whether the bird pecks or not. Similarly, rats begin to handle small objects, such as a lever, when food is presented nearby.^[30]^[31] Strikingly, pigeons and rats persist in this behavior even when pecking the key or pressing the lever leads to less food (omission training).^[32]^[33] Another apparent operant behavior that appears without reinforcement is contrafreeloading.

These observations and others appear to contradict the law of effect, and they have prompted some researchers to propose new conceptualizations of operant reinforcement (e.g.^[34]^[35]^[36]) A more general view is that autoshaping is an instance of classical conditioning; the autoshaping procedure has, in fact, become one of the most common ways to measure classical conditioning. In this view, many behaviors can be influenced by both classical contingencies (stimulus-response) and operant contingencies (response-reinforcement), and the experimenter's task is to work out how these interact.^[37]

The example of someone having a positive experience with a drug is easy to see how drug dependence and the law of effect works. The tolerance for a drug goes up as one continues to use it after having a positive experience with a certain amount the first time.^[38] It will take more and more to get that same feeling. This is when the controlled substance in an experiment would have to be modified and the experiment would really begin. The law of work for psychologist B. F. Skinner almost half a century later on the principles of operant conditioning, "a learning process by which the effect, or consequence, of a response influences the future rate of production of that response.^[39]

Applications

Reinforcement and punishment are ubiquitous in human social interactions, and a great many applications of operant principles have been suggested and implemented. Following are a few examples.

Applied behavior analysis

Applied behavior analysis is the discipline initiated by B. F. Skinner that applies the principles of conditioning to the modification of socially significant human behavior. It uses the basic concepts of conditioning theory, including conditioned stimulus (S^C), discriminative stimulus (S^d), response (R), and reinforcing stimulus (S^rein or S^r for reinforcers, sometimes S^ave for aversive stimuli).^[22] A conditioned stimulus controls behaviors developed through respondent (classical) conditioning, such as emotional reactions. The other three terms combine to form Skinner's "three-term contingency": a discriminative stimulus sets the occasion for responses that lead to reinforcement. Researchers have found the following protocol to be effective when they use the tools of operant conditioning to modify human behavior:{{citation needed|date=June 2014}}

Practitioners of applied behavior analysis (ABA) bring these procedures, and many variations and developments of them, to bear on a variety of socially significant behaviors and issues. In many cases, practitioners use operant techniques to develop constructive, socially acceptable behaviors to replace aberrant behaviors. The techniques of ABA have been effectively applied in to such things as early intensive behavioral interventions for children with an autism spectrum disorder (ASD)^[40] research on the principles influencing criminal behavior, HIV prevention,^[41] conservation of natural resources,^[42] education,^[43] gerontology,^[44] health and exercise,^[45] industrial safety,^[46] language acquisition,^[47] littering,^[48] medical procedures,^[49] parenting,^[50] psychotherapy,{{citation needed|date=January 2018}} seatbelt use,^[51] severe mental disorders,^[52] sports,^[53] substance abuse, phobias, pediatric feeding disorders, and zoo management and care of animals.^[54] Some of these applications are among those described below.

Addiction and dependence

Positive and negative reinforcement play central roles in the development and maintenance of addiction and drug dependence. An addictive drug is intrinsically rewarding; that is, it functions as a primary positive reinforcer of drug use. The brain's reward system assigns it incentive salience (i.e., it is "wanted" or "desired"),^[55]^[56]^[57] so as an addiction develops, deprivation of the drug leads to craving. In addition, stimuli associated with drug use – e.g., the sight of a syringe, and the location of use – become associated with the intense reinforcement induced by the drug.^[55]^[56]^[57] These previously neutral stimuli acquire several properties: their appearance can induce craving, and they can become conditioned positive reinforcers of continued use.^[55]^[56]^[57] Thus, if an addicted individual encounters one of these drug cues, a craving for the associated drug may reappear. For example, anti-drug agencies previously used posters with images of drug paraphernalia as an attempt to show the dangers of drug use. However, such posters are no longer used because of the effects of incentive salience in causing relapse upon sight of the stimuli illustrated in the posters.

In drug dependent individuals, negative reinforcement occurs when a drug is self-administered in order to alleviate or "escape" the symptoms of physical dependence (e.g., tremors and sweating) and/or psychological dependence (e.g., anhedonia, restlessness, irritability, and anxiety) that arise during the state of drug withdrawal.^[55]

Animal training

Animal trainers and pet owners were applying the principles and practices of operant conditioning long before these ideas were named and studied, and animal training still provides one of the clearest and most convincing examples of operant control. Of the concepts and procedures described in this article, a few of the most salient are the following:

(b) the use of secondary reinforcement, (e.g. sounding a clicker immediately after a desired response, then giving yummy);

(e) intermittent reinforcement, as in gradually reducing the frequency of reinforcement to induce persistent behavior without satiation;

(f) chaining, where a complex behavior is gradually constructed from smaller units.^[58]

Animal training has effects on positive reinforcement and negative reinforcement. Schedules of reinforcements may play a big role on the animal training case.

Child behaviour – parent management training

Providing positive reinforcement for appropriate child behaviors is a major focus of parent management training. Typically, parents learn to reward appropriate behavior through social rewards (such as praise, smiles, and hugs) as well as concrete rewards (such as stickers or points towards a larger reward as part of an incentive system created collaboratively with the child).^[60] In addition, parents learn to select simple behaviors as an initial focus and reward each of the small steps that their child achieves towards reaching a larger goal (this concept is called "successive approximations").^[60]^[61]

Economics

Both psychologists and economists have become interested in applying operant concepts and findings to the behavior of humans in the marketplace. An example

is the analysis of consumer demand, as indexed by the amount of a commodity that is purchased. In economics, the degree to which price influences consumption is called "the price elasticity of demand." Certain commodities are more elastic than others; for example, a change in price of certain foods may have a large effect on the amount bought, while gasoline and other essentials may be less affected by price changes. In terms of operant analysis, such effects may be interpreted in terms of motivations of consumers and the relative value of the commodities as reinforcers.^[62]

Gambling – variable ratio scheduling

As stated earlier in this article, a variable ratio schedule yields reinforcement after the emission of an unpredictable number of responses. This schedule typically generates rapid, persistent responding. Slot machines pay off on a variable ratio schedule, and they produce just this sort of persistent lever-pulling behavior in gamblers. The variable ratio payoff from slot machines and other forms of gambling has often been cited as a factor underlying gambling addiction.^[63]

Nudge theory

Nudge theory (or nudge) is a concept in behavioural science, political theory and economics which argues that indirect suggestions to try to achieve non-forced compliance can influence the motives, incentives and decision making of groups and individuals, at least as effectively – if not more effectively – than direct instruction, legislation, or enforcement.

Praise

The concept of praise as a means of behavioral reinforcement is rooted in B.F. Skinner's model of operant conditioning. Through this lens, praise has been viewed as a means of positive reinforcement, wherein an observed behavior is made more likely to occur by contingently praising said behavior.^[64] Hundreds of studies have demonstrated the effectiveness of praise in promoting positive behaviors, notably in the study of teacher and parent use of praise on child in promoting improved behavior and academic performance,^[65]^[80] but also in the study of work performance.^[66] Praise has also been demonstrated to reinforce positive behaviors in non-praised adjacent individuals (such as a classmate of the praise recipient) through vicarious reinforcement.^[67] Praise may be more or less effective in changing behavior depending on its form, content and delivery. In order for praise to effect positive behavior change, it must be contingent on the positive behavior (i.e., only administered after the targeted behavior is enacted), must specify the particulars of the behavior that is to be reinforced, and must be delivered sincerely and credibly.^[68]

Acknowledging the effect of praise as a positive reinforcement strategy, numerous behavioral and cognitive behavioral interventions have incorporated the use of praise in their protocols.^[69]^[70] The strategic use of praise is recognized as an evidence-based practice in both classroom management^[69] and parenting training interventions,^[71] though praise is often subsumed in intervention research into a larger category of positive reinforcement, which includes strategies such as strategic attention and behavioral rewards.

Several studies have been done on the effect cognitive-behavioral therapy and operant-behavioral therapy have on different medical conditions. When patients developed cognitive and behavioral techniques that changed their behaviors, attitudes, and emotions; their pain severity decreased. The results of these studies showed an influence of cognitions on pain perception and impact presented explained the general efficacy of Cognitive-Behavioral therapy (CBT) and Operant-Behavioral therapy (OBT).

Psychological manipulation

Braiker identified the following ways that manipulators control their victims:^[72]

Traumatic bonding

Traumatic bonding occurs as the result of ongoing cycles of abuse in which the intermittent reinforcement of reward and punishment creates powerful emotional bonds that are resistant to change.^[73]^[74]

'The necessary conditions for traumatic bonding are that one person must dominate the other and that the level of abuse chronically spikes and then subsides. The relationship is characterized by periods of permissive, compassionate, and even affectionate behavior from the dominant person, punctuated by intermittent episodes of intense abuse. To maintain the upper hand, the victimizer manipulates the behavior of the victim and limits the victim's options so as to perpetuate the power imbalance. Any threat to the balance of dominance and submission may be met with an escalating cycle of punishment ranging from seething intimidation to intensely violent outbursts. The victimizer also isolates the victim from other sources of support, which reduces the likelihood of detection and intervention, impairs the victim's ability to receive countervailing self-referent feedback, and strengthens the sense of unilateral dependency...The traumatic effects of these abusive relationships may include the impairment of the victim's capacity for accurate self-appraisal, leading to a sense of personal inadequacy and a subordinate sense of dependence upon the dominating person. Victims also may encounter a variety of unpleasant social and legal consequences of their emotional and behavioral affiliation with someone who perpetrated aggressive acts, even if they themselves were the recipients of the aggression. '.

Military Psychology

Human beings have an innate resistance to killing and are reluctant to act in a direct, aggressive way towards members of their own species, even to save life. This resistance to killing has caused infantry to be remarkably inefficient throughout the history of military warfare.^[76]

This phenomenon was not understood until S.L.A. Marshall (Brigadier General and military historian) undertook interview studies of WWII infantry immediately following combat engagement. Marshall's well-known and controversial book, Men Against Fire, revealed that only 15% of soldiers fired their rifles with the purpose of killing in combat.^[77] Following acceptance of Marshall's research by the US Army in 1946, the Human Resources Research Office of the US Army began implementing new training protocols which resemble operant conditioning methods. Subsequent applications of such methods increased the percentage of soldiers able to kill to around 50% in Korea and over 90% in Vietnam.^[76] Revolutions in training included replacing traditional pop-up firing ranges with three-dimensional, man-shaped, pop-up targets which collapsed when hit. This provided immediate feedback and acted as positive reinforcement for a soldier's behavior.^[78] Other improvements to military training methods have included the timed firing course; more realistic training; high repetitions; praise from superiors; marksmanship rewards; and group recognition. Negative reinforcement includes peer accountability or the requirement to retake courses. Modern military training conditions mid-brain response to combat pressure by closely simulating actual combat, using mainly Pavlovian Classical Conditioning and Skinnerian operant Conditioning (both forms of Behaviorism).^[76]

Psychological distancing includes physical distance, dehumanizing the enemy (including through propaganda), and the impersonal use of technology such as night vision, drones, and airstrikes. Modern conditioning techniques have had parallel effects on law enforcement firing rates.^[78]

Video games

The majority{{citation needed|date=September 2018}} of video games are designed around a compulsion loop, adding a type of positive reinforcement through a variable rate schedule to keep the player playing. This can lead to the pathology of video game addiction.^[80]

As part of a trend in the monetization of video games during the 2010s, some games offered loot boxes as rewards or as items purchasable by real world funds. Boxes contains a random selection of in-game items. The practice has been tied to the same methods that slot machines and other gambling devices dole out rewards, as it follows a variable rate schedule. While the general perception that loot boxes are a form of gambling, the practice is only classified as such in a few countries. However, methods to use those items as virtual currency for online gambling or trading for real world money has created a skin gambling market that is under legal evaluation.^[81]

Workplace culture of fear

Ashforth discussed potentially destructive sides of leadership and identified what he referred to as petty tyrants: leaders who exercise a tyrannical style of management, resulting in a climate of fear in the workplace.^[82] Partial or intermittent negative reinforcement can create an effective climate of fear and doubt.^[72] When employees get the sense that bullies are tolerated, a climate of fear may be the result.^[83]

Individual differences in sensitivity to reward, punishment, and motivation have been studied under the premises of reinforcement sensitivity theory and have also been applied to workplace performance.

One of the many reasons proposed for the dramatic costs associated with healthcare is the practice of defensive medicine. Prabhu reviews the article by Cole and discusses how the responses of two groups of neurosurgeons are classic operant behavior. One group practice in a state with restrictions on medical lawsuits and the other group with no restrictions. The group of neurosurgeons were queried anonymously on their practice patterns. The physicians changed their practice in response to a negative feedback (fear from lawsuit) in the group that practiced in a state with no restrictions on medical lawsuits.^[84]

See also

References

1. ^Jenkins, H. M. "Animal Learning and Behavior Theory" Ch. 5 in Hearst, E. "The First Century of Experimental Psychology" Hillsdale N. J., Earlbaum, 1979
2. ^¹{{cite journal|last1=Thorndike|first1=E.L.|year=1901|title=Animal intelligence: An experimental study of the associative processes in animals|url=|journal=Psychological Review Monograph Supplement|volume=2|issue=|pages=1–109}}
3. ^Miltenberger, R. G. "Behavioral Modification: Principles and Procedures". Thomson/Wadsworth, 2008. p. 9.
4. ^Miltenberger, R. G., & Crosland, K. A. (2014). Parenting. The wiley blackwell handbook of operant and classical conditioning. (pp. 509–531) Wiley-Blackwell. {{DOI|10.1002/9781118468135.ch20}}
5. ^Skinner, B. F. "The Behavior of Organisms: An Experimental Analysis", 1938 New York: Appleton-Century-Crofts
6. ^{{cite journal|last1=Skinner|first1=B. F.|year=1950|title=Are theories of learning necessary?|url=|journal=Psychological Review|volume=57|issue=4|pages=193–216|doi=10.1037/h0054367|pmid=15440996}}
7. ^Schacter, Daniel L., Daniel T. Gilbert, and Daniel M. Wegner. "B. F. Skinner: The role of reinforcement and Punishment", subsection in: Psychology; Second Edition. New York: Worth, Incorporated, 2011, 278–288.
8. ^¹Ferster, C. B. & Skinner, B. F. "Schedules of Reinforcement", 1957 New York: Appleton-Century-Crofts
9. ^{{cite journal|last=Staddon|first=J. E. R|author2=D. T Cerutti|date=February 2003|title=Operant Conditioning|journal=Annual Review of Psychology|volume=54|issue=1|pages=115–144|doi=10.1146/annurev.psych.54.101601.145124|pmc=1473025|pmid=12415075}}
10. ^Mecca Chiesa (2004) Radical Behaviorism: The philosophy and the science
11. ^Skinner, B. F. "Science and Human Behavior", 1953. New York: MacMillan
12. ^Skinner, B.F. (1948). Walden Two. Indianapolis: Hackett
13. ^Skinner, B. F. "Verbal Behavior", 1957. New York: Appleton-Century-Crofts
14. ^{{cite journal|last1=Neuringer|first1=A|year=2002|title=Operant variability: Evidence, functions, and theory|url=|journal=Psychonomic Bulletin & Review|volume=9|issue=4|pages=672–705|doi=10.3758/bf03196324|pmid=12613672}}
15. ^{{cite book |last1=Skinner |first1=B.F. |title=Science and Human Behavior |date=2014 |publisher=The B.F. Skinner Foundation |location=Cambridge, MA |isbn= |page=70 |url=http://www.bfskinner.org/newtestsite/wp-content/uploads/2014/02/ScienceHumanBehavior.pdf |accessdate=13 March 2019}}
16. ^{{cite journal|year=2015|title=Neuronal reward and decision signals: from theories to data|journal=Physiological Reviews|volume=95|issue=3|pages=853–951|doi=10.1152/physrev.00023.2014|pmc=4491543|pmid=26109341|quote=Rewards in operant conditioning are positive reinforcers. ... Operant behavior gives a good definition for rewards. Anything that makes an individual come back for more is a positive reinforcer and therefore a reward. Although it provides a good definition, positive reinforcement is only one of several reward functions. ... Rewards are attractive. They are motivating and make us exert an effort. ... Rewards induce approach behavior, also called appetitive or preparatory behavior, and consummatory behavior. ... Thus any stimulus, object, event, activity, or situation that has the potential to make us approach and consume it is by definition a reward.|vauthors=Schultz W}}
17. ^Schacter et al.2011 Psychology 2nd ed. pg.280–284 Reference for entire section Principles version 130317
18. ^¹Miltenberger, R. G. "Behavioral Modification: Principles and Procedures". Thomson/Wadsworth, 2008. p. 84.
19. ^Miltenberger, R. G. "Behavioral Modification: Principles and Procedures". Thomson/Wadsworth, 2008. p. 86.
20. ^{{cite journal|last1=Tucker|first1=M.|last2=Sigafoos|first2=J.|last3=Bushell|first3=H.|year=1998|title=Use of noncontingent reinforcement in the treatment of challenging behavior|url=|journal=Behavior Modification|volume=22|issue=4|pages=529–547|doi=10.1177/01454455980224005|pmid=9755650}}
21. ^{{cite journal|last1=Poling|first1=A.|last2=Normand|first2=M.|year=1999|title=Noncontingent reinforcement: an inappropriate description of time-based schedules that reduce behavior|url=|journal=Journal of Applied Behavior Analysis|volume=32|issue=2|pages=237–238|doi=10.1901/jaba.1999.32-237|pmc=1284187}}
22. ^¹²Pierce & Cheney (2004) Behavior Analysis and Learning
23. ^{{cite journal|last1=Cole|first1=M.R.|year=1990|title=Operant hoarding: A new paradigm for the study of self-control|url=|journal=Journal of the Experimental Analysis of Behavior|volume=53|issue=2|pages=247–262|doi=10.1901/jeab.1990.53-247|pmid=2324665|pmc=1323010}}
24. ^"Activity of pallidal neurons during movement", M.R. DeLong, J. Neurophysiol., 34:414–27, 1971
25. ^¹Richardson RT, DeLong MR (1991): Electrophysiological studies of the function of the nucleus basalis in primates. In Napier TC, Kalivas P, Hamin I (eds), The Basal Forebrain: Anatomy to Function (Advances in Experimental Medicine and Biology, vol. 295. New York, Plenum, pp. 232–252
26. ^PNAS 93:11219-24 1996, Science 279:1714–8 1998
27. ^Neuron 63:244–253, 2009, Frontiers in Behavioral Neuroscience, 3: Article 13, 2009
28. ^Michael J. Frank, Lauren C. Seeberger, and Randall C. O'Reilly (2004) "By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism," Science 4, November 2004
29. ^{{cite journal|last1=Schultz|first1=Wolfram|year=1998|title=Predictive Reward Signal of Dopamine Neurons|url=|journal=The Journal of Neurophysiology|volume=80|issue=1|pages=1–27|doi=10.1152/jn.1998.80.1.1|pmid=9658025}}
30. ^{{cite journal|last1=Timberlake|first1=W|year=1983|title=Rats' responses to a moving object related to food or water: A behavior-systems analysis|url=|journal=Animal Learning & Behavior|volume=11|issue=3|pages=309–320|doi=10.3758/bf03199781}}
31. ^{{cite journal|last1=Neuringer|first1=A.J.|year=1969|title=Animals respond for food in the presence of free food|url=|journal=Science|volume=166|issue=3903|pages=399–401|doi=10.1126/science.166.3903.399}}
32. ^{{cite journal|last1=Williams|first1=D.R.|last2=Williams|first2=H.|year=1969|title=Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement|url=|journal=J. Exper. Analys. Of Behav|volume=12|issue=4|pages=511–520|doi=10.1901/jeab.1969.12-511|pmid=16811370|pmc=1338642}}
33. ^{{cite journal|last1=Peden|first1=B.F.|last2=Brown|first2=M.P.|last3=Hearst|first3=E.|year=1977|title=Persistent approaches to a signal for food despite food omission for approaching.|url=|journal=Journal of Experimental Psychology: Animal Behavior Processes|volume=3|issue=4|pages=377–399|doi=10.1037/0097-7403.3.4.377}}
34. ^{{cite journal|last1=Gardner|first1=R.A.|last2=Gardner|first2=B.T.|year=1988|title=Feedforward vs feedbackward: An ethological alternative to the law of effect|url=|journal=Behavioral and Brain Sciences|volume=11|issue=3|pages=429–447|doi=10.1017/s0140525x00058258}}
35. ^Gardner, R. A. & Gardner B.T. (1998) The structure of learning from sign stimuli to sign language. Mahwah NJ: Lawrence Erlbaum Associates.
36. ^{{cite journal|last1=Baum|first1=W. M.|year=2012|title=Rethinking reinforcement: Allocation, induction and contingency|url=|journal=Journal of the Experimental Analysis of Behavior|volume=97|issue=1|pages=101–124|doi=10.1901/jeab.2012.97-101|pmid=22287807|pmc=3266735}}
37. ^Locurto, C. M., Terrace, H. S., & Gibbon, J. (1981) Autoshaping and conditioning theory. New York: Academic Press.
38. ^Neil, Carlson; et al. (2007). Psychology The Science Of Behaviour. New Jersey, USA: Pearson Education Canada, Inc.,. p. 516.
39. ^Gray, Peter. Psychology, Worth, NY. 6th ed. pp 108–109
40. ^{{cite journal|author1=Dillenburger, K.|author2=Keenan, M.|year=2009|title=None of the As in ABA stand for autism: dispelling the myths|journal=J Intellect Dev Disabil|volume=34|issue=2|pages=193–95|doi=10.1080/13668250902845244|pmid=19404840}}
41. ^{{cite journal|author1=DeVries, J.E.|author2=Burnette, M.M.|author3=Redmon, W.K.|year=1991|title=AIDS prevention: Improving nurses' compliance with glove wearing through performance feedback|journal=Journal of Applied Behavior Analysis|volume=24|issue=4|pages=705–11|doi=10.1901/jaba.1991.24-705|pmc=1279627|pmid=1797773}}
42. ^{{cite journal|author1=Brothers, K.J.|author2=Krantz, P.J.|author3=McClannahan, L.E.|year=1994|title=Office paper recycling: A function of container proximity|journal=Journal of Applied Behavior Analysis|volume=27|issue=1|pages=153–60|doi=10.1901/jaba.1994.27-153|pmc=1297784|pmid=16795821}}
43. ^{{cite book |author1=Dardig, Jill C.|author2=Heward, William L.|author3=Heron, Timothy E.|author4=Nancy A. Neef|author5=Peterson, Stephanie|author6=Diane M. Sainato|author7= Cartledge, Gwendolyn|author8=Gardner, Ralph|author9=Peterson, Lloyd R.|author10= Susan B. Hersh |title=Focus on behavior analysis in education: achievements, challenges, and opportunities |publisher= Pearson/Merrill/Prentice Hall |location=Upper Saddle River, NJ |year=2005 |isbn=978-0-13-111339-8}}
44. ^{{cite journal|author1=Gallagher, S.M.|author2=Keenan M.|year=2000|title=Independent use of activity materials by the elderly in a residential setting|journal=Journal of Applied Behavior Analysis|volume=33|issue=3|pages=325–28|doi=10.1901/jaba.2000.33-325|pmc=1284256|pmid=11051575}}
45. ^{{cite journal|author1=De Luca, R.V.|author2=Holborn, S.W.|year=1992|title=Effects of a variable-ratio reinforcement schedule with changing criteria on exercise in obese and nonobese boys|journal=Journal of Applied Behavior Analysis|volume=25|issue=3|pages=671–79|doi=10.1901/jaba.1992.25-671|pmc=1279749|pmid=1429319}}
46. ^{{cite journal|author1=Fox, D.K.|author2=Hopkins, B.L.|author3=Anger, W.K.|year=1987|title=The long-term effects of a token economy on safety performance in open-pit mining|journal=Journal of Applied Behavior Analysis|volume=20|issue=3|pages=215–24|doi=10.1901/jaba.1987.20-215|pmc=1286011|pmid=3667473}}
47. ^{{cite journal|author1=Drasgow, E.|author2=Halle, J.W.|author3=Ostrosky, M.M.|year=1998|title=Effects of differential reinforcement on the generalization of a replacement mand in three children with severe language delays|journal=Journal of Applied Behavior Analysis|volume=31|issue=3|pages=357–74|doi=10.1901/jaba.1998.31-357|pmc=1284128|pmid=9757580}}
48. ^{{cite journal|author1=Powers, R.B.|author2=Osborne, J.G.|author3=Anderson, E.G.|year=1973|title=Positive reinforcement of litter removal in the natural environment|journal=Journal of Applied Behavior Analysis|volume=6|issue=4|pages=579–86|doi=10.1901/jaba.1973.6-579|pmc=1310876|pmid=16795442}}
49. ^{{cite journal|author1=Hagopian, L.P.|author2=Thompson, R.H.|year=1999|title=Reinforcement of compliance with respiratory treatment in a child with cystic fibrosis|journal=Journal of Applied Behavior Analysis|volume=32|issue=2|pages=233–36|doi=10.1901/jaba.1999.32-233|pmc=1284184|pmid=10396778}}
50. ^{{cite journal|author1=Kuhn, S.A.C.|author2=Lerman, D.C.|author3=Vorndran, C.M.|year=2003|title=Pyramidal training for families of children with problem behavior|journal=Journal of Applied Behavior Analysis|volume=36|issue=1|pages=77–88|doi=10.1901/jaba.2003.36-77|pmc=1284418|pmid=12723868}}
51. ^{{cite journal|author1=Van Houten, R.|author2=Malenfant, J.E.L.|author3=Austin, J.|author4=Lebbon, A.|year=2005|title=The effects of a seatbelt-gearshift delay prompt on the seatbelt use of motorists who do not regularly wear seatbelts|journal=Journal of Applied Behavior Analysis|volume=38|issue=2|pages=195–203|doi=10.1901/jaba.2005.48-04|pmc=1226155|pmid=16033166|editor=Vollmer, Timothy}}
52. ^{{cite journal|author1=Wong, S.E.|author2=Martinez-Diaz, J.A.|author3=Massel, H.K.|author4=Edelstein, B.A.|author5=Wiegand, W.|author6=Bowen, L.|author7=Liberman, R.P.|year=1993|title=Conversational skills training with schizophrenic inpatients: A study of generalization across settings and conversants|journal=Behavior Therapy|volume=24|issue=2|pages=285–304|doi=10.1016/S0005-7894(05)80270-9}}
53. ^{{cite journal|author1=Brobst, B.|author2=Ward, P.|year=2002|title=Effects of public posting, goal setting, and oral feedback on the skills of female soccer players|journal=Journal of Applied Behavior Analysis|volume=35|issue=3|pages=247–57|doi=10.1901/jaba.2002.35-247|pmc=1284383|pmid=12365738}}
54. ^{{cite journal|author1=Forthman, D.L.|author2=Ogden, J.J.|year=1992|title=The role of applied behavior analysis in zoo management: Today and tomorrow|journal=Journal of Applied Behavior Analysis|volume=25|issue=3|pages=647–52|doi=10.1901/jaba.1992.25-647|pmc=1279745|pmid=16795790}}
55. ^¹²³{{cite book|year=2016|title=Reinforcement principles for addiction medicine; from recreational drug use to psychiatric disorder|journal=Prog. Brain Res.|volume=223|issue=|pages=63–76|doi=10.1016/bs.pbr.2015.07.005|pmid=26806771|quote=Abused substances (ranging from alcohol to psychostimulants) are initially ingested at regular occasions according to their positive reinforcing properties. Importantly, repeated exposure to rewarding substances sets off a chain of secondary reinforcing events, whereby cues and contexts associated with drug use may themselves become reinforcing and thereby contribute to the continued use and possible abuse of the substance(s) of choice. ...
An important dimension of reinforcement highly relevant to the addiction process (and particularly relapse) is secondary reinforcement (Stewart, 1992). Secondary reinforcers (in many cases also considered conditioned reinforcers) likely drive the majority of reinforcement processes in humans. In the specific case of drug [addiction], cues and contexts that are intimately and repeatedly associated with drug use will often themselves become reinforcing ... A fundamental piece of Robinson and Berridge's incentive-sensitization theory of addiction posits that the incentive value or attractive nature of such secondary reinforcement processes, in addition to the primary reinforcers themselves, may persist and even become sensitized over time in league with the development of drug addiction (Robinson and Berridge, 1993). ...
Negative reinforcement is a special condition associated with a strengthening of behavioral responses that terminate some ongoing (presumably aversive) stimulus. In this case we can define a negative reinforcer as a motivational stimulus that strengthens such an “escape” response. Historically, in relation to drug addiction, this phenomenon has been consistently observed in humans whereby drugs of abuse are self-administered to quench a motivational need in the state of withdrawal (Wikler, 1952).|vauthors=Edwards S|series=Progress in Brain Research|isbn=9780444635457}}
56. ^¹²{{cite journal|date=April 2012|title=From prediction error to incentive salience: mesolimbic computation of reward motivation|journal=Eur. J. Neurosci.|volume=35|issue=7|pages=1124–1143|doi=10.1111/j.1460-9568.2012.07990.x|pmc=3325516|pmid=22487042|quote=When a Pavlovian CS+ is attributed with incentive salience it not only triggers ‘wanting’ for its UCS, but often the cue itself becomes highly attractive – even to an irrational degree. This cue attraction is another signature feature of incentive salience. The CS becomes hard not to look at (Wiers & Stacy, 2006; Hickey et al., 2010a; Piech et al., 2010; Anderson et al., 2011). The CS even takes on some incentive properties similar to its UCS. An attractive CS often elicits behavioral motivated approach, and sometimes an individual may even attempt to ‘consume’ the CS somewhat as its UCS (e.g., eat, drink, smoke, have sex with, take as drug). ‘Wanting’ of a CS can turn also turn the formerly neutral stimulus into an instrumental conditioned reinforcer, so that an individual will work to obtain the cue (however, there exist alternative psychological mechanisms for conditioned reinforcement too).|vauthors=Berridge KC}}
57. ^¹²{{cite journal|date=May 2015|title=Pleasure systems in the brain|journal=Neuron|volume=86|issue=3|pages=646–664|doi=10.1016/j.neuron.2015.02.018|pmc=4425246|pmid=25950633|quote=An important goal in future for addiction neuroscience is to understand how intense motivation becomes narrowly focused on a particular target. Addiction has been suggested to be partly due to excessive incentive salience produced by sensitized or hyper-reactive dopamine systems that produce intense ‘wanting’ (Robinson and Berridge, 1993). But why one target becomes more ‘wanted’ than all others has not been fully explained. In addicts or agonist-stimulated patients, the repetition of dopamine-stimulation of incentive salience becomes attributed to particular individualized pursuits, such as taking the addictive drug or the particular compulsions. In Pavlovian reward situations, some cues for reward become more ‘wanted’ more than others as powerful motivational magnets, in ways that differ across individuals (Robinson et al., 2014b; Saunders and Robinson, 2013). ... However, hedonic effects might well change over time. As a drug was taken repeatedly, mesolimbic dopaminergic sensitization could consequently occur in susceptible individuals to amplify ‘wanting’ (Leyton and Vezina, 2013; Lodge and Grace, 2011; Wolf and Ferrario, 2010), even if opioid hedonic mechanisms underwent down-regulation due to continual drug stimulation, producing ‘liking’ tolerance. Incentive-sensitization would produce addiction, by selectively magnifying cue-triggered ‘wanting’ to take the drug again, and so powerfully cause motivation even if the drug became less pleasant (Robinson and Berridge, 1993).|vauthors=Berridge KC, Kringelbach ML}}
58. ^McGreevy, P & Boakes, R."Carrots and Sticks: Principles of Animal Training".(Sydney: "Sydney University Press"., 2011)
59. ^{{cite web|url=https://seaworld.org/en/animal-info/animal-infobooks/animal-training/animal-training-basics|website=Animal training basics|publisher=Seaworld parks|title=All About Animal Training - Basics | SeaWorld Parks & Entertainment}}
60. ^¹Kazdin AE (2010). Problem-solving skills training and parent management training for oppositional defiant disorder and conduct disorder. Evidence-based psychotherapies for children and adolescents (2nd ed.), 211–226. New York: Guilford Press.
61. ^Forgatch MS, Patterson GR (2010). Parent management training — Oregon model: An intervention for antisocial behavior in children and adolescents. Evidence-based psychotherapies for children and adolescents (2nd ed.), 159–78. New York: Guilford Press.
62. ^Domjan, M. (2009). The Principles of Learning and Behavior. Wadsworth Publishing Company. 6th Edition. pages 244–249.
63. ^{{cite journal|last1=Bleda|first1=Miguel Ángel Pérez|last2=Nieto|first2=José Héctor Lozano|date=2012|title=Impulsivity, Intelligence, and Discriminating Reinforcement Contingencies in a Fixed-Ratio 3 Schedule|url=https://search-proquest-com.qe2a-proxy.mun.ca/docview/1439791203?accountid=12378|journal=The Spanish Journal of Psychology|volume=3|issue=15|pages=922–929}}
64. ^{{cite book|last1=Kazdin|first1=Alan|title=History of behavior modification: Experimental foundations of contemporary research|date=1978|publisher=University Park Press|location=Baltimore}}
65. ^{{cite journal|last1=Strain|first1=Phillip S.|last2=Lambert|first2=Deborah L.|last3=Kerr|first3=Mary Margaret|last4=Stagg|first4=Vaughan|last5=Lenkner|first5=Donna A.|date=1983|title=Naturalistic assessment of children's compliance to teachers' requests and consequences for compliance|journal=Journal of Applied Behavior Analysis|volume=16|issue=2|pages=243–249|doi=10.1901/jaba.1983.16-243|pmid=16795665|pmc=1307879}}
66. ^{{cite journal|last1=Crowell|first1=Charles R.|last2=Anderson|first2=D. Chris|last3=Abel|first3=Dawn M.|last4=Sergio|first4=Joseph P.|date=1988|title=Task clarification, performance feedback, and social praise: Procedures for improving the customer service of bank tellers|journal=Journal of Applied Behavior Analysis|volume=21|issue=1|pages=65–71|doi=10.1901/jaba.1988.21-65|pmc=1286094|pmid=16795713}}
67. ^{{cite journal|last1=Kazdin|first1=Alan E.|date=1973|title=The effect of vicarious reinforcement on attentive behavior in the classroom|journal=Journal of Applied Behavior Analysis|volume=6|issue=1|pages=71–78|doi=10.1901/jaba.1973.6-71|pmid=16795397|pmc=1310808}}
68. ^{{cite journal|last1=Brophy|first1=Jere|title=On praising effectively|journal=The Elementary School Journal|date=1981|volume=81|issue=5|pages=269–278|jstor=1001606|doi=10.1086/461229}}
69. ^¹{{cite journal|last1=Simonsen|first1=Brandi|last2=Fairbanks|first2=Sarah|last3=Briesch|first3=Amy|last4=Myers|first4=Diane|last5=Sugai|first5=George|date=2008|title=Evidence-based Practices in Classroom Management: Considerations for Research to Practice|journal=Education and Treatment of Children|volume=31|issue=1|pages=351–380|doi=10.1353/etc.0.0007}}
70. ^{{cite book|last1=Weisz|first1=John R.|last2=Kazdin|first2=Alan E.|title=Evidence-based psychotherapies for children and adolescents|date=2010|publisher=Guilford Press}}
71. ^¹{{cite journal|last1=Garland|first1=Ann F.|last2=Hawley|first2=Kristin M.|last3=Brookman-Frazee|first3=Lauren|last4=Hurlburt|first4=Michael S.|date=May 2008|title=Identifying Common Elements of Evidence-Based Psychosocial Treatments for Children's Disruptive Behavior Problems|journal=Journal of the American Academy of Child & Adolescent Psychiatry|volume=47|issue=5|pages=505–514|doi=10.1097/CHI.0b013e31816765c2|pmid=18356768}}
72. ^¹{{Cite book|title=Who's Pulling Your Strings ? How to Break The Cycle of Manipulation |first=Harriet B.|last=Braiker |year=2004 |isbn=978-0-07-144672-3}}
73. ^{{Cite journal|url = |title = Traumatic Bonding: The development of emotional attachments in battered women and other relationships of intermittent abuse|last = Dutton|date = 1981|journal = Victimology: An International Journal|doi = |pmid = |access-date = |last2 = Painter|issue = 7}}
74. ^Chrissie Sanderson. [https://books.google.com/books?id=5vA42Opyx9cC&pg=PA84 Counselling Survivors of Domestic Abuse]. Jessica Kingsley Publishers; 15 June 2008. {{ISBN|978-1-84642-811-1}}. p. 84.
75. ^http://www.encyclopedia.com/social-sciences/applied-and-social-sciences-magazines/traumatic-bonding
76. ^¹²³⁴{{Cite book|title=On Killing: the Psychological Cost of Learning to Kill in War and Society|last=Grossman|first=Dave|publisher=Little Brown|year=1995|isbn=978-0316040938|location=Boston|pages=}}
77. ^{{Cite book|title=Men Against Fire: the Problem of Battle Command in Future War|last=Marshall|first=S.L.A.|publisher=Infantry Journal|year=1947|isbn=978-0-8061-3280-8|location=Washington|pages=}}
78. ^¹²{{Cite web|url=https://www.killology.com/behavioral-psychology|title=Behavioral Psychology|last=Murray, K.A., Grossman, D., & Kentridge, R.W.|date=21 October 2018|website=https://www.killology.com/behavioral-psychology|archive-url=|archive-date=|dead-url=|access-date=}}
79. ^{{Cite book|title=The Psychology of Conflict and Combat|last=Shalit|first=Ben|publisher=Praeger|year=1998|isbn=978-0275927530|location=New York|pages=}}
80. ^John Hopson: Behavioral Game Design, Gamasutra, 27 April 2001
81. ^{{cite web | url = http://www.eurogamer.net/articles/2017-10-11-are-loot-boxes-gambling | title = Are loot boxes gambling? | first = Vic | last = Hood | date = 12 October 2017 | accessdate = 12 October 2017 | work = Eurogamer }}
82. ^Petty tyranny in organizations, Ashforth, Blake, Human Relations, Vol. 47, No. 7, 755–778 (1994)
83. ^Helge H, Sheehan MJ, Cooper CL, Einarsen S "Organisational Effects of Workplace Bullying" in Bullying and Harassment in the Workplace: Developments in Theory, Research, and Practice (2010)
84. ^Operant Conditioning and the Practice of Defensive Medicine. Vikram C. Prabhu World Neurosurgery, 2016-07-01, Volume 91, Pages 603–605