Why did the kitten cross the road? A meditation on positive versus negative reinforcement in addiction ====================================================================================================== * Marco Leyton Why did the kitten cross the road? One possibility is that there is something better on the other side (e.g., warm sun or sun-paired cue) (Box 1a). A second possibility is that there is something lacking or depleting on the first side (e.g., temperature sapping cold). Distinguishing between these possibilities is challenging and cannot be answered by experimental designs using positive versus negative reinforcement. 1–3 If the kitten is more likely to cross the road following temperature changes on the opposite side, it is called positive reinforcement. If the behaviour is emitted following temperature changes on the starting side, it is called negative reinforcement. Yet in both scenarios the kitten is approaching the warmer side. Box 1 ### Notes 1. The original title was “Why did the chicken cross the road?” but evidently chickens prefer cooler temperatures. Too complicated. 2. Occasion setters promote the ability of other stimuli to elicit a response and may or may not have conditioned effects of their own. For our eponymous kitten, grey skies could be occasion setters that augment the temperature contrast effect. So, why did the kitten cross the road? As a start, the kitten is unlikely to cross unless it has evidence that the other side is preferable; i.e., in and of itself, cold temperature might trigger a motivational state, but it will lack direction unless the kitten has either previously associated the other side with warmth or can feel the radiating heat. Does the magnitude of temperature differential matter? If the difference is small, there might be little motivation to cross. If the difference is large, the motivation to approach could be greater. Most work suggests that this differential is more important than the absolute values, a phenomenon called a “contrast effect.” Indeed, the relative difference between options is more important than the absolute reward for prompting nucleus accumbens dopamine release4 and motivated behaviours.5–9 There has been much discussion about whether these processes are relevant for understanding clinically problematic drug seeking. This includes proposals that repeated substance use initially occurs because the individual is seeking reward but later switches to avoidance of withdrawal symptoms. However, most evidence suggests that, in and of themselves, abstinence syndromes are low motivational states.10,11 With further experience, withdrawal symptoms may come to serve as occasion setters (Box 1b), increasing striatal dopamine release12,13 and the ability of drug-paired cues to elicit approach.11,13,14 Together, this evidence suggests that debates about positive versus negative reinforcement are largely semantic and uninformative. The relevant processes are more complex than captured by these terms;11,14–20 people with severe addictions alternate between high and low reward-seeking states;17–21 and their drug seeking, per se, continues to reflect approach behaviours, now invigorated by the contrasting alternatives and elevated readiness to respond (Box 2). Box 2 ### Implications for addiction research and clinical practice Much of the impetus for this essay comes from a debate about how withdrawal symptoms affect drug-seeking behaviours. It is proposed here that there are 2 main effects: (i) signalling that it is time to obtain drug, and (ii) heightening the contrast between available options. The development of these withdrawal-promoted effects constitutes an addition to the accumulating number of stimuli that can trigger drug seeking rather than a “switch” from approach to avoidance. Indeed, interventions that provide little more than an easing of withdrawal symptoms demonstrate poor clinical efficacy including high rates of morbidity and mortality;22,23 despite this, they are disconcertingly common.23,24 ## Acknowledgements The author thanks Uri Shalev, Paul Clarke, Joe Rochford and Paul Vezina for feedback on earlier versions of this manuscript. ## Footnotes * The views expressed in this editorial are those of the author(s) and do not necessarily reflect the position of the Canadian Medical Association or its subsidiaries, the journal’s editorial board or the Canadian College of Neuropsychopharmacology. * **Competing interests:** None declared. This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) licence, which permits use, distribution and reproduction in any medium, provided that the original publication is properly cited, the use is noncommercial (i.e., research or educational use), and no modifications or adaptations are made. See: [https://creativecommons.org/licenses/by-nc-nd/4.0/](https://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. Baron A, Galizio M. Positive and negative reinforcement: Should the distinction be preserved? Behav Anal 2005;28:85–98. [PubMed](http://jpn.ca/lookup/external-ref?access_num=22478443&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 2. Baron A, Galizio M. The distinction between positive and negative reinforcement: use with care. Behav Anal 2006;29:141–51. [PubMed](http://jpn.ca/lookup/external-ref?access_num=22478461&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 3. Michael J. Comment on Baron and Gazlio (2005). Behav Anal 2006; 29:117–9. [PubMed](http://jpn.ca/lookup/external-ref?access_num=22478456&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 4. Genn RF, Ahn S, Phillips AG. Attenuated dopamine efflux in the rat nucleus accumbens during successful negative contrast. Behav Neurosci 2004;118:869–73. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1037/0735-7044.118.4.869&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=15301614&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 5. Crespi LP. Quantitative variation of incentive and performance in the white rat. Am Psychol 1942;55:467–517. 6. Reynolds GS. Behavioral contrast. J Exp Anal Behav 1961;4:57–71. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1901/jeab.1961.4-57&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=13741096&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) [Web of Science](http://jpn.ca/lookup/external-ref?access_num=A1961CAN6600011&link_type=ISI) 7. Beninger RJ, Kendall SB. Behavioral contrast in rats with different reinforcers and different response topographies. J Exp Anal Behav 1975;24:267–80. [PubMed](http://jpn.ca/lookup/external-ref?access_num=16811878&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 8. Toates F. Motivational systems. New York: Cambridge University Press, 1986. 9. Venniro M, Zhang M, Caprioli D, et al. Volitional social interaction prevents drug addiction in rat models. Nat Neurosci 2018;21:1520–9. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1038/s41593-018-0246-6&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=30323276&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 10. Stewart J, Wise RA. Reinstatement of heroin self-administration habits: morphine prompts and naltrexone discourages renewed responding after extinction. Psychopharmacology (Berl) 1992;108:79–84. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1007/BF02245289&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=1410149&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 11. Shaham Y, Rajabi H, Stewart J. Relapse to heroin-seeking in rats under opioid maintenance: the effects of stress, heroin priming, and withdrawal. J Neurosci 1996;16:1957–63. [Abstract/FREE Full Text](http://jpn.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Njoiam5ldXJvIjtzOjU6InJlc2lkIjtzOjk6IjE2LzUvMTk1NyI7czo0OiJhdG9tIjtzOjE5OiIvanBuLzQ2LzEvRTE4NC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 12. Kojori ES, Naganawa M, Ramchandani VA, et al. Contributions of opioid receptors to striatal dopamine release during naloxone precipitated withdrawal [poster]. American College of Neuropsychopharmacology Annual Meeting; 2020 Dec. 8. 13. Shi Z, Jagannathan K, Padley JH, et al. The role of withdrawal in mesocorticolimbic drug cue reactivity in opioid use disorder. Addict Biol 2020; doi:10.1111/adb.12977. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1111/adb.12977.&link_type=DOI) 14. Hutcheson DM, Everitt BJ, Robbins TW, et al. The role of withdrawal in heroin addiction: enhances reward or promotes avoidance? Nat Neurosci 2001;4:943–7. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1038/nn0901-943&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=11528427&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) [Web of Science](http://jpn.ca/lookup/external-ref?access_num=000170698600022&link_type=ISI) 15. Stolerman I. Drugs of abuse: behavioural principles, methods and terms. Trends Pharmacol Sci 1992;13:170–6. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1016/0165-6147(92)90059-F&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=1604709&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) [Web of Science](http://jpn.ca/lookup/external-ref?access_num=A1992HT39300002&link_type=ISI) 16. Stewart J. Psychological and neural mechanisms of relapse. Philos Trans R Soc Lond B Biol Sci 2008;363:3147–58. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1098/rstb.2008.0084&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=18640921&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 17. Leyton M, Vezina P. Dopamine ups and downs in vulnerability to addictions: a neurodevelopmental model. Trends Pharmacol Sci 2014; 35:268–76. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1016/j.tips.2014.04.002&link_type=DOI) 18. Robinson TE, Berridge KC. The incentive sensitization theory of addiction: some current issues. Philos Trans R Soc Lond B Biol Sci 2008;363:3137–46. [CrossRef](http://jpn.ca/lookup/external-ref?access_num=10.1098/rstb.2008.0093&link_type=DOI) [PubMed](http://jpn.ca/lookup/external-ref?access_num=18640920&link_type=MED&atom=%2Fjpn%2F46%2F1%2FE184.atom) 19. King A, Vena A, Hasin DS, et al. Subjective responses to alcohol in the development and maintenance of alcohol use disorder. Am J Psychiatry 2021;[doi.org/10.1176/appi.ajp.2020.20030247](http://doi.org/10.1176/appi.ajp.2020.20030247). 20. Koob GF, Volkow ND. Neurobiology of addiction: a neurocircuitry analysis. Lancet Psychiatry 2016;3:760–73. 21. Zilverstand A, Huang AS, Alia-Klein N, et al. Neuroimaging impaired response inhibition and salience attribution in human drug addiction: a systematic review. Neuron 2018;98:886–903. 22. Chang Z, Lichtenstein P, Larsson H, et al. Substance use disorders, psychiatric disorders, and mortality after release from prison: a nationwide longitudinal cohort study. Lancet Psychiatry 2015;2:422–30. 23. Wakeman SE, Larochelle MR, Ameli O, et al. Comparative effectiveness of different treatment pathways for opioid use disorder. JAMA Netw Open 2020;3:e1920622. 24. Fletcher AM. Inside rehab: the surprising truth about addiction treatment — and how to get help that works. New York: Viking Penguin; 2013.