Reward learning in the development and maintenance of chronic back pain
Authors: Li-Bo Zhang, Li Hu
Journal: Cell Reports Medicine (2022)

Treating and preventing chronic pain require our understanding of how it develops and maintains. Löffler et al. (2022)1Löffler M. Levine S.M. Usai K. Desch S. Kandić M. Nees F. Flor H. Corticostriatal circuits in the transition to chronic back pain: the predictive role of reward learning.Cell Rep. Med. 2022; 3: 100677-1-100677-13Google Scholar demonstrate that distinct operant learning signals in the vmPFC-NAc pathway predict the development and maintenance of chronic back pain. Treating and preventing chronic pain require our understanding of how it develops and maintains. Löffler et al. (2022)1Löffler M. Levine S.M. Usai K. Desch S. Kandić M. Nees F. Flor H. Corticostriatal circuits in the transition to chronic back pain: the predictive role of reward learning.Cell Rep. Med. 2022; 3: 100677-1-100677-13Google Scholar demonstrate that distinct operant learning signals in the vmPFC-NAc pathway predict the development and maintenance of chronic back pain. Chronic pain, which persists for more than three months after injury recovery,2Treede R.-D. Rief W. Barke A. Aziz Q. Bennett M.I. Benoliel R. Cohen M. Evers S. Finnerup N.B. First M.B. et al.A classification of chronic pain for ICD-11.Pain. 2015; 156: 1003-1007https://doi.org/10.1097/j.pain.0000000000000160Crossref PubMed Scopus (1426) Google Scholar has been consistently ranked as one of the most burdensome nonfatal diseases for decades.3Vos T. Flaxman A.D. Naghavi M. Lozano R. Michaud C. Ezzati M. Shibuya K. Salomon J.A. Abdalla S. Aboyans V. et al.Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010.Lancet. 2012; 380: 2163-2196https://doi.org/10.1016/S0140-6736(12)61729-2Abstract Full Text Full Text PDF PubMed Scopus (5863) Google Scholar Understanding how chronic pain develops from acute pain and how it maintains is the key to successful treatment and prevention of the debilitating disease. Operant conditioning has long been proposed as a potential mechanism of pain chronicity.4Vlaeyen J.W.S. Crombez G. Behavioral conceptualization and treatment of chronic pain.Annu. Rev. Clin. Psychol. 2020; 16: 187-212https://doi.org/10.1146/annurev-clinpsy-050718-095744Crossref PubMed Scopus (56) Google Scholar The ventromedial prefrontal cortex (vmPFC)-nucleus accumbens (NAc) pathway underlies crucial aspects of operant conditioning, for example, expectation and prediction error (i.e., the difference between what is expected and what actually happens).5Abler B. Walter H. Erk S. Kammerer H. Spitzer M. Prediction error as a linear function of reward probability is coded in human nucleus accumbens.Neuroimage. 2006; 31: 790-795https://doi.org/10.1016/j.neuroimage.2006.01.001Crossref PubMed Scopus (305) Google Scholar, 6Kim H. Shimojo S. O'Doherty J.P. Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex.Cereb. Cortex. 2011; 21: 769-776https://doi.org/10.1093/cercor/bhq145Crossref PubMed Scopus (147) Google Scholar, 7Tu Y. Bi Y. Zhang L. Wei H. Hu L. Mesocorticolimbic pathways encode cue-based expectancy effects on pain.J. Neurosci. 2020; 40: 382-394https://doi.org/10.1523/jneurosci.1082-19.2019Crossref PubMed Google Scholar However, it is still unclear how operant learning processes encoded in the vmPFC-NAc pathway contribute to the development and maintenance of chronic pain. In this issue of Cell Reports Medicine, using fMRI, Löffler et al.1Löffler M. Levine S.M. Usai K. Desch S. Kandić M. Nees F. Flor H. Corticostriatal circuits in the transition to chronic back pain: the predictive role of reward learning.Cell Rep. Med. 2022; 3: 100677-1-100677-13Google Scholar demonstrate that different operant learning-related neural responses in the vmPFC-NAc pathway predict the transition from subacute back pain (SABP) to chronic back pain (CBP) and the maintenance of CBP (Figure 1). They followed 50 SABP patients for 6 months and enrolled 29 CBP patients and 29 healthy individuals. All participants completed an operant reward learning task in the scanner, where they responded to two colored arrow symbols as quickly as possible to win a monetary reward or pain relief. These two types of rewards were delivered with a probability of 50%. As a result, the absence of reward would indicate a negative prediction error (NPE) and the presence of reward a positive prediction error (PPE). This study design enables the authors to identify which reward learning signals in the vmPFC and NAc predict the development and maintenance of CBP and determine whether the predictors differ between the two stages of chronic pain. To identify predictors of pain chronicity, Löffler et al. conducted a series of correlation and pattern decoding analyses using learning task-based fMRI responses and resting-state fMRI data. They quantified the persistence of pain in SABP patients by computing percentage changes in pain severity scores between the baseline and follow-up. In the reward learning task, blood-oxygen-level-dependent (BOLD) responses in the left NAc during monetary PPE (i.e., presence of monetary rewards) and NPE (i.e., absence of monetary rewards) correlated positively with pain persistence and discriminated between SABP patients who recovered and those who still suffered from pain after six months. Moreover, larger connectivity between right NAc and vmPFC during monetary NPE also predicted pain persistence. By analyzing resting-state fMRI data, Löffler and colleagues showed that the left NAc-vmPFC connectivity per se predicted the transition to chronic pain. Additional pattern decoding analysis revealed that the activity pattern in the right NAc during the presentation of discriminative stimuli (i.e., colored arrow symbols) associated with pain relief could distinguish persistent and recovered SABP patients. Next, Löffler et al. compared CBP patients and healthy controls to identify predictors of chronic pain maintenance. Compared with healthy individuals, CBP patients exhibited decreased vmPFC activity during monetary PPE, increased left NAc-vmPFC connectivity during monetary PPE, and increased vmPFC activity during the presentation of discriminative stimuli for monetary rewards. However, no significant NAc-vmPFC connectivity differences were found at rest. Further analysis also failed to predict pain severity in CBP patients with neural responses in the vmPFC-NAc pathway. Altogether, this study shows that reward signals in the vmPFC-NAc pathway can predict the development and maintenance of CBP. Notably, findings from CBP patients contrast with those from SABP patients (Figure 1). For example, pain persistence was associated with larger left NAc responses during monetary PPE, but not vmPFC responses, which nevertheless differed between CBP patients and healthy participants. On the other hand, larger vmPFC responses during the presentation of discriminative stimuli for monetary rewards were observed in CBP patients, but these responses did not predict pain persistence for SABP patients. The authors inferred from these findings that the development and maintenance of CBP are characterized by the exploration-exploitation dilemma reflected in the vmPFC-NAc pathway. Specifically, the transition from SABP to CBP is predicted by the exploration of reward feedbacks, the period when prediction error is processed in areas like the NAc. The maintenance of CBP, however, is associated with the exploitation of past reward signals, as indicated by the enhanced vmPFC responses to discriminative stimuli for monetary reward. The importance of the vmPFC-NAc pathway in chronic pain has been highlighted previously.8Navratilova E. Porreca F. Reward and motivation in pain and pain relief.Nat. Neurosci. 2014; 17: 1304-1312https://doi.org/10.1038/nn.3811Crossref PubMed Scopus (319) Google Scholar,9Baliki M.N. Petre B. Torbey S. Herrmann K.M. Huang L. Schnitzer T.J. Fields H.L. Apkarian A.V. Corticostriatal functional connectivity predicts transition to chronic back pain.Nat. Neurosci. 2012; 15: 1117-1119https://doi.org/10.1038/nn.3153Crossref PubMed Scopus (737) Google Scholar Löffler et al. provide a precious opportunity to investigate how the vmPFC-NAc pathway distinctly contributes to the development and maintenance of CBP by following SABP patients for half a year and recruiting both CBP patients and healthy individuals. This study has clear clinical significance. For example, operant learning-based therapies or modulating brain activities in the vmPFC-NAc pathway may help prevent the transition to or maintenance of CBP. A recent preliminary study has shown that the transition from subacute to chronic back pain in females can be prevented by a 3-month treatment with Levodopa combined with naproxen, which targets dopaminergic neurons in the NAc.10Reckziegel D. Tétreault P. Ghantous M. Wakaizumi K. Petre B. Huang L. et al.Sex-specific pharmacotherapy for back pain: a proof-of-concept randomized trial.Pain Ther. 2021; 10: 1375-1400https://doi.org/10.1007/s40122-021-00297-2Crossref PubMed Scopus (10) Google Scholar One limitation in Löffler et al. is that they did not collect fMRI data from SABP patients in the follow-up. Had they done so, more insights into pain chronicity could have been gained by directly comparing brain responses between persistent and recovered SABP patients in the follow-up period or between persistent SABP patients and CBP patients. For a better treatment of chronic pain, more studies with larger sample sizes are needed to replicate Löffler et al.'s findings and further untangle the causal relationship between the vmPFC-NAc pathway and pain chronicity. Nevertheless, Löffler et al. still deepen our understanding of how operant learning and pain chronicity interact, and they present positive evidence that the vmPFC-NAc pathway may be a potential target for treating and preventing chronic pain. Corticostriatal circuits in the transition to chronic back pain: The predictive role of reward learningLöffler et al.Cell Reports MedicineJuly 6, 2022In BriefCorticostriatal pathways contribute to the development of chronic back pain. In this issue of Cell Reports Medicine, Löffler et al. demonstrate that reward-learning signals in a prefrontal-limbic pathway predict the transition from subacute to chronic back pain and characterize the chronic stage of back pain. Full-Text PDF Open Access