# Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome

Alexandre Salvador, Yulia Worbe, Cécile Delorme, Giorgio Coricelli, Raphaël Gaillard, Trevor W. Robbins, Andreas Hartmann, Stefano Palminteri

► To cite this version:

Alexandre Salvador, Yulia Worbe, Cécile Delorme, Giorgio Coricelli, Raphaël Gaillard, et al. Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome. Scientific Reports, 2017, 7, pp.6292. 10.1038/s41598-017-06547-8. hal-01580171

HAL Id: hal-01580171

https://hal.sorbonne-universite.fr/hal-01580171

Submitted on 1 Sep 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
SCIENTIFIC REPORTS

<figure><img src="image_2.png" /></figure>

OPEN

# Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome

Received: 25 July 2016

Accepted: 15 June 2017

Published online: 24 July 2017

Alexandre Salvador<fnref n="1" />,², Yulia Worbe³, Cécile Delorme³, Giorgio Coricelli⁴, Raphaël Gaillard², Trevor W. Robbins⁵, Andreas Hartmann³ & Stefano Palminteri ID <fnref n="1" />,⁶,⁷

The dopamine partial agonist aripiprazole is increasingly used to treat pathologies for which other antipsychotics are indicated because it displays fewer side effects, such as sedation and depression-like symptoms, than other dopamine receptor antagonists. Previously, we showed that aripiprazole may protect motivational function by preserving reinforcement-related signals used to sustain reward-maximization. However, the effect of aripiprazole on more cognitive facets of human reinforcement learning, such as learning from the forgone outcomes of alternative courses of action (i.e., counterfactual learning), is unknown. To test the influence of aripiprazole on counterfactual learning, we administered a reinforcement learning task that involves both direct learning from obtained outcomes and indirect learning from forgone outcomes to two groups of Gilles de la Tourette (GTS) patients, one consisting of patients who were completely unmedicated and the other consisting of patients who were receiving aripiprazole monotherapy, and to healthy subjects. We found that whereas learning performance improved in the presence of counterfactual feedback in both healthy controls and unmedicated GTS patients, this was not the case in aripiprazole-medicated GTS patients. Our results suggest that whereas aripiprazole preserves direct learning of action-outcome associations, it may impair more complex inferential processes, such as counterfactual learning from forgone outcomes, in GTS patients treated with this medication.

Aripiprazole is a recently introduced antipsychotic medication with dopamine receptor partial agonist mechanisms<fnref n="1" />. In schizophrenia patients, aripiprazole exhibited efficacy comparable to that of typical and atypical antipsychotics in the treatment of positive and negative symptoms as well as in the prevention of relapse²,³. Its efficacy has also been demonstrated in other neurological disorders for which antipsychotics are indicated, such as Gilles de la Tourette syndrome (GTS)⁴,⁵. Its tolerability is often considered superior to that of typical antipsychotics, and it is associated with fewer adverse side effects, such as extrapyramidal and metabolic syndromes⁶,⁷. In GTS, aripiprazole is effective for suppressing tics while displaying a less severe side effect profile than dopamine receptor antagonists with regard to motivational deficits such as sedation and depressive reactions⁸. Due to this advantageous cost-benefit trade-off, aripiprazole has become a widely prescribed treatment for schizophrenia and GTS.

Pharmacological studies in humans suggest that dopamine receptor antagonist-induced sedation and depressive states may be the consequence of blunting of reward-related signals⁹,¹⁰. For instance, reward-seeking behaviour and reward prediction errors encoded in the ventral striatum were reduced by haloperidol administration in healthy volunteers¹¹. In contrast, both functions were preserved in GTS patients medicated with aripiprazole¹².

<footnote n="1">¹Laboratoire de Neurosciences Cognitives, Institut National de la Santé et de la Recherche Médicale, Paris, France. ²Centre de Psychiatrie et Neuroscience, Hôpital Sainte Anne, Paris, France. ³National Reference Centre for Gilles de la Tourette Syndrome, Department of Neurology, Institut du Cerveau et de la Moelle Epinière, Hôpital de la Pitié-Salpêtrière, Paris, France. ⁴Department of Economics, University of Southern California, California, USA. ⁵Department of Psychology and Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, UK. ⁶Departement d'Études Cognitives, École Normale Supérieure, Paris, France. ⁷Institut d'Études de la Cognition, Université de Recherche Paris Sciences et Lettres, Paris, France. Correspondence and requests for materials should be addressed to S.P. (email: stefano.palminteri@ens.fr)</footnote>
<table><caption>**Table 1.** Demographic characteristics and psychometric scales for participants by treatment group. The "p2" p-values correspond to the comparison between the unmedicated and aripiprazole groups (two-sample t-test). The "p3" p-values correspond to the comparison among all three groups (one-way analysis of variance).</caption><thead><tr><th></th><th>Controls</th><th>Unmedicated</th><th>Aripiprazole</th><th>P2</th><th>P3</th></tr></thead><tbody><tr><td>N</td><td>20</td><td>17</td><td>14</td><td></td><td></td></tr><tr><td>Age (m sd)</td><td>32.35 (13.36)</td><td>30.76 (10.33)</td><td>32.07 (11.52)</td><td>0.742</td><td>0.916</td></tr><tr><td>Sex = Female (%)</td><td>9 (45.0%)</td><td>4 (23.5%)</td><td>5 (35.7%)</td><td>0.729</td><td>0.395</td></tr><tr><td>Study (m sd)</td><td>14.40 (1.70)</td><td>13.24 (1.95)</td><td>12.79 (2.26)</td><td>0.557</td><td>0.050</td></tr><tr><td>NART (m sd)</td><td>308.50 (94.70)</td><td>262.81 (93.72)</td><td>267.00 (106.20)</td><td>0.911</td><td>0.310</td></tr><tr><td>YGTSS (m sd)</td><td>—</td><td>37.87 (15.95)</td><td>31.14 (13.29)</td><td>0.230</td><td>—</td></tr><tr><td>Disease Duration (m sd)</td><td>—</td><td>23.88 (10.95)</td><td>23.29 (11.81)</td><td>0.888</td><td>—</td></tr><tr><td>BDI (m sd)</td><td>1.75 (2.38)</td><td>6.59 (5.97)</td><td>7.07 (5.81)</td><td>0.822</td><td>0.003</td></tr><tr><td>STAI A (m sd)</td><td>47.60 (3.86)</td><td>47.76 (2.97)</td><td>47.08 (4.25)</td><td>0.606</td><td>0.874</td></tr><tr><td>STAI B (m sd)</td><td>47.71 (4.21)</td><td>50.29 (6.94)</td><td>51.09 (6.36)</td><td>0.762</td><td>0.272</td></tr><tr><td>BIS BAS (m sd)</td><td>44.90 (5.18)</td><td>41.41 (5.76)</td><td>40.36 (6.55)</td><td>0.637</td><td>0.059</td></tr><tr><td>BIS 11 (m sd)</td><td>60.40 (8.71)</td><td>65.94 (11.64)</td><td>69.29 (11.90)</td><td>0.437</td><td>0.057</td></tr><tr><td>Years on Aripip. (m sd)</td><td>—</td><td>—</td><td>5.75 (3.33)</td><td>—</td><td>—</td></tr><tr><td>Aripip. Dose, mg (m sd)</td><td>—</td><td>—</td><td>6.96 (6.88)</td><td>—</td><td>—</td></tr></tbody></table>

These results are consistent with the idea that, as opposed to dopamine receptor antagonists, aripiprazole preserves motivational functions via preserving reward-related signals.

Despite the observations described above, in humans, reinforcement learning is seldom solely based on learning from obtained outcomes (i.e., factual outcomes)¹³. In fact, human reinforcement learning often makes use of more abstract inferential processes, including learning from forgone outcomes¹⁴, ¹⁵. In other words, counterfactual learning refers to the ability to learn not only from direct experience but also from hypothetical outcomes (the outcomes of the option that was not chosen). Previous neuroimaging studies have demonstrated that subjects take into account counterfactual feedback when it is available and have suggested that this form of learning could be underpinned by a dorsal prefrontal system¹⁶⁻¹⁸, despite the fact that some other studies have suggested that factual and counterfactual outcomes may be processed by the same neural system involving the ventral striatum¹⁹, ²⁰. On the pharmacological level, a recent study that investigated counterfactual learning under a regimen of dietary depletion of serotonin and dopamine/noradrenalin precursors indicated that brain tracking of fictive prediction error might be sensitive to both dopamine and serotonin manipulation²¹.

Here, to characterize the effect of aripiprazole on counterfactual learning, we administered a recently developed behavioural task that contrasts learning from obtained and hypothetical outcomes to a group of medication-free GTS patients, a group of GTS patients with aripiprazole as their only medication, and matched healthy controls²². GTS patients represented an ideal model for this investigation because in this population we have already shown the beneficial effects of aripiprazole compared to a dopamine receptor antagonist in factual learning, that is, in learning from obtained outcomes (as opposed to counterfactual learning, which is learning from forgone outcomes)¹². In addition, unlike many schizophrenic patients, GTS patients have relatively preserved cognitive efficiency²³, ²⁴. Finally, by investigating the effect of aripiprazole in a population that is commonly treated with this medication, our findings have direct clinical relevance.

## Results

**Demographic and psychometric results.** All patients consulting at the GTS Reference Centre in Paris and meeting inclusion and exclusion criteria were screened for inclusion and offered participation in this study until we reached a figure of 40 patients (20 per treatment) giving consent to be included. The sample size for the current study was specified in the ethical approval and determined based on previous studies realized in our lab. Patients taking any medication other than aripiprazole (i.e., pimozide, risperidone, haloperidol, bromazepam or escitalopram) were not included in the final analysis. One patient did not complete the task and was also excluded from the analysis. This led to a final sample of 31 GTS patients (17 without any medication and 14 with aripiprazole monotherapy) (Table 1). In addition, 20 healthy controls obtained through advertising were included. Two significant differences were found when comparing the 3 groups: the number of years of study (F(2,48) = 3.2, p = 0.050) (although the results of the National Adult Reading Test (NART; F(2,46) = 1.2, p = 0.31), which measures verbal intelligence, did not differ among the groups) and the Beck Depression Inventory score (BDI, F(2,48) = 6.72, p = 0.0027). In addition, two scales showed marginal differences among the three groups: the Barratt Impulsiveness Scale (BIS-11; F(2,48) = 3.00, p = 0.059) and the Behavioural Inhibition/Behavioural Activation Scale (BIS/BAS; F(2,48) = 3.04, p = 0.057). However, there was no significant difference between the aripiprazole and unmedicated GTS groups on any demographic or psychometric scale or in disease severity index or measures of intelligence (all p > 0.2, two-sample t-test).

**Behavioural results.** Subjects performed a probabilistic instrumental learning task adapted from previous imaging studies²², ²⁵. During the instrumental probabilistic learning task, the subjects were required to learn
<figure><img src="image_3.png" /><figcaption>(B) Partial feedback condition</figcaption></figure>

<figure><img src="image_4.png" /></figure>

**Figure 1.** Task. (A) Task contingencies and factorial design. The attribution of symbols to each condition was randomized across subjects. (B) Typical trials. A novel trial started after a fixation screen (500 ms). Subjects were required to select between the two options by pressing one of the corresponding two buttons with their left or right index fingers to select the leftmost or the rightmost option, respectively, within a 3000- ms time window. After the choice window, a red pointer appeared below the selected option for 500 ms. At the end of the trial, the options disappeared and the selected option was replaced by the outcome ("+0.5 €", "0.0 €" or "-0.5 €") for 3000 ms. In the complete information context, the outcome corresponding to the unchosen option (counterfactual) was also displayed.

which stimuli had the greatest likelihood of resulting in an advantageous outcome through trial and error. The dependent variable was the subject's accuracy; an "accurate" (or "correct") choice was choice of the stimulus that is on average more rewarding or less punishing. Both feedback valence (reward vs. punishment) and feedback information (partial feedback vs. complete feedback) were manipulated using a within-subjects factorial design (Fig. 1A).

A preliminary analysis of variance (ANOVA) evaluating accuracy as a function of trial, feedback information, feedback valence and group (aripiprazole-treated GTS patients, unmedicated GTS patients, and controls) showed that there was a significant main effect of group (F(2,4864) = 14.5, p < 0.001), a significant main effect of trial number (F(1,4864) = 46.4, p < 0.001), and a significant main effect of feedback information (F(1,4864) = 23.7, p < 0.001), with an interaction effect of group with feedback information (F(2,4864) = 15.35, p < 0.001) but no main effect of feedback valence (F(1,4864) = 0.8, p > 0.3). Feedback valence was therefore excluded from the subsequent ANOVA analysis.

The final ANOVA, which evaluated accuracy as a function of trial, feedback information, and group, showed that there was a significant main effect of trial number on correct choice rate (F(1,2432) = 41.1, p < 0.001), indicating that accuracy improved with learning (Fig. 2A). In addition, there was a significant main effect of feedback information (F(1,2432) = 21.0, p < 0.001) and of group (F(2,2432) = 12.9, p < 0.001), with a significant interaction between group and feedback information (F(2,2432) = 13.6, p < 0.001), indicating that counterfactual feedback did not positively modulate the accuracy similarly in the three groups. The interaction effect of group and feedback information remained significant when years of study, BDI score, and BIS.11 or BIS.BAS impulsivity scores were included either individually or all together (F(2,2260) = 22.8, p < 0.001).

We then defined the « counterfactual gain » as the difference in accuracy between the complete feedback and the partial feedback conditions. A confirmatory ANOVA evaluating counterfactual gain as a function of group and trial showed a significant main effect of group (F(2,1216) = 17.9, p < 0.001), indicating that the groups benefited differently from counterfactual information. There was no main effect of trial (F(1,1216) = 1.00, p = 0.3), indicating that the benefit from counterfactual information was present for the entire duration of the experiment. The effect of group remained significant when years of study, BDI score, and BIS.11 or BIS.BAS impulsivity scores were included either individually or all together (F(2,1130) = 25.1, p < 0.001).
<figure><img src="image_5.png" /><figcaption>**Figure 2.** (A) Learning curves as a function of feedback information and group. The bold lines represent trial-by-trial average accuracy over the three sessions. The shaded areas between the thin lines represent the standard error of the mean with subject as the random factor. Light and dark grey represent partial and complete feedback conditions, respectively. (B) Average performance averaged across the 24 trials. (C) Average « counterfactual gain » (complete minus partial accuracy) (Co. = controls; Un. = unmedicated; Ar. = aripiprazole). \*p < 0.05, one-sample t-test; \*\*p < 0.05, two-sample t-test. The error bars represent the standard error of the mean with subject as the random factor.</figcaption></figure>

To assess the directionality of the critical ANOVA effects in a concise manner, we plotted and analysed the accuracy and the counterfactual gain averaged across trials. Accuracy in the complete feedback condition was significantly higher than accuracy in the partial feedback condition in both the control and unmedicated GTS groups ($t(19) = -2.6, p < 0.05$, and $t(16) = -2.3, p < 0.05$, respectively) but not in the aripiprazole GTS group ($t(13) = 0.151, p = 0.882$) (Fig. 2B). The average counterfactual gain was significantly higher in the control group and in the unmedicated group than in the aripiprazole group (8.3% controls versus 0.3% aripiprazole, $t(31.5) = 2.2, p < 0.05$; t-test 10.5% unmedicated versus 0.3% aripiprazole, $t(23.3) = 2.1, p < 0.05$). There was no difference in counterfactual gain between the control and unmedicated groups ($t(29.3) = -0.4, p = 0.701$) (Fig. 2C).

Interestingly, in the aripiprazole GTS group, we found a significant correlation between treatment dose and accuracy in the complete feedback condition (Spearman's correlation test $\rho = -0.66, p < 0.01$), indicating that the higher the dose of atypical antipsychotic medication received, the lower the accuracy in the complete feedback condition. This correlation remained significant when the only patient with a 30-mg dose of aripiprazole was excluded ($\rho = -0.57, p < 0.05$) (Fig. 3). In contrast, treatment dose did not correlate with accuracy in the partial feedback condition (Spearman's correlation test $\rho = -0.47, p < 0.05$).

To assess evidence in favour of the null hypothesis (i.e., the absence of counterfactual learning in the aripiprazole group), we performed a Bayesian equivalent of a t-test (see the Materials and Methods section). This analysis showed that the probability that the average counterfactual gain falls within a region of practical equivalence (i.e., ROPE: [-1.5%, 1.5%] interval) is small (4%) in both the unmedicated GTS group and in the control group, whereas this probability is 5.75 times larger (23%) in the aripiprazole group (Fig. 4@). This Bayesian approach provides evidence that the absence of counterfactual learning in the aripiprazole group does not arise from a lack of power in detecting it.

Finally, we analysed the reaction times using an ANOVA with trial, group and feedback information as factors (see Table 2). The ANOVA revealed a significant effect of trial, indicating that reaction time decreased across trials ($F(1,2432) = 17.8, p < 0.001$). Feedback information and group did not affect reaction time ($F(1,2432) = 0.08, p = 0.772$ and $F(2,2432) = 2.74, p = 0.064$), nor did any of the interaction factors, indicating that reaction time was not modulated by the pathology or by the treatment.

## Discussion

Using a probabilistic learning paradigm with factual (where subjects were informed only about the result of the chosen outcome) and counterfactual (where subjects were also informed about the result of the unchosen outcome) feedback information conditions in healthy controls and aripiprazole-medicated and unmedicated GTS
<figure><img src="image_6.png" /><figcaption>**Figure 3.** Correlation between aripiprazole dose and accuracy in the complete feedback context in all subjects (left) and excluding the subject with the highest dose (right).</figcaption></figure>

<figure><img src="image_7.png" /><figcaption>**Figure 4.** Results of the Bayesian analysis for evidence in favour of the null hypothesis for the difference between accuracy in the complete and partial feedback conditions (i.e., « counterfactual gain ») for each group. ROPE is the region of practical equivalence, which was set at the level of 3% ([-1.5%, 1.5%]). “4% in ROPE” means that there is a 4% chance that the true average counterfactual gain lies within the region of the practical equivalence interval.</figcaption></figure>

<table><caption>**Table 2.** Average behavioural data (mean ± s.e.m.).</caption><thead><tr><th rowspan="2">Condition</th><th colspan="4">Accuracy (correct choice rate)</th><th colspan="4">Reaction time (seconds)</th></tr><tr><th>Rew./Par.</th><th>Rew./Com.</th><th>Pun./Par.</th><th>Pun./Com.</th><th>Rew./Par.</th><th>Rew./Com.</th><th>Pun./Par.</th><th>Pun./Com.</th></tr></thead><tbody><tr><td>Controls</td><td>0.68 ± 0.04</td><td>0.76 ± 0.04</td><td>0.68 ± 0.03</td><td>0.77 ± 0.04</td><td>1.16 ± 0.04</td><td>1.21 ± 0.06</td><td>1.37 ± 0.06</td><td>1.27 ± 0.06</td></tr><tr><td>Unmedic.</td><td>0.61 ± 0.05</td><td>0.74 ± 0.05</td><td>0.65 ± 0.04</td><td>0.72 ± 0.04</td><td>1.14 ± 0.06</td><td>1.16 ± 0.06</td><td>1.29 ± 0.06</td><td>1.28 ± 0.07</td></tr><tr><td>Aripipraz.</td><td>0.66 ± 0.05</td><td>0.64 ± 0.04</td><td>0.69 ± 0.03</td><td>0.70 ± 0.05</td><td>1.15 ± 0.06</td><td>1.16 ± 0.06</td><td>1.28 ± 0.06</td><td>1.27 ± 0.07</td></tr></tbody></table>

patients, we showed a specific effect of aripiprazole on counterfactual learning in the absence of any effect on factual learning in GTS patients receiving this medication.

All subjects performed significantly above chance level in the partial feedback condition, and accuracy did not differ across the groups. As previously shown, control subjects had higher accuracy in the complete feedback condition than in the partial feedback condition²², ²⁶. However, in GTS patients, counterfactual learning was affected by medication status: unmedicated patients behaved similarly to healthy controls, whereas aripiprazole-medicated patients did not improve their performance in the presence of counterfactual feedback. Counterfactual learning, as implemented in our task, requires at least two component processes: a “peripheral” process, which corresponds to the fact that the complete feedback condition mobilizes additional attentional resources; and a “central” process, which corresponds to the integration of hypothetical prospects (“counterfactuals”) in reinforcement learning²⁷.
Was the effect of aripiprazole on counterfactual learning the hallmark of a specific impairment in counterfactual reasoning or a consequence of reduced attention? Evidence against a nonspecific "peripheral" effect is the fact that baseline performance (as measured in the partial feedback condition) did not differ in the unmedicated and the aripiprazole GTS groups. If anything, average accuracy in the partial feedback condition was numerically higher in the aripiprazole GTS group than in the unmedicated GTS group (67.5% vs. 63.0%). Further evidence against the idea of a general attentional decrease is our finding that reaction times did not differ among the groups, indicating a similar level of engagement in the task for the subjects in all groups.

The preserved ability to learn from factual outcomes during aripiprazole treatment replicates previous work by Worbe and colleagues showing that aripiprazole did not affect probabilistic reward learning in GTS patients¹². This characteristic of aripiprazole strikingly contrasts with the robust observation that dopamine antagonists blunt reward-related learning and performance⁹⁻¹¹. Reduced counterfactual learning has been reported in nicotine addiction²⁸. It may therefore be argued that this learning deficit may contribute to the increased likelihood of behavioural addictions, such as pathological gambling, in aripiprazole-medicated patients²⁹ as well as the observation that aripiprazole increases cigarette smoking³⁰.

The reduction in counterfactual learning in the aripiprazole group may come as a surprise because early studies proposed that, given its particular mechanism of action as a partial D2 agonist, aripiprazole would preserve or even improve high-level cognitive function through improved frontal dopamine release³¹, ³². However, later studies mitigated this expectation by showing no effect or even a deterioration in executive functions following aripiprazole administration³³⁻³⁹. Consistent with those findings, imaging studies failed to demonstrate an increase in frontal function and even showed reduced frontal metabolism associated with reduced performance in executive function tasks⁴⁰⁻⁴². These contrasting findings on prefrontal dopamine might be linked to aripiprazole dose; low-dose systemic aripiprazole (0.5 mg/kg) was shown to increase extracellular dopamine levels in the cortex, whereas high-dose aripiprazole (10 mg/kg) reduced dopamine levels in mice⁴³, ⁴⁴. This might explain why we find a detrimental effect on counterfactual learning that increases significantly with aripiprazole dose in our study.

Aripiprazole has binding affinity for both dopamine and serotonin receptors¹. Its affinity for 5-HT1A receptors in particular may provide an explanation for the apparent discrepancy between preserved factual learning and reduced counterfactual learning. Dopamine and serotonin have been associated with both automatic/reflexive and deliberative/reflective reinforcement processing, which in our task could be incorporated into factual and counterfactual learning⁴⁵⁻⁴⁸. In particular, it has been shown that dietary depletion of tryptophan reduces the propensity to implement cognitive strategies in a reinforcement-learning task⁴⁶, ⁴⁹, and aripiprazole has been shown to reduce serotonin output in the prefrontal cortex and the dorsal raphe nucleus⁵⁰. In the light of these findings, it may be argued that aripiprazole's detrimental effect on counterfactual learning is mediated by an alteration in serotoninergic neurotransmission. Aripiprazole would therefore have a specific pattern of effects on reinforcement learning that includes both preserved direct/factual learning due to its dopamine partial agonist property and reduced indirect/counterfactual learning due to its prefrontal serotonin disruption effect. Future studies in which specific dopaminergic and serotoninergic pharmacological agents are used are required to determine whether the effect of aripiprazole on counterfactual learning is mediated by its dopaminergic affinity or its serotonergic affinity or by a combination of the two.

Is the detrimental effect of aripiprazole on counterfactual learning specific to GTS patients or generalizable? The answer to this question is closely related to the mechanism through which aripiprazole blunts counterfactual learning. GTS has been hypothesized to be dependent on a constitutive hyperactivity of dopaminergic neurotransmission⁵¹, ⁵². Positron emission tomography and post-mortem studies found evidence of increased dopamine concentration in both the striatum and the prefrontal cortex of GTS patients⁵³⁻⁵⁷. Thus, if the negative effect of aripiprazole on counterfactual learning is mediated by the dopamine system, the alterations of this neuromodulator that occur in GTS may preclude the generalizability of our result to other pathologies and to the general population. On the other hand, there is no current clear hypothesis and no replicated data implicating the serotoninergic system in GTS, with recent negative results⁵⁸, ⁵⁹. Thus, if the negative effect of aripiprazole on counterfactual learning is mediated by the serotonin system, it is less likely that it is specific to GTS patients.

Previous studies suggest that hyperactive reinforcement learning may contribute significantly to GTS symptoms⁶⁰, ⁶¹. Assuming that positive and negative prediction errors are represented by phasic fluctuations in dopaminergic transmission, we previously found that reinforcement learning in unmedicated GTS subjects was consistent with a functional hyperdopaminergia, both in terms of enhanced reward⁶² and reduced punishment learning⁶³. These findings were obtained when reward-outcome contingencies were deterministic and unconscious as measured by post-test assessments of cue visibility and stimulus-reward associations and using a task that has been shown to rely specifically on the ventral striatum⁶⁴. In contrast, our current results were obtained using a probabilistic instrumental learning task that employs perfectly visible (therefore conscious) cues and recruits both the cortex (namely, the medial prefrontal cortices and the insula) and the ventral striatum²². In the present study, we found that unmedicated GTS patients performed equally well in the reward-seeking condition and in the punishment-avoidance condition. Taken together, our current and previous findings might suggest that in GTS excessive positive reinforcement occurs for implicit/unconscious (as opposed to explicit/conscious) learning processes; this possibility could hypothetically be supported by the dependence of these two types of processes on different neural substrates (subcortical vs. prefrontal)⁶⁵. This however is probably a partial explanation as in a slightly different paradigm in healthy subjects a valence-specific effect was obtained as a result of dopamine manipulation using consciously perceived cues⁹.

A potential limitation of our study is that it was observational, meaning that we included patients who were already either unmedicated or undergoing treatment with aripiprazole. The absence of group randomization raises the question that the effects attributed to aripiprazole may arise from pre-existing phenotypic between-group differences that determined the patients' medication status. This is unlikely for several reasons. First, very few patients are either never or always medicated; thus, medication status fluctuates and does not
seem to be a patient-specific characteristic⁸. Second, to control as much as possible for this potential confounding factor, we measured several clinical, psychological and cognitive parameters and compared them between groups. We ensured through a psychiatric interview that the included GTS subjects did not have comorbid psychiatric diagnoses. We further measured a number of dimensions that could account for learning differences in our task, including general intelligence, disease severity, and cognitive and clinical dimensions, such as impulsivity, anxiety and depression, through rating scales. None of these dimensions differed significantly between aripiprazole-treated and unmedicated GTS patients; it is therefore unlikely that they could account for the reduction in counterfactual learning found in the aripiprazole group. Two of these dimensions, depression (BDI) and level of study, differed significantly between the control group and the two GTS groups, and impulsivity differed marginally. This, of course, does not affect our main claim regarding a difference between unmedicated and aripiprazole GTS patients. However, as a formal control, we included these dimensions as cofactors in the ANOVA analysis and found that the reported effects remained significant. To summarize, while the absence of group randomization is a methodological limitation that requires us to be cautious in concluding that the difference in counterfactual learning across groups is a specific result of treatment, we controlled for a number of potential confounding factors to make this conclusion as robust as possible.

Another potential limitation of our study is its relatively small sample size. While the number of participants analysed in each group is consistent with previous publications targeting reinforcement learning in GTS patients¹², ⁶², ⁶³, one could wonder whether the absence of difference in accuracy between the complete feedback and partial feedback conditions in the aripiprazole group might be due to a lack of power. However, the Bayesian analysis provided evidence that the absence of a difference in accuracy between the partial and complete feedback conditions specifically in the aripiprazole GTS group did not arise as the result of a lack of power.

To conclude, we demonstrated a negative effect of aripiprazole on counterfactual learning in a population of aripiprazole-medicated GTS patients. At present, it is unclear whether this finding can be generalized to other clinical populations and, most notably, to schizophrenic patients, for whom treatment with aripiprazole is becoming increasingly popular. It is also unclear at this stage whether the observed effect is mediated by the dopaminergic system or the serotoninergic system. Further research is needed to address these questions. Nonetheless, our findings shed new light on the characterization of the cognitive profile of aripiprazole in GTS patients treated with this medication and represent a first step in understanding the neuropharmacology of counterfactual learning.

## Materials and Methods

**Participants.** The ethics committee of the Pitié-Salpêtrière Hospital approved the study (N° Promoteur: C11-34; N° CPP: 97*19; N° ANSM: B121209-31). All participants gave written informed consent prior to participation in the study, and the study was conducted in accordance with the Declaration of Helsinki (1964).

All patients consulting at the GTS Reference Centre in Paris and meeting inclusion and exclusion criteria were screened for inclusion and offered participation in this study. They were examined by a multidisciplinary team experienced in GTS (AH and YW). Tic severity was rated on the Yale Global Tic Severity Scale⁶⁶. Inclusion criteria for the patients were as follows: age above 18 and confirmed diagnosis of GTS fulfilling the DSM-5 criteria. Aripiprazole-medicated GTS patients were on stable antipsychotic treatment for at least 4 weeks. Exclusion criteria included the co-occurrence of Axis I psychiatric disorders, including current major depressive disorder, current anxiety disorder, current or past psychotic disorder, substance abuse aside from nicotine, attention deficit disorder and obsessive-compulsive disorders. These pathologies were screened using both subsections of the Mini International Neuropsychiatry Inventory (MINI) and a clinical evaluation performed by a trained neurologist who investigated the presence of diagnostic criteria for OCD or ADHD as detailed in the DSM-IV TR. Exclusion criteria also included any neurological or movement disorder other than tics as evaluated by a qualified neurologist before inclusion, as well as the use of any medication (including antidepressants and benzodiazepines) in the unmedicated GTS group and the presence of any co-medication in the aripiprazole GTS group.

Healthy volunteers were recruited by hospital-based advertisements. The inclusion criterion for healthy volunteers was age over 18 years. The exclusion criteria were the same as for TS patients plus a personal history of tics and any concomitant treatment except contraceptive pills for women.

**Behavioural task.** The subjects performed a probabilistic instrumental learning task adapted from previous imaging studies²², ²⁵. The subjects were first provided with written instructions, and these were reformulated orally if needed. Each participant first performed a short training session (16 trials) aimed at familiarizing the participant with the task's timing and responses. The participant then performed three learning sessions.

The options were abstract symbols taken from the Agathodaimon font. Each session contained eight novel options grouped into four novel fixed pairs. The pairs of options were fixed so that a given option was always presented with the same other option. Thus, within each session, pairs of options represented stable choice contexts. Within sessions, each pair of options was presented 24 times for a total of 96 trials. The four option pairs corresponded to the four conditions (reward/partial, reward/complete, punishment/partial and punishment/complete), and the four conditions were associated with different pairs of outcomes (reward contexts: winning 0.5 € versus nothing; punishment contexts: losing 0.5 € versus nothing) and the provision of a different amount of information at feedback (partial or complete). In the partial feedback contexts, only the outcome regarding the chosen option was provided, whereas in the complete feedback contexts the outcomes of both the chosen and the unchosen option were provided (Fig. 1A). Within each pair, the two options were associated with the two possible outcomes with reciprocal probabilities (0.75/0.25 and 0.25/0.75). The subjects were informed that the aim of the task was to maximize their payoff and that only factual (and not counterfactual) outcomes counted. Between cues, the outcome probability was independent on a trial-by-trial basis, although it was anti-correlated on average. Thus, in a complete feedback trial, the subjects could observe the same outcome from both cues on 37.5% of trials and different outcomes from each cue on 62.5% of trials.
Pairs of options were presented in a pseudo-randomized and unpredictable manner to each subject (inter-
mixed design). During each trial, one option was randomly presented on the left and one on the right side of a
central fixation cross (Fig. 1B). The side on which a given option was presented was also pseudo-randomized
such that a given option was presented an equal number of times on the left and on the right of the central cross.

**Statistical analysis.** From the learning task, we extracted accuracy. An “accurate” (or “correct”) choice occurs when the subject selects the most rewarding symbol in the reward-seeking context (i.e., the symbols that yielded +0.5 € in 75% of cases and 0 € in 25% of cases) or selects the less punishing symbol in the punishment-avoidance context (i.e., the symbols that yielded 0 € in 75% of cases and -0.5 € in 25%). The central hypothesis regarding the effect of aripiprazole was assessed using a repeated measures ANOVA with group (« Controls », « Unmedicated », and « Aripiprazole ») as the between-subjects factor and trial (1:24), feedback valence (reward vs. punishment avoidance) and feedback information (partial feedback vs. complete feedback) as the within-subject factors. A specific effect of aripiprazole on counterfactual learning would result in a significant group x feedback information interaction. As a control, we performed an ANCOVA analysis that included additional psychometric measures (education, BDI, BIS.11 and BIS.BAS) as covariates. As an additional control, we performed the same ANOVA on reaction times. We also performed a confirmatory ANOVA on the “counterfactual gain”, which was defined as the difference in the accuracy achieved in the complete and partial feedback contexts (a positive “counterfactual gain” indicates a beneficial effect of counterfactual feedback on performance).

To assess the directionality of the effect, we reported the average values of all dependent variables as well as the
results of Student's t-tests (two sample t-tests were used when comparing groups, and one sample t-test was used
when comparing group-values to zero). A Welch-Satterthwaite approximation was used when the variance was
not equal across the groups⁶⁷. Correlations, in particular the correlation between treatment dose and accuracy,
were computed using Spearman's test. The significance level was set at 5%.

To assess evidence in favour of the null hypothesis (i.e., no difference in accuracy in the complete and partial
feedback conditions), we performed a Bayesian equivalent of a t-test using Monte Carlo Markov chain analysis to
compute the posterior probability of the difference in accuracy between the two feedback information conditions
for each group. This analysis was conducted using the Bayesian Estimation Supersedes the t-Test (BEST) package
version 0.4.0 in R statistical software with the BESTmcmc and plot.BEST functions. The region of practical equiv-
alence (ROPE) was set at 3%, meaning that we considered a difference included in the [-1.5%, 1.5%] interval to
be too small to be considered relevant. Evidence for the null hypothesis was the probability that the actual dif-
ference between feedback information conditions lies in the ROPE for each group. This probability was assessed
through Monte Carlo Markov chain analysis; 100 000 simulations were run for each test.

References

1. Potkin, S. G. et al. Aripiprazole, an antipsychotic with a novel mechanism of action, and risperidone vs placebo in patients with schizophrenia and schizoaffective disorder. *Arch Gen Psychiatry* **60**, 681–690 (2003).

2. Pigott, T. A. et al. Aripiprazole for the prevention of relapse in stabilized patients with chronic schizophrenia: a placebo-controlled 26-week study. *J Clin Psychiatry* **64**, 1048–1056 (2003).

3. Kane, J. M. et al. Efficacy and safety of aripiprazole and haloperidol versus placebo in patients with schizophrenia and schizoaffective disorder. *J Clin Psychiatry* **63**, 763–771 (2002).

4. Kawohl, W., Schneider, F., Vernaleken, I. & Neuner, I. Aripiprazole in the pharmacotherapy of Gilles de la Tourette syndrome in adult patients. *The world journal of biological psychiatry* **10**, 827–831 (2009).

5. Neuner, I., Nordt, C., Schneider, F. & Kawohl, W. Effectiveness of aripiprazole in the treatment of adult Tourette patients up to 56 months. *Hum Psychopharmacol* **27**, 364–369 (2012).

6. Citrome, L., Kalsekar, I., Baker, R. A. & Hebden, T. A review of real-world data on the effects of aripiprazole on weight and metabolic outcomes in adults. *Curr Med Res Opin* **30**, 1629–1641 (2014).

7. Stroup, T. S. et al. A randomized trial examining the effectiveness of switching from olanzapine, quetiapine, or risperidone to aripiprazole to reduce metabolic risk: comparison of antipsychotics for metabolic problems (CAMP). *Am J Psychiatry* **168**, 947–956 (2011).

8. Hartmann, A. & Worbe, Y. Pharmacological treatment of Gilles de la Tourette syndrome. *Neurosci Biobehav Rev* **37**, 1157–1161 (2013).

9. Frank, M. J., Seeberger, L. C. & O'Reilly, R. C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. *Science* **306**, 1940–1943 (2004).

10. Eisenegger, C. et al. Role of dopamine D2 receptors in human reinforcement learning. *Neuropsychopharmacology* **39**, 2366–2375 (2014).

11. Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J. & Frith, C. D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. *Nature* **442**, 1042–1045 (2006).

12. Worbe, Y. et al. Reinforcement learning and Gilles de la Tourette syndrome: dissociation of clinical phenotypes and pharmacological treatments. *Arch Gen Psychiatry* **68**, 1257–1266 (2011).

13. O'Doherty, J. P., Lee, S. W. & McNamee, D. The structure of reinforcement-learning mechanisms in the human brain. *Current Opinion in Behavioral Sciences* **1**, 94–100 (2015).

14. Coricelli, G. & Rustichini, A. Counterfactual thinking and emotions: regret and envy learning. Philosophical transactions of the Royal Society of London. *Series B, Biological sciences* **365**, 241–247 (2010).

15. Coricelli, G., Dolan, R. J. & Sirigu, A. Brain, emotion and decision making: the paradigmatic example of regret. *Trends in cognitive sciences* **11**, 258–265 (2007).

16. Boorman, E. D., Behrens, T. E. & Rushworth, M. F. Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex. *PLoS biology* **9**, e1001093 (2011).

17. Fischer, A. G. & Ullsperger, M. Real and fictive outcomes are processed differently but converge on a common adaptive mechanism. *Neuron* **79**, 1243–1255 (2013).

18. Koechlin, E. An evolutionary computational theory of prefrontal executive function in decision-making. Philosophical transactions of the Royal Society of London. *Series B, Biological sciences* **369** (2014).

19. Kishida, K. T. et al. Subsecond dopamine fluctuations in human striatum encode superposed error signals about actual and counterfactual reward. *Proceedings of the National Academy of Sciences of the United States of America* **113**, 200–205 (2016).

20. Li, J. & Daw, N. D. Signals in human striatum are appropriate for policy update rather than value prediction. *The Journal of neuroscience* **31**, 5504–5511 (2011).
21. Tobia, M. J. et al. Neural systems for choice and valuation with counterfactual learning signals. *NeuroImage* 89, 57–69 (2014).

22. Palminteri, S., Khamassi, M., Joffily, M. & Coricelli, G. Contextual modulation of value signals in reward and punishment learning. *Nat Commun* 6, 8096 (2015).

23. Leckman, J. F. Tourette's syndrome. *Lancet* 360, 1577–1586 (2002).

24. Singer, H. S. Tourette's syndrome: from behaviour to biology. *Lancet Neurol* 4, 149–159 (2005).

25. Palminteri, S., Boraud, T., Lafargue, G., Dubois, B. & Pessiglione, M. Brain hemispheres selectively track the expected value of contralateral options. *J Neurosci* 29, 13465–13472 (2009).

26. Palminteri, S., Kilford, E. J., Coricelli, G. & Blakemore, S.-J. The Computational Development of Reinforcement Learning during Adolescence. *PLoS computational biology* 12, e1004953 (2016).

27. Baird, A. A. & Fugelsang, J. A. The emergence of consequential thought: evidence from neuroscience. Philosophical transactions of the Royal Society of London. *Series B, Biological sciences* 359, 1797–1804 (2004).

28. Chiu, P. H., Lohrenz, T. M. & Montague, P. R. Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task. *Nature neuroscience* 11, 514–520 (2008).

29. Moore, T. J., Glenmullen, J. & Mattison, D. R. Reports of pathological gambling, hypersexuality, and compulsive shopping associated with dopamine receptor agonist drugs. *JAMA internal medicine* 174, 1930–1933 (2014).

30. Lofwall, M. R., Nuzzo, P. A., Campbell, C. & Walsh, S. L. Aripiprazole effects on self-administration and pharmacodynamics of intravenous cocaine and cigarette smoking in humans. *Experimental and clinical psychopharmacology* 22, 238–247 (2014).

31. Jordan, S. et al. The antipsychotic aripiprazole is a potent, partial agonist at the human 5-HT1A receptor. *European journal of pharmacology* 441, 137–140 (2002).

32. Tamminga, C. A. & Carlsson, A. Partial dopamine agonists and dopaminergic stabilizers, in the treatment of psychosis. *Current drug targets CNS and neurological disorders* 1, 141–147 (2002).

33. Yasui-Furukori, N., Kaneda, A., Sugawara, N., Tomita, T. & Kaneko, S. Effect of adjunctive treatment with aripiprazole to atypical antipsychotics on cognitive function in schizophrenia patients. *J Psychopharmacol* 26, 806–812 (2012).

34. Schlagenhauf, F. et al. Switching schizophrenia patients from typical neuroleptics to aripiprazole: effects on working memory dependent functional activation. *Schizophr Res* 118, 189–200 (2010).

35. Suzuki, H., Gen, K. & Inoue, Y. An unblinded comparison of the clinical and cognitive effects of switching from first-generation antipsychotics to aripiprazole, perospirone or olanzapine in patients with chronic schizophrenia. *Prog Neuropsychopharmacol Biol Psychiatry* 35, 161–168 (2011).

36. Wang, C., Zheng, D., Xu, J., Lam, W. & Yew, D. T. Brain damages in ketamine addicts as revealed by magnetic resonance imaging. *Front Neuroanat* 7, 23 (2013).

37. Lee, B. J. et al. Effect of aripiprazole on cognitive function and hyperprolactinemia in patients with schizophrenia treated with risperidone. *Clin Psychopharmacol Neurosci* 11, 60–66 (2013).

38. Maat, A. et al. Open, randomized trial of the effects of aripiprazole versus risperidone on social cognition in schizophrenia. *Eur Neuropsychopharmacol* 24, 575–584 (2014).

39. Yeh, C.-B. et al. Neurocognitive effects of aripiprazole in adolescents and young adults with schizophrenia. *Nord J Psychiatry* 68, 219–224 (2014).

40. Kim, E. et al. The relationship between antipsychotic D2 occupancy and change in frontal metabolism and working memory: A dual [(11)C]raclopride and [(18)F]FDG imaging study with aripiprazole. *Psychopharmacology* 227, 221–229 (2013).

41. Handley, R. et al. Acute effects of single-dose aripiprazole and haloperidol on resting cerebral blood flow (rCBF) in the human brain. *Hum Brain Mapp* 34, 272–282 (2013).

42. Bolstad, I. et al. No difference in frontal cortical activity during an executive functioning task after acute doses of aripiprazole and haloperidol. *Frontiers in human neuroscience* 9, 296 (2015).

43. Zocchi, A., Fabbri, D. & Heidbreder, C. A. Aripiprazole increases dopamine but not noradrenaline and serotonin levels in the mouse prefrontal cortex. *Neuroscience letters* 387, 157–161 (2005).

44. Tanahashi, S., Yamamura, S., Nakagawa, M., Motomura, E. & Okada, M. Dopamine D2 and serotonin 5-HT1A receptors mediate the actions of aripiprazole in mesocortical and mesoaccumbens transmission. *Neuropharmacology* 62, 765–774 (2012).

45. Wunderlich, K., Smittenaar, P. & Dolan, R. J. Dopamine enhances model-based over model-free choice behavior. *Neuron* 75, 418–424 (2012).

46. Worbe, Y. et al. Valence-dependent influence of serotonin depletion on model-based choice strategy. *Molecular psychiatry* 21, 624–629 (2016).

47. Doll, B. B., Bath, K. G., Daw, N. D. & Frank, M. J. Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning. *The Journal of neuroscience* 36, 1211–1222 (2016).

48. Sharp, M. E., Foerde, K., Daw, N. D. & Shohamy, D. Dopamine selectively remediates 'model-based' reward learning: a computational approach. *Brain* 139, 355–364 (2016).

49. Tanaka, S. C. et al. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. *PloS one* 2, e1333 (2007).

50. Bortolozzi, A., Díaz-Mataix, L., Toth, M., Celada, P. & Artigas, F. *In vivo* actions of aripiprazole on serotonergic and dopaminergic systems in rodent brain. *Psychopharmacology* 191, 745–758 (2007).

51. Graybiel, A. M. & Canales, J. J. The neurobiology of repetitive behaviors: clues to the neurobiology of Tourette syndrome. *Adv Neurol* 85, 123–131 (2001).

52. Albin, R. L. & Mink, J. W. Recent advances in Tourette syndrome research. *Trends Neurosci* 29, 175–182 (2006).

53. Malison, R. T. et al. [123I]beta-CIT SPECT imaging of striatal dopamine transporter binding in Tourette's disorder. *Am J Psychiatry* 152, 1359–1361 (1995).

54. Gilbert, D. L. et al. Altered mesolimbocortical and thalamic dopamine in Tourette syndrome. *Neurology* 67, 1695–1697 (2006).

55. Wong, D. F. et al. Mechanisms of dopaminergic and serotonergic neurotransmission in Tourette syndrome: clues from an *in vivo* neurochemistry study with PET. *Neuropsychopharmacology* 33, 1239–1251 (2008).

56. Minzer, K., Lee, O., Hong, J. J. & Singer, H. S. Increased prefrontal D2 protein in Tourette syndrome: a postmortem analysis of frontal cortex and striatum. *J Neurol Sci* 219, 55–61 (2004).

57. Yoon, D. Y., Gause, C. D., Leckman, J. F. & Singer, H. S. Frontal dopaminergic abnormality in Tourette syndrome: a postmortem analysis. *J Neurol Sci* 255, 50–56 (2007).

58. Xu, L. et al. Lack of genetic association of 5-HTR2A 102 T/C and -1438A/G polymorphisms with Tourette syndrome in a family-based association study in a Chinese Han population. *Asia-Pacific psychiatry* 8, 87–91 (2016).

59. Yi, M., Zhang, Y., Wang, Y., Su, N. & Liu, S. Association between the polymorphism of C861G (rs6296) in the serotonin 1B receptor gene and Tourette syndrome in Han Chinese people. *Asia-Pacific psychiatry*. doi:10.1111/appy.12196 (2015).

60. Palminteri, S. & Pessiglione, M. Reinforcement learning and Tourette syndrome. *International review of neurobiology* 112, 131–153 (2013).

61. Maia, T. V. & Frank, M. J. From reinforcement learning models to psychiatric and neurological disorders. *Nature neuroscience* 14, 154–162 (2011).

62. Palminteri, S. et al. Dopamine-dependent reinforcement of motor skill learning: evidence from Gilles de la Tourette syndrome. *Brain* 134, 2287–2301 (2011).
63. Palminteri, S. et al. Pharmacological modulation of subliminal learning in Parkinson's and Tourette's syndromes. *Proc Natl Acad Sci USA* **106**, 19179–19184 (2009).

64. Pessiglione, M. et al. Subliminal instrumental conditioning demonstrated in the human brain. *Neuron* **59**, 561–567 (2008).

65. Delorme, C. et al. Enhanced habit formation in Gilles de la Tourette syndrome. *Brain* **139**, 605–615 (2016).

66. Leckman, J. F. et al. The Yale Global Tic Severity Scale: initial testing of a clinician-rated scale of tic severity. *J Am Acad Child Adolesc Psychiatry* **28**, 566–573 (1989).

67. Welch, B. On the comparison of several mean values: an alternative approach. *Biometrika* **38**, 330–336 (1951).

## Acknowledgements

A.S. was supported by a Fondation pour la Recherche Médicale grant (grant number FDM20120624489). S.P. is supported by an ATIP-Avenir starting grant (R16069JS) and a Collaborative Research in Computational Neuroscience ANR-NSF grant (ANR-16-NEUC-0004). The study was supported by a grant from the Association Française du Syndrome de Gilles de la Tourette to Y.W. The funding agencies did not influence the content of the manuscript. The Institut d'Etude de la Cognition is supported financially by the LabEx IEC (ANR-10-LABX-0087 IEC) and the IDEX PSL* (ANR-10-IDEX-0001-02 PSL*).

## Author Contributions

A.S. performed the experiments, analysed the data, interpreted the results and wrote the manuscript. Y.W. designed the study, performed the experiment, interpreted the results and edited the manuscript. C.D. performed the experiments and edited the manuscript. G.C., R.G., T.W.R. interpreted the results and edited the manuscript.

A.H. designed the study and interpreted the results. S.P. designed the study, analysed the data, interpreted the results and wrote the manuscript.

## Additional Information

**Competing Interests:** The authors declare that they have no competing interests.

**Publisher's note:** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_8.png" /></figure>

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

© The Author(s) 2017