# Myocardial perfusion quantification with Rb-82 PET: good interobserver agreement of Carimas software on global, regional, and segmental levels

Sergey Nesterov, Emmanuel Deshayes, Luis Eduardo Juarez-Orozco, Robert Dekemp, Roberto Sciagrà, Simona Malaspina, Leonardo Settimo, Chunlei Han, Darja Ryzhkova, Irina Kostina, et al.

<figure><img src="image_1.png" /></figure>

## To cite this version:

Sergey Nesterov, Emmanuel Deshayes, Luis Eduardo Juarez-Orozco, Robert Dekemp, Roberto Sciagrà, et al.. Myocardial perfusion quantification with Rb-82 PET: good interobserver agreement of Carimas software on global, regional, and segmental levels. Annals of Nuclear Medicine, 2022, 36 (6), pp.507-514. 10.1007/s12149-022-01729-5. hal-05319362

HAL Id: hal-05319362

https://hal.science/hal-05319362v1

Submitted on 17 Oct 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>
# Myocardial perfusion quantification with Rb-82 PET: good interobserver agreement of Carimas software on global, regional, and segmental levels

Sergey V. Nesterov<sup>1,7</sup> · Emmanuel Deshayes<sup>2,8</sup> · Luis Eduardo Juarez-Orozco<sup>1</sup> · Robert A. deKemp<sup>3</sup> ·

Roberto Sciagrà<sup>4</sup> · Simona Malaspina<sup>1</sup> · Leonardo Settimo<sup>4</sup> · Chunlei Han<sup>1</sup> · Darja V. Ryzhkova<sup>5</sup> · Irina S. Kostina<sup>5</sup> ·

Kilem L. Gwet<sup>6</sup> · John O. Prior<sup>2</sup> · Juhani M. Knuuti<sup>1</sup>

Received: 14 October 2021 / Accepted: 9 February 2022 / Published online: 22 February 2022

© The Author(s) 2022

## Abstract

**Purpose** To estimate the interobserver agreement of the Carimas software package (SP) on global, regional, and segmental levels for the most widely used myocardial perfusion PET tracer—Rb-82.

**Materials and methods** Rest and stress Rb-82 PET scans of 48 patients with suspected or known coronary artery disease (CAD) were analyzed in four centers using the Carimas SP.

We considered values to agree if they simultaneously had an intraclass correlation coefficient (ICC) > 0.75 and a difference < 20% of the median across all observers.

**Results** The median values on the segmental level were 1.08 mL/min/g for rest myocardial blood flow (MBF), 2.24 mL/min/g for stress MBF, and 2.17 for myocardial flow reserve (MFR). For the rest MBF and MFR, all the values at all the levels fulfilled were in excellent agreement. For stress MBF, at the global and regional levels, all the 24 comparisons showed excellent agreement. Only 1 out of 102 segmental comparisons (seg. 14) was over the adequate agreement limit—23.5% of the median value (ICC = 0.95).

**Conclusion** Interobserver agreement for Rb-82 PET myocardial perfusion quantification analyzed with Carimas is good at any LV segmentation level—global, regional, and segmental. It is good for all the estimates—rest MBF, stress MBF, and MFR.

**Keywords** Myocardial perfusion quantification · Myocardial blood flow · Rubidium-82 · Quantitative imaging · Absolute quantification · Imaging software · Agreement · Reproducibility · PET standardization · Standards in nuclear cardiology · Carimas

<figure><img src="image_3.png" /></figure>

Sergey V. Nesterov
sergey.nesterov@tyks.fi

¹ Turku PET Centre, University of Turku and Turku University Hospital, Turku, Finland

² University of Lausanne, Lausanne, Switzerland

³ National Cardiac PET Center, University of Ottawa Heart Institute, Ottawa, Canada

⁴ University of Florence, Florence, Italy

⁵ Almazov Federal Heart, Blood and Endocrinology Centre, Saint Petersburg, Russia

⁶ Advanced Analytics LLC, Gaithersburg, MD, USA

⁷ IM Sechenov Institute of Evolutionary Physiology and Biochemistry RAS, Saint Petersburg, Russia

⁸ Regional Cancer Institute of Montpellier (ICM)-Val d'Aurelle, Montpellier, France

## Abbreviations

<table><tr><td>ICC</td><td>Intraclass correlation coefficient</td></tr><tr><td>LV</td><td>Left ventricle</td></tr><tr><td>MBF</td><td>Myocardial blood flow</td></tr><tr><td>MFR</td><td>Myocardial flow reserve</td></tr><tr><td>MMRM</td><td>Linear mixed model for repeated measures</td></tr><tr><td>MPQ</td><td>Myocardial perfusion quantification</td></tr><tr><td>SP</td><td>Software package</td></tr><tr><td>TCM</td><td>Tissue compartment model</td></tr><tr><td>TKM</td><td>Tracer kinetic modeling</td></tr></table>

## Introduction

Myocardial perfusion imaging with PET enables quantification of the myocardial blood flow (MBF) in absolute terms (mL/min/g). The three clinically available PET perfusion
tracers are O-15 water, N-13 ammonia, and Rb-82—the latter being the most widely used [1], likely because its production does not require an on-site cyclotron. Also, Rb-82 has been extensively validated for clinical practice [2].

A fundamental part of myocardial perfusion quantification (MPQ) with PET is the image's software-based transformation into MBF estimates. This transformation completes through tracer kinetic modeling (TKM), which fits a tissue compartment model (TCM) to the data—the registered radioactive counts through the scan time. Although quite a few TCMs have been published and validated, our cross-comparison study of those published and implemented models for Rb-82 demonstrated that the differences between the values received with different models could be as high as 130% [3].

The lack of confidence in MBF values provided by dedicated software packages has gradually come to the forefront [4–6]. One of the critical elements of such trust is the SP's internal reproducibility—the agreement between repeat analyses done by different observers using the same software package (SP)—i.e., users of an SP must get results that would agree [7–9].

This study focused on analyzing the interobserver agreement of Carimas SP on all the levels—global, regional, and segmental—for the most widely used tracer—Rb-82.

## Materials and methods

All Rb-82 PET studies were performed at the Department of Nuclear Medicine of the University Hospital of Lausanne (Switzerland) according to routine clinical practice. The local ethics committee approved the study protocol. Each patient provided written informed consent before the study.

Forty-eight (N=48) consecutive patients with suspected or known CAD were studied after an overnight fast and were instructed to forego caffeine- or theophylline-containing products or medications 24 h before the study. The patients underwent rest and adenosine-induced stress Rb-82 PET.

## PET image acquisition

A brief CT scout was acquired, followed by a CT attenuation correction (AC) scan (120 kV, 10 mA); CT AC image alignment with PET was verified visually by an experienced technologist and corrected, if necessary, by the manual 3D translation, using the vendor's program.

PET scans were acquired on a Discovery 690 PET/CT (GE Healthcare, Milwaukee, WI, USA) using a 3D list-mode acquisition after a 30-s (constant-activity square-wave) infusion of Rb-82 (10 MBq/kg, Jubilant DraxImage, Kirkland, Canada). An 8-min rest acquisition was started ~10–15 s after starting the intravenous Rb-82 infusion. Following the rest data acquisition, patients underwent a pharmacological

stress study. The patient kept the same position, while adenosine (0.84 mg/kg) was infused over 6 min. Two minutes after the start of adenosine infusion, Rb-82 infusion was started. The PET acquisition for pharmacological stress was performed the same way as described for the rest [10].

Dynamic images were reconstructed using the vendor VPFX time-of-flight algorithm (two iterations and 24 subsets) into 24 time frames (12×8 s, 5×12 s, 1×30 s, 1×60 s, 2×120 s), with 6.4 mm 3D Gaussian post-filtering.

## PET image analysis

The reconstructed images—rest and stress—were delivered to four PET facilities in Finland, Italy, Russia, and Switzerland. The four investigators utilized the Carimas SP [3, 7–9] and were blind to the other readers' results.

### Carimas

In Carimas (Turku PET Centre, University of Turku and Turku University Hospital, Turku, Finland), the myocardial segmentation is done semi-automatically—a user defines long and short axes. The input function from the LV cavity is defined as a reduced volume of the LV.

Cairimas has two ways to control and assure the image analysis quality: (a) visualization of segmentation results with broad manual adjusting capabilities and (b) plotting the fitted TAC with corresponding data and goodness of fit displayed in the modeling results table.

For Rb-82 PET, Carimas implemented the one-tissue compartment model (1TCM) suggested by Lortie et al. in 2007 [11]. The program calculates global MBF based on a myocardial global TAC; the same principle applies to regional and segmental—17-segment AHA model [12]—MBF values. Figure 1 shows the analysis workflow in Carimas using an Rb-82 stress MBF image as an example.

## The studied values

Image analysis delivered global, regional, and segmental values for three parameters: rest MBF, stress MBF, and myocardial flow reserve (MFR), which is the unitless ratio of the stress to the rest MBF values. Global values were averaged over the whole LV; regional values considered the three vascular territories (left anterior descending [LAD], left circumflex [LCx], and right coronary artery [RCA]), and the segmental values followed the established 17-segment AHA standard model [12].

The four observers provided six comparisons for any studied parameter (the formula is N(N−1)/2). Thus, we had six comparisons for each global flow parameter—six for rest MBF, six for stress MBF, and six for MFR (e.g., *Observer1 Global MFR* vs. *Observer4 Global MFR*). We had 18
<figure><img src="image_4.png" /><figcaption>**Fig. 1** The analysis workflow in Carimas (performed for an Rb-82 stress MBF image)</figcaption></figure>

comparisons (six by three) for each flow parameter for the three vascular territories—e.g., *Observer2 RCA sMBF* vs. *Observer3 RCA sMBF*. We had 102 comparisons (6 × 17) for each parameter for the segments—e.g., *Observer3 seg10 rMBF* vs. *Observer4 seg10 rMBF*.

## Statistical analysis

The number of compared sets (four) exceeded two, and we could not use the standard approach to measure the agreement proposed by Bland and Altman [13]; therefore, we applied a custom linear mixed model for repeated measures (MMRM) [14]. The statistical model output included two main agreement metrics—intraclass correlation coefficient (ICC) and the absolute difference between values from the implemented TKM—both calculated for each comparison.

We considered the agreement between models sufficient if the absolute difference was less than 20% of the

corresponding median across all observers and the corresponding ICC ≥ 0.75. We introduced this criterion for the acceptable discrepancy in our earlier work [2], accounting for previous reports in the field [15] and the reported variability of within-subject perfusion estimates [16], and based the standard for the adequate ICC threshold on the literature data [17]. [Of note, the 20% difference can be seen as substantial (the concerns for its magnitude are in [18]), yet, when there are no other generally accepted cutoff values of the sort, it serves us a decent seamark to navigate safely.]

We expressed the difference between MBF and MFR values as a percent of their corresponding medians to unify the scale of disagreements through all the estimated parameters.

## Biplot visualization

To visualize a large number of results, we used a custom biplot [3], relating the two defined metrics—the differences
and the ICC values of compared pairs. In this plot, the X axis shows pairwise differences between the model values, and the Y axis shows corresponding pairwise values of 1 – ICC. In this biplot, the origin (x=0 and y=0) is the point of identity between the compared values, where there is no absolute difference, and the ICC is equal to 1. Thus, the farther the values are from the origin, the less they agree—either showing an absolute difference or a reduced ICC. The predefined criteria for the good agreement were a rectangular region on the biplot. Thus, this biplot intuitively visualizes our agreement criteria—the dots inside these borders represented pairs with the high agreement.

# Results

## Patient characteristics and hemodynamics

The study population demographics and hemodynamic characteristics are in Table 1.

As expected, during the pharmacological stress test, the heart rate increased (*P* < 0.001). At the same time, blood pressure showed a mild decrease (*P* < 0.05), resulting in a rate pressure product (RPP) net increase of approximately 7.7% (*P* < 0.01). All 48 patients, including the one with a blood pressure of 70/30 mm Hg during stress, tolerated the pharmacological stress test well.

## Measurement of MBF and MFR in absolute values

The obtained absolute perfusion values are in Table 2. The median values on the segmental level were 1.08 mL/min/g for rest MBF, 2.24 mL/min/g for stress MBF, and 2.17 for MFR.

## Interobserver agreement of the myocardial perfusion estimates

The agreement values are in Fig. 2: A—for global and regional levels, B—for the segmental level. For the rest MBF and MFR, all the values at all the levels—global, regional, segmental—fulfilled both the requirements for the excellent agreement. Moreover, for the rest MBF, 90% of differences did not exceed 3% of the corresponding median on the global and regional levels and 4.5% at the segmental level. For MFR, 90% of the differences did not exceed 5% of the corresponding median at the global and regional levels and 6% at the segmental level. The most considerable difference was 11.8% of the median (ICC = 0.91) for MFR in segment 14 (distal septal).

For stress MBF, at the global and regional levels, all the 24 comparisons showed excellent agreement. It was the case that 90% of differences did not exceed 6% of the

<table><caption>**Table 1** Population characteristics</caption><tbody><tr><td>Number of subjects</td><td>48</td></tr><tr><td>Number of males (% of total)</td><td>35 (73%)</td></tr><tr><td>Age, years. (range)</td><td>63 ± 12.7 (33–87)</td></tr><tr><td>Weight, kg (range)</td><td>79 ± 15.3 (48–116)</td></tr><tr><td>Body mass index, kg/m² (range)</td><td>27.0 ± 4.78 (16.0–41.7)</td></tr><tr><td>Symptoms</td><td>36 (75%)</td></tr><tr><td>Angina</td><td>28 (58%)</td></tr><tr><td>Dyspnoea</td><td>27 (56%)</td></tr><tr><td>Family history of cardiovascular disease</td><td>14 (29%)</td></tr><tr><td>Known CAD</td><td>24 (50%)</td></tr><tr><td>Previous myocardial infarction</td><td>15 (31%)</td></tr><tr><td>Received procedures</td><td>20 (42%)</td></tr><tr><td>Coronary artery bypass graft surgery</td><td>5 (10%)</td></tr><tr><td>Percutaneous coronary intervention</td><td>17 (35%)</td></tr><tr><td>Hypercholesterolaemia</td><td>29 (60%)</td></tr><tr><td>Arterial hypertension</td><td>38 (79%)</td></tr><tr><td>Diabetes mellitus</td><td>10 (21%)</td></tr><tr><td>Currently smoking or ex-smoker</td><td>28 (58%)</td></tr><tr><td colspan="2"><strong>Hemodynamics at rest</strong></td></tr><tr><td>Heart rate, beats/min (range)</td><td>76 ± 17.0 (49–135)</td></tr><tr><td>Systolic blood pressure, mm Hg (range)</td><td>136 ± 22.3 (94–212)</td></tr><tr><td>Diastolic blood pressure, mm Hg (range)</td><td>71 ± 13.3 (46–110)</td></tr><tr><td>Rate pressure product, mm/min (range)</td><td>10,400 ± 2870 (6000–18,900)</td></tr><tr><td colspan="2"><strong>Hemodynamics at pharmacological stress</strong></td></tr><tr><td>Heart rate, beats/min (range)</td><td>85 ± 15.6* (48–135)</td></tr><tr><td>Systolic blood pressure, mm Hg (range)</td><td>131 ± 21.1† (70–183)</td></tr><tr><td>Diastolic blood pressure, mm Hg (range)</td><td>68 ± 15.1† (30–115)</td></tr><tr><td>Rate pressure product, mm/min (range)</td><td>11,200 ± 2870‡ (6100–21,600)</td></tr></tbody></table>

Values are n (%) or arithmetic mean ± SD

*p* < 0.001 vs. rest; †p < 0.05 vs. rest; ‡p < 0.01

corresponding median, while at the segmental level, 90% of the differences did not exceed 9%. Only 1 out of 102 comparisons, again in segment 14, was over the adequate agreement limit—23.5% of the median value. Still, the ICC was 0.95.

# Discussion

We evaluated the interobserver agreement of PET MPQ for the most widely used tracer—Rb-82—using Carimas SP. Different operators analyzed the data from 48 scanned patients with suspected or known CAD in four centers. The observers had different levels of experience with the software—from an observer who learned Carimas to analyze
<table><caption>Table 2 MBF and MFR values</caption><thead><tr><th rowspan="2"></th><th colspan="3">Rest MBF</th><th colspan="3">Stress MBF</th><th colspan="3">MFR</th></tr><tr><th>OBS_1</th><th>OBS_2</th><th>OBS_3</th><th>OBS_4</th><th>OBS_1</th><th>OBS_2</th><th>OBS_3</th><th>OBS_4</th><th>OBS_1</th><th>OBS_2</th><th>OBS_3</th><th>OBS_4</th></tr></thead><tbody><tr><td>Global</td><td>1.11 ± 0.36</td><td>1.12 ± 0.39</td><td>1.12 ± 0.36</td><td>1.11 ± 0.36</td><td>2.38 ± 1.04</td><td>2.44 ± 1.12</td><td>2.48 ± 1.05</td><td>2.38 ± 1.07</td><td>2.18 ± 0.82</td><td>2.25 ± 0.92</td><td>2.27 ± 0.86</td><td>2.19 ± 0.85</td></tr><tr><td>LAD</td><td>1.12 ± 0.38</td><td>1.13 ± 0.41</td><td>1.14 ± 0.38</td><td>1.12 ± 0.38</td><td>2.31 ± 1.09</td><td>2.39 ± 1.16</td><td>2.51 ± 1.15</td><td>2.32 ± 1.12</td><td>2.10 ± 0.87</td><td>2.18 ± 0.94</td><td>2.25 ± 0.89</td><td>2.12 ± 0.88</td></tr><tr><td>LCx</td><td>1.08 ± 0.33</td><td>1.09 ± 0.34</td><td>1.09 ± 0.32</td><td>1.09 ± 0.33</td><td>2.30 ± 0.92</td><td>2.31 ± 0.96</td><td>2.30 ± 0.88</td><td>2.27 ± 0.93</td><td>2.17 ± 0.75</td><td>2.19 ± 0.81</td><td>2.15 ± 0.75</td><td>2.14 ± 0.73</td></tr><tr><td>RCA</td><td>1.16 ± 0.42</td><td>1.15 ± 0.43</td><td>1.11 ± 0.41</td><td>1.13 ± 0.42</td><td>2.86 ± 1.32</td><td>2.86 ± 1.42</td><td>2.82 ± 1.38</td><td>2.80 ± 1.38</td><td>2.54 ± 1.07</td><td>2.58 ± 1.16</td><td>2.58 ± 1.13</td><td>2.55 ± 1.12</td></tr><tr><td>Seg01</td><td>1.07 ± 0.31</td><td>1.07 ± 0.32</td><td>1.05 ± 0.32</td><td>1.05 ± 0.32</td><td>2.06 ± 0.65</td><td>2.10 ± 0.71</td><td>2.06 ± 0.64</td><td>2.07 ± 0.70</td><td>2.04 ± 0.72</td><td>2.09 ± 0.81</td><td>2.14 ± 0.90</td><td>2.10 ± 0.77</td></tr><tr><td>Seg02</td><td>1.11 ± 0.33</td><td>1.12 ± 0.35</td><td>1.10 ± 0.34</td><td>1.10 ± 0.34</td><td>2.34 ± 0.74</td><td>2.41 ± 0.87</td><td>2.36 ± 0.78</td><td>2.37 ± 0.85</td><td>2.21 ± 0.72</td><td>2.25 ± 0.76</td><td>2.29 ± 0.83</td><td>2.24 ± 0.73</td></tr><tr><td>Seg03</td><td>1.21 ± 0.41</td><td>1.18 ± 0.41</td><td>1.12 ± 0.40</td><td>1.17 ± 0.41</td><td>2.92 ± 1.16</td><td>2.90 ± 1.32</td><td>2.76 ± 1.26</td><td>2.84 ± 1.26</td><td>2.54 ± 0.96</td><td>2.54 ± 0.99</td><td>2.54 ± 1.07</td><td>2.54 ± 1.01</td></tr><tr><td>Seg04</td><td>0.97 ± 0.36</td><td>0.97 ± 0.36</td><td>0.90 ± 0.34</td><td>0.95 ± 0.37</td><td>2.40 ± 1.10</td><td>2.35 ± 1.17</td><td>2.17 ± 1.28</td><td>2.37 ± 1.19</td><td>2.61 ± 1.17</td><td>2.53 ± 1.17</td><td>2.39 ± 1.17</td><td>2.59 ± 1.21</td></tr><tr><td>Seg05</td><td>0.96 ± 0.31</td><td>0.97 ± 0.32</td><td>0.94 ± 0.30</td><td>0.97 ± 0.31</td><td>2.14 ± 0.94</td><td>2.11 ± 0.95</td><td>1.99 ± 0.87</td><td>2.15 ± 0.97</td><td>2.28 ± 0.88</td><td>2.22 ± 0.88</td><td>2.13 ± 0.83</td><td>2.26 ± 0.86</td></tr><tr><td>Seg06</td><td>1.06 ± 0.31</td><td>1.10 ± 0.32</td><td>1.06 ± 0.30</td><td>1.07 ± 0.31</td><td>2.08 ± 0.76</td><td>2.12 ± 0.77</td><td>2.05 ± 0.70</td><td>2.10 ± 0.79</td><td>2.01 ± 0.66</td><td>2.03 ± 0.73</td><td>2.02 ± 0.72</td><td>2.02 ± 0.67</td></tr><tr><td>Seg07</td><td>1.24 ± 0.37</td><td>1.22 ± 0.41</td><td>1.26 ± 0.36</td><td>1.23 ± 0.38</td><td>2.39 ± 0.86</td><td>2.40 ± 0.95</td><td>2.51 ± 0.89</td><td>2.40 ± 0.89</td><td>2.03 ± 0.79</td><td>2.08 ± 0.84</td><td>2.11 ± 0.80</td><td>2.05 ± 0.77</td></tr><tr><td>Seg08</td><td>1.31 ± 0.44</td><td>1.33 ± 0.48</td><td>1.34 ± 0.42</td><td>1.32 ± 0.44</td><td>2.72 ± 1.08</td><td>2.87 ± 1.20</td><td>3.03 ± 1.19</td><td>2.85 ± 1.17</td><td>2.17 ± 0.83</td><td>2.26 ± 0.85</td><td>2.35 ± 0.85</td><td>2.23 ± 0.79</td></tr><tr><td>Seg09</td><td>1.35 ± 0.48</td><td>1.32 ± 0.49</td><td>1.28 ± 0.45</td><td>1.31 ± 0.47</td><td>3.20 ± 1.34</td><td>3.28 ± 1.49</td><td>3.28 ± 1.46</td><td>3.18 ± 1.42</td><td>2.46 ± 0.95</td><td>2.58 ± 1.08</td><td>2.65 ± 1.08</td><td>2.52 ± 1.03</td></tr><tr><td>Seg10</td><td>1.17 ± 0.44</td><td>1.15 ± 0.46</td><td>1.12 ± 0.43</td><td>1.13 ± 0.43</td><td>2.99 ± 1.44</td><td>2.93 ± 1.51</td><td>2.84 ± 1.39</td><td>2.85 ± 1.46</td><td>2.67 ± 1.24</td><td>2.69 ± 1.30</td><td>2.61 ± 1.18</td><td>2.63 ± 1.25</td></tr><tr><td>Seg11</td><td>1.11 ± 0.37</td><td>1.11 ± 0.38</td><td>1.11 ± 0.36</td><td>1.11 ± 0.37</td><td>2.59 ± 1.17</td><td>2.56 ± 1.19</td><td>2.54 ± 1.12</td><td>2.48 ± 1.11</td><td>2.42 ± 1.05</td><td>2.39 ± 1.06</td><td>2.32 ± 0.91</td><td>2.32 ± 0.98</td></tr><tr><td>Seg12</td><td>1.19 ± 0.35</td><td>1.20 ± 0.38</td><td>1.22 ± 0.34</td><td>1.20 ± 0.35</td><td>2.42 ± 0.93</td><td>2.42 ± 0.97</td><td>2.46 ± 0.90</td><td>2.39 ± 0.92</td><td>2.09 ± 0.70</td><td>2.11 ± 0.77</td><td>2.08 ± 0.69</td><td>2.05 ± 0.66</td></tr><tr><td>Seg13</td><td>1.11 ± 0.37</td><td>1.11 ± 0.42</td><td>1.16 ± 0.37</td><td>1.13 ± 0.38</td><td>2.21 ± 1.00</td><td>2.26 ± 1.10</td><td>2.37 ± 1.05</td><td>2.23 ± 1.05</td><td>2.05 ± 0.91</td><td>2.11 ± 0.99</td><td>2.12 ± 0.97</td><td>2.05 ± 0.96</td></tr><tr><td>Seg14</td><td>1.25 ± 0.52</td><td>1.29 ± 0.58</td><td>1.32 ± 0.50</td><td>1.28 ± 0.51</td><td>2.65 ± 1.44</td><td>2.86 ± 1.53</td><td>3.17 ± 1.62</td><td>2.78 ± 1.45</td><td>2.18 ± 1.01</td><td>2.31 ± 1.11</td><td>2.45 ± 1.08</td><td>2.25 ± 1.00</td></tr><tr><td>Seg15</td><td>1.21 ± 0.49</td><td>1.21 ± 0.53</td><td>1.19 ± 0.47</td><td>1.17 ± 0.46</td><td>3.00 ± 1.91</td><td>3.07 ± 1.88</td><td>3.19 ± 1.89</td><td>2.90 ± 1.70</td><td>2.52 ± 1.48</td><td>2.67 ± 1.70</td><td>2.75 ± 1.47</td><td>2.54 ± 1.42</td></tr><tr><td>Seg16</td><td>1.12 ± 0.37</td><td>1.11 ± 0.39</td><td>1.15 ± 0.36</td><td>1.12 ± 0.37</td><td>2.41 ± 1.17</td><td>2.42 ± 1.16</td><td>2.53 ± 1.11</td><td>2.33 ± 1.09</td><td>2.21 ± 0.98</td><td>2.26 ± 1.01</td><td>2.26 ± 0.93</td><td>2.14 ± 0.89</td></tr><tr><td>Seg17</td><td>1.09 ± 0.43</td><td>1.13 ± 0.52</td><td>1.10 ± 0.44</td><td>1.08 ± 0.40</td><td>2.34 ± 1.38</td><td>2.41 ± 1.41</td><td>2.53 ± 1.42</td><td>2.26 ± 1.28</td><td>2.18 ± 1.05</td><td>2.24 ± 1.17</td><td>2.32 ± 1.01</td><td>2.13 ± 1.01</td></tr></tbody></table>

Values are means ± SD (n=48)

<figure><img src="image_5.png" /></figure>
<figure><img src="image_6.png" /><figcaption>**Fig. 2** Cross-comparison biplot for MBF and MFR values: **A** on global and regional levels, **B** on the segmental level. The X axis is the difference in MBF and MFR values presented as a percentage of the corresponding median; the Y axis is 1-ICC. The x range of the green outline represents ±20% of the median value for Rb-82 cross-comparisons; the y range—ICC values over 0.75. The green rectangle encompasses the area of excellent agreement. The chart element is the compared area (e.g., s14) and an ordinal number of the six comparisons from 1 to 6</figcaption></figure>

these data to observers routinely using it. Notwithstanding, the results were highly reproducible at every level of analysis—global, regional, and segmental—for all the obtained perfusion estimates (rest MBF, stress MBF, and MFR).

Our study's particular feature was the level range achieved by evaluating perfusion estimates' reproducibility at all segmentation levels. Researchers who have cross-compared myocardial PET SPs avoided the segmental level, except for our group's studies using O-15 water [7] and C-11 acetate [8]. However, averaging multiple segments in a single vascular territory underestimates visually discernible perfusion defects, making segmental analysis clinically relevant. Therefore, to envision the “clinical reality” of MPQ, we cannot bypass this level—it simply provides us with more information on the myocardium. Also, as shown by Berti et al. [19], the assessment of absolute myocardial perfusion parameters measured at a segment level leads to reliable and accurate identification of patients with significant coronary stenosis at invasive coronary angiography (ICA) and/or coronary computed tomography angiography (CCTA).

In this study, the interobserver differences for MBF and MFR values were less than the predefined 20%: the majority (90%) were <4.5% for segmental rest MBF, <9% for

segmental stress MBF, and <6% for segmental MFR. These differences were smaller than the corresponding segmental differences reported previously in the RUBY-10 project [3] (90% of those differences <25% for segmental rest MBF, 32% for segmental stress MBF, and 16.5% for segmental MFR), which utilized the same patient set and also implemented the 1TCM [11] to investigate the agreement across eight different SPs. Therefore, this study's excellent agreement might originate from the uniformity of observer-independent processes in the Carimas SP, such as image reorientation or segmentation.

We know that SPs vary in operator interaction and manipulation necessary for the adequate reconstruction and, therefore, for reliable MPQ. Some SPs like QPET and Syngo MBF require minimal observer interaction; others like PMOD and Carimas assume more manual adjustment in the alignment and border detection of the observer to provide accurate MPQ. There hardly can be a winner here yet. Although the current capabilities of machines allow for the complete automatization of many processes and results would likely be congruent, such automatization of the analysis process would necessarily pose a new question: who will be liable for the diagnosis? Machines cannot be, so human
observers will want a possibility to interfere with the analy-
sis process. And by doing so, they will bring their sources
of possible discrepancies.

Further research into the interobserver reproducibility
of MPQ across different SPs might be enlightening. How-
ever, we can already speculate that intra-SP reproducibility
will generally be higher than between SPs (considering our
results and the results from the RUBY-10 together).

Currently, we can suggest that if clinical analysts use
Carimas for Rb-82 PET MPQ, they can safely assume that
their results will be reproducible.

Limitations

The limitation of this study is the absence of a gold standard,
so we cannot claim, in this paper, the quantitative accuracy
of Carimas SP. Yet, the study's goal was to assess the repro-
ducibility and not accuracy regarding absolute values.

We did not study the software agreement as a function
of types of CAD or degrees of its severity. We reflected
this limitation in the title, and the paper itself, calling the
agreement we received “good” and not “excellent.” How-
ever, technically, the resulting level of agreement could have
been termed "excellent."

We used only Rb-82 data from one center, acquired on
one scanner, reconstructed with one algorithm. We do not
consider it a limitation, because introducing these new vari-
ables into our combinatorial study would have led to the
project's practical impossibility.

We treat the imminent need for standardization in PET
MPQ in several papers [4, 6, 20].

New knowledge gained

Interobserver agreement on the segmental level can be good for Rb-82 PET MPQ.

Conclusions

Interobserver agreement for Rb-82 PET myocardial perfu-
sion quantification analyzed with Carimas is good at any LV
segmentation level—global, regional, and segmental. It is
good for all the estimates—rest MBF, stress MBF, and MFR.

**Funding** Open Access funding provided by University of Turku (UTU) including Turku University Central Hospital. The salary of the corresponding author came from the University of Turku, Finland.

**Availability of data and materials** In CHUV, Lausanne, Switzerland.

Declarations

**Conflict of interest** None.

**Ethics approval** Acquired.

**Consent to participate** Acquired.

**Consent for publication** Acquired.

**Code availability** Carimas is not an open-source software.

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

References

1. Saraste A, Kajander S, Han C, Nesterov SV, Knuuti J. PET: is myocardial flow quantification a clinical reality? J Nucl Cardiol. 2012;19(5):1044–59.

2. Sciagrà R, Lubberink M, Hyafil F, Saraste A, Slart RHJA, Agostini D, et al. EANM procedural guidelines for PET/CT quantitative myocardial perfusion imaging. Eur J Nucl Med Mol Imaging. 2020. https://doi.org/10.1007/s00259-020-05046-9.

3. Nesterov SV, Deshayes E, Sciagrà R, Settimo L, Declerck JM, Pan X-B, et al. Quantification of myocardial blood flow in absolute terms using 82Rb PET imaging. JACC Cardiovasc Imaging. 2014;7(11):1119–27.

4. Nesterov SV, Knuuti J. How accurate is the accuracy? J Nucl Cardiol Off Publ Am Soc Nucl Cardiol. 2018. https://doi.org/10.1007/s12350-018-01537-3.

5. Zampella E, Assante R, Acampa W, Cuocolo A. Cardiac PET imaging: Lost in quantification. It's time to find the way. J Nucl Cardiol Off Publ Am Soc Nucl Cardiol. 2020. https://doi.org/10.1007/s12350-020-02332-9.

6. Nesterov SV, Knuuti JM. 82Rb-PET MPQ: Do normal values exist? J Nucl Cardiol. 2020. https://doi.org/10.1007/s12350-020-02362-3.

7. Nesterov SV, Han C, Mäki M, Kajander S, Naum AG, Helenius H, et al. Myocardial perfusion quantitation with 15O-labelled water PET: high reproducibility of the new cardiac analysis software (Carimas™). Eur J Nucl Med Mol Imaging. 2009;36(10):1594–602.

8. Nesterov SV, Turta O, Han C, Maki M, Lisinen I, Tuunanen H, Knuuti J. C-11 acetate has excellent reproducibility for quantification of myocardial oxidative metabolism. Eur Heart J Cardiovasc Imaging. 2015;16(5):500–6.

9. Nesterov SV, Sciagrà R, Juarez Orozco L, Prior JO, Settimo L, Han C, Deshayes E, DeKemp RA, Ryzhkova DV, Gwet KL, Knuuti JM. One-tissue compartment model for myocardial
perfusion quantification with N-13 ammonia PET provides matching results—a cross-comparison between Carimas, Flow-Quant, and PMOD. J Nucl Cardiol. 2021. https://doi.org/10.1007/s12350-021-02741-4.

10. Prior JO, Allenbach G, Valenta I, et al. Quantification of myocardial blood flow with 82Rb positron emission tomography: clinical validation with 15O-water. Eur J Nucl Med Mol Imaging. 2012;39(6):1037–47.

11. Lortie M, Beanlands RSB, Yoshinaga K, Klein R, Dasilva JN, deKemp RA. Quantification of myocardial blood flow with 82Rb dynamic PET imaging. Eur J Nucl Med Mol Imaging. 2007;34(11):1765–74.

12. Cerqueira MD, Weissman NJ, Dilsizian V, Jacobs AK, Kaul S, Laskey WK, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. Circulation. 2002;105(4):539–42.

13. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.

14. Davis CS. Statistical methods for the analysis of repeated measurements. New York: Springer; 2003.

15. Efseaff M, Klein R, Ziadi MC, Beanlands RS, deKemp RA. Short-term repeatability of resting myocardial blood flow measurements using rubidium-82 PET imaging. J Nucl Cardiol Off Publ Am Soc Nucl Cardiol. 2012;19(5):997–1006. https://doi.org/10.1007/s12350-012-9600-3.13.

16. Kitkungvan D, Johnson NP, Roby AE, Patel MB, Kirkeeide R, Gould KL. Routine clinical quantitative rest stress myocardial perfusion for managing coronary artery disease: clinical relevance of test-retest variability. JACC Cardiovasc Imaging. 2017;10:565–77. https://doi.org/10.1016/j.jcmg.2016.09.019.

17. Rosner B. Fundamentals of biostatistics. 7th ed. Boston: Brooks/Cole, Cengage Learning; 2011.

18. Gewirtz H. How close is close enough? JACC Cardiovasc Imaging. 2014;7(11):1128–9. https://doi.org/10.1016/j.jcmg.2014.09.001.

19. Berti V, Sciagrà R, Neglia D, Pietilä M, Scholte AJ, Nekolla S, et al. Segmental quantitative myocardial perfusion with PET for the detection of significant coronary artery disease in patients with stable angina. Eur J Nucl Med Mol Imaging. 2016;43(8):1522–9. https://doi.org/10.1007/s00259-016-3362-0.

20. Nesterov SV, Lee BC, Moody JB, Slomka P, Han C, Knuuti JM. The status and future of PET myocardial blood flow quantification software. Ann Nucl Cardiol. 2016;2(1):106–10. https://doi.org/10.17996/ANC.02.01.106.

**Publisher's Note** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.