# Performance of baseline FDG-PET/CT radiomics for prediction of bone marrow minimal residual disease status in the LyMa-101 trial

Caroline Bodet-Milin, Cyrille Morvant, Thomas Carlier, Gauthier Frecon, Olivier Tournilhac, Violaine Safar, Françoise Kraeber-Bodéré, Steven Le Gouill, Élizabeth A. Macintyre, Clément Bailly

<figure><img src="image_1.png" /></figure>

## ► To cite this version:

Caroline Bodet-Milin, Cyrille Morvant, Thomas Carlier, Gauthier Frecon, Olivier Tournilhac, et al. Performance of baseline FDG-PET/CT radiomics for prediction of bone marrow minimal residual disease status in the LyMa-101 trial. Scientific Reports, 2023, 13 (1), 10.1038/s41598-023-45215-y. hal-04271275

HAL Id: hal-04271275

https://hal.science/hal-04271275v1

Submitted on 14 Nov 2023

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons CC BY 4.0 - Attribution - International License
<figure><img src="image_3.png" /></figure>

OPEN

# Performance of baseline FDG-PET/CT radiomics for prediction of bone marrow minimal residual disease status in the LyMa-101 trial

Caroline Bodet-Milin<sup>1,2</sup>, Cyrille Morvant<sup>1,2</sup>, Thomas Carlier<sup>1,2</sup>, Gauthier Frecon<sup>2</sup>, Olivier Tournilhac<sup>3</sup>, Violaine Safar<sup>4</sup>, Françoise Kraeber-Bodere<sup>1,2</sup>, Steven Le Gouill<sup>1,5</sup>, Elizabeth Macintyre<sup>6</sup> & Clément Bailly<sup>1,2,✉</sup>

The prognostic value of <sup>18</sup>F-Fluorodeoxyglucose positron emission tomography/computed tomography (FDG-PET/CT) at baseline or the predictive value of minimal residual disease (MRD) detection appear as potential tools to improve mantle cell lymphoma (MCL) patients' management. The LyMa-101, a phase 2 trial of the LYSA group (ClinicalTrials.gov:NCT02896582) reported induction therapy with obinutuzumab, a CD20 monoclonal antibody. Herein, we investigated the added prognostic value of radiomic features (RF) derived from FDG-PET/CT at diagnosis for MRD value prediction. FDG-PET/CT of 59 MCL patients included in the LyMa-101 trial have been independently, blindly and centrally reviewed. RF were extracted from the disease area with the highest uptake and from the total metabolic tumor volume (TMTV). Two models of machine learning were used to compare several combinations for prediction of MRD before autologous stem cell transplant consolidation (ASCT). Each algorithm was generated with or without constrained feature selections for clinical and laboratory parameters. Both algorithms showed better discrimination performances for negative vs positive MRD in the lesion with the highest uptake than in the TMTV. The constrained use of clinical and biological features showed a clear loss in sensitivity for the prediction of MRD status before ASCT, regardless of the machine learning model. These data plead for the importance of FDG-PET/CT RF compared to clinical and laboratory parameters and also reinforced the previously made hypothesis that the prognosis of the disease in MCL patients is linked to the most aggressive contingent, within the lesion with the highest uptake.

The management of mantle cell lymphoma (MCL) has dramatically progressed with the use of autologous stem cell transplant consolidation (ASCT) and new targeted therapies<fnref n="1" />. The predictive value of minimal residual disease (MRD) detection, measuring the deepness of treatment response²,³ and the prognostic value of <sup>18</sup>F-Fluorodeoxyglucose positron emission tomography/computed tomography (FDG-PET/CT) at baseline⁴ appear as additional tools to improve MCL patients' management. A growing number of studies have focused on the extraction of a large amount of quantitative data from multimodal medical images, often referred to as "textural features" or "radiomics". A few studies have successfully explored the potential combination of these metrics with clinical data in MCL patients⁵,⁶. As shown in the prospective LyMA-PET study and supported in a work by Mayerhoefer et al., combining radiomic features (RF) with bio-clinical scores can potentially improve risk stratification. All of these efforts provide the groundwork for future studies exploring the value of RF in PET imaging. In this regard, the multicentric LyMa-101, a phase 2 trial of the LYSA group (ClinicalTrials.gov, NCT02896582) reported the success of an induction therapy with obinutuzumab plus DHAP (dexamethasone, high-dose cytarabine, cisplatin), on MRD status in the bone marrow after four cycles⁷. In the LyMa-101 study, obinutuzumab appeared as a valuable antiCD20 antibody alternative to Rituximab in patients with mantle-cell

<footnote n="1">¹Université de Nantes, CHU Nantes, CNRS, Inserm, CRCINA, 44000 Nantes, France. ²Nuclear Medicine Unit, University Hospital, 44093 Nantes, France. ³Haematology and Cell Therapy Department, Hôpital Estaing, CHU de Clermont-Ferrand, Clermont-Ferrand, France. ⁴Department of Hematology, Hospices Civils de Lyon, Lyon Sud Hospital, Pierre-Bénite, France. ⁵Institut Curie, Paris and Saint-Cloud, Université Versailles-Saint Quentin, Saint-Cloud, France. ⁶Onco-Haematology, Université de Paris, Hôpital and Institut Necker-Enfants Malades, Assistance-Publique-Hôpitaux de Paris, INSERM U1151, Paris, France. ⁷email: clement.bailly@chu-nantes.fr</footnote>
lymphoma who are eligible for frontline transplantation. This work has also highlighted the interest of early surrogate markers, such as MRD to detect patients responding poorly to chemotherapy and who might therefore benefit from alternative approaches at a much earlier stage. The aim of our study was to investigate in this cohort the potential added prognostic value of RF derived from FDG-PET/CT at diagnosis for MRD prediction at the end of induction.

## Materials and methods

Baseline FDG-PET/CT of MCL patients were retrieved and independently, blindly and centrally reviewed. FDG-PET/CT images were acquired according to local protocols and following the rules of good practice. FDG-PET/CT images were analysed on a dedicated workstation (PLANET®Onco-Solution, Dosisoft, France). The Fuzzy Local Adaptive Bayesian (FLAB) approach was used for volume segmentation⁸. RF were extracted from the disease area with the highest uptake and from the total metabolic tumor volume (TMTV) using the IBSI compliant PyRadiomics framework with two different methods of quantization (linear using 64 bins and absolute using fixed bins of 0.3 SUV). The first step was dedicated to select the most robust RF with respect to randomness. For this purpose, RF were first tested by shuffling 50 times the signal within the disease area segmentation and non-contributive ones (i.e. identical results within 2 × 1,96σ over 50 iterations) were excluded⁹. In a second step, RF (including the conventional FDG-PET/CT features: SUVmax, total metabolic volume, total lesion glycolysis and SUVmax gradient (calculated as the difference between SUVmax and the pathological focus with minimal activity for each patient)) were further selected using the Maximum-Relevance-Minimum-Redundancy (MRMR) and normalized taking into account outliers. Two models of machine learning (support vector machine (SVC) and Ridge logistic regression (LR Ridge)) were assessed. A leave-one-out cross validation (LOOCV) on the training set was performed to select the hyperparameters. Several combinations for prediction of bone marrow MRD before ASCT were considered. Briefly, each algorithm was generated with or without constrained feature selections for clinical and laboratory parameters (age, sex, ECOG performance status, White Blood Count (WBC), Lactate Deshydrogenase level (LDH), MIPI score, Ann Arbor stage and blastoid variant)¹⁰. This step was repeated using the ten most important RF according to MRMR and extracted from the disease area with the highest uptake and from the TMTV. Consequently, four different models were analysed. The discrimination performance of the models was evaluated by comparing the areas under receiver operator characteristic (ROC) curves (AUC). The imbalanced datasets property was considered through the use of SMOTENC and the pipeline was repeated five times to derive the results variability. SMOTENC (Synthetic Minority Over-sampling Technique for Nominal and Continuous variables) is an extension of SMOTE for dataset containing continuous and categorical variables. The aim is to handle the minority class by oversampling in the context of imbalance dataset. The study was approved by Ouest VI (Brest, France) Ethics Committee, in accordance with the Declaration of Helsinki and Guidelines for Good Clinical Practice. All patients gave written informed consent. A general graphical representation of the Materials and methods section is shown in Supplementary Fig. 1.

## Results

During the course of the LyMa-101 study, 86 patients were enrolled and 67 patients had MRD assessment at the end of induction, corresponding to the primary endpoint, quantified by quantitative PCR. Baseline FDG-PET/CT data were available for 59 patients of them. These patients did not statistically differ than the rest of LyMa-101 population in terms of baseline characteristics, follow-up and outcome (Table 1). In our cohort, 11 patients (19%) were MRD-positive and 48 (81%) reached MRD negativity by the end of induction, before ASCT.

LR Ridge with or without constrained clinical and biological data showed AUCs of up to 0.63 and 0.82 for negative vs positive MRD in the lesion with the highest uptake and 0.53 and 0.64 in the TMTV (Fig. 1a). SVC with or without constrained clinical and biological data showed AUCs of up to 0.73 and 0.80 for negative vs positive MRD in the lesion with the highest uptake and 0.51 and 0.62 in the TMTV (Fig. 1b). Furthermore, the constrained use of clinical and biological features showed a clear loss in sensitivity and specificity for the prediction of MRD status before ASCT, regardless of the machine learning model (Fig. 2). Of note, no conventional PET parameters remained among the ten most important PET-derived features selected after MRMR.

## Discussion

Despite the limited sample size, a number of relevant conclusions can be drawn from our findings. First, this study reinforced the previously made hypothesis that the prognosis of the disease in MCL patients is linked to the most aggressive contingent¹¹, within the lesion with the highest uptake, the performance of the models based on the TMTV appearing inferior. Despite a prognostic value described in other non-Hodgkin lymphomas¹² and in one MCL study¹³, FDG-PET/CT calculation of total tumor volume load does not seem to be of interest in this subtype of lymphoma. This might be explained by the frequent splenic involvement in MCL, sometimes massive, and which is not systematically associated with a poorer prognosis¹⁰ but responsible of important metabolic volumes and thus large inter-individual variability. Second, as already demonstrated⁵,⁶,¹⁴, these data plead for the importance of RF in MCL patients. In our work, whether the models were operator-supervised with imposed clinical features commonly known for their high prognostic value, or whether the models were free to determine all features based on their importance, all selected features were RF. They outperformed classical FDG-PET/CT features and were of higher importance than all clinical and biological features. These results are slightly different from the data published by Mayerhoefer et al. in which the combination of ECOG performance status, WBC, LDH level and Ki-67 index to the radiomic signature significantly increased 2-years progression free survival (PFS) prediction⁶. In their study, RFs were extracted from the TMTV which explains probably the discrepancies. It should be noted, however, that this study considered PFS as an endpoint, whereas we assessed the impact of these features on MRD, an indirect surrogate of survival.
<table><caption>**Table 1.** Demographical and bio-clinical characteristics.</caption><thead><tr><th>Characteristics</th><th>Study population (n=59)</th><th>LyMa-101 population (n=86)</th></tr></thead><tbody><tr><td>Median age (years)</td><td>54.9 (32-65)</td><td>58 (51-62)</td></tr><tr><td>Sex</td><td></td><td></td></tr><tr><td>Male</td><td>41 (69%)</td><td>63 (73%)</td></tr><tr><td>Female</td><td>18 (31%)</td><td>23 (27%)</td></tr><tr><td>Performance status (ECOG)</td><td></td><td></td></tr><tr><td>0</td><td>39 (66%)</td><td>55 (64%)</td></tr><tr><td>1</td><td>19 (32%)</td><td>27 (31%)</td></tr><tr><td>2</td><td>1 (2%)</td><td>4 (5%)</td></tr><tr><td>MIPI score</td><td></td><td></td></tr><tr><td>Low risk</td><td>34 (57%)</td><td>47 (55%)</td></tr><tr><td>Intermediate risk</td><td>15 (25%)</td><td>24 (28%)</td></tr><tr><td>High risk</td><td>10 (17%)</td><td>14 (16%)</td></tr><tr><td>Ki-67*</td><td></td><td></td></tr><tr><td>&gt; 30%</td><td>17 (29%)</td><td>29 (34%)</td></tr><tr><td>Blastoid variant</td><td>11 (19%)</td><td>15 (17%)</td></tr><tr><td>Ann Arbor stage</td><td></td><td></td></tr><tr><td>II</td><td>0</td><td>2 (2%)</td></tr><tr><td>III</td><td>3 (5%)</td><td>6 (7%)</td></tr><tr><td>IV</td><td>56 (95%)</td><td>78 (91%)</td></tr></tbody></table>

<figure><img src="image_4.png" /><figcaption>**Figure 1.** ROC curves for LR Ridge (a) and for SVC (b) according to the disease area considered for RF computation (hottest lesion or TMTV).</figcaption></figure>

Another particularity of our work regarding the literature is the use of bone marrow MRD rather than PFS or overall survival as our clinical endpoint, in contrast to many lymphoma studies that focused on prognostic features. This approach was selected in the LyMa-101 study because MCL is a relatively rare subtype of lymphoma, and thus more limited sample size and shorter follow-up times can be employed to achieve a suitable number of events. Several phase 2 or 3 prospective trials have reported the correlation between MRD and PFS supporting its use before ASCT for treatment management of MCL patients as a surrogate marker²,³ for long-term outcome. Moreover, MRD residual disease negativity in bone marrow is more difficult to achieve than in peripheral blood, allowing for a rigorous evaluation of treatment efficacy.

The main limitation of the current work is obviously the lack of an external test set to confirm the reported results and minimize the risk of overfitting. Given the relatively rare disease incidence, an LOOCV was used to account for the small dataset of the Lyma-101 study. The intuition reported in the current work needs to be confirmed by an external dataset using the same therapy strategy. Finally, the small number of patients per center involved in this multicentric study prevented the use of harmonisation techniques such as ComBat-like approaches¹⁵. Therefore, it was not considered in this study.

In conclusion, our results demonstrated the predictive value of initial FDG-PET/CT on bone marrow MRD after induction in the Lyma-101 study and the importance of FDG-PET/CT RF extracted from the lesion with the highest uptake compared to clinical and laboratory parameters. Although these metrics are not routinely
<figure><img src="image_5.png" /><figcaption>**Figure 2.** Impact of the use of clinical features on sensitivity (a) and specificity (b) for LR Ridge and SVC (disease area: hottest lesion).</figcaption></figure>

calculated, these data again show the value of FDG-PET imaging in MCL and the likely need to integrate radiomics into a personalized multi-technology treatment-risk profiling composite score. Further prospective investigations are warranted to confirm these observations.

## Data availability

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

Received: 14 April 2023; Accepted: 17 October 2023

Published online: 24 October 2023

## References

1. Dreyling, M. et al. Newly diagnosed and relapsed mantle cell lymphoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. *Ann. Oncol.* **28**, iv62–iv71 (2017).

2. Jung, D., Jain, P., Yao, Y. & Wang, M. Advances in the assessment of minimal residual disease in mantle cell lymphoma. *J. Hematol. Oncol.* **13**, 127 (2020).

3. Pott, C. et al. Molecular remission is an independent predictor of clinical outcome in patients with mantle cell lymphoma after combined immunochemotherapy: A European MCL intergroup study. *Blood* **115**, 3215–3223 (2010).

4. Bailly, C. et al. Interest of FDG-PET in the management of mantle cell lymphoma. *Front. Med.* **6**, 70 (2019).

5. Carlier, T. et al. Quantification of intratumor heterogeneity derived from baseline FDG PET/CT in untreated mantle cell lymphoma patients enrolled in a prospective phase III trial of the LYSA group: Preliminary results. *J. Nucl. Med.* **56**, 429–429 (2015).

6. Mayerhoefer, M. E. et al. Radiomic features of glucose metabolism enable prediction of outcome in mantle cell lymphoma. *Eur. J. Nucl. Med. Mol. Imaging* **46**, 2760–2769 (2019).

7. Gouill, S. L. et al. Molecular response after obinutuzumab plus high-dose cytarabine induction for transplant-eligible patients with untreated mantle cell lymphoma (LyMa-101): A phase 2 trial of the LYSA group. *Lancet Haematol.* **7**, e798-807 (2020).

8. Hatt, M., Cheze le Rest, C., Turzo, A., Roux, C. & Visvikis, D. A fuzzy locally adaptive Bayesian segmentation approach for volume determination in PET. *IEEE Trans. Med. Imaging* **28**, 881–93 (2009).

9. Pfaehler, E. et al. Plausibility and redundancy analysis to select FDG-PET textural features in non-small cell lung cancer. *Med. Phys.* **48**, 1226–1238 (2021).

10. Vose, J. M. Mantle cell lymphoma: 2017 update on diagnosis, risk-stratification, and clinical management. *Am. J. Hematol.* **92**, 806–813 (2017).

11. Bailly, C. et al. Prognostic value of FDG-PET in patients with mantle cell lymphoma: Results from the LyMa-PET Project. *Haematologica* **105**, e33–e36 (2020).

12. Al Tabaa, Y., Bailly, C. & Kanoun, S. FDG-PET/CT in lymphoma: Where do we go now?. *Cancers* **13**, 5222 (2021).

13. Albano, D. et al. Prognostic role of baseline 18F-FDG PET/CT metabolic parameters in mantle cell lymphoma. *Ann. Nucl. Med.* **33**, 449–458 (2019).

14. Liu, F. et al. Prognostic value of heterogeneity index derived from baseline 18F-FDG PET/CT in mantle cell lymphoma. *Front. Oncol.* **12**, 862473 (2022).

15. Xu, H. et al. Radiomics prognostic analysis of PET/CT images in a multicenter head and neck cancer cohort: Investigating ComBat strategies, sub-volume characterization, and automatic segmentation. *Eur. J. Nucl. Med. Mol. Imaging* **50**, 1720–1734 (2023).

## Acknowledgements

This work was supported by grants from the French National Agency for Research IRON Labex n° ANR-11-LABX-0018-0; INCa-DGOS-Inserm-12558 (SIRIC ILIAD); and ISITE NExT n° ANR-16-IDEX-0007.
**Author contributions**

S.L.G., E.M., C.B. and C.B.M. designed the experiments. All authors performed the study. T.C., G.F. and C.B. did the data post-processing and statistical analysis. G.F., T.C. and C.B. analyzed the data and composed the draft. All authors reviewed the manuscript and have given approval to its final version.

**Funding**

This work was supported by grants from the French National Agency for Research IRON Labex n° ANR-11-LABX-0018-0; INCa-DGOS-Inserm-12558 (SIRIC ILIAD); and ISITE NExT n° ANR-16-IDEX-0007.

**Competing interests**

The authors declare no competing interests.

**Additional information**

**Supplementary Information** The online version contains supplementary material available at https://doi.org/10.1038/s41598-023-45215-y.

**Correspondence** and requests for materials should be addressed to C.B.

**Reprints and permissions information** is available at www.nature.com/reprints.

**Publisher's note** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_6.png" /></figure>

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

© The Author(s) 2023