# Deep Learning for the Automatic Quantification of Pleural Plaques in Asbestos-Exposed Subjects

Ilyes Benlala, Baudouin Denis de Senneville, Gael Dournes, Morgane Menant, Celine Gramond, Isabelle Thaon, Benedicte Clin, Patrick Brochard, Antoine Gislard, Pascal Andujar, et al.

► To cite this version:

Ilyes Benlala, Baudouin Denis de Senneville, Gael Dournes, Morgane Menant, Celine Gramond, et al. Deep Learning for the Automatic Quantification of Pleural Plaques in Asbestos-Exposed Subjects. International Journal of Environmental Research and Public Health, 2022, 19 (3), pp.1417-1439. doi:10.3390/ijerph19031417. This article is licensed under a Creative Commons Attribution 4.0 International License.

HAL Id: hal-03610113

https://hal.science/hal-03610113

Submitted on 16 Mar 2022

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

Article

# Deep Learning for the Automatic Quantification of Pleural Plaques in Asbestos-Exposed Subjects

Ilyes Benlala<sup>1,2,3,*</sup>, Baudouin Denis De Senneville<sup>4</sup>, Gael Dournes<sup>1,2,3</sup>, Morgane Menant<sup>5</sup>, Celine Gramond<sup>5</sup>, Isabelle Thaon<sup>6</sup>, Bénédicte Clin<sup>7,8,†</sup>, Patrick Brochard<sup>1,9</sup>, Antoine Gislard<sup>10,11</sup>, Pascal Andujar<sup>12,13,14,15</sup>, Soizick Chammings<sup>15</sup>, Justine Gallet<sup>5</sup>, Aude Lacourt<sup>5</sup>, Fleur Delva<sup>5</sup>, Christophe Paris<sup>16,17</sup>, Gilbert Ferretti<sup>18,19,20</sup>, Jean-Claude Pairon<sup>12,13,14,15</sup> and François Laurent<sup>1,2,3</sup>

<figure><img src="image_3.png" /></figure>

check for
updates

**Citation:** Benlala, I.; De Senneville, B.D.; Dournes, G.; Menant, M.; Gramond, C.; Thaon, I.; Clin, B.; Brochard, P.; Gislard, A.; Andujar, P.; et al. Deep Learning for the Automatic Quantification of Pleural Plaques in Asbestos-Exposed Subjects. *Int. J. Environ. Res. Public Health* **2022**, *19*, 1417. https://doi.org/10.3390/ijerph19031417

Academic Editor: Paul B. Tchounwou

Received: 16 December 2021

Accepted: 23 January 2022

Published: 27 January 2022

**Publisher's Note:** MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_4.png" /></figure>

**Copyright:** © 2022 by the authors.
Licensee MDPI, Basel, Switzerland.
This article is an open access article
distributed under the terms and
conditions of the Creative Commons
Attribution (CC BY) license (https://
creativecommons.org/licenses/by/
4.0/).

**Abstract:** Objective: This study aimed to develop and validate an automated artificial intelligence (AI)-driven quantification of pleural plaques in a population of retired workers previously occupationally exposed to asbestos. Methods: CT scans of former workers previously occupationally exposed to asbestos who participated in the multicenter APEXS (Asbestos PostExposure Survey) study were collected retrospectively between 2010 and 2017 during the second and the third rounds of the survey. A hundred and forty-one participants with pleural plaques identified by expert radiologists at the 2nd and the 3rd CT screenings were included. Maximum Intensity Projection (MIP) with 5 mm thickness was used to reduce the number of CT slices for manual delineation. A Deep Learning AI algorithm using 2D-convolutional neural networks was trained with 8280 images from 138 CT scans of 69 participants for the semantic labeling of Pleural Plaques (PP). In all, 2160 CT images from 36 CT scans of 18 participants were used for AI testing versus ground-truth labels (GT). The clinical

<footnote n="1">¹ Faculté de Médecine, Université de Bordeaux, 33000 Bordeaux, France; gael.dournes@u-bordeaux.fr (G.D.); patrick.brochard@chu-bordeaux.fr (P.B.); francois.laurent@chu-bordeaux.fr (F.L.)</footnote>

<footnote n="2">² Service d'Imagerie Médicale Radiologie Diagnostique et Thérapeutique, CHU de Bordeaux, 33000 Bordeaux, France</footnote>

<footnote n="3">³ Centre de Recherche Cardio-Thoracique de Bordeaux, INSERM U1045, Université de Bordeaux, 33000 Bordeaux, France</footnote>

<footnote n="4">⁴ Mathematical Institute of Bordeaux (IMB), CNRS, INRIA, Bordeaux INP, UMR 5251, Université de Bordeaux, 33400 Talence, France; baudouin.denis-de-senneville@u-bordeaux.fr</footnote>

<footnote n="5">5 Epicene Team, Bordeaux Population Health Research Center, INSERM UMR 1219, Université de Bordeaux, 33000 Bordeaux, France; morgane.menant@u-bordeaux.fr (M.M.); celine.gramond@u-bordeaux.fr (C.G.); justine.gallet@u-bordeaux.fr (J.G.); aude.lacourt@inserm.fr (A.L.); fleur.delva@chu-bordeaux.fr (F.D.)</footnote>

<footnote n="6">6 Centre de Consultation de Pathologies Professionnelles, CHRU de Nancy, Université de Lorraine, 54000 Nancy, France; i.thaon@chru-nancy.fr</footnote>

<footnote n="7">7 Service de Santé au Travail et Pathologie Professionnelle, CHU Caen, 14000 Caen, France; clin-b@chu-caen.fr</footnote>

<footnote n="8">8 Faculté de Médecine, Université de Caen, 14000 Caen, France</footnote>

<footnote n="9">9 Service de Médecine du Travail et de Pathologies Professionnelles, CHU de Bordeaux, 33000 Bordeaux, France</footnote>

<footnote n="10">10 Faculté de Médecine, Normandie Université, UNIROUEN, UNICAEN, ABTE, 76000 Rouen, France; Antoine.Gislard@chu-rouen.fr</footnote>

<footnote n="11">11 Centre de Consultations de Pathologie Professionnelle, CHU de Rouen, CEDEX, 76031 Rouen, France</footnote>

<footnote n="12">12 Equipe GEIC20, INSERM U955, 94000 Créteil, France; pascal.andujar@inserm.fr (P.A.); jc.pairon@chicreteil.fr (J.-C.P.)</footnote>

<footnote n="13">13 Faculté de Santé, Université Paris-Est Créteil, 94000 Créteil, France</footnote>

<footnote n="14">14 Service de Pathologies Professionnelles et de l'Environnement, Centre Hospitalier Intercommunal Créteil, Institut Santé-Travail Paris-Est, 94000 Créteil, France</footnote>

<footnote n="15">15 Institut Interuniversitaire de Médecine du Travail de Paris-Ile de France, 94000 Créteil, France; soizick.chammings@iimtpif.fr</footnote>

<footnote n="16">16 Service de Santé au Travail et Pathologie Professionnelle, CHU Rennes, 35000 Rennes, France; christophe.paris@inserm.fr</footnote>

<footnote n="17">17 Institut de Recherche en Santé, Environnement et Travail, INSERM U1085, 35000 Rennes, France</footnote>

<footnote n="18">18 INSERM U 1209 IAB, 38700 La Tronche, France; gferretti@chu-grenoble.fr</footnote>

<footnote n="19">19 Domaine de la Merci, Faculté de Médecine, Université Grenoble Alpes, 38706 La Tronche, France</footnote>

<footnote n="20">20 Service de Radiologie Diagnostique et Interventionnelle Nord, CHU Grenoble Alpes, CS 10217, 38043 Grenoble, France</footnote>

<footnote>* Correspondence: ilyes.ben-lala@u-bordeaux.fr</footnote>

<footnote>† INSERM U1086 « ANTICIPE », 14000 Caen, France.</footnote>
validity of the method was evaluated longitudinally in 54 participants with pleural plaques. Results: The concordance correlation coefficient (CCC) between AI-driven and GT was almost perfect (>0.98) for the volume extent of both PP and calcified PP. The 2D pixel similarity overlap of AI versus GT was good (DICE = 0.63) for PP, whether they were calcified or not, and very good (DICE = 0.82) for calcified PP. A longitudinal comparison of the volumetric extent of PP showed a significant increase in PP volumes (*p* < 0.001) between the 2nd and the 3rd CT screenings with an average delay of 5 years. Conclusions: AI allows a fully automated volumetric quantification of pleural plaques showing volumetric progression of PP over a five-year period. The reproducible PP volume evaluation may enable further investigations for the comprehension of the unclear relationships between pleural plaques and both respiratory function and occurrence of thoracic malignancy.

**Keywords:** artificial intelligence; pleural plaques; asbestos exposure

# 1. Introduction

The association between occupational asbestos exposure and the increase in benign and malignant respiratory diseases has been demonstrated through several studies in the last decades [1]. Among these asbestos exposure manifestations, pleural plaques (PP) are the most frequent effects of such exposure [2–4]. Chest x-rays are widely used in the screening for respiratory diseases in the context of occupational asbestos exposure. However, computed tomography (CT) scans showed higher sensitivity and specificity for both pleural and parenchymal abnormalities [5]. Pleural plaques are localized, well-demarcated areas of thickening in the parietal pleura consisting of hyaline fibrosis [6,7]. They may have a smooth or irregular/nodular surface with the parenchyma, and they exhibit a soft-tissue attenuation with sometimes calcifications [1]. In France, workers are entitled to financial compensation and early retirement in the case of asbestos-related disease, including pleural plaques. Indeed, pleural plaques are considered as the hallmark of asbestos exposure, and their prevalence is correlated to several determinants of exposure [8]. Despite several studies, there is still some controversy about the issue of whether or not pleural plaques are responsible for respiratory function impairment [9–11]. Furthermore, studies [12,13] have suggested that PP might be an independent risk factor for malignancy in workers previously occupationally exposed to asbestos. However, the progression of PP extent has not been studied yet due to the lack of consensual quantitative methods. Few studies focused on quantifying PP extent either visually [9,14] or using manual/semi-automated methods [15–17]. These methods demonstrate fair to good reproducibility, but they are time-consuming and cumbersome.

In the last few years, Deep learning (DL) has been considered as the most reliable technique for medical image segmentation [18]. However, to the best of our knowledge, pleural plaques segmentation using DL has never been reported. Thus, using AI-driven PP segmentation may allow reproducible quantification of pleural plaques. This may help to further investigate relationships between asbestos exposure and benign and malignant respiratory diseases. Therefore, the objective of this study was to validate a novel fully automated quantitative method for PP evaluation based on DL.

# 2. Material and Methods

## 2.1. *Study Design*

This is a retrospective cohort study involving retired workers exposed to asbestos during their working life and without already compensated asbestos-related disease. The hospital ethics committee approved the study (CPPRB Paris-Cochin n°1946 (2002), CPP Ile De France III n°1946/11/02-02 (2010)). All participants received information about the study and gave their written informed consent.
## 2.2. Settings

Asbestos-Related Diseases COhort (ARDCO) is a French surveillance program where retired workers exposed to asbestos during their working life were included between October 2003 and December 2005 in four regions. They benefited from a free medical check-up, including chest CT scan and pulmonary function tests repeated every 5 years. Chest CT scans were sent to the regional coordinating centers and constituted the Asbestos Post EXposure Survey (APEXS) study.

## 2.3. Participants

The study analyses the second and third round of screening (collected in 2010 and 2017 respectively) since CT scans of the first round were of insufficient quality (5 mm slice thickness without high resolution CT acquisition and/or the digital format was missing). Finally, participants with pleural plaques identified by expert radiologists at the 2nd and the 3rd CT screenings were included (Figure 1).

<figure><img src="image_5.png" /><figcaption>**Figure 1.** Study Flow-Chart of selected patients with related Computed Tomography (CT). CT = computed tomography.</figcaption></figure>

## 2.4. Data

We extracted data from the APEXS survey, managed by Institut Interuniversitaire de Médecine du Travail de Paris-Ile de France, Créteil, France. Data contain patients' CT scans and characteristics (age: years; gender: Male/Female; smoking status: Never smoker/Ex-smoker/Current smoker; Asbestos exposure: Duration (years) and Time since first exposure (years); Related conditions on CT scans: Lung nodule/Asbestosis/Lung cancer).

## 2.5. Chest CT Scans Visual Analysis

To establish the diagnosis of pleural plaques, a consensus of three expert radiologists was used as previously reported [14]. Pleural plaques were defined according to the Fleischner society glossary of terms [19]. The thickness of PP was evaluated by classifying the most thickened plaque into four categories: <2 mm, 2–5 mm, 5–10 mm, and >10 mm. The extent of pleural plaques was classified into four categories according to the cumulative area of pleural plaques detected on each section and virtually reported on the single section at the level of the carina. The following thresholds were used: <1 cm length, between 1 cm and one-quarter of the perimeter of the hemithorax, between one-quarter and one-half of the perimeter of the hemithorax, more than one-half of the perimeter of the hemithorax. The number of PP was also reported according to three categories: equal to one; equal to two and more than two. The product of (the thickness x the cumulative area x number
of plaques) constituted the visual extent score of PP. The standardized readings were randomized, blinded to other experts' readings.

## 2.6. AI Training Framework

Briefly, trained thoracic radiologists blinded to the participants' characteristics have manually delineated pleural plaques on standard kernel reconstructed CT images in a random fashion. The manual segmentation was considered as the ground truth (GT). A pre-processing using thin maximum intensity projection (MIP) was used to limit the number of images for the manual segmentation. A five-millimeter slice thickness for MIP was used. Therefore, the number of chest CT slices decreased from 300 to 60 approximately.

A 2D-convolutional neural network (CNN) was trained utilizing the Training cohort. We used one single input channel (i.e., the CT image). We used the U-Net architecture presented in Figure S1 [20] which shown good performance for the segmentation of small regions [21,22]. To reduce memory consumption without impacting performance, we selected a basis of 24 filters of 3 × 3 − 24 for the first layer, 48 for the second and so on, as proposed in [23]. The loss function (L) was a combination of binary cross-entropy (L<sub>BCE</sub>) [24] and Dice loss (L<sub>DL</sub>) [25] which is demonstrated to be well suited for imbalanced structure segmentation [26]. L was defined as:

$$ 
\begin{aligned}
L &= L_{BCE} + L_{DL} \\
L_{BCE} &= -(y \log(\hat{y}) + (1 - y) \log(1 - \hat{y})) \\
L_{DL} &= 1 - \frac{2y\hat{y}+1}{y+\hat{y}+1}
\end{aligned}
$$

y and ˆy being the true and the predicted value of the CNN, respectively.

The following parameters were employed: input resolution = 512 × 512, batch size = 1, optimizer = Adam [27], learning rate = 0.001, epoch = 200, dropout = 0.5 after each block of the descending path, upsampling based on trilinear interpolation in the decoder, skip connections between encoder and decoder based on concatenation. To improve the ability for CNN to generalize, the training dataset was expanded through data augmentation (horizontal/vertical flips were applied during training). Our test platform was an Intel Xeon E5-2683 2.4 GHz equipped by a GPU Nvidia Tesla P100 with 16 GB of memory. Our implementation was done using Tensorflow 1.4 and Keras 2.2.4.

## 2.7. Test Cohort

2D-similarity and 3D-concordance assessments between AI-driven and GT test labels were performed. Calcified pleural plaques were identified by using a threshold of 100 Hounsfield units (HU) on the masks of PP, and their similarity and volume concordance was also assessed. A longitudinal comparison of PP volume progression was evaluated. Correlation with the visual extent score of PP was assessed.

## 2.8. Clinical Validation Cohort

Longitudinal paired-comparison analyses of PP volumes were performed. AI-driven PP volume quantification was performed on both native CT slices (slice thickness 1–1.25 mm), and MIP processed CT images. In addition, correlation with PP visual extent score was evaluated.

## 2.9. Reproducibility Assessment

AI-driven measurements were performed twice in the test cohort, while two observers blinded to any other data and the other observer labels, manually segmented a random subset of 20 CT exams. For intra-observer reproducibility, the subset of 20 CTs was re-segmented manually by the first observer a month later to avoid recall bias.
## 2.10. Statistical Analysis

Data were expressed as medians with a 95% confidence interval (CI). The similarity was assessed by calculating the balanced accuracy, Sorensen–DICE similarity coefficient (DICE), precision, and recall [28]. Concordance was assessed by concordance correlation coefficient (CCC) and Bland–Altman analysis [29]. Normality was evaluated using Shapiro–Wilk test. Spearman's rho coefficient assessed correlations. A comparison of paired-medians was made by the Wilcoxon-rank test. Correlation coefficients were classified as null (=0) to almost perfect (≥0.95) [30].

# 3. Results

## 3.1. Participants

The study population consisted of 141 asbestos-exposed participants with pleural plaques at both the second and the third screening rounds after excluding 20 participants with unreadable CD-ROMs (Figure 1). Eighty-seven participants constituted the semantic evaluation cohort. Stratified randomization based on the CT scanner models was used to split the original CT dataset into two non-overlapping groups [31], i.e., Train cohort (n = 8280 CT slices from 138 CT examinations of 69 participants) and independent Test cohort (n = 2160 CT slices from 36 CT examinations of 18 participants) without cross-validation. There were 13 CT models from four major manufacturers (Supplementary Table S1).

Finally, to independently evaluate the clinical relevance and validity of the AI-driven PP quantification, a clinical validation cohort was constituted (n = 54 participants).

Age, smoking status, asbestos exposure characteristics and related lung conditions are summarized in Table 1.

<table><caption>**Table 1.** Patients' characteristics of the 141 asbestos-exposed retired workers from the French Asbestos Related Diseases Cohort followed between 2010 and 2017 (all had pleural plaques on CT scan at both the second and third screening rounds).</caption><thead><tr><th></th><th></th><th>Training Cohort<br>(n = 69)</th><th>Test Cohort<br>(n = 18)</th><th>Clinical<br>Validation<br>Cohort<br>(n = 54)</th></tr></thead><tbody><tr><td rowspan="5">Age<br>Gender<br>Smoking status</td><td>Years</td><td>71 ± 4</td><td>71 ± 5</td><td>70 ± 4</td></tr><tr><td>Male/Female</td><td>68/1</td><td>18/0</td><td>54/0</td></tr><tr><td>Never smoker</td><td>14</td><td>5</td><td>18</td></tr><tr><td>Ex smoker</td><td>51</td><td>11</td><td>32</td></tr><tr><td>Current Smoker</td><td>4</td><td>2</td><td>4</td></tr><tr><td rowspan="2">Asbestos<br>exposure</td><td>Total duration<br>(y)</td><td>36 (34–38)</td><td>38 (35–39)</td><td>35 (33–37)</td></tr><tr><td>Time since first<br>exposure (y)</td><td>52 ± 5</td><td>53 ± 6</td><td>52 ± 4</td></tr><tr><td rowspan="3">Related<br>conditions</td><td>Lung nodule<br>(yes/no)</td><td>15/54</td><td>9/9</td><td>29/25</td></tr><tr><td>Asbestosis<br>(yes/no)</td><td>4/65</td><td>1/17</td><td>3/51</td></tr><tr><td>Lung cancer<br>(yes/no)</td><td>3/66</td><td>0/18</td><td>4/50</td></tr></tbody></table>

Data are means ± sd or medians (95% CI) for continuous variables and absolute value for categorical variables.

## 3.2. Similarity and Concordance of Test Cohort

Axial CT slices of the 36 CT examinations (n = 2160 slices) were shuffled randomly before being segmented by the 2D-CNN. The 2D pixel similarity overlap of AI versus GT
was good (DICE = 0.63). The similarity overlap for calcified pleural plaques was found very good (DICE = 0.82) (Figure 2, Table 2). The AI-driven PP volume segmentation's balanced accuracy for both PP and calcified PP was good to very good (0.78 and 0.90, respectively). (Table 2).

<figure><img src="image_6.png" /><figcaption>**Figure 2.** Axial MIP (5 mm) CT images of 80-year-old male. Left panel represents GT pleural plaques segmentation (green). Right panel represents AI pleural plaques segmentation (red). Note the different pleural plaques localization at three levels of the chest. Anterolateral PPs at the aortic arch level (A,B); Calcified PPs at the carina level (C,D) Posterolateral and diaphragmatic PPs at the lower chest (E,F). Legends: MIP = maximum intensity projection; CT = computed tomography; GT= ground truth; AI = artificial intelligence.</figcaption></figure>
<table><caption>**Table 2.** 2D pixel similarity and 3D volume concordance between AI-driven and Ground Truth in the Test cohort (18 patients).</caption><thead><tr><th></th><th>Pleural Plaques</th><th>Calcified Pleural Plaques</th></tr></thead><tbody><tr><td><strong>2D Pixel Similarity</strong></td><td></td><td></td></tr><tr><td><em>N</em> = 2160 axial CT slices</td><td></td><td></td></tr><tr><td><strong>Balanced Accuracy</strong></td><td>0.78</td><td>0.90</td></tr><tr><td><strong>DICE</strong></td><td>0.63</td><td>0.82</td></tr><tr><td><strong>Recall</strong></td><td>0.56</td><td>0.80</td></tr><tr><td><strong>Precision</strong></td><td>0.71</td><td>0.84</td></tr><tr><td><strong>3D Volume Extent (mL)</strong></td><td></td><td></td></tr><tr><td><em>N</em> = 36 CT scans</td><td></td><td></td></tr><tr><td><strong>Concordance:</strong></td><td>0.98</td><td>0.99</td></tr><tr><td>CCC (95% CI)</td><td>(0.96; 0.99)</td><td>(0.99; 0.99)</td></tr><tr><td><strong>Bland-Altman (mL):</strong></td><td>2.3</td><td>-0.3</td></tr><tr><td>Mean difference (LOA)</td><td>(-17.4; 22)</td><td>(-2.2; 1.6)</td></tr></tbody></table>

Legend: AI = artificial intelligence; CCC = concordance correlation coefficient; CI = confidence interval; LOA = limits of agreement.

After re-assigning CT slices to their initial examinations (*n* = 36 CTs), the 3D concordance between AI-driven volume calculations and GT labels was almost perfect for both PP and calcified PP (CCC > 0.98 95%CI: 0.96–0.99) (Table 2). At the Bland–Altman analysis, the mean difference between AI-driven volume and GT volume was small (less than 2.3 mL for PP and calcified PP) (Table 2).

### 3.3. *Correlations with Visual Pleural Plaques Extent Score*

There was a significant moderate correlation between the AI-driven PP volumetric quantification and the PP visual extent score in the test cohort (rho = 0.66, *p* < 0.001). The correlation coefficient was similar to that of the GT label (rho = 0.68, *p* < 0.001). Similarly, in the clinical validation cohort, there was a significant correlation between the AI-driven PP volume and the visual PP extent (rho = 0.56, *p* < 0.001).

### 3.4. *Longitudinal Comparison of Pleural Plaques Volume Progression*

In the clinical validation cohort, participants had a significant increase in AI-driven volumetric quantification of both PP and calcified PP between the second and the third rounds of CT screening (*p* < 0.001) (Figure 3, Table 3). The median differences were 5.71 mL (95%CI: 3.57–9.48) and 2.85 mL (95%CI: 1.62–7.76) for PP and calcified PP, respectively. The median percentage of the increase was 70% (95%CI: 38–123%) and 143% (95%CI: 85–230%) for PP and calcified PP, respectively. Similarly, in the test cohort, there was an increase in both AI-driven PP volume and GT PP volume between the two rounds of CT screening (*p* < 0.001). (Supplementary Table S2). There was also an increase in the visual extent score of PP between the two CT scans for both the test cohort and the clinical validation cohort (*p* = 0.003) (Supplementary Table S3).
<figure><img src="image_7.png" /><figcaption>**Figure 3.** CT images of 71 years-old male at the 2nd (left panel) and the 3rd (right panel) CT screening rounds. Note the increase in pleural plaques volume (E) 28.01 mL and (F) 49.25 mL), with the increase in calcifications (red arrows). (A,B) Axial native CT images (1 mm slice thickness); (C,D) Coronal native CT images; (E,F) 3D-volume rendering of CT images.</figcaption></figure>
<table><caption>**Table 3.** Longitudinal comparison of AI-driven pleural plaques quantification in the clinical validation cohort (n = 54 patients).</caption><thead><tr><th></th><th></th><th>CT<sup>2nd</sup></th><th>CT<sup>3rd</sup></th><th>p-Value</th></tr></thead><tbody><tr><td rowspan="2">AI-driven<br>quantification<br>Pleural Plaques (mL)</td><td>Median</td><td>7.1</td><td>12.1</td><td rowspan="2">&lt;0.001</td></tr><tr><td>95%CI</td><td>(4.4–11.5)</td><td>(9.8–16.9)</td></tr><tr><td rowspan="2">Calcified Pleural<br>Plaques (mL)</td><td>Median</td><td>1.3</td><td>3.5</td><td rowspan="2">&lt;0.001</td></tr><tr><td>95%CI</td><td>(0.6–2.6)</td><td>(2.2–5.3)</td></tr></tbody></table>

Legend: AI = artificial intelligence; CI = confidence interval; CTx = computed tomography at the 2nd or the 3rd screening round.

Moreover, there was no significant difference between AI-driven PP volume quantification using native CT images and thin MIP pre-processed CT images (Supplementary Table S4).

### 3.5. Reproducibility of Evaluation

As expected, the quantitative measurements of AI-driven segmentation had an almost perfect reproducibility when repeated twice in all 36 CT scans (2160 axial CT slices) of the Test cohort (DICE > 0.99) (Table 4). The similarity between manual segmentations performed by either the same observer or two independent observers was also assessed in a subset of 20 CTs (1200 axial CT slices). This additional evaluation showed a DICE coefficient of 0.72 and 0.75 for PP and calcified PP segmentations, respectively, in the inter-observer evaluation; and 0.87 and 0.89 in the intra-observer evaluation. The concordance correlation coefficients for the manual and AI-driven PP quantification were excellent (>0.98). (Table 4). In addition, the time requested to perform a manual GT was higher (i.e., a median time of 15 min) than that requested to perform AI-driven labeling (i.e., a median time of 18 s for thin MIP images and 90 s for native images).

<table><caption>**Table 4.** Reproducibility of AI and manual Pleural Plaques quantification.</caption><thead><tr><th></th><th colspan="2">Pleural Plaques</th><th colspan="2">Calcified Pleural Plaques</th></tr></thead><tbody><tr><td>Comparisons</td><td>2D<sup>1</sup></td><td>3D<sup>2</sup></td><td>2D<sup>1</sup></td><td>3D<sup>2</sup></td></tr><tr><td>AI vs. AI<br>(n = 2160 CT slices in 36 CT)</td><td>&gt;0.99</td><td>&gt;0.99 [0.99–1]</td><td>&gt;0.99</td><td>&gt;0.99 [0.99–1]</td></tr><tr><td>Manual<sub>1</sub> vs. Manual<sub>2</sub><br>(n = 1200 CT slices in 20 CT)</td><td>0.72</td><td>0.98 [0.95–0.99]</td><td>0.75</td><td>0.98 [0.95–0.99]</td></tr><tr><td>Manual<sub>1</sub> vs. Manual<sub>1</sub><br>(n = 1200 CT slices in 20 CT)</td><td>0.87</td><td>0.98 [0.97–0.99]</td><td>0.89</td><td>0.99 [0.97–0.99]</td></tr></tbody></table>

Legends: Manual<sub>1</sub> = segmentation performed by the first Observer; Manual<sub>2</sub> = segmentation performed by the second Observer; AI = artificial intelligence; CT=computed tomography. <sup>1</sup>2D pixel similarity (dice); <sup>2</sup>3D volume extent (ml) (CCC).

## 4. Discussion

This study shows that AI-driven quantitative measurement of pleural plaques is a reliable, fully automatic technique that can provide relevant information about pleural plaques progression in a population of retired workers previously occupationally exposed to asbestos. The method showed good similarity and very good concordance with manual segmentation of pleural plaques. Volumetric measurements of pleural plaques demonstrated a significant increase between two rounds of CT screening with an average delay of five years. In addition, the PP volume quantification showed a significant correlation with expert visual CT score of PP extent.

This study has some limitations. First, this was a retrospective first attempt to evaluate the novel method. Large prospective studies may bring more insights into pleural plaques
volume quantification and asbestos exposure. Second, detection of pleural plaques was out of scope since the diagnosis of pleural plaque presence is easily made by an expert radiologist in few seconds. However, using the same dataset, AI algorithms could be trained for detection tasks. Further evaluation using alternative strategies such as multiple CNNs with major voting [31], multiplane consensus labeling [32], or 3D AI algorithms [33] would be worth evaluating, albeit with a heavy computational burden. We used 2D-CNN to train the model in a slice-by-slice fashion to account for pleural plaque localization, or shape heterogeneity. Moreover, using CT slices as inputs, the Training dataset was large enough (8280 CT slices) for accurate development of the model [34]. Using 3D-CNN would limit the Training dataset in addition to the anisotropy due to the MIP pre-processing that may impede the generalizability of the model. Indeed, we demonstrated that by using 2D-CNN, PP segmentation was similar whether performed on native CT images or pre-processed 5 mm thin MIP images.

To the best of our knowledge, our study is the first that aimed to develop and validate AI-driven quantification of pleural plaques in a population of retired workers previously occupationally exposed to asbestos. Indeed, Sousa et al. [35] have reported a combination of CNN and support vector machines (SVM) classification based on 3D patch selection to detect pleural plaques without segmentation or quantitative measurement. They showed good to a very good Kappa for classifying 3D patches into pleural plaque or healthy tissue. However, their dataset was too small and heavily unbalanced, with 22% of CTs with pleural plaques (16/71), which may have led to overfitting.

Manual segmentation of pleural plaques could be a tedious and time-consuming task, which may have prevented the radiologists' community from tackling the issue of automatic quantification using DL. In this study, to facilitate manual segmentation, CT scans were pre-processed using maximum intensity projection. Therefore, the number of chest CT slices decreased from 300 to 60 approximatively. The rationale of using a thin MIP over a maximum of five slices (i.e., 5 mm of thickness) is that pleural plaques show attenuation values higher than the surrounding structures (i.e., lung, fat), which facilitate the detection and delineation of PP. On the contrary, the ribs, which are often in contact with PP, show a higher attenuation value. However, a MIP along five-millimeter of thickness would prevent the overlap of PP and costal structures. Moreover, with a thin MIP, partial volume artifacts at the pleura thoracic wall interfaces were limited, especially in non-vertical areas such as the diaphragm and the apices. In addition, we demonstrated that AI-driven pleural plaques volume derived from either native CT images or MIP pre-processed CT images was not different. In the last few years, we have evaluated semi-automated segmentation of pleural plaques [17] and showed very good reproducibility of the PP measurements. Nonetheless, since the semi-automated technique was based on a convex-hull algorithm, many false positives and false negatives occurred, and a substantial amount of manual editing was required. On the other hand, visual scoring of pleural plaques was extensively used in asbestos exposure studies showing good kappa coefficients for binary evaluations but with poor or moderate kappa coefficients for thickness or extent pleural plaques evaluations [14].

The use of DL in medical imaging in the last few years, allowed a giant leap of image segmentation with less and less of manual editing [18]. Indeed, with fine-tuning and the constant increase in medical imaging databases, CNNs will improve dramatically, leading to fully automated tasks performed by the machine.

In our study, an independent Testing cohort of 2160 CT slices was used, including the whole chest without preselecting a few slices with pleural plaques. Thus, this provided an extensive overview of the performance of the technique. We reported a DICE coefficient of 0.63 for PP segmentation, which represents a good overlap index, knowing that pleural plaques may have less than one millimeter of thickness and a very limited extent [36]. Indeed, the Dice coefficient is known to assign a lower score for very small structures involving few pixels with insufficient overlap [28]. Thus, any misclassified pixel would have decreased substantially the Dice similarity coefficient. Regarding calcified PP, the Dice coefficient was found very good (0.82), which may be related to relatively easy classification
of the calcified pixels by the model due to their high attenuation value. Since the Dice metric
does not include true negatives, CCC was used to assess PP volumes at the participant level
showing excellent 3D concordance with GT. Furthermore, we showed that the AI-driven
volumetric PP quantification was consistent with the visual extent score of PP.

This is the first time that longitudinal evaluation of pleural plaques has been reported. We showed a progression of pleural plaques volume through the five-year delays between the two rounds of CT screening. This was expected since pleural plaques were demonstrated to be associated with asbestos exposure latency [8]. Nevertheless, our volumetric quantification objectively depicts the progression of pleural plaques. In addition, we reported an increase in calcified pleural plaques between the two rounds of CT screening. Indeed, calcified pleural plaques are also known to be related to latency [37].

Relationships between the prevalence of pleural plaques and benign or malignant respiratory diseases were extensively evaluated in the scientific literature [38]. The presence of pleural plaques was found to be an independent risk factor for lung cancer or mesothelioma [12,13]. In addition, the extent of pleural plaques evaluated using visual score showed a correlation with the decline of forced vital capacity [9]. Moreover, correlation between pleural plaques extent using visual scores and asbestos exposure duration and latency has been already reported [37]. In our study, we showed significant correlations between AI-driven PP volume quantification and visual scoring. Hence, this reproducible novel method offers promising multiple perspectives for the researchers in the field of respiratory diseases related to asbestos exposure.

The AI-driven technique has several advantages in comparison to visual or semi-
automated evaluations of pleural plaques extent. A few seconds are needed to accomplish
the whole segmentation of pleural plaques with an almost perfect reproducibility. In
contrast, the visual/manual scores are time-consuming with moderate reproducibility. This
detailed quantification of pleural and calcified pleural plaques may be more relevant in
evaluating the relationships with benign and malignant respiratory diseases.

Although four manufacturers were represented in this study, additional evaluation
with other manufacturers and CT models would be desirable to increase the generalizability
of the AI model.

**5. Conclusions**

We showed for the first time that an automated AI-driven quantification of pleural plaques is feasible, which may help researchers to decipher the unclear relationships between pleural plaques and both respiratory function and chest malignancy.

**Supplementary Materials:** The following are available online https://www.mdpi.com/article/10.3390/ijerph19031417/s1. Supplementary Table S1: Characteristics of CT scans. Supplementary Table S2: longitudinal comparison of manual and AI-driven pleural plaques quantification in the Test cohort. Supplementary Table S3: longitudinal comparison of Visual evaluation of PP extent. Supplementary Table S4: comparison of pleural plaques volume in the clinical validation cohort using Maximum Intensity projection Vs Native thin slices. Supplementary Figure S1. Illustration of the 2D U-Net architecture used for the segmentation of pleural plaques.

**Author Contributions:** Conceptualization, I.B., G.D., F.L. and J.-C.P.; methodology, I.B., B.D.D.S., G.D., F.L.; validation, I.B., B.D.D.S., G.D., F.L. and J.-C.P.; formal analysis, I.B., B.D.D.S., G.D., F.L. and J.-C.P.; investigation, I.B., B.D.D.S., G.D., F.L., M.M., I.T., B.C., P.B., A.G., P.A., S.C., C.P., G.F. and J.-C.P.; resources I.B., B.D.D.S., G.D., F.L., I.T., B.C., P.B., A.G., P.A., S.C., F.D., C.P., G.F. and J.-C.P.; data curation, I.B., B.D.D.S., M.M., C.G., J.G., A.L.; writing—original draft preparation, I.B., B.D.D.S.; writing—review and editing, I.B., B.D.D.S., G.D., F.L., M.M., C.G., I.T., B.C., P.B., A.G., P.A., S.C., J.G., A.L., F.D., C.P., G.F. and J.-C.P.; visualization, I.B., B.D.D.S., supervision, F.L and J.-C.P.; project administration, S.C.; funding acquisition, F.L., I.T., B.C., P.B., A.G., P.A., S.C., C.P., G.F. and J.-C.P. All authors have read and agreed to the published version of the manuscript.

**Funding:** This research was funded by French National Health Insurance (Occupational Risk Prevention Department), French Ministry of Labour and Social Relations, French Agency for Food,
Environmental and Occupational Health and Safety (ANSES grant 07-CRD-51, EST 2006/1/43, EST 2009/68).

**Institutional Review Board Statement:** The study was approved by the hospital ethics committee (CPPRB Paris-Cochin n°1946 (2002), CPP Ile De France III n°1946/11/02-02 (2010)).

**Informed Consent Statement:** All participants received information about the study and gave their written informed consent.

**Data Availability Statement:** The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy.

**Acknowledgments:** The authors thank Mathieu Rouby, Claire Haeck, and Marie Legrix for their technical support.

**Conflicts of Interest:** The authors declare no conflict of interest.

## References

1. Guidotti, T.L.; Miller, A.; Christiani, D.; Wagner, G.; Balmes, J.; Harber, P.; Brodkin, C.A.; Rom, W.; Hillerdal, G.; Harbut, M.; et al. Diagnosis and Initial Management of Nonmalignant Diseases Related to Asbestos. *Am. J. Respir. Crit. Care Med.* **2004**, *170*, 691–715. [CrossRef]

2. Remy-Jardin, M.; Sobaszek, A.; Duhamel, A.; Mastora, I.; Zanetti, C.; Remy, J. Asbestos-related Pleuropulmonary Diseases: Evaluation with Low-Dose Four-Detector Row Spiral CT. *Radiology* **2004**, *233*, 182–190. [CrossRef]

3. Laurent, F.; Tunon de Lara, M. Exposure to asbestos. Role of thoracic imagery in screening and follow-up. *Rev. Mal. Respir.* **1999**, *16*, 1193–1202. [PubMed]

4. Beigelman-Aubry, C.; Ferretti, G.; Mompoint, D.; Ameille, J.; Letourneux, M.; Laurent, F. Computed tomographic atlas of benign asbestos related pathology. *Rev. Mal. Respir.* **2007**, *24*, 759–781. [CrossRef]

5. Staples, C.A.; Gamsu, G.; Ray, C.S.; Webb, W.R. High resolution computed tomography and lung function in asbestos-exposed workers with normal chest radiographs. *Am. Rev. Respir. Dis.* **1989**, *139*, 1502–1508. [CrossRef]

6. Norbet, C.; Joseph, A.; Rossi, S.S.; Bhalla, S.; Gutierrez, F.R. Asbestos-related lung disease: A pictorial review. *Curr. Probl. Diagn. Radiol.* **2015**, *44*, 371–382. [CrossRef]

7. Gevenois, P.A.; de Maertelaer, V.; Madani, A.; Winant, C.; Sergent, G.; De Vuyst, P. Asbestosis, pleural plaques and diffuse pleural thickening: Three distinct benign responses to asbestos exposure. *Eur. Respir. J.* **1998**, *11*, 1021–1027. [CrossRef]

8. Paris, C.; Thierry, S.; Brochard, P.; Letourneux, M.; Schorle, E.; Stoufflet, A.; Ameille, J.; Conso, F.; Pairon, J.C.; National APEXS Members. Pleural plaques and asbestosis: Dose- and time-response relationships based on HRCT data. *Eur. Respir. J.* **2009**, *34*, 72–79. [CrossRef]

9. Clin, B.; Paris, C.; Ameille, J.; Brochard, P.; Conso, F.; Gislard, A.; Laurent, F.; Letourneux, M.; Luc, A.; Schorle, E.; et al. Do asbestos-related pleural plaques on HRCT scans cause restrictive impairment in the absence of pulmonary fibrosis? *Thorax* **2011**, *66*, 985–991. [CrossRef]

10. Moolgavkar, S.H.; Anderson, E.L.; Chang, E.T.; Lau, E.C.; Turnham, P.; Hoel, D.G. A review and critique of U.S. EPA's risk assessments for asbestos. *Crit. Rev. Toxicol.* **2014**, *44*, 499–522. [CrossRef]

11. Kopylev, L.; Christensen, K.Y.; Brown, J.S.; Cooper, G.S. A systematic review of the association between pleural plaques and changes in lung function. *Occup. Environ. Med.* **2015**, *72*, 606–614. [CrossRef] [PubMed]

12. Pairon, J.-C.; Laurent, F.; Rinaldo, M.; Clin, B.; Andujar, P.; Ameille, J.; Brochard, P.; Chammings, S.; Ferretti, G.; Galateau-Sallé, F.; et al. Pleural Plaques and the Risk of Pleural Mesothelioma. *JNCI J. Natl. Cancer Inst.* **2013**, *105*, 293–301. [CrossRef]

13. Pairon, J.-C.; Andujar, P.; Rinaldo, M.; Ameille, J.; Brochard, P.; Chamming'S, S.; Clin, B.; Ferretti, G.; Gislard, A.; Laurent, F.; et al. Asbestos Exposure, Pleural Plaques, and the Risk of Death from Lung Cancer. *Am. J. Respir. Crit. Care Med.* **2014**, *190*, 1413–1420. [CrossRef] [PubMed]

14. Laurent, F.; Paris, C.; Ferretti, G.R.; Beigelman, C.; Montaudon, M.; Latrabe, V.; Jankowski, A.; Badachi, Y.; Clin, B.; Gislard, A.; et al. Inter-reader agreement in HRCT detection of pleural plaques and asbestosis in participants with previous occupational exposure to asbestos. *Occup. Environ. Med.* **2014**, *71*, 865–870. [CrossRef]

15. Van Cleemput, J.; De Raeve, H.; Verschakelen, J.A.; Rombouts, J.; Lacquet, L.M.; Nemery, B. Surface of Localized Pleural Plaques Quantitated by Computed Tomography Scanning. *Am. J. Respir. Crit. Care Med.* **2001**, *163*, 705–710. [CrossRef]

16. Cha, Y.K.; Kim, J.S.; Kwon, J.H. Quantification of pleural plaques by computed tomography and correlations with pulmonary function: Preliminary study. *J. Thorac. Dis.* **2018**, *10*, 2118–2124. [CrossRef] [PubMed]

17. Dournes, G.; Dubois, A.; Benlala, I.; Lacourt, A.; Paris, C.; Gislard, A.; Clin, B.; Pairon, J.-C.; Baldacci, F.; Laurent, F. 3-Dimensional Quantification of Composite Pleural Plaque Volume in Patients Exposed to Asbestos Using High-resolution Computed Tomography: A Validation Study. *J. Thorac. Imaging* **2019**, *34*, 320–325. [CrossRef]

18. Hesamian, M.H.; Jia, W.; He, X.; Kennedy, P. Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges. *J. Digit. Imaging* **2019**, *32*, 582–596. [CrossRef]
19. Hansell, D.M.; Bankier, A.A.; MacMahon, H.; McLoud, T.C.; Müller, N.L.; Remy, J. Fleischner Society: Glossary of Terms for Thoracic Imaging. *Radiology* **2008**, *246*, 697–722. [CrossRef]

20. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015; Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F., Eds.; Springer International Publishing: Cham, Switzerland, 2015; pp. 234–241.

21. De Brébisson, A.; Montana, G. Deep neural networks for anatomical brain segmentation. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA, 7–12 June 2015; pp. 20–28. [CrossRef]

22. Huo, Y.; Xu, Z.; Xiong, Y.; Aboud, K.; Parvathaneni, P.; Bao, S.; Bermudez, C.; Resnick, S.M.; Cutting, L.E.; Landman, B.A. 3D Whole Brain Segmentation using Spatially Localized Atlas Network Tiles. *NeuroImage* **2019**, *194*, 105–119. [CrossRef]

23. Coupé, P.; Mansencal, B.; Clément, M.; Giraud, R.; Denis de Senneville, B.; Ta, V.-T.; Lepetit, V.; Manjon, J.V. AssemblyNet: A large ensemble of CNNs for 3D whole brain MRI segmentation. *NeuroImage* **2020**, *219*, 117026. [CrossRef] [PubMed]

24. Ma, Y.-D.; Liu, Q.; Quan, Z.-B. Automated image segmentation using improved PCNN model based on cross-entropy. In Proceedings of the 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, Hong Kong, China, 20–22 October 2004; IEEE: Piscataway, NJ, USA, 2005; pp. 743–746. [CrossRef]

25. Sudre, C.H.; Li, W.; Vercauteren, T.; Ourselin, S.; Cardoso, M.J. Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations. *arXiv* **2017**, arXiv:1707.03237, 240–248. [CrossRef]

26. Sugino, T.; Kawase, T.; Onogi, S.; Kin, T.; Saito, N.; Nakajima, Y. Loss Weightings for Improving Imbalanced Brain Structure Segmentation Using Fully Convolutional Networks. *Healthcare* **2021**, *9*, 938. [CrossRef]

27. Kingma, D.P.; Ba, J. Adam: A Method for Stochastic Optimization. *Comput. Sci.* **2017**, arXiv:1412.6980v9.

28. Taha, A.A.; Hanbury, A. Metrics for evaluating 3D medical image segmentation: Analysis, selection, and tool. *BMC Med. Imaging* **2015**, *15*, 29. [CrossRef]

29. Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. *Stat. Methods Med. Res.* **1999**, *8*, 135–160. [CrossRef]

30. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. *Biometrics* **1977**, *33*, 159–174. [CrossRef]

31. Dournes, G.; Hall, C.S.; Willmering, M.M.; Brody, A.S.; Macey, J.; Bui, S.; Denis-De-Senneville, B.; Berger, P.; Laurent, F.; Benlala, I.; et al. Artificial intelligence in CT for quantifying lung changes in the era of CFTR modulators. *Eur. Respir. J.* **2021**, 2100844. [CrossRef]

32. Zha, W.; Fain, S.B.; Schiebler, M.L.; Evans, M.D.; Nagle, S.K.; Liu, F. Deep convolutional neural networks with multiplane consensus labeling for lung function quantification using UTE proton MRI. *J. Magn. Reson. Imaging* **JMRI 2019**, *50*, 1169–1181. [CrossRef]

33. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. *Nature* **2015**, *521*, 436–444. [CrossRef]

34. Cho, J.; Lee, K.; Shin, E.; Choy, G.; Do, S. How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? *arXiv* **2015**, arXiv:1511.06348.

35. Sousa, A.M.; Castelo-Fernández, C.; Osaku, D.; Bagatin, E.; Reis, F.; Falcão, A.X. An Approach for Asbestos-related Pleural Plaque Detection. In Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Montréal, QC, Canada, 20–24 July 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1343–1346.

36. Alfudhili, K.M.; Lynch, D.A.; Laurent, F.; Ferretti, G.R.; Dunet, V.; Beigelman-Aubry, C. Focal pleural thickening mimicking pleural plaques on chest computed tomography: Tips and tricks. *Br. J. Radiol.* **2016**, *89*, 20150792. [CrossRef] [PubMed]

37. Kim, Y.; Myong, J.-P.; Lee, J.K.; Kim, J.S.; Kim, Y.K.; Jung, S.-H. CT Characteristics of Pleural Plaques Related to Occupational or Environmental Asbestos Exposure from South Korean Asbestos Mines. *Korean J. Radiol.* **2015**, *16*, 1142–1152. [CrossRef] [PubMed]

38. Maxim, L.D.; Niebo, R.; Utell, M.J. Are pleural plaques an appropriate endpoint for risk analyses? *Inhal. Toxicol.* **2015**, *27*, 321–334. [CrossRef]