Association of Residual Plasma Viremia and
Intima-Media Thickness in Antiretroviral-Treated
Patients with Controlled Human Immunodeficiency
Virus Infection

Anders Boyd, Jean-Luc Meynard, Laurence Morand-Joubert, Adrien Michon,
Franck Boccara, Jean-Philippe Bastard, Assia Samri, Nabila Haddour, Ziad
Mallat, Jacqueline Capeau, et al.

► To cite this version:

Anders Boyd, Jean-Luc Meynard, Laurence Morand-Joubert, Adrien Michon, Franck Boccara, et al. . Association of Residual Plasma Viremia and Intima-Media Thickness in Antiretroviral-Treated Patients with Controlled Human Immunodeficiency Virus Infection. PLoS ONE, 2014, 9 (11), pp.e113876. 10.1371/journal.pone.0113876 . hal-01344825

HAL Id: hal-01344825

https://hal.sorbonne-universite.fr/hal-01344825v1

Submitted on 12 Jul 2016

**HAL** is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons CC BY 4.0 - Attribution - International License
<figure><img src="image_2.png" /></figure>

CrossMark
click for updates

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Boyd A, Meynard J-L, Morand-Joubert L, Michon A, Boccara F, et al. (2014) Association of Residual Plasma Viremia and Intima-Media Thickness in Antiretroviral-Treated Patients with Controlled Human Immunodeficiency Virus Infection. PLoS ONE 9(11): e113876. doi:10.1371/journal.pone.0113876

**Editor:** Cristian Apetrei, University of Pittsburgh Center for Vaccine Research, United States of America

**Received:** June 24, 2014

**Accepted:** October 8, 2014

**Published:** November 21, 2014

**Copyright:** © 2014 Boyd et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability:** The authors confirm that, for approved reasons, some access restrictions apply to the data underlying the findings. The data cannot be publicly available due to legal and ethical restrictions from the French Authority (Commission nationale de l'informatique et des libertés). Data are from the ANRS EP42 CHIC study. Requests for data use can be made to the Scientific Manager of the study (Moïse Desvarieux at md108@cumc.columbia.edu) or a representative from the Agence nationale de recherche sur le sida et les hépatites virales (Sandrine Couffin-Cadiergues at sandrine.couffin-cadiergues@anrs.fr).

**Funding:** This study was funded by the Agence Nationale de Recherche sur le Sida et les Hépatites (ANRS grant 2007/303 to MD) and Sidaction (grant AI 20). AB was awarded a post-doctoral fellowship from the Agence nationale de recherche sur le sida et les hépatites virales. MD is also the recipient of a Chair in Chronic Disease from the École des Hautes Etudes en Santé Publique, France. This collaboration was rendered possible by a Contrat d'Interface (to MD) between INSERM and Hôpital Saint-Antoine. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing Interests:** FB reports receiving research grants from Boehringer-Ingelheim and Gilead Sciences. All other authors report having no association, be it commercial or other, that might pose a conflict of interest.

RESEARCH ARTICLE

# Association of Residual Plasma Viremia and Intima-Media Thickness in Antiretroviral-Treated Patients with Controlled Human Immunodeficiency Virus Infection

Anders Boyd¹*, Jean-Luc Meynard²,³, Laurence Morand-Joubert⁴, Adrien Michon⁵, Franck Boccara²,⁶,⁷, Jean-Philippe Bastard²,⁸, Assia Samri²,⁹, Nabila Haddour²,⁶, Ziad Mallat¹⁰,¹¹, Jacqueline Capeau²,⁸, Moïse Desvarieux¹²,¹³, Pierre-Marie Girard¹,²,³, for the Collaboration in HIV, Inflammation and Cardiovascular Disease Study

1. INSERM UMR_S 1136, Institut Pierre Louis d'Epidémiologie et de Santé Publique, Paris, France, 2. Sorbonne Université, UPMC Univ Paris-6, Paris, France, 3. Department of Infectious and Tropical Diseases, Hôpital Saint-Antoine, AP-HP, Paris, France, 4. Sorbonne Universités, UPMC Univ Paris 06, INSERM, UMR_S 1136, Institut Pierre Louis d'Epidémiologie et de Santé Publique, Laboratoire de Virologie, Saint Antoine, APHP, Paris, France, 5. Service de médecine interne, Hôpital Européen Georges Pompidou, AP-HP, Paris, France, 6. Department of Cardiology, Hôpital Saint-Antoine, AP-HP, Paris, France, 7. INSERM UMR_S 938, Paris, France, 8. APHP, Hôpital Tenon, Service de biochimie et hormonologie, Inserm UMR_S938, and Institute of Cardiometabolism and Nutrition, Paris, France, 9. Inserm, UMR-S945, IFR113, Department of Immunology, Paris, France, 10. Inserm U970, Cardiovascular Research Center, and Université Paris-Descartes University, Paris, France, 11. Department of Medicine, University of Cambridge, Cambridge, United Kingdom, 12. Department of Epidemiology, Columbia University, Mailman School of Public Health, New York, New York, United States of America, 13. Inserm U738 and Ecole des Hautes Études en Santé Publique, Paris, France

*boyd@u707.jussieu.fr

## Abstract

**Background:** While residual plasma viremia is commonly observed in HIV-infected patients undergoing antiretroviral treatment (ART), little is known about its subclinical consequences.

**Methods:** This cross-sectional study included 47 male, never-smoking, non-diabetic patients with ≥4 years of ART and controlled HIV-replication (HIV-viral load, VL <20 copies/mL for ≥1 year). Residual HIV-VL was measured using an ultrasensitive assay (quantification limit: 1 copy/ml). Patients were categorized as having detectable (D; 1-20 copies/mL, n=14) or undetectable (UD; <1 copies/mL, n=33) HIV-VL. Linear regression was used to model the difference in total carotid intima-media thickness [c-IMT, measures averaged across common carotid artery (cca), bifurcation, and internal carotid artery] and cca-IMT alone across detection groups. Multivariable models were constructed for each endpoint in a forward-stepwise approach.
**Results:** No significant differences were observed between viremia groups with respect to median ART-duration (9.6 years, IQR=6.8–10.9), nadir CD4+T-cell (208/mm³, IQR=143–378), and CD4+T-cell count (555/mm³, IQR=458–707). Median adjusted inflammatory markers tended to be higher in patients with D- than UD-viremia, with differences in IL-10 being significant (*p*=0.03). After adjustment on age, systolic blood pressure, and insulin resistance, mean cca-IMT was significantly lower in patients with undetectable (0.668 mm±0.010) versus detectable viremia (0.727 mm±0.015, *p*=0.002). Cca-IMT was also independently associated with age and insulin resistance. Mean adjusted total c-IMT was no different between viremia groups (*p*=0.2), however there was large variability in bifurcation c-IMT measurements.

**Conclusions:** Higher cca-IMT was observed in patients with detectable, compared to undetectable, HIV-VL in never-smoking ART-controlled patients, suggesting that residual HIV viremia may be linked to atherosclerosis.

## Introduction

Among HIV-1-infected patients, antiretroviral therapy (ART) typically leads to the suppression of HIV-replication below the quantification limit of many conventional techniques. Even though these patients would be considered as having controlled HIV viral load (usually at <50 copies/mL), roughly two-thirds continue to exhibit residual viremia between 1–50 copies/mL during long-term ART. [1–4] The consequences of residual viremia are poorly understood and while several recent studies have examined the effect of residual viremia on various inflammatory markers [3, 5], these findings have rarely extended to the subclinical or clinical level. [6]

We have previously reported a strong association between increased carotid intima media thickness (c-IMT) and known HIV-duration, regardless of ART, implying that c-IMT could still be increasing during infection despite control of HIV-replication. [7] Residual viremia and alteration in inflammatory cytokines and/or chemokines could be potential explanations for this observation. We thus aimed to compare a number of pro-inflammatory and anti-inflammatory markers, chemokines, and c-IMT in an antiretroviral-treated population of non-smoking, male patients according to levels of residual viremia.

## Materials and Methods

### Study design

The Collaboration on HIV, Inflammation and Cardiovascular Disease study was specifically designed to study the impact of treatment versus HIV on subclinical vascular disease. [7] Inclusion criteria were heavily restricted as to reduce
confounding by specifically smoking and gender. Briefly, fifty age-matched (±5 years) triads (n=150) of never-smoking, male subjects were enrolled in three groups: a) HIV-infected patients >35 years old, undergoing ART for ≥4 years, and with HIV-1 RNA viral load <400 copies/mL; b) HIV-infected patients for ≥2 years, ART-naïve and not meeting the indication for ART-initiation; and c) HIV-negative as confirmed by serology. All patients were recruited from Saint-Antoine Hospital (Paris, France) between March 2008-June 2009 and provided written informed consent. The protocol was approved by the Hôtel-Dieu Hospital Ethics Committee (Paris, France).

For this sub-study, we decided to primarily focus on ART-treated patients with undetectable HIV replication based on standard techniques. Only the 50 ART-treated patients from group (a) were therefore included. Among them, three patients were additionally excluded because they had an HIV-VL between 20-400 copies/mL. In total, 47 patients were included in present analysis.

## Quantification of biochemical and virological parameters

HIV-VL was measured using an adapted Cobas AmpliPrep/Cobas TaqMan HIV-1 assay (Roche Diagnostics, Meylan, France; quantification limit: 1 copy/ml). [7] Patients were defined as having either detectable (D; 1–20 copies/mL, n=14) or undetectable (UD; <1 copies/mL, n=33) levels of HIV-viremia.

Inflammatory markers and chemokines were selected for their specific role in HIV-infection [7] and quantified from serum samples stored at –80°C. Interleukin (IL)-6, IL-18, IL-10, IL-27 (Bender Medsystems, Burlingame, CA, USA), resistin (R&D Systems, Minneapolis, MN, USA), total and high molecular weight (HMW) adiponectin (Bühlman, Düsseldorf, Germany) levels were analyzed using an enzyme-linked immunosorbent assay. Serum high-sensitivity C-reactive protein (hs-CRP) and serum amyloid-A (SSA) were measured by immunonephelometry on an IMMAGE analyzer (Beckman-Coulter, Miami, FL, USA). Plasma D-dimer was measured by enzyme linked fluorescent assay on a VIDAS analyzer (Biomérieux, Marcy-l'Etoile, France). Chemokines were quantified from plasma using the BD Cytometric Bead Array system (BD, Franklin Lakes, NJ, USA).

## Assessing c-IMT and hypertension

c-IMT scanning and reading protocols have been detailed elsewhere. [7, 8] Total c-IMT was calculated as a composite measure (mean of 12 sites), combining near and far wall of the common carotid artery (cca)-IMT, bifurcation c-IMT, and internal carotid artery (ica)-IMT, bilaterally. Measures with the highest variability were bifurcation c-IMT (SD=0.106, 75th-25th%tile=0.130), followed by cca-IMT (SD=0.082, 75th-25th%tile=0.093) and ica-IMT (SD=0.071, 75th-25th%tile=0.100). Hypertension was defined by prior physician's diagnosis, systolic blood pressure ≥140 mmHg, diastolic blood pressure ≥90 mmHg, or the use of antihypertensive drugs.
## Statistical analysis

In order to be consistent with previous analyses [7], median pro-/anti-inflammatory markers and chemokines were adjusted *a priori* by age, hypertension, and duration of ART using quantile regression. Adjusted median levels were compared between D and UD groups using a two-tailed t-test based on estimated variance. [9]

Linear regression was used to model the mean difference in total c-IMT and cca-IMT levels comparing D versus UD groups (Δ). Univariate models were constructed to estimate the mean difference in total c-IMT and cca-IMT levels across various risk-factors. A multivariable model was constructed using a predictive approach, while forcing viremia group in the model and including risk-factors with a *p*<0.05 from univariate analyses in a forward-stepwise manner. In order to avoid model overfitting, we evaluated the addition of each covariable using the Bayesian Information Criteria, which penalizes model complexity by the number of observations. After fitting the full multivariable model, other HIV and metabolic risk factors were added individually to the full model so that residual confounding could be assessed. Multivariable models were also constructed for the bifurcation c-IMT and ica-IMT segments, however residual confounding was not assessed. All statistics were performed using STATA (v12.1, College Station, TX, USA).

## Results

Patient characteristics are described in Table 1, while stratified on viremia group. Patients were at low-risk of cardiovascular disease (CVD) [median (IQR) D:A:D score [10] of 10-year CVD-risk: 3.2% (2.6%–5.6%)], while three patients had concomitant statin-use. Three patients had BMI >30 kg/m² and no patients were diagnosed with glucose intolerance or diabetes.

## Inflammatory markers and residual-viremia

Median adjusted pro-inflammatory markers tended to be higher in patients with D- than UD-viremia (hs-CRP: 3.11 vs 2.43 mg/l; IL-18: 213.8 vs 89.7 pg/mL; resistin: 6.48 vs 6.25 ng/ml; IL-6: 1.33 vs 0.79 pg/mL; D-Dimer: 147.4 vs 139.3 ng/ml, respectively) as was insulinemia (7.3 vs 6.0 mU/l), although no significant differences were observed (Table 2). Likewise, patients with D-viremia exhibited higher adjusted median levels of anti-inflammatory markers than with UD-viremia (HMW/total adiponectin: 1.06/3.61 vs 0.92/2.54 µg/ml; IL-27: 1325 vs 1111 pg/mL; IL-10: 0.94 vs 0.65 pg/mL, respectively), with only differences in IL-10 being significant (*p*=0.03). In addition, no significant difference in chemokines were observed between groups, yet Mig was roughly 1.5-times higher and fractalkine 2-times higher in patients with D- vs. UD-viremia.
<table><caption>**Table 1.** Demographic and HIV characteristics between viremia groups.</caption><thead><tr><th></th><th>D-viremia<br>(n=14)</th><th>UD-viremia<br>(n=33)</th><th>p*</th></tr></thead><tbody><tr><td><strong>General characteristics</strong></td><td></td><td></td><td></td></tr><tr><td>Age, years<sup>†</sup></td><td>41 (37–48)</td><td>40 (37–43)</td><td>0.2</td></tr><tr><td>BMI, kg/m<sup>2</sup><sup>†</sup></td><td>23 (21–24)</td><td>22 (21–25)</td><td>0.8</td></tr><tr><td>Hypertension**</td><td>2 (14.3)</td><td>1 (3.0)</td><td>0.2</td></tr><tr><td>Total cholesterol mmol/L<sup>††</sup></td><td>5.05 (4.48–5.28)</td><td>4.68 (4.21–5.70)</td><td>0.5</td></tr><tr><td>HDL cholesterol mmol/L<sup>††</sup></td><td>1.20 (0.79–1.37)</td><td>1.09 (0.95–1.31)</td><td>0.4</td></tr><tr><td>LDL cholesterol mmol/L<sup>††</sup></td><td>3.10 (2.74–3.29)</td><td>3.19 (2.60–3.91)</td><td>0.8</td></tr><tr><td>Triglycerides mmol/L<sup>††</sup></td><td>1.63 (0.81–2.44)</td><td>1.19 (0.92–2.03)</td><td>0.3</td></tr><tr><td>Fasting glucose mmol/L<sup>††</sup></td><td>4.52 (4.07–5.00)</td><td>4.53 (4.28–4.97)</td><td>0.9</td></tr><tr><td>HOMA-IR<sup>††</sup></td><td>1.69 (1.20–2.33)</td><td>1.41 (1.07–1.91)</td><td>0.2</td></tr><tr><td>QUICKI<sup>††</sup></td><td>0.355 (0.344–0.371)</td><td>0.365 (0.350–0.384)</td><td>0.5</td></tr><tr><td><strong>HIV Infection</strong></td><td></td><td></td><td></td></tr><tr><td>Duration of HIV infection, years<sup>†</sup></td><td>13.0 (7.9–17.0)</td><td>10.4 (7.6–15.1)</td><td>0.5</td></tr><tr><td>Duration of ART, years<sup>†</sup></td><td>10.5 (5.2–11.4)</td><td>9.5 (7.1–10.5)</td><td>0.8</td></tr><tr><td>CD4+ count, cells/mm<sup>3</sup><sup>†</sup></td><td>475 (420–771)</td><td>557 (508–703)</td><td>0.5</td></tr><tr><td>Nadir CD4+ count<sup>†</sup></td><td>147 (88–364)</td><td>254 (170–378)</td><td>0.2</td></tr><tr><td>CD8:CD4 ratio<sup>†</sup></td><td>1.20 (0.91–1.57)</td><td>1.31 (0.89–1.57)</td><td>0.9</td></tr><tr><td>HIV-RNA, copies/mL<sup>†</sup></td><td>6 (3–10)</td><td>0</td><td>ntp</td></tr><tr><td>Years from last HIV-VL >50<sup>†</sup></td><td>3.4 (1.4–5.0)</td><td>4.1 (2.1–6.3)</td><td>0.5</td></tr><tr><td>D-viremia<br>(n=14)</td><td></td><td>UD-viremia<br>(n=33)</td><td>p*</td></tr><tr><td><strong>Antiretroviral medication</strong></td><td></td><td></td><td></td></tr><tr><td>Treatment with NRTI**</td><td>13 (92.9)</td><td>32 (97.0)</td><td>0.5</td></tr><tr><td>Duration of NRTI treatment<sup>†</sup></td><td>147.9 (91.7–199.6)</td><td>124.7 (79.1–193.1)</td><td>0.4</td></tr><tr><td>Treatment with NNRTI**</td><td>6 (42.9)</td><td>17 (51.5)</td><td>0.6</td></tr><tr><td>Duration of NNRTI treatment<sup>†</sup></td><td>67.1 (18.5–109.7)</td><td>100.4 (81.4–115.6)</td><td>0.3</td></tr><tr><td>Treatment with PI**</td><td>9 (64.3)</td><td>12 (36.4)</td><td>0.1</td></tr><tr><td>Duration of PI treatment<sup>†</sup></td><td>107.3 (95.9–127.9)</td><td>77.1 (59.7–134.0)</td><td>0.3</td></tr><tr><td>Treatment with raltegravir**</td><td>2 (14.3)</td><td>0</td><td>0.08</td></tr></tbody></table>

All patients were male, non smokers.

*Significance determined using a Kruskal-Wallis equality-of-populations rank test for continuous variables and Pearson $\chi^2$ test or Fisher's Exact test for categorical variables;

**number (%);

†median (25-75th%tile).

††Medians (25th and 75th %tiles) adjusted by age, hypertension, and duration of ART using quantile regression. Significance determined using a two-tailed t-test based on variance estimations.

D – detectable; UD – undetectable; HDL – high-density lipid; LDL – low-density lipid; HOMA-IR – homeostatic model assessment of insulin resistance; QUICKI – quantitative insulin sensitivity check index; HIV – human immunodeficiency virus; ART – antiretroviral therapy; cp/mL – copies/mL; VL – viral load; NRTI – nucleos(-t)ide reverse transcriptase inhibitor; NNRTI – non-nucleos(-t)ide reverse transcriptase inhibitor; PI – protease inhibitor; ntp – no test performed.

doi:10.1371/journal.pone.0113876.t001

## Carotid-IMT and residual viremia

As shown in Table 3, mean total c-IMT was significantly different between D and UD groups in univariate analysis. However, after adjusting on age and HOMA-IR
<table><caption>**Table 2.** Description of pro- and anti-inflammatory markers between viremia groups.</caption><thead><tr><th></th><th>(n=14)</th><th>D-viremia<br>(n=33)</th><th>UD-viremia<br>p*</th></tr></thead><tbody><tr><td><strong>Pro-inflammatory</strong></td><td></td><td></td><td></td></tr><tr><td>Hs-CRP mg/l</td><td>3.11 (0.59-4.82)</td><td>2.43 (0.65-5.14)</td><td>0.5</td></tr><tr><td>Resistin ng/ml</td><td>6.48 (5.06-8.06)</td><td>6.25 (4.40-8.66)</td><td>0.9</td></tr><tr><td>IL-18** pg/mL</td><td>213.8 (134.3-305.7)</td><td>89.7 (4.5-180.3)</td><td>0.06</td></tr><tr><td>IL-6** pg/mL</td><td>1.33 (0.79-1.57)</td><td>0.79 (0.37-1.21)</td><td>0.2</td></tr><tr><td>D-Dimer ng/ml</td><td>147.4 (108.0-226.5)</td><td>139.3 (113.4-177.7)</td><td>0.8</td></tr><tr><td>Insulin mU/l</td><td>7.35 (5.17-9.14)</td><td>6.04 (5.03-10.21)</td><td>0.4</td></tr><tr><td>Serum Amyloid A** mg/l</td><td>5.1 (5.1-10.3)</td><td>5.1 (5.1-8.4)</td><td>ntp</td></tr><tr><td><strong>Anti-inflammatory</strong></td><td></td><td></td><td></td></tr><tr><td>Total adiponectin µg/ml</td><td>3.61 (2.07-5.86)</td><td>2.54 (1.48-3.61)</td><td>0.07</td></tr><tr><td>HMW adinopectin µg/ml</td><td>1.06 (0.86-2.46)</td><td>0.92 (0.69-1.51)</td><td>0.7</td></tr><tr><td>IL-27** pg/mL</td><td>1325 (638-2872)</td><td>1111 (430-2287)</td><td>0.6</td></tr><tr><td>IL-10** pg/mL</td><td>0.94 (0.69-1.55)</td><td>0.65 (0.41-0.82)</td><td>0.03</td></tr><tr><td><strong>Chemokines</strong></td><td></td><td></td><td></td></tr><tr><td>ICAM-1 pg/mL</td><td>128589 (10010-145134)</td><td>121905 (100908-128912)</td><td>0.6</td></tr><tr><td>I-TAC pg/mL</td><td>257.5 (108.8-339.8)</td><td>254.7 (153.7-350.6)</td><td>0.9</td></tr><tr><td>IP-10 pg/mL</td><td>214.1 (168.8-354.7)</td><td>237.4 (164.3-415.8)</td><td>0.6</td></tr><tr><td>Fractalin** pg/mL</td><td>82.1 (11.2-415.3)</td><td>41.4 (11.2-264.1)</td><td>0.5</td></tr><tr><td>VCAM-1 pg/mL</td><td>129635 (121514-189670)</td><td>141891 (117047-164106)</td><td>0.6</td></tr><tr><td>Mig pg/mL</td><td>376 (270-797)</td><td>261 (152-794)</td><td>0.3</td></tr><tr><td>MCP-1 pg/mL</td><td>76.9 (31.6-103.4)</td><td>51.7 (35.3-77.5)</td><td>0.2</td></tr><tr><td>E-selectin pg/mL</td><td>10344 (8131-33045)</td><td>11787 (4928-23219)</td><td>0.7</td></tr><tr><td>P-selectin pg/mL</td><td>125138 (87195-164171)</td><td>144574 (92185-189056)</td><td>0.7</td></tr><tr><td>Soluble CD14 ng/ml</td><td>1066 (935-1365)</td><td>1043 (885-1281)</td><td>0.9</td></tr></tbody></table>

All patients were male, non smokers.

Medians (25th and 75th %tiles) were adjusted by age, hypertension, and duration of antiretroviral therapy using quantile regression.

*Significance determined using a two-tailed t-test based on estimated variance.

**Thresholds for biochemical markers were included in the summary statistic and calculated using the median between the commercial threshold given and 0.

D – detectable; UD – undetectable; us-CRP – ultra-sensitive C-reactive protein; IL – interleukin; HMW – high molecular weight; ICAM-1 – intercellular adhesion molecule-1; I-TAC – interferon inducible T-cell alpha chemoattractant; IP-10 – inducible protein-10; VCAM-1 – vascular cell adhesion molecule-1; MCP-1 – monocyte chemoattractant protein-1.

doi:10.1371/journal.pone.0113876.t002

(both of which were independently associated with total c-IMT), there was no significant difference between viremia groups (mean ± SE, D: 0.768 mm ± 0.014 versus UD: 0.746 mm ± 0.009, p=0.2). In further analysis, the difference between viremia groups remained non-significant after separately and additionally adjusting (to the full multivariable model) for years undergoing ART (Δ=0.024 mm, p=0.14), years of known HIV-infection (Δ=0.022 mm, p=0.19), years of undetectable HIV-viremia from most recent HIV-VL >50 copies/mL (Δ=0.021 mm, p=0.2), nadir CD4+ cell count (Δ=0.028, p=0.11), or protease inhibitor (PI)-use (Δ=0.022 mm, p=0.2). The following CVD risk factors were also added separately to the full multivariable model, showing no significant
<table><caption>**Table 3.** Total and common carotid artery intima media thicknesses between viremia groups.</caption><thead><tr><th rowspan="3"></th><th colspan="4">Total c-IMT</th><th colspan="4">cca-IMT</th></tr><tr><th colspan="2">Univariate</th><th colspan="2">Multivariable</th><th colspan="2">Univariate</th><th colspan="2">Multivariable</th></tr><tr><th>Δ* (95% CI)</th><th>p</th><th>Δ* (95% CI)</th><th>p</th><th>Δ* (95% CI)</th><th>p</th><th>Δ* (95% CI)</th><th>p</th></tr></thead><tbody><tr><td>D- vs UD-viremia groups</td><td>0.045 (0.002, 0.089)</td><td>0.04</td><td>0.021 (-0.012, 0.055)</td><td>0.2</td><td>0.074 (0.026, 0.123)</td><td>0.003</td><td>0.059 (0.022, 0.095)</td><td>0.002</td></tr><tr><td colspan="9"><strong>Cardiovascular risk-factors</strong></td></tr><tr><td>Age (per 10 years)</td><td>0.077 (0.047, 0.106)</td><td>&lt;0.001</td><td>0.061 (0.032, 0.089)</td><td>&lt;0.001</td><td>0.077 (0.040, 0.114)</td><td>&lt;0.001</td><td>0.048 (0.018, 0.078)</td><td>0.002</td></tr><tr><td>SBP (per 10 mmHg)</td><td>0.015 (0.000, 0.030)</td><td>0.06</td><td></td><td></td><td>0.020 (0.003, 0.038)</td><td>0.02</td><td>0.012 (-0.002, 0.027)</td><td>0.09</td></tr><tr><td>Hypertension**</td><td>0.010 (0.020, 0.179)</td><td>0.02</td><td></td><td></td><td>0.166 (0.080, 0.252)</td><td>&lt;0.001</td><td></td><td></td></tr><tr><td>HDL-cholesterol (per mmol/L)</td><td>-0.046 (-0.123, 0.031)</td><td>0.2</td><td></td><td></td><td>-0.027 (-0.117, 0.064)</td><td>0.6</td><td></td><td></td></tr><tr><td>LDL-cholesterol (per mmol/L)</td><td>0.027 (0.005, 0.048)</td><td>0.02</td><td></td><td></td><td>0.024 (-0.002, 0.050)</td><td>0.07</td><td></td><td></td></tr><tr><td>Family history of CVD</td><td>0.000 (-0.084, 0.086)</td><td>0.9</td><td></td><td></td><td>0.045 (-0.053, 0.143)</td><td>0.4</td><td></td><td></td></tr><tr><td>HOMA-IR</td><td>0.036 (0.017, 0.055)</td><td>0.001</td><td>0.025 (0.009, 0.042)</td><td>0.003</td><td>0.051 (0.031, 0.072)</td><td>&lt;0.001</td><td>0.034 (0.014, 0.053)</td><td>0.001</td></tr><tr><td>Statin-use</td><td>-0.006 (-0.091, 0.079)</td><td>0.9</td><td></td><td></td><td>0.061 (-0.036, 0.159)</td><td>0.2</td><td></td><td></td></tr><tr><td colspan="9"><strong>HIV-related factors</strong></td></tr><tr><td>Nadir CD4+ (per 100 cells/mm³)</td><td>-0.004 (-0.015, 0.007)</td><td>0.5</td><td></td><td></td><td>-0.001 (-0.014, 0.012)</td><td>0.9</td><td></td><td></td></tr><tr><td>CD4+ (per 100 cells/mm³)</td><td>0.004 (-0.007, 0.015)</td><td>0.4</td><td></td><td></td><td>0.003 (-0.010, 0.016)</td><td>0.7</td><td></td><td></td></tr><tr><td>Duration of ART (per year)</td><td>0.012 (0.005, 0.020)</td><td>0.002</td><td></td><td></td><td>0.007 (-0.003, 0.017)</td><td>0.15</td><td></td><td></td></tr><tr><td>Yrs from last HIV VL &gt;50 cp/mL</td><td>-0.001 (-0.009, 0.006)</td><td>0.7</td><td></td><td></td><td>0.000 (-0.009, 0.009)</td><td>0.9</td><td></td><td></td></tr><tr><td>PI-use</td><td>0.025 (-0.016, 0.066)</td><td>0.2</td><td></td><td></td><td>0.020 (-0.028, 0.068)</td><td>0.4</td><td></td><td></td></tr><tr><td>Abacavir-use</td><td>-0.017 (-0.063, 0.029)</td><td>0.5</td><td></td><td></td><td>-0.023 (-0.076, 0.031)</td><td>0.4</td><td></td><td></td></tr></tbody></table>

All patients were male, non smokers.

*Difference in intima media maximal thickness between groups.

**Hypertension was defined by prior physician's diagnosis or systolic blood pressure ≥140 mmHg or diastolic blood pressure ≥90 mmHg.

c-IMT – carotid intima media thickness; cca-IMT – common carotid artery intima media thickness; D – detectable; UD – undetectable; SBP – systolic blood pressure; HDL – high-density lipid; LDL – low-density lipid; CVD – cardiovascular disease; HOMA-IR – homeostatic model assessment of insulin resistance; ART – antiretroviral therapy; VL – viral load; PI – protease inhibitors.

doi:10.1371/journal.pone.0113876.t003

differences between viremia groups: HDL- (Δ=0.021 mm, p=0.2) or LDL-cholesterol (Δ=0.022 mm, p=0.2), statin-use (Δ=0.019, p=0.3), and family history of CVD (Δ=0.023, p=0.18).

In contrast, a significant difference between groups was found in mean adjusted cca-IMT (mean ± SE, D: 0.727 mm ± 0.015 versus UD: 0.668 mm ± 0.010, p=0.002), which remained independently associated with age and HOMA-IR. This difference remained statistically significant after separately and additionally
adjusting (to the full multivariable model) for years undergoing ART ($\Delta$=0.059 mm, *p*=0.003), years of known HIV-infection ($\Delta$=0.058 mm, *p*=0.003), years of undetectable HIV-viremia from most recent HIV-VL >50 copies/mL ($\Delta$=0.059 mm, *p*=0.002), nadir CD4+ cell count ($\Delta$=0.059, *p*=0.002) and protease inhibitor (PI)-use ($\Delta$=0.060 mm, *p*=0.002). The significant association continued to remain after additionally adjusting for HDL- ($\Delta$=0.057 mm, *p*=0.003) or LDL-cholesterol ($\Delta$=0.058 mm, *p*=0.003), statin- use ($\Delta$=0.042, *p*=0.04), and family history of CVD ($\Delta$=0.057, *p*=0.004).

As shown in Table 4, only age was significantly associated with increased bifurcation c-IMT, while no significant difference was observed between viremia groups (mean ± SE, D: 0.840 mm ± 0.024 versus UD: 0.841 mm ± 0.016, *p*=0.9). Conversely, HIV-RNA viremia >1 copy/mL was the only significant variable associated with differences in ica-IMT in multivariable analysis (mean ± SE, D: 0.758 mm ± 0.019 versus UD: 0.707 mm ± 0.012, *p*=0.03).

## Plaque prevalence and residual viremia

Plaque prevalence tended to be higher in patients with respective D versus UD-viremia (50.0% vs 24.2%, *p*=0.1). As expected, plaque was mostly located on the carotid bifurcation segment (*n*=12) or on several sites (ica and bifurcation, *n*=2; cca and bifurcation, *n*=1).

## Discussion

In this highly-selected population, we report for the first time that residual viremia was strongly associated with increased IMT on the common carotid artery segment, broadening similar findings at higher HIV-RNA levels during ART [11] and among patients displaying elite control of HIV-replication. [12, 13] When examining the other carotid artery segments, we observed that HIV-VL between 1-20 copies was the only significant predictor of thicker internal carotid artery IMT. Nevertheless, it was clear that IMT at the bifurcation segment, which is known to be rather heterogeneous between individuals [14], showed the highest variability of all IMT segments measured with high prevalence of plaque. This could help explain why no difference in total c-IMT was observed between viremia groups.

Furthermore, the magnitude of difference observed on the cca-IMT could be considered clinically relevant. For instance, Ando et al. [15] reported in a large cross-sectional study that an average increase in cca-IMT of 0.04–0.06 mm was associated with a 10-year increase in age. Among younger HIV-infected patients, mean cca-IMT was shown to be 0.04 mm higher in patients 40–47 compared to 24–35 years of age. [16] It would then appear that the difference of roughly 0.06 mm between viremia groups, even after adjusting for age, systolic blood pressure, and HOMA-IR, falls in line with clinically important thresholds. Interestingly, preliminary evidence has pointed to a roughly 4% increased
<table><caption>**Table 4.** Bifurcation and internal carotid artery intima media thicknesses between viremia groups.</caption><thead><tr><th rowspan="3"></th><th colspan="4">Bifurcation IMT</th><th colspan="4">ica-IMT</th></tr><tr><th colspan="2">Univariate</th><th colspan="2">Multivariable</th><th colspan="2">Univariate</th><th colspan="2">Multivariable</th></tr><tr><th>Λ* (95% CI)</th><th>p</th><th>Λ* (95% CI)</th><th>p</th><th>Λ* (95% CI)</th><th>p</th><th>Λ* (95% CI)</th><th>p</th></tr></thead><tbody><tr><td>D- vs UD-viremia groups</td><td>0.033 (-0.036, 0.101)</td><td>0.3</td><td>-0.001 (-0.058, 0.059)</td><td>0.9</td><td>0.051(0.007, 0.096)</td><td>0.03</td><td>**</td><td></td></tr><tr><td colspan="9"><strong>Cardiovascular risk-factors</strong></td></tr><tr><td>Age (per 10 years)</td><td>0.110 (0.064, 0.157)</td><td>&lt;0.001</td><td>0.111 (0.062, 0.159)</td><td>&lt;0.001</td><td>0.032 (-0.006, 0.069)</td><td>0.09</td><td></td><td></td></tr><tr><td>SBP (per 10 mmHg)</td><td>0.018 (-0.005, 0.042)</td><td>0.13</td><td></td><td></td><td>-0.005 (-0.021, 0.011)</td><td>0.5</td><td></td><td></td></tr><tr><td>Hypertension***</td><td>0.070 (-0.057, 0.197)</td><td>0.3</td><td></td><td></td><td>0.062 (-0.023, 0.146)</td><td>0.15</td><td></td><td></td></tr><tr><td>HDL-cholesterol (per mmol/L)</td><td>-0.068 (-0.185, 0.048)</td><td>0.2</td><td></td><td></td><td>-0.036 (-0.116, 0.043)</td><td>0.4</td><td></td><td></td></tr><tr><td>LDL-cholesterol (per mmol/L)</td><td>0.043 (0.011, 0.075)</td><td>0.01</td><td></td><td></td><td>0.013 (-0.011, 0.036)</td><td>0.3</td><td></td><td></td></tr><tr><td>Family history of CVD</td><td>-0.014 (-0.143, 0.115)</td><td>0.8</td><td></td><td></td><td>-0.044 (-0.130, 0.041)</td><td>0.3</td><td></td><td></td></tr><tr><td>HOMA-IR</td><td>0.042 (0.011, 0.073)</td><td>0.009</td><td></td><td></td><td>0.005 (-0.018, 0.027)</td><td>0.7</td><td></td><td></td></tr><tr><td>Statin-use</td><td>-0.067 (-0.194, 0.061)</td><td>0.3</td><td></td><td></td><td>-0.022 (-0.108, 0.065)</td><td>0.6</td><td></td><td></td></tr><tr><td colspan="9"><strong>HIV-related factors</strong></td></tr><tr><td>Nadir CD4+ (per 100 cells/mm³)</td><td>-0.005 (-0.022, 0.012)</td><td>0.5</td><td></td><td></td><td>-0.004 (-0.016, 0.007)</td><td>0.5</td><td></td><td></td></tr><tr><td>CD4+ (per 100 cells/mm³)</td><td>0.163 (-0.260, 0.586)</td><td>0.4</td><td></td><td></td><td>0.080 (-0.212, 0.371)</td><td>0.6</td><td></td><td></td></tr><tr><td>Duration of ART (per year)</td><td>0.020 (0.008, 0.031)</td><td>0.001</td><td></td><td></td><td>0.008 (0.000, 0.017)</td><td>0.046</td><td></td><td></td></tr><tr><td>Yrs from last HIV VL &gt;50 cp/mL</td><td>-0.003 (-0.015, 0.008)</td><td>0.6</td><td></td><td></td><td>0.001 (-0.007, 0.008)</td><td>0.9</td><td></td><td></td></tr><tr><td>PI-use</td><td>0.022 (-0.041, 0.085)</td><td>0.5</td><td></td><td></td><td>0.028 (-0.015, 0.071)</td><td>0.2</td><td></td><td></td></tr><tr><td>Abacavir-use</td><td>-0.036 (-0.106, 0.034)</td><td>0.3</td><td></td><td></td><td>0.008 (-0.041, 0.057)</td><td>0.7</td><td></td><td></td></tr></tbody></table>

All patients were male, non smokers.

*Difference in intima media maximal thickness between groups.

**D-viremia was the only significant predictor. Adding duration of ART to the model did not improve model fit (difference in BIC: 0.616) and was hence not included.

***Hypertension was defined by prior physician's diagnosis or systolic blood pressure ≥140 mmHg or diastolic blood pressure ≥90 mmHg. IMT – intima media thickness; ica-IMT – internal carotid artery intima media thickness; D – detectable; UD – undetectable; SBP – systolic blood pressure; HDL – high-density lipid; LDL – low-density lipid; CVD – cardiovascular disease; HOMA-IR – homeostatic model assessment of insulin resistance; ART – antiretroviral therapy; VL – viral load; PI – protease inhibitors.

doi:10.1371/journal.pone.0113876.t004

absolute difference in prevalent 5-year mortality when comparing patients with 1–19 copies/mL and <1 copy/mL [6], suggesting a potential clinical association with residual viremia. Naturally, these results need to be confirmed in larger epidemiological studies.

Although a wide variety of biomarkers have produced strong associations with higher levels of HIV-replication [6, 17, 18], several studies have failed to demonstrate their significance at <50 copies/mL. [3, 5] From our data, it is hard to determine what role inflammation has on increased c-IMT. The generally higher inflammatory levels observed in patients with detectable versus undetectable HIV viremia indicates that the degree of systemic inflammation may be slightly attenuated, compared to inflammation at higher HIV levels. Larger populations would be needed to properly establish any meaningful difference. Even so, the biological source of inflammation during persistent HIV-viremia remains unclear, as evidence has reported a number of putative mechanisms related to continual production of HIV-RNA from latent reservoirs. [1, 3, 19]
No association with c-IMT and any specific antiretroviral treatment was noted in our study, contrary to other epidemiological reports. [11, 12, 18] Our study sample does have certain obvious differences compared to these studies in that the patient numbers were much smaller and CVD-risk much lower, greatly affecting the power necessary to establish a difference in c-IMT for any one treatment. Nevertheless, future research should pay particular attention to some of the more recent and commonly-used treatments. For example, treatment-experienced patients with well-controlled HIV-RNA have shown substantial reductions in inflammatory markers and markers of monocyte activation after switching to ART containing the integrase inhibitor raltegravir (RAL). [20, 21] Whether these results directly translate into changes in subclinical markers of atherosclerosis is debatable, given that switching to RAL-based regimens failed to show improvement in flow-mediated dilation. [22] Moreover, studies examining both switching to and intensification of RAL-based ART have not demonstrated any further decrease in ultrasensitive HIV-RNA detection [23, 24], leaving it difficult to hypothesize how residual viremia would fit into the association between RAL and inflammation.

One of the major limitations of our study was the few numbers of patients included. We attempted to mitigate the impact of this problem by accounting for two major classical CVD risk factors, smoking and gender, in the study design, where otherwise large variability would have been introduced. As a result, IMT levels were much lower than what has been previously reported among HIV-infected subjects. Indeed, generalizability of our results was limited, yet with the added advantage of increased validity.

Another limitation of our study was that we did not perform repeated measurements of ultrasensitive HIV-RNA, since the aliquots of plasma required to do so exceeded the available amount. Nevertheless, we examined ultrasensitive VL 12-months prior to study visit in a subset of patients (N=37), showing a proportion of patients with HIV-VL below detection threshold at both time points (45.9%) that was roughly similar to a longitudinal study measuring ultrasensitive HIV-RNA in quadruplicate. [3] Finally, outliers could account for some of the differences observed. We repeated the analysis using robust linear regression, which assigns a lower weight to values with higher absolute residuals, to reconstruct the multivariable models, giving similar models with the same conclusion with respect to all c-IMT segments (data not shown). Furthermore, we employed a multivariable modeling strategy known to limit the number of potential confounders, hence all models could only include a handful of confounders at a time. Future research needs to establish how other CVD risk-factors could play a role in the purported association between residual viremia and increased IMT.

In conclusion, higher IMT in certain carotid artery segments was observed in patients with residual viremia. This finding warrants larger longitudinal studies in order to confirm our results and determine if changes in residual viremia are correlated with changes in inflammatory markers and c-IMT.
## Acknowledgments

We are grateful to the patients. We acknowledge Ludivine Laurans, Lydie Houssou and Marie-Christine Rincon for their respective technical assistance for quantifying inflammatory and metabolic markers; Manuela Sebire, Alina Ciuchete, Loïc Desquilbet, Nelly Desplanque, and Catherine Lupin for participant recruitment, management, and data collection; Dr. Jürgen Tredup, Dr. Pauline Campa, Dr. Diane Bollens, Dr. Bénédicte Lefebvre, Dr. Marie-Caroline Meyohas, Dr. Jérôme Pacanowski, Dr. Zineb Ouazene, Dr. Gilles Raguin, Dr. Phillippe Tangre, Dr. Laurent Fonquernie, and Dr. Karine Lacombe for stellar patient recruitment; Sandrine Couffin-Cadiergues and Marcia Trumeau for administrative assistance.

## Author Contributions

Conceived and designed the experiments: AB JLM MD PMG. Performed the experiments: LMJ FB JPB AS NH ZM. Analyzed the data: AB JLM MD PMG. Contributed reagents/materials/analysis tools: LMJ AM FB JPB AS NH ZM JC. Wrote the paper: AB JLM LMJ AM FB JPB AS NH ZM JC MD PMG.

## References

1. Palmer S, Maldarelli F, Wiegand A, Bernstein B, Hanna GJ, et al. (2008) Low-level viremia persists for at least 7 years in patients on suppressive antiretroviral therapy. Proc Natl Acad Sci U S A 105: 3879–3884. doi:10.1073/pnas.0800050105.

2. Hatano H, Delwart EL, Norris PJ, Lee T-H, Neilands TB, et al. (2010) Evidence of persistent low-level viremia in long-term HAART-suppressed, HIV-infected individuals. AIDS 24: 2535–2539. doi:10.1097/QAD.0b013e32833dba03.

3. Chun T-W, Murray D, Justement JS, Hallahan CW, Moir S, et al. (2011) Relationship between residual plasma viremia and the size of HIV proviral DNA reservoirs in infected individuals receiving effective antiretroviral therapy. J Infect Dis 204: 135–138. doi:10.1093/infdis/jir208.

4. Maggiolo F, Callegaro A, Cologni G, Bernardini C, Velenti D, et al. (2012) Ultrasensitive assessment of residual low-level HIV viremia in HAART-treated patients and risk of virological failure. J Acquir Immune Defic Syndr 60: 473–482. doi:10.1097/QAI.0b013e3182567a57.

5. Bastard J-P, Soulié C, Fellahi S, Haïm-Boukobza S, Simon A, et al. (2012) Circulating interleukin-6 levels correlate with residual HIV viraemia and markers of immune dysfunction in treatment-controlled HIV-infected patients. Antivir Ther 17: 915–919. doi:10.3851/IMP2093.

6. Eastburn A, Scherzer R, Zolopa AR, Benson C, Tracy R, et al. (2011) Association of low level viremia with inflammation and mortality in HIV-infected adults. PLoS One 6: e26320. doi:10.1371/journal.pone.0026320.

7. Desvarieux M, Boccara F, Meynard J-L, Bastard J-P, Mallat Z, et al. (2013) Infection duration and inflammatory imbalance are associated with atherosclerotic risk in HIV-infected never-smokers independent of antiretroviral therapy. AIDS 27: 2603–2614. doi:10.1097/QAD.0b013e3283634819.

8. Desvarieux M, Demmer RT, Rundek T, Boden-Albala B, Jacobs DR Jr, et al. (2005) Periodontal microbiota and carotid intima-media thickness: the Oral Infections and Vascular Disease Epidemiology Study (INVEST). Circulation 111: 576–582. doi:10.1161/01.CIR.0000154582.37101.15.

9. Koenker R, Bassett G (1982) Robust Tests for Heteroscedasticity Based on Regression Quantiles. Econometrica 50: 43–61.
10. Friis-Møller N, Thiébaut R, Reiss P, Weber R, Monforte AD, et al. (2010) Predicting the risk of cardiovascular disease in HIV-infected patients: the data collection on adverse effects of anti-HIV drugs study. Eur J Cardiovasc Prev Rehabil 17: 491-501. doi:10.1097/HJR.0b013e328336a150.

11. Baker JV, Henry WK, Patel P, Bush TJ, Conley LJ, et al. (2011) Progression of carotid intima-media thickness in a contemporary human immunodeficiency virus cohort. Clin Infect Dis 53: 826-835. doi:10.1093/cid/cir497.

12. Hsue PY, Hunt PW, Schnell A, Kalapus SC, Hoh R, et al. (2009) Role of viral replication, antiretroviral therapy, and immunodeficiency in HIV-associated atherosclerosis. AIDS 23: 1059-1067. doi:10.1097/QAD.0b013e32832b514b.

13. Pereyra F, Lo J, Triant VA, Wei J, Buzon MJ, et al. (2012) Increased coronary atherosclerosis and immune activation in HIV-1 elite controllers. AIDS 26: 2409-2412. doi:10.1097/QAD.0b013e32835a9950.

14. Touboul P-J, Hennerici MG, Meairs S, Adams H, Amarenco P, et al. (2012) Mannheim carotid intima-media thickness and plaque consensus (2004-2006-2011). An update on behalf of the advisory board of the 3rd, 4th and 5th watching the risk symposia, at the 13th, 15th and 20th European Stroke Conferences, Mannheim, Germany, 2004, Brussels, Belgium, 2006, and Hamburg, Germany, 2011. Cerebrovasc Dis 34: 290-296. doi:10.1159/000343145.

15. Ando F, Takekuma K, Niino N, Shimokata H (2000) Ultrasonic evaluation of common carotid intima-media thickness (IMT) –influence of local plaque on the relationship between IMT and age. J Epidemiol 10: S10-17.

16. Mercié P, Thiébaut R, Aurillac-Lavignolle V, Pellegrin JL, Yvorra-Vives MC, et al. (2005) Carotid intima-media thickness is slightly increased over time in HIV-1-infected patients. HIV Med 6: 380-387. doi:10.1111/j.1468-1293.2005.00324.x.

17. Mangili A, Polak JF, Quach LA, Gerrior J, Wanke CA (2011) Markers of atherosclerosis and inflammation and mortality in patients with HIV infection. Atherosclerosis 214: 468-473. doi:10.1016/j.atherosclerosis.2010.11.013.

18. Ross AC, Rizk N, O'Riordan MA, Dogra V, El-Bejjani D, et al. (2009) Relationship between inflammatory markers, endothelial activation markers, and carotid intima-media thickness in HIV-infected patients receiving antiretroviral therapy. Clin Infect Dis 49: 1119-1127. doi:10.1086/605578.

19. Havlir DV, Strain MC, Clerici M, Ignacio C, Trabattoni D, et al. (2003) Productive infection maintains a dynamic steady state of residual viremia in human immunodeficiency virus type 1-infected persons treated with suppressive antiretroviral therapy for five years. J Virol 77: 11212-11219.

20. Lake JE, McComsey GA, Hulgan T, Wanke CA, Mangili A, et al. (2014) Switch to raltegravir decreases soluble CD14 in virologically suppressed overweight women: the Women, Integrase and Fat Accumulation Trial. HIV Med 15: 431-441. doi:10.1111/hiv.12128.

21. Silva EF, Charreau I, Gourmel B, Mourah S, Kalidi I, et al. (2013) Decreases in inflammatory and coagulation biomarkers levels in HIV-infected patients switching from enfuvirtide to raltegravir: ANRS 138 substudy. J Infect Dis 208: 892-897. doi:10.1093/infdis/jit280.

22. Gupta SK, Mi D, Moe SM, Dubé MP, Liu Z (2013) Effects of switching from efavirenz to raltegravir on endothelial function, bone mineral metabolism, inflammation, and renal function: a randomized, controlled trial. J Acquir Immune Defic Syndr 64: 279-283.

23. Vallejo A, Gutierrez C, Hernandez-Novoa B, Diaz L, Madrid N, et al. (2012) The effect of intensification with raltegravir on the HIV-1 reservoir of latently infected memory CD4 T cells in suppressed patients. AIDS 26: 1885-1894. doi:10.1097/QAD.0b013e3283584521.

24. Lam YMP, McBride KL, Amin J, Cordery DV, Kelleher AD, et al. (2012) Switching virally suppressed, treatment-experienced patients to a raltegravir-containing regimen does not alter levels of HIV-1 DNA. PLoS One 7: e31990. doi:10.1371/journal.pone.0031990.