<figure><img src="image_1.png" /></figure>

HAL
open science

# Performance comparison of next-generation sequencing platforms for determining HIV-1 coreceptor use

Stéphanie Raymond, Florence Nicot, Nicolas Jeanne, Olivier Delfour, Romain Carcenac, Caroline Lefebvre, Michelle Cazabat, Karine Sauné, Pierre Delobel, Jacques Izopet

<figure><img src="image_2.png" /></figure>

## ► To cite this version:

Stéphanie Raymond, Florence Nicot, Nicolas Jeanne, Olivier Delfour, Romain Carcenac, et al. Performance comparison of next-generation sequencing platforms for determining HIV-1 coreceptor use. Scientific Reports, 2017, 7 (1), 10.1038/srep42215. doi: 10.1038/srep42215

HAL Id: hal-05053139

https://hal.science/hal-05053139v1

Submitted on 1 May 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_3.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
SCIENTIFIC REPORTS

OPEN

# Performance comparison of next-generation sequencing platforms for determining HIV-1 coreceptor use

Received: 10 October 2016

Accepted: 06 January 2017

Published: 10 February 2017

Stéphanie Raymond<fnref n="1" />,²,³, Florence Nicot³, Nicolas Jeanne³, Olivier Delfour³, Romain Carcenac³, Caroline Lefebvre³, Michelle Cazabat<fnref n="1" />,³, Karine Sauné<fnref n="1" />,²,³, Pierre Delobel<fnref n="1" />,²,⁴ & Jacques Izopet<fnref n="1" />,²,³

The coreceptor used by HIV-1 must be determined before a CCR5 antagonist, part of the arsenal of antiretroviral drugs, is prescribed because viruses that enter cells using the CXCR4 coreceptor are responsible for treatment failure. HIV-1 tropism is also correlated with disease progression and so must be determined for virological studies. Tropism can be determined by next-generation sequencing (NGS), but not all of these new technologies have been fully validated for use in clinical practice. The Illumina NGS technology is used in many laboratories but its ability to predict HIV-1 tropism has not been evaluated while the 454 GS-Junior (Roche) is used for routine diagnosis. The genotypic prediction of HIV-1 tropism is based on sequencing the V3 region and interpreting the results with an appropriate algorithm. We compared the performances of the MiSeq (Illumina) and 454 GS-Junior (Roche) systems with a reference phenotypic assay. We used clinical samples for the NGS tropism predictions and assessed their ability to quantify CXCR4-using variants. The data show that the Illumina platform can be used to detect minor CXCR4-using variants in clinical practice but technical optimization are needed to improve quantification.

Human immunodeficiency virus (HIV) enters its host cells following the interaction between the virus envelope glycoprotein (Gp120), the cell surface CD4 receptor, and a chemokine receptor, which may be CCR5 and/or CXCR4, acting as a coreceptor<fnref n="1" />. The HIV tropism is defined by the coreceptor(s) use and is correlated with disease progression². Thus, it is essential to determine the HIV coreceptor used before including a CCR5 antagonist in a patient's antiretroviral regimen³. Previous clinical studies have found that minor variants in the virus quasi-species may be responsible for the virological failure of a CCR5-antagonist-based treatment⁴,⁵. Deep sequencing techniques can detect minor variants, especially ones that use CXCR4⁶⁻⁸. The 454 GS-Junior sequencing platform (Roche) can reliably predict HIV-1 tropism⁹⁻¹¹. The Ion Torrent Personal Genome Machine has also been validated for tropism determination¹². Another study evaluated the Illumina platform for determining HIV-1 drug resistance and HIV-1 tropism¹³⁻¹⁵. Nevertheless, analytical validation for determining HIV-1 tropism in clinical practice is still limited. We, therefore, evaluated the performances of the Illumina MiSeq platform for predicting HIV tropism by comparing its performance with that of the 454 GS-Junior system and a reference recombinant virus phenotypic entry assay.

## Results

**Sensitivity of deep sequencing for detecting minor CXCR4-using variants.** We determined the sensitivity threshold of NGS by calculating the error rate, either globally or for each position of V3. The mean frequency of V3 variant artifacts determined after analysis of 20 virus clones with the Illumina was 0.078% [exact Poisson 99% confidence interval (CI), 0.059–0.097] of the reads (Fig. 1). This fixed cut-off provided sensitivity thresholds of 0.35% for 2000 reads of MiSeq and of 0.26% for 5000 reads. We then used the same material to

<footnote n="1">¹INSERM, U1043, Toulouse, F-31300, France. ²Université Toulouse III Paul-Sabatier, Faculté de Médecine Toulouse-Purpan, Toulouse, F-31300, France. ³CHU de Toulouse, Hôpital Purpan, Laboratoire de Virologie, Toulouse, F-31300, France. ⁴CHU de Toulouse, Hôpital Purpan, Service des Maladies Infectieuses et Tropicales, Toulouse, F-31300, France. Correspondence and requests for materials should be addressed to S.R. (email: raymond.s@chu-toulouse.fr)</footnote>
<figure><img src="image_4.png" /><figcaption>**Figure 1.** Error rate of amplification and deep sequencing for each NGS platform at each position of the V3 sequence. The error rates for the MiSeq Illumina (Fig. 1A) and 454 GS-Junior (Fig. 1B) are shown on two separate graphs. The global mean (blue line) is the mean frequency of artifactual V3 variants of 20 virus clones. The position mean (red line) is the error rate estimated at each position of V3 by comparing the UDS reads to the Sanger sequences of 20 clones. The shaded regions represent the 99% confidence interval of global (blue) and position (red) mean error rates.</figcaption></figure>

compare the systems. The mean frequency of V3 variant artifacts found with the 454 GS-Junior was 0.018% [exact Poisson 99% CI, -0.033-0.039] of the reads. This provided a sensitivity threshold of 0.25% for 2000 reads with this system. We next determined position-specific error rates along the V3 sequence, defined as the upper 99% confidence interval (Poisson statistics) of the mean frequency of artifactual codons at each V3 position among the 20 virus clones (Fig. 1). We then attributed a weighted error rate to each position and used these rates to construct a sensitivity threshold matrix for each position of V3 to retain a minor virus variant harboring point mutations as authentic for a given number of reads with P < 0.001. The position-specific mean error rate of the MiSeq system was 0.034% at position 8 of V3 and 0.142% at position 13 V3, with great variation over the full length of the V3 region. The position-specific mean error rate of the 454 GS-Junior system was 0% at positions 33 and 35 and 0.176% at position 20 of V3. The largest variations occurred between amino acids 19 and 21, which are located in a homopolymeric region.

**Sensitivity and linearity for quantifying CXCR4-using variants.** We evaluated the sensitivity of the NGS for quantifying CXCR4-using variants with artificial mixtures of pure X4 (CHS02) and R5 (CHS11) virus clones. The MiSeq NGS detected 0.5% of X4 viruses in 2/3 mixtures and 1% in 3/3 mixtures. The 454 GS-Junior NGS detected 1% of X4 viruses in 2/3 mixtures and 5% of X4 viruses in 3/3 mixtures (Table 1). Linear regression analysis of the proportion of CXCR4-using variants (0.5 to 100%) plotted against the expected frequencies yielded coefficients of determination of $R^2 = 0.926$ for the MiSeq data (Fig. 2A) and $R^2 = 0.993$ for the 454 GS-Junior data (Fig. 2B). Spearman analysis showed significant correlations between the expected values and the values obtained with both MiSeq ($\rho = 1, p < 0.001$) and the 454 GS-Junior ($\rho = 1, p < 0.001$). Linear regression showed that the MiSeq system overestimated the X4 variants (MiSeq = 19.95 + 0.90*X4 input) while the proportion of X4 variants quantified with 454 GS-Junior was very similar to the theoretical value (454 GS-Junior = 1.58 + 1.02*X4 input).
<table><caption>**Table 1. Detecting and quantifying X4 variants in HIV-1 quasispecies by deep sequencing.** Each CHS11(R5):CHS02 (X4) virus mixture was assessed in triplicate (T1, T2, T3) or duplicate beyond 5%.</caption><thead><tr><th rowspan="2">X4 input %</th><th colspan="3">MiSeq</th><th rowspan="2">Mean</th><th rowspan="2">CV %</th><th colspan="4">454 GS-Junior</th><th rowspan="2">CV %</th></tr><tr><th>T1</th><th>T2</th><th>T3</th><th>T1</th><th>T2</th><th>T3</th><th>Mean</th></tr></thead><tbody><tr><td>0.5</td><td>0.0</td><td>10.7</td><td>21.0</td><td>10.6</td><td>99</td><td>0.0</td><td>0.0</td><td>0.0</td><td>0.0</td><td>-</td></tr><tr><td>1.0</td><td>17.6</td><td>15.0</td><td>2.9</td><td>11.8</td><td>66</td><td>0.6</td><td>0.5</td><td>0.0</td><td>0.4</td><td>88</td></tr><tr><td>5.0</td><td>18.3</td><td>35.2</td><td>24.5</td><td>26</td><td>33</td><td>5.0</td><td>4.2</td><td>5.3</td><td>4.8</td><td>12</td></tr><tr><td>20.0</td><td>51.9</td><td>57.4</td><td>-</td><td>54.7</td><td>7</td><td>30.0</td><td>25.2</td><td>-</td><td>27.6</td><td>12</td></tr><tr><td>50.0</td><td>61.1</td><td>78.7</td><td>-</td><td>69.9</td><td>18</td><td>56.2</td><td>53.1</td><td>-</td><td>54.7</td><td>4</td></tr><tr><td>75.0</td><td>96.0</td><td>89.6</td><td>-</td><td>92.8</td><td>5</td><td>80.6</td><td>81.6</td><td>-</td><td>81.1</td><td>1</td></tr><tr><td>100.0</td><td>100.0</td><td>100.0</td><td>-</td><td>100.0</td><td>0</td><td>100.0</td><td>100.0</td><td>-</td><td>100.0</td><td>0</td></tr></tbody></table>

<figure><img src="image_5.png" /></figure>

<figure><img src="image_6.png" /><figcaption>**Figure 2. Quantifying X4 variants in HIV-1 quasispecies by deep sequencing.** Each CHS11(R5):CHS02 (X4) virus mixture was assessed in triplicate or duplicate beyond 5%. Figure 2A. Linear regression of the percentage of X4 variants quantified by MiSeq. Figure 2B. Linear regression of the percentage of X4 variants quantified by 454 GS-Junior. Solid black line is the regression line. Dotted black lines show the 95% confidence interval of the mean.</figcaption></figure>

**Comparison of deep sequencing and a phenotypic method for predicting tropism.** We compared the genotypic predictions obtained using the MiSeq and 454 GS-Junior systems and the Pyrovir tropism prediction (http://diag.ablsa.com/pyrovir/submit.php) and the phenotype using TTT in 52 plasma samples from antiretroviral naïve patients (Table 2). The phenotypic assay found 33 R5 samples and 19 R5X4/X4 samples. The MiSeq and Pyrovir methods correctly predicted 30 R5 samples and 10 X4 samples with an overall concordance with the phenotype of 77% (Table 3). The 454 GS-Junior and Pyrovir systems correctly predicted 28 R5 samples and 9 X4 samples with an overall concordance with the phenotype of 71%.
<table><caption>Table 2. NGS and phenotypic assay results for 52 clinical samples.</caption><thead><tr><th rowspan="2">Sample</th><th rowspan="2">HIV-1 subtype</th><th rowspan="2">Viral load (log cop/mL)</th><th colspan="2">MiSeq</th><th colspan="2">454 GS-Junior</th><th rowspan="2">Phenotype<br>TTT</th></tr><tr><th>Reads number</th><th>%X4</th><th>Reads number</th><th>%X4</th></tr></thead><tbody><tr><td>1</td><td>B</td><td>3.93</td><td>14779</td><td>&lt;0.2</td><td>4964</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>2</td><td>B</td><td>5.32</td><td>7582</td><td>&lt;0.2</td><td>4759</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>3</td><td>B</td><td>5.33</td><td>9402</td><td>&lt;0.2</td><td>4765</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>4</td><td>B</td><td>3.89</td><td>5856</td><td>&lt;0.2</td><td>5279</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>5</td><td>B</td><td>5.11</td><td>12150</td><td>&lt;0.2</td><td>2415</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>6</td><td>B</td><td>6.70</td><td>4028</td><td>&lt;0.3</td><td>2645</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>7</td><td>B</td><td>4.55</td><td>552</td><td>&lt;0.6</td><td>3345</td><td>&lt;0.2</td><td>R5</td></tr><tr><td>8</td><td>B</td><td>5.67</td><td>4766</td><td>&lt;0.2</td><td>2948</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>9</td><td>B</td><td>4.89</td><td>6681</td><td>&lt;0.2</td><td>5210</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>10</td><td>B</td><td>5.87</td><td>7131</td><td>&lt;0.2</td><td>2675</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>11</td><td>B</td><td>6.11</td><td>12195</td><td>&lt;0.2</td><td>977</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>12</td><td>B</td><td>5.82</td><td>3275</td><td>&lt;0.3</td><td>1468</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>13</td><td>B</td><td>5.65</td><td>2534</td><td>&lt;0.3</td><td>1606</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>14</td><td>B</td><td>5.03</td><td>2484</td><td>&lt;0.3</td><td>2386</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>15</td><td>B</td><td>7.00</td><td>1997</td><td>&lt;0.3</td><td>1331</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>16</td><td>B</td><td>7.00</td><td>3360</td><td>&lt;0.3</td><td>1389</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>17</td><td>B</td><td>6.48</td><td>2378</td><td>&lt;0.3</td><td>2793</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>18</td><td>B</td><td>6.72</td><td>2461</td><td>&lt;0.3</td><td>2526</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>19</td><td>B</td><td>5.77</td><td>3221</td><td>&lt;0.3</td><td>2541</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>20</td><td>B</td><td>5.83</td><td>1123</td><td>&lt;0.4</td><td>1828</td><td>&lt;0.3</td><td>R5</td></tr><tr><td>21</td><td>B</td><td>3.19</td><td>8817</td><td>&lt;0.2</td><td>6513</td><td>&lt;0.4</td><td>R5</td></tr><tr><td>22</td><td>C</td><td>5.13</td><td>3523</td><td>&lt;0.3</td><td>1943</td><td>&lt;0.4</td><td>R5</td></tr><tr><td>23</td><td>B</td><td>&gt;7</td><td>10484</td><td>&lt;0.2</td><td>2370</td><td>&lt;0.5</td><td>R5</td></tr><tr><td>24</td><td>B</td><td>2.70</td><td>8379</td><td>&lt;0.2</td><td>3478</td><td>&lt;0.5</td><td>R5</td></tr><tr><td>25</td><td>B</td><td>4.89</td><td>1888</td><td>&lt;0.3</td><td>1886</td><td>&lt;0.5</td><td>R5</td></tr><tr><td>26</td><td>B</td><td>6.00</td><td>2456</td><td>&lt;0.3</td><td>1719</td><td>&lt;0.5</td><td>R5</td></tr><tr><td>27</td><td>B</td><td>6.95</td><td>2638</td><td>&lt;0.3</td><td>629</td><td>&lt;0.8</td><td>R5</td></tr><tr><td>28</td><td>B</td><td>5.47</td><td>1563</td><td>&lt;0.4</td><td>180</td><td>&lt;0.8</td><td>R5</td></tr><tr><td>29</td><td>B</td><td>5.81</td><td>10769</td><td>&lt;0.2</td><td>4522</td><td>0.2</td><td>R5</td></tr><tr><td>30</td><td>B</td><td>4.66</td><td>5455</td><td>&lt;0.2</td><td>4216</td><td>0.7</td><td>R5</td></tr><tr><td>31</td><td>B</td><td>5.81</td><td>5993</td><td>4.2</td><td>2246</td><td>2.6</td><td>R5</td></tr><tr><td>32</td><td>B</td><td>6.55</td><td>12181</td><td>3.3</td><td>2499</td><td>5.6</td><td>R5</td></tr><tr><td>33</td><td>B</td><td>7.00</td><td>4174</td><td>29.8</td><td>2383</td><td>9.5</td><td>R5</td></tr><tr><td>34</td><td>B</td><td>5.00</td><td>6983</td><td>7.3</td><td>2551</td><td>6</td><td>R5X4</td></tr><tr><td>35</td><td>B</td><td>5.90</td><td>2622</td><td>100</td><td>4291</td><td>100</td><td>R5X4</td></tr><tr><td>36</td><td>B</td><td>3.83</td><td>2366</td><td>100</td><td>2308</td><td>100</td><td>R5X4</td></tr><tr><td>37</td><td>CRF01</td><td>6.00</td><td>3640</td><td>&lt;0.3</td><td>2881</td><td>&lt;0.1</td><td>R5X4</td></tr><tr><td>38</td><td>B</td><td>6.34</td><td>5080</td><td>&lt;0.2</td><td>2335</td><td>&lt;0.3</td><td>R5X4</td></tr><tr><td>39</td><td>B</td><td>3.82</td><td>7560</td><td>&lt;0.2</td><td>2851</td><td>&lt;0.3</td><td>R5X4</td></tr><tr><td>40</td><td>B</td><td>4.34</td><td>3332</td><td>&lt;0.3</td><td>5562</td><td>&lt;0.4</td><td>R5X4</td></tr><tr><td>41</td><td>B</td><td>5.78</td><td>6053</td><td>0.3</td><td>3372</td><td>&lt;0.4</td><td>R5X4</td></tr><tr><td>42</td><td>B</td><td>6.41</td><td>5333</td><td>&lt;0.2</td><td>25085</td><td>&lt;0.5</td><td>R5X4</td></tr><tr><td>43</td><td>B</td><td>3.83</td><td>4882</td><td>&lt;0.2</td><td>3317</td><td>&lt;0.5</td><td>R5X4</td></tr><tr><td>44</td><td>CRF02</td><td>5.58</td><td>2054</td><td>&lt;0.3</td><td>4647</td><td>&lt;0.5</td><td>R5X4</td></tr><tr><td>45</td><td>B</td><td>4.09</td><td>1948</td><td>0.7</td><td>5395</td><td>&lt;0.5</td><td>R5X4</td></tr><tr><td>46</td><td>B</td><td>4.55</td><td>19404</td><td>&lt;0.2</td><td>1950</td><td>&lt;0.6</td><td>R5X4</td></tr><tr><td>47</td><td>B</td><td>4.46</td><td>948</td><td>40.3</td><td>3137</td><td>38.9</td><td>R5X4</td></tr><tr><td>48</td><td>B</td><td>4.75</td><td>4264</td><td>&lt;0.3</td><td>2694</td><td>8.7</td><td>R5X4</td></tr><tr><td>49</td><td>B</td><td>2.78</td><td>3313</td><td>100</td><td>4120</td><td>99.4</td><td>R5X4</td></tr><tr><td>50</td><td>B</td><td>6.64</td><td>2657</td><td>1.3</td><td>3283</td><td>99.6</td><td>R5X4</td></tr><tr><td>51</td><td>CRF01</td><td>2.69</td><td>546</td><td>11.5</td><td>5330</td><td>99.7</td><td>R5X4</td></tr><tr><td>52</td><td>B</td><td>5.08</td><td>8977</td><td>100</td><td>2799</td><td>100</td><td>X4</td></tr></tbody></table>
<table><caption>Table 3. HIV-1 tropism predictions by the two NGS methods and a phenotypic method.</caption><thead><tr><th rowspan="2"></th><th rowspan="2"></th><th colspan="2">Phenotype TTT</th><th rowspan="2">Concordance NGS/TTT</th></tr><tr><th>R5</th><th>X4</th></tr></thead><tbody><tr><td rowspan="2">MiSeq/PyroVir</td><td>R5</td><td>30</td><td>9</td><td rowspan="2">77%</td></tr><tr><td>X4</td><td>3</td><td>10</td></tr><tr><td rowspan="2">454 GS-Junior/Pyrovir</td><td>R5</td><td>28</td><td>10</td><td rowspan="2">71%</td></tr><tr><td>X4</td><td>5</td><td>9</td></tr></tbody></table>

The concordance between the two NGS methods for predicting HIV-1 tropism was 90%. The two NGS methods disagreed on 5 samples (samples 29, 30, 41, 45 and 48 in Table 2): MiSeq predicted two to be X4-using (X4 variant frequencies: 0.3 and 0.7%) that were R5 according to the 454 GS-Junior. The 454 GS-Junior predicted 3 samples as X4 (X4 variant frequencies: 0.2, 0.7 and 8.7%) while the MiSeq system identified them as R5. The phenotype of the discordant samples showed that MiSeq correctly predicted the tropism of four of the five samples (samples 29, 30, 41 and 45).

We also evaluated the capacity of the MiSeq and 454 GS-Junior systems to accurately quantify CXCR4-using variants by comparing the percentages of X4 variants in 11 samples with concordant detection of X4 variants (Table 2). The MiSeq system gave the percentage of CXCR4-using variants as 1.3–100% (mean = 45.2%), while the 454 GS-Junior system gave values of 2.6–100% (mean = 60.1%). Spearman analysis showed a significant correlation between the two methods (Spearman, $\rho$ = 0.667, $p$ = 0.025).

## Discussion

We assessed the analytical performance of the MiSeq Illumina deep sequencing system for determining HIV-1 coreceptor use and compared it to that of the 454 GS-Junior Roche method. The capacities of the two deep sequencing methods for determining HIV-1 tropism in clinical samples were also compared to the reference phenotypic method.

We first determined the error rate of the NGS resulting from PCR bias and sequencing errors. The error rate of the MiSeq Illumina (0.078%) was greater than that of the 454 GS-Junior Roche (0.018%), but this was partly offset by more reads (mean: 5542) with the MiSeq than with the 454 GS-Junior (mean: 3480). We used the error rate to discriminate between the true and artifactual mutations⁹. The sensitivities of the two systems for detecting minor CXCR4-using variants were similar: 0.26% for 5000 reads for the MiSeq Illumina and 0.25% for 2000 reads for the 454 GS-Junior Roche. Our results for the Illumina deep sequencing are thus similar to those of another study that found error rates of 0.47% for the HIV reverse transcriptase plasmids and of 0.26% for the HCV NS3 plasmids at nucleotide level¹⁶. The position-specific error rate obtained using MiSeq was homogeneous because the nucleic acid combination does not influence the errors of PCR or sequencing. In contrast, the pyrosequencing was influenced by the presence of homopolymeric regions as previously described¹⁷.

Previous studies have shown that minor CXCR4-using variants are responsible for the failure of CCR5-antagonist based treatments⁵,⁶. Thus, assays that are very sensitive for detecting minor variants are required to ensure the safe use of CCR5 antagonists. We used mixtures of R5 and X4 virus clones to determine the sensitivities for detecting minor X4 variants. The MiSeq system was more sensitive (0.5–1%) than the 454 GS-Junior system (1–5%), perhaps because more reads were obtained with the MiSeq than with the 454 GS-Junior. This sensitivity is similar to that published for the 454 GS-Junior¹⁰. The quantification of X4 variants in the mixtures showed that the MiSeq overestimated the frequency of X4 viruses by around 20% for low values. As we mentioned in Methods, the PCR protocols used on the two platforms were slightly different, which could explain how PCR bias may have favoured the amplification of X4 clones of CHS02 strain. Thus, technical optimization is required to improve the accuracy of CXCR4-using variant quantification, as was done for the 454 GS-Junior assay⁹. However, the CXCR4-using variants in the clinical samples quantified using the MiSeq system correlated well with the 454 GS-Junior data.

The two NGS assays agreed in their analyses of 90% of the 52 clinical samples, similar to the concordance between two phenotypic assays for predicting HIV-1 tropism⁷,¹⁸. The concordance of both NGS assays with the phenotypic assay was higher than 70%. However, genotypic prediction using deep sequencing was less sensitive for detecting X4 viruses compared to a phenotypic assay. The genotypic prediction is often poor for the non-B subtypes of HIV-1¹⁹. However, the 52 samples in our panel included only four samples with non-B subtypes (2 CRF01-AE, 1 CRF02-AG and 1 subtype C) and a correct prediction was observed for two samples (1 CRF01-AE and 1 subtype C). We also tested the capacity of two other genotypic algorithms, the CM classifier (http://spg.med.tsinghua.edu.cn/CM.html) and geno2pheno 5.75% (http://coreceptor.geno2pheno.org/index.php) for predicting tropism²⁰,²¹. The sensitivity of the CM classifier for detecting the CXCR4-using variants was only 42% and 53% using the data set obtained with the MiSeq and 454 GS-Junior, respectively (data not shown). The sensitivity of geno2pheno 5.75% for detecting the CXCR4-using variants was 63% using both data sets and the difference with the sensitivity of Pyrovir was not significant (data not shown). Thus, the performance of Pyrovir for predicting tropism using deep sequencing was similar to the performance of other validated genotypic algorithms on this data set. The sensitivity of the genotypic algorithms needs to be improved for the prediction of CXCR4-using variants. Only the V3 region of the envelope is used to predict HIV-1 tropism while the complete envelope sequence is used in the phenotypic assay. Previous studies have shown that other envelope regions are involved in the coreceptor used for virus entry²²,²³. New generations of sequencing systems that allow sequencing of the complete HIV-1 envelope and new algorithms based on analysis of other regions may improve the genotypic prediction of HIV-1 coreceptor use.
We have demonstrated that the MiSeq Illumina technology is as accurate as the 454 GS-Junior Roche system technology for determining HIV-1 tropism compared to a reference phenotypic assay. However, the quantification of CXCR4-using variants needs to be improved. Next-generation sequencing plus accurate genotypic algorithms for predicting HIV-1 tropism will eventually provide sensitive methods for managing the administration of CCR5 antagonists and for pathophysiological studies.

## Materials and Methods

**Samples and nucleic acid extraction.** Plasma samples were obtained from 52 HIV-1-infected patients followed at the Department of Infectious Diseases of Toulouse University Hospital, France. Their HIV-1 tropism was determined during follow-up in accordance with French medical guidelines. The experimental protocol was approved by the Toulouse University Hospital. The patients gave their informed consent for virological studies. Plasmid clones of *env* obtained from HIV-1 subtype B primary isolates were used to determine the error rates of the deep sequencing systems. Artificial mixtures of X4 and R5 virus clones were used to assess the sensitivity and linearity of assays of minor CXCR4-using variant by these systems. CHS02 (GenBank accession no. DQ136867.1, X4 phenotype) and CHS11 (GenBank accession no. DQ136859.1, R5 phenotype) were mixed in defined proportions of X4:R5 viruses (0:100; 0.5:99.5; 1:99; 5:95; 20:80; 50:50; 75:25 and 100:0, each with 2–3 replicates). Virus RNA was extracted using the QIAamp Viral RNA Mini Kit.

**Phenotypic characterization of HIV-1 coreceptor usage.** We determined the HIV-1 tropism with the Toulouse Tropism Test (TTT) phenotypic assay²⁴. Briefly, a fragment encoding the gp120 and the ectodomain of gp41 was amplified by reverse transcription-PCR (RT-PCR) using HIV-1 RNA isolated from the patient's plasma. The PCR products were then subjected to nested PCR. Two amplifications were performed in parallel on aliquots of each sample; the amplified products were then pooled to prevent sampling bias of the virus population. The phenotype of HIV-1 coreceptor use was determined using a recombinant virus entry assay with the pNL43-Δenv-Luc2 vector. We transfected 293 T cells with both the NheI-linearized pNL43-Δenv-Luc2 vector DNA and the product of the nested PCR obtained from the challenged HIV-1-containing sample. The chimeric recombinant virus particles released into the supernatant were used to infect U87 indicator cells bearing CD4 and either CCR5 or CXCR4. Virus entry was assessed by measuring the luciferase activity in lysed cells. Minor X4 variants were detected when they accounted for 0.5% or more of the total population as assessed in experiments performed on mixtures of various X4/R5 DNA ratios.

**454 GS-Junior/Roche deep sequencing of the HIV-1 V3 env region.** A 415-nucleotide long fragment encompassing the V3 *env* region was generated by nested PCR as previously described⁹. The amplified PCR products were purified using Agencourt Ampure PCR purification beads (Beckman Coulter, Brea, CA) and quantified using a Quant-iT Picogreen dsDNA Assay Kit (Invitrogen) on a LightCycler 480 (Roche Diagnostics, Meylan, France). PCR amplicons were combined and clonally amplified on DNA capture beads in water-in-oil emulsion micro-reactors. A total of 500,000 DNA-enriched beads were deposited in the wells of a full GS Junior Titanium PicoTiterPlate device and pyrosequenced in both the forward and reverse directions. The sequences of the V3 *env* regions were first processed using GS Amplicon Variant Analyzer (AVA) software (Roche). Only sequences that had been read in both senses were used for further analyses.

**Illumina deep sequencing of the HIV-1 V3 env region.** The samples were prepared for sequencing on Illumina MiSeq at the genomic platform of Toulouse (http://get.genotoul.fr/). The first PCR amplified, in duplicate, a 3075-nucleotide long fragment. The nested PCR amplified a 406-nucleotide long fragment encompassing the V3 *env* region. The amplified PCR products were purified using Agencourt Ampure PCR Purification beads (Beckman Coulter, Brea, CA) and quantified using a Quant-iT Picogreen dsDNA Assay Kit (Invitrogen) on a LightCycler 480 (Roche Diagnostics, Meylan, France). PCR amplicons were combined and diluted to obtain a concentration of 30 ng/µL and the Nextera XT DNA Library Preparation kit was used for index amplification. Reads containing undefined nucleotides ('N's) were filtered out. This can occur when the signals of nucleotides incorporated in a cluster are much lower than those of surrounding clusters. Only sequences with an average phred equivalent quality score of >Q30 were retained.

**Genotypic prediction of HIV-1 coreceptor use.** The sequence reads were aligned with the BaL consensus sequence (GenBank accession no. AY426110.1) and processed using an in-house automated data cleaning strategy⁹. Non-functional V3 sequences were discarded using biological filters and statistical filters were used to discard sequences with artifactual point mutations. As previously reported⁹, V3 sequences were considered to be non-functional if (i) they did no start and end with the cysteine required for the disulfide bond; (ii) they were not 32–38 amino-acids long; (iii) they contained a stop codon; (iv) they were not sufficiently like the V3 consensus at three typical motifs: a "CTRP"-like signature at the N-terminus, a "GPGR"-like signature at the hairpin crown, or a "QAHC"-like signature at the C-terminus with an identity of 0.5 and 0.75 for substitution and insertion/deletion of an amino-acid at any of the three signature motifs. This biological and statistical data cleaning strategy has been integrated in a program (PyroVir, IDDN FR.001.160011.000.S.P.2012.000.31230, Inserm-Transfert) that provides a fast, automated position-specific process for inferring HIV-1 tropism from V3 env deep sequencing data with improved detection of minor variants. The genotypic rule used to predict CXCR4-usage can be changed according to the virus subtype, particularly for subtypes D and CRF01-AE for which we have developed specific algorithms²⁵,²⁶. We used the combined 11/25 and net charge rules to infer the tropism of each virus clone from the V3 amino acid sequence. It requires one of the following criteria for predicting the CXCR4 coreceptor usage of HIV-1 subtype B²⁷,²⁸: (i) an R or K at position 11 of V3 and/or a K at position 25; (ii) an R at position 25 of V3 and a net charge of at least +5; and (iii) a net charge of at least +6. The V3 net charge was calculated by subtracting the
number of negatively charged amino acids (D and E) from the number of positively charged ones (K and R). The CM classifier (generic prediction) was used to predict tropism with cleaned data of V3 amino acid sequences²⁰.

**Determining the position-specific error rates of deep sequencing along the V3 sequence.** As the errors generated during deep sequencing are sequence-dependent, we determined specific error rates at each position in V3. We measured the mean codon error rate, based on the worst error rate of the 3 nucleotides, among the 20 clones at each V3 position. The position-specific error rates were then defined as the upper limit of the 99% confidence interval of the mean frequency of artifactual codons among the 20 clones at each position of V3. We then determined weighted error rates to construct a sensitivity threshold matrix at each position of V3 to identify authentic virus variants harboring a point mutation for a given number of reads with P < 0.001 (Poisson statistics).

**Data analysis.** Poisson statistics were calculated using R version 3.0.0. The linearity of the X4 variant quantifications was estimated by linear regression of data for mixtures of X4:R5 viruses (XLSTAT, Addinsoft). A Bland-Altman analysis (scatter plot of the differences between the paired measurements plotted against their means) of samples containing X4 variants obtained with MiSeq and 454 GS-Junior systems was used to assess graphically the magnitude of disagreement between the methods and estimate the overall bias. A Spearman's correlation coefficient was used to assess the strength of linear association between the methods for quantifying X4 variants.

**References**

1. Berger, E. A., Murphy, P. M. & Farber, J. M. Chemokine receptors as HIV-1 coreceptors: roles in viral entry, tropism, and disease. *Annual review of immunology* **17**, 657–700 (1999).

2. Schuitemaker, H. et al. Biological phenotype of human immunodeficiency virus type 1 clones at different stages of infection: progression of disease is associated with a shift from monocytotropic to T-cell-tropic virus population. *Journal of virology* **66**, 1354–60 (1992).

3. Gulick, R. M. et al. Maraviroc for previously treated patients with R5 HIV-1 infection. *N. Engl. J. Med.* **359**, 1429–1441 (2008).

4. Archer, J. et al. Detection of low-frequency pretherapy chemokine (CXC motif) receptor 4 (CXCR4)-using HIV-1 with ultra-deep pyrosequencing. *AIDS (London, England)* **23**, 1209–18 (2009).

5. Swenson, L. C. et al. Deep V3 sequencing for HIV type 1 tropism in treatment-naive patients: a reanalysis of the MERIT trial of maraviroc. *Clin Infect Dis* **53**, 732–42 (2011).

6. Swenson, L. C. et al. Deep sequencing to infer HIV-1 co-receptor usage: application to three clinical trials of maraviroc in treatment-experienced patients. *J Infect Dis* **203**, 237–45 (2011).

7. Saliou, A. et al. Concordance between two phenotypic assays and ultradeep pyrosequencing for determining HIV-1 tropism. *Antimicrob Agents Chemother* **55**, 2831–6 (2011).

8. Raymond, S. et al. Frequency of CXCR4-using viruses in primary HIV-1 infections using ultra-deep pyrosequencing. *AIDS* **25**, 1668–70 (2011).

9. Jeanne, N. et al. Position-specific automated processing of V3 env ultra-deep pyrosequencing data for predicting HIV-1 tropism. *Sci Rep* **5**, 16944 (2015).

10. Knapp, D. J. H. F. et al. 'Deep' sequencing accuracy and reproducibility using Roche/454 technology for inferring co-receptor usage in HIV-1. *PLoS ONE* **9**, e99508 (2014).

11. Kagan, R. M. et al. A genotypic test for HIV-1 tropism combining Sanger sequencing with ultradeep sequencing predicts virologic response in treatment-experienced patients. *PLoS ONE* **7**, e46334 (2012).

12. Gibson, R. M. et al. Sensitive deep-sequencing-based HIV-1 genotyping assay to simultaneously determine susceptibility to protease, reverse transcriptase, integrase, and maturation inhibitors, as well as HIV-1 coreceptor tropism. *Antimicrob. Agents Chemother.* **58**, 2167–2185 (2014).

13. Dudley, D. M. et al. Cross-clade simultaneous HIV drug resistance genotyping for reverse transcriptase, protease, and integrase inhibitor mutations by Illumina MiSeq. *Retrovirology* **11**, 122 (2014).

14. Ram, D. et al. Evaluation of GS Junior and MiSeq next-generation sequencing technologies as an alternative to Trugene population sequencing in the clinical HIV laboratory. *J. Virol. Methods* **212**, 12–16 (2015).

15. Archer, J. et al. Use of four next-generation sequencing platforms to determine HIV-1 coreceptor tropism. *PLoS ONE* **7**, e49602 (2012).

16. Thys, K. et al. Performance assessment of the Illumina massively parallel sequencing platform for deep sequencing analysis of viral minority variants. *J. Virol. Methods* **221**, 29–38 (2015).

17. Wang, C., Mitsuya, Y., Gharizadeh, B., Ronaghi, M. & Shafer, R. W. Characterization of mutation spectra with ultra-deep pyrosequencing: application to HIV-1 drug resistance. *Genome Res.* **17**, 1195–1201 (2007).

18. Skrabal, K. et al. Determining human immunodeficiency virus coreceptor use in a clinical setting: degree of correlation between two phenotypic assays and a bioinformatic model. *Journal of clinical microbiology* **45**, 279–84 (2007).

19. Garrido, C. et al. Evaluation of eight different bioinformatics tools to predict viral tropism in different human immunodeficiency virus type 1 subtypes. *J Clin Microbiol* **46**, 887–91 (2008).

20. Shen, H.-S. et al. HIV coreceptor tropism determination and mutational pattern identification. *Sci Rep* **6**, 21280 (2016).

21. Lengauer, T., Sander, O., Sierra, S., Thielen, A. & Kaiser, R. Bioinformatics prediction of HIV coreceptor usage. *Nat. Biotechnol.* **25**, 1407–1410 (2007).

22. Groenink, M. et al. Relation of phenotype evolution of HIV-1 to envelope V2 configuration. *Science (New York, N.Y)* **260**, 1513–6 (1993).

23. Thielen, A. et al. Improved prediction of HIV-1 coreceptor usage with sequence information from the second hypervariable loop of gp120. *J Infect Dis* **202**, 1435–43 (2010).

24. Raymond, S. et al. Development and performance of a new recombinant virus phenotypic entry assay to determine HIV-1 coreceptor usage. *J Clin Virol* **47**, 126–130 (2010).

25. Raymond, S. et al. Genotypic prediction of HIV-1 subtype D tropism. *Retrovirology* **8**, 56 (2011).

26. Raymond, S. et al. Genotypic prediction of HIV-1 CRF01-AE tropism. *J. Clin. Microbiol.* **51**, 564–570 (2013).

27. Delobel, P. et al. Population-based sequencing of the V3 region of env for predicting the coreceptor usage of human immunodeficiency virus type 1 quasispecies. *Journal of clinical microbiology* **45**, 1572–80 (2007).

28. Raymond, S. et al. Correlation between genotypic predictions based on V3 sequences and phenotypic determination of HIV-1 tropism. *AIDS (London, England)* **22**, F11–6 (2008).
**Acknowledgements**

We thank the genomic platform of Toulouse (INRA) for assistance with MiSeq Illumina sequencing. This work was supported by INSERM and Illumina, who provided the MiSeq Reagent Kit v3.

**Author Contributions**

S.R., P.D. and J.I. designed the project. S.R., F.N. and J.I. analyzed results and wrote the manuscript. N.J. and O.D. performed bio-informatics analyses. K.S. performed statistical analyses. F.N., R.C., C.L. and M.C. carried out the experiments.

**Additional Information**

**Competing financial interests:** The authors declare no competing financial interests.

**How to cite this article:** Raymond, S. *et al*. Performance comparison of next-generation sequencing platforms for determining HIV-1 coreceptor use. *Sci. Rep.* **7**, 42215; doi: 10.1038/srep42215 (2017).

**Publisher's note:** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

<figure><img src="image_7.png" /></figure>

This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

© The Author(s) 2017