# HIV-1 Drug Resistance Mutations: Potential Applications for Point-of-Care Genotypic Resistance Testing

Soo-Yon Rhee, Michael R Jordan, Elliot Raizes, Arlene Chua, Neil Parkin, Rami Kantor, Gert U van Zyl, Irene Mukui, Mina C Hosseinipour, Lisa M Frenkel, et al.

► To cite this version:

Soo-Yon Rhee, Michael R Jordan, Elliot Raizes, Arlene Chua, Neil Parkin, et al.. HIV-1 Drug Resistance Mutations: Potential Applications for Point-of-Care Genotypic Resistance Testing. PLoS ONE, 2015, 10 (12), pp.e0145772. 10.1371/journal.pone.0145772. hal-04985856

HAL Id: hal-04985856

https://hal.science/hal-04985856v1

Submitted on 11 Mar 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

RESEARCH ARTICLE

# HIV-1 Drug Resistance Mutations: Potential Applications for Point-of-Care Genotypic Resistance Testing

Soo-Yon Rhee¹*, Michael R. Jordan², Elliot Raizes³, Arlene Chua⁴,⁵, Neil Parkin⁶, Rami Kantor⁷, Gert U. Van Zyl⁸,⁹, Irene Mukui¹⁰, Mina C. Hosseinipour¹¹, Lisa M. Frenkel¹², Nicaise Ndembi¹³, Raph L. Hamers¹⁴, Tobias F. Rinke de Wit¹⁴, Carole L. Wallis¹⁵, Ravindra K. Gupta¹⁶, Joseph Fokam¹⁷,¹⁸, Clement Zeh¹⁹, Jonathan M. Schapiro²⁰, Sergio Carmona²¹,²², David Katzenstein¹, Michele Tang¹, Avelin F. Aghokeng²³, Tulio De Oliveira²⁴, Annemarie M. J. Wensing²⁵, Joel E. Gallant²⁶, Mark A. Wainberg²⁷, Douglas D. Richman²⁸,²⁹, Joseph E. Fitzgibbon³⁰, Marco Schito³¹, Silvia Bertagnolio³², Chunfu Yang³, Robert W. Shafer¹

1 Department of Medicine, Stanford University, Stanford, CA, United States of America, 2 Tufts University School of Medicine, Boston, MA, United States of America, 3 Division of Global HIV/AIDS, Centers for Disease Control and Prevention, Atlanta, GA, United States of America, 4 Medecins Sans Frontieres, Access Campaign, Geneva, Switzerland, 5 Institute of Infectious Diseases and Epidemiology, Tan Tock Seng Hospital, Singapore, Singapore, 6 Data First Consulting, Belmont, CA, United States of America, 7 Alpert Medical School, Brown University, Providence, RI, United States of America, 8 National Health Laboratory Service, Tygerberg, Coastal Branch, South Africa, 9 Division of Medical Virology, Stellenbosch University, Parow, South Africa, 10 National AIDS and Sexually Transmitted Infection (STI) Control Programme, Ministry of Health, Nairobi, Kenya, 11 UNC Project, Lilongwe, Malawi, 12 University of Washington and Seattle Children's Research Institute, Seattle, WA, United States of America, 13 Institute of Human Virology, Abuja, Nigeria, 14 Amsterdam Institute for Global Health and Development (AIGHD), Department of Global Health, Academic Medical Center of the University of Amsterdam, Amsterdam, Netherlands, 15 Lancet Laboratories and BARC-SA, Johannesburg, South Africa, 16 Department of Infection, University College London, London, United Kingdom, 17 Chantal BIYA International Reference Centre for Research on HIV/AIDS Prevention and Management, Yaoundé, Cameroon, 18 Faculty of Medicine and Biomedical Sciences (FMBS) of the University of Yaoundé 1, Yaoundé, Cameroon, 19 Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America, 20 National Hemophilia Center, Tel Hashomer, Israel, 21 Department of Haematology and Molecular Medicine, University of Witwatersrand, Johannesburg, South Africa, 22 National Health Laboratory Services, Johannesburg, South Africa, 23 Virology Laboratory CREMER-IMPM, Yaoundé, Cameroon, 24 Africa Centre for Health and Population Studies, School of Laboratory Medicine and Medical Sciences, University of KwaZulu-Natal, Durban, South Africa, 25 Virology, Department of Medical Microbiology, University Medical Center Utrecht, Utrecht, the Netherlands, 26 Southwest CARE Center, Santa Fe, NM, United States of America, 27 McGill University AIDS Centre, Jewish General Hospital, Montreal, Quebec, Canada, 28 Department of Pathology, University of California San Diego, La Jolla, CA, United States of America, 29 Veterans Affairs San Diego Healthcare System, San Diego, CA, United States of America, 30 Drug Development and Clinical Sciences Branch, Division of AIDS, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD, United States of America, 31 HJF-DAIDS, A Division of The Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD, United States of America, 32 HIV Department WHO, Geneva, Switzerland

* syrhee@stanford.edu

## Abstract

The increasing prevalence of acquired and transmitted HIV-1 drug resistance is an obstacle to successful antiretroviral therapy (ART) in the low- and middle-income countries (LMICs) hardest hit by the HIV-1 pandemic. Genotypic drug resistance testing could

<figure><img src="image_3.png" /></figure>

OPEN ACCESS

**Citation:** Rhee S-Y, Jordan MR, Raizes E, Chua A, Parkin N, Kantor R, et al. (2015) HIV-1 Drug Resistance Mutations: Potential Applications for Point-of-Care Genotypic Resistance Testing. PLoS ONE 10(12): e0145772. doi:10.1371/journal.pone.0145772

**Editor:** Paul Richard Harrigan, University of British Columbia, CANADA

**Received:** April 7, 2015

**Accepted:** December 8, 2015

**Published:** December 30, 2015

**Copyright:** This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.

**Data Availability Statement:** Data are available from the Stanford University HIV Drug Resistance Database (http://hivdb.stanford.edu/pages/poc.html).

**Funding:** RWS and SYR were supported in part by a grant from the Bill and Melinda Gates Foundation and from the NIH (AI068581). NP was supported by a grant from the Bill and Melinda Gates Foundation. MRJ was supported in part by CFAR 1P30A142853. This project has been supported in part by the President's Emergency Plan for AIDS Relief (PEPFAR) through the Centers for Disease Control and Prevention (CDC). Data First Consulting
provided support in the form of salaries for authors NP, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the 'author contributions' section. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing Interests:** One of the authors is employed by a commercial company, Data First Consulting. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.

facilitate the choice of initial ART in areas with rising transmitted drug resistance (TDR) and enable care-providers to determine which individuals with virological failure (VF) on a first- or second-line ART regimen require a change in treatment. An inexpensive near point-of-care (POC) genotypic resistance test would be useful in settings where the resources, capacity, and infrastructure to perform standard genotypic drug resistance testing are limited. Such a test would be particularly useful in conjunction with the POC HIV-1 viral load tests that are currently being introduced in LMICs. A POC genotypic resistance test is likely to involve the use of allele-specific point mutation assays for detecting drug-resistance mutations (DRMs). This study proposes that two major nucleoside reverse transcriptase inhibitor (NRTI)-associated DRMs (M184V and K65R) and four major NNRTI-associated DRMs (K103N, Y181C, G190A, and V106M) would be the most useful for POC genotypic resistance testing in LMIC settings. One or more of these six DRMs was present in 61.2% of analyzed virus sequences from ART-naïve individuals with intermediate or high-level TDR and 98.8% of analyzed virus sequences from individuals on a first-line NRTI/NNRTI-containing regimen with intermediate or high-level acquired drug resistance. The detection of one or more of these DRMs in an ART-naïve individual or in an individual with VF on a first-line NRTI/NNRTI-containing regimen may be considered an indication for a protease inhibitor (PI)-containing regimen or closer virological monitoring based on cost-effectiveness or country policy.

## Introduction

The global scale-up of antiretroviral therapy (ART) has dramatically reduced HIV-1-associated mortality, mother-to-child HIV-1 transmission, and adult HIV-1 incidence [1–4]. These public health accomplishments are the result of the widespread administration of standardized first-line regimens containing two nucleoside reverse transcriptase inhibitors (NRTIs) plus a non-nucleoside RT inhibitor (NNRTI), followed by a ritonavir-boosted lopinavir (LPV/r)-containing regimen in those individuals who subsequently develop virological failure (VF) [5, 6]. However, the margin of long-term ART success is compromised by the development of acquired drug resistance (ADR) and transmitted drug resistance (TDR) [7, 8].

Between 10% and 30% of individuals receiving a first-line NRTI/NNRTI-containing treatment regimen will develop VF at some point during their treatment [9–11]; the majority of these individuals are expected to acquire NRTI- and/or NNRTI-resistant viruses [7, 11–13]. As the number of individuals with ADR has increased so has the proportion of newly infected individuals with TDR [7, 14–16]. In many regions, the proportion of individuals with transmitted NNRTI resistance has been increasing since ART scale-up [7, 14, 15]. In recent studies, TDR levels above five percent were reported in about one-fourth of the surveys conducted in Sub-Saharan Africa and South/Southeast Asia and more than one-half of the surveys conducted in the Latin America/Caribbean region [7, 14, 15, 17, 18].

In upper-income countries, HIV-1 genotypic resistance testing is used to guide the selection of initial ART and subsequent treatments in individuals with VF. However, in the low- and middle-income countries (LMICs), the resources and capacity to perform standard genotypic resistance testing for individual management are limited or concentrated in a few central laboratories. A point-of-care (POC) genotypic resistance test would avoid the logistical challenges and delays associated with centralized genotypic resistance testing. Even in the
context of a public health approach to ART, where few standardized regimens are available, a reliable and inexpensive POC genotypic resistance test would enable HIV-1 care providers to optimize HIV treatment management and make informed treatment decisions for three categories of individuals: (1) ART-naïve individuals starting therapy; (2) individuals with VF on an initial NRTI/NNRTI-containing regimen; and (3) individuals with persistently detectable viremia on a first- or second-line protease inhibitor (PI)-containing regimen. The objective of this study was to develop recommendations on the most useful drug-resistance mutations (DRMs) for genotypic drug resistance testing to encourage manufacturers developing POC diagnostic assays.

# Materials and Methods

## Conceptual design

As the choice of DRMs for a POC genotypic resistance test depends on the proportions of DRMs in different populations and on expert opinion of the clinical significance of DRMs in LMIC settings, the senior author and the main funder agreed that this paper should be written by a group of experts in the areas of drug resistance, assay development, and public health. The senior author joined with HIV drug resistance experts at the World Health Organization (WHO), U.S. National Institutes of Health (NIH), and U.S. Centers for Disease Control and Prevention (CDC) to assemble a group of experts who reviewed successive drafts of this manuscript.

Because NRTIs, NNRTIs, and PIs are the ARV classes used in most LMICs, we sought to identify the NRTI, NNRTI, and PI-associated DRMs with the greatest sensitivity and specificity for ARV selection pressure and the greatest effect on *in vitro* and *in vivo* ARV susceptibility. The frequency of mutations was analyzed in publicly available datasets comprising individuals with TDR, VF on a first-line NRTI/NNRTI-containing regimen, and VF on an initial boosted PI-containing regimen.

## Mutation classification

The Stanford HIV Drug Resistance Database (HIVDB) mutation penalty scoring system was used to identify major NRTI, NNRTI, and PI-resistance mutations and to characterize the level of resistance in clinical isolates. HIVDB has an online genotypic resistance interpretation program to help clinicians and laboratories interpret HIV-1 genotypic resistance tests. The program accepts submitted RT, protease and/or integrase sequences and returns a list of penalty scores for each DRM in the sequence and an estimate of reduced susceptibility for each ARV obtained by adding the penalty scores for each DRM. The DRM penalty scores (http://hivdb.stanford.edu/DR/) are based upon the sensitivity and specificity of a mutation for selective ARV drug pressure and the effect of a mutation on *in vitro* susceptibility and virological response to therapy. The DRM penalty scores also reflect consensus about the clinical significance of a DRM as reflected by experts such as the IAS-USA Drug Resistance Mutations Group [19].

An HIVDB penalty score of 15 to 29 predicts low-level resistance; a score of 30 to 59 predicts intermediate resistance; and a score of 60 or above predicts high-level resistance. In this analysis, NRTI and PI DRMs with a score of 30 or more and NNRTI DRMs with a score of 60 or more are referred to as major DRMs. A lower score cut-off is used for the NRTIs and PIs because high-level NRTI and PI resistance usually results from the accumulation of multiple DRMs associated with low-level and intermediate resistance rather than from a single DRM associated with high-level resistance. S1, S2 and S3 Tables contain the HIVDB DRM penalty scores and summarize information that were considered in developing the HIVDB scoring system.
## Analyses

To identify the most common major NRTI and NNRTI DRMs associated with TDR, we used a dataset of sequences from more than 50,000 individuals included in a recently published meta-analysis of 287 studies of which 151 studies were conducted in Sub-Saharan Africa and the LMICs of South/Southeast Asia [16].

To identify the most common major NRTI and NNRTI DRMs associated with VF on a first-line NRTI/NNRTI-containing regimen, we used a dataset of sequences from 4,926 individuals from 68 published studies available in HIVDB through June 2014 for which RT sequences were available. Each study contained sequences from five or more individuals receiving a first-line regimen comprising emtricitabine (FTC) or lamivudine (3TC) plus abacavir (ABC) stavudine (d4T), tenofovir (TDF), or zidovudine (AZT) plus efavirenz (EFV) or nevirapine (NVP).

To identify the most common major PI-associated DRMs, we used a dataset of sequences from 1,214 previously PI-naïve individuals with VF on an LPV/r-containing regimen. An insufficient number of published sequences were available from previously PI-naïve individuals receiving ritonavir-boosted atazanavir (ATV/r) or darunavir (DRV/r) to perform a similar analysis. Therefore, for these PIs, we used data from published studies whether or not the underlying sequences were publicly available.

For the analysis of individuals with TDR or VF on a first-line NRTI/NNRTI-containing regimen we examined the sensitivity of sets of mutations for identifying individuals having viruses with intermediate or high-level resistance to the NRTIs 3TC, ABC, AZT, FTC, or TDF; intermediate or high-level resistance to the NNRTIs NVP or EFV; and intermediate or high-level resistance to one of the preceding NRTIs or NNRTIs. For the RT and protease, different mutations at the same position (e.g., M184V and M184I) were treated as separate DRMs despite the fact that some POC assays may be designed to detect multiple amino acids at the same position. Tier 1 POC DRMs were defined as DRMs that the authors believed should ideally be included in an initial version of a POC genotypic resistance test. Non-tier 1 POC DRMs were defined as DRMs that might be useful in subsequent versions of a POC test contingent upon changes in ARV treatment strategies and the molecular epidemiology of HIV-1 drug resistance.

## Results

### Most common major NRTI- and NNRTI-resistance mutations in individuals with TDR

Fig 1 shows the absolute and cumulative prevalence of the major NRTI and NNRTI DRMs in RT sequences from a recently published individual-level meta-analysis of more than 50,000 ARV-naïve individuals in 287 published studies [16]. M184V was the most common transmitted major NRTI-associated DRM, occurring in 54% of viruses from individuals with intermediate or high-level NRTI TDR in LMICs and 31% of viruses from individuals with intermediate or high-level NRTI TDR in upper-income countries. M184I, K65R, L74V/I, Y115F and the TAMs K70R and T215Y/F were the next most common transmitted major NRTI DRMs. The TAMs M41L, D67N/E/G and K219Q/E/N/R and the T215 revertant mutations (T215C/D/E/S/I/V) were the most common non-major transmitted NRTI DRMs. Subtype was not a major determinant of which NRTI DRMs occurred in TDR isolates in LMICs.

K103N, Y181C and G190A were the three most common NNRTI DRMs in all regions and subtypes, occurring in more than 60% of viruses with intermediate or high-level NNRTI TDR. K103S, V106M, Y188L and G190S/E accounted for most of the remaining transmitted major NNRTI DRMs in LMICs. A98G and K101E were the most common non-major transmitted
<table><thead><tr><th colspan="4">Low- and Middle-Income Countries<br>(n=24,173 individuals)</th><th colspan="4">Upper-Income Countries<br>(n=24,898 individuals)</th></tr><tr><th></th><th>DRM</th><th>Absolute<br>%</th><th>Cumulative<br>%</th><th></th><th>DRM</th><th>Absolute<br>%</th><th>Cumulative<br>%</th></tr></thead><tbody><tr><td rowspan="12">Major<br>NRTI DRM<br>in Viruses<br>with NRTI<br>Resistance<br>(n=281)</td><td>184V</td><td>54.4</td><td>54.4</td><td rowspan="12">Major<br>NRTI DRM<br>in Viruses<br>with NRTI<br>Resistance<br>(n=770)</td><td>184V</td><td>31.1</td><td>31.1</td></tr><tr><td>70R</td><td>17.1</td><td>63.3</td><td>215Y</td><td>18.8</td><td>43</td></tr><tr><td>184I</td><td>6.4</td><td>68.7</td><td>70R</td><td>14.6</td><td>52.2</td></tr><tr><td>65R</td><td>5.7</td><td>73</td><td>65R</td><td>3.1</td><td>54.5</td></tr><tr><td>215Y</td><td>16.7</td><td>77.2</td><td>215F</td><td>6.4</td><td>56.2</td></tr><tr><td>74I</td><td>5</td><td>80.8</td><td>74V</td><td>4.1</td><td>57.2</td></tr><tr><td>115F</td><td>2.5</td><td>83.3</td><td>184I</td><td>2.1</td><td>58.1</td></tr><tr><td>215F</td><td>9.3</td><td>85.1</td><td>151M</td><td>2</td><td>58.9</td></tr><tr><td>74V</td><td>3.9</td><td>85.8</td><td>74I</td><td>2.9</td><td>59.6</td></tr><tr><td>151M</td><td>1.4</td><td>87.2</td><td>115F</td><td>1.7</td><td>59.7</td></tr><tr><td>67d</td><td>0</td><td>-</td><td>67d</td><td>0</td><td>-</td></tr><tr><td>69i</td><td>0</td><td>-</td><td>69i</td><td>0</td><td>-</td></tr><tr><td>Other</td><td>12.8</td><td>100</td><td>Other</td><td>40.3</td><td>100</td></tr><tr><td rowspan="15">Major<br>NNRTI DRM<br>in Viruses<br>with NNRTI<br>Resistance<br>(n=715)</td><td>103N</td><td>39.8</td><td>39.8</td><td rowspan="15">Major<br>NNRTI DRM<br>in Viruses<br>with NNRTI<br>Resistance<br>(n=1,074)</td><td>103N</td><td>53.4</td><td>53.4</td></tr><tr><td>181C</td><td>17.1</td><td>54.4</td><td>181C</td><td>11.7</td><td>62.2</td></tr><tr><td>190A</td><td>11.8</td><td>62.1</td><td>190A</td><td>9.3</td><td>68.9</td></tr><tr><td>188L</td><td>2.2</td><td>64.2</td><td>188L</td><td>4</td><td>72.1</td></tr><tr><td>103S</td><td>3.1</td><td>65.5</td><td>103S</td><td>2.7</td><td>73.5</td></tr><tr><td>190S</td><td>1.3</td><td>66.5</td><td>188H</td><td>1.2</td><td>74.6</td></tr><tr><td>190E</td><td>1</td><td>67.6</td><td>188C</td><td>1.2</td><td>75.7</td></tr><tr><td>106M</td><td>1.3</td><td>68.4</td><td>106A</td><td>1.2</td><td>76.6</td></tr><tr><td>100I</td><td>1.3</td><td>69.3</td><td>106M</td><td>0.9</td><td>77.3</td></tr><tr><td>106A</td><td>0.7</td><td>69.9</td><td>190S</td><td>1.1</td><td>78</td></tr><tr><td>188C</td><td>0.9</td><td>70.5</td><td>190E</td><td>0.7</td><td>78.7</td></tr><tr><td>230L</td><td>1.5</td><td>71.1</td><td>230L</td><td>0.7</td><td>79.1</td></tr><tr><td>181I</td><td>0.4</td><td>71.5</td><td>181I</td><td>0.8</td><td>79.4</td></tr><tr><td>188H</td><td>0.4</td><td>71.8</td><td>100I</td><td>1.9</td><td>79.6</td></tr><tr><td>181V</td><td>0.4</td><td>72</td><td>101P</td><td>0.9</td><td>79.7</td></tr><tr><td>101P</td><td>0.4</td><td>72.4</td><td>181V</td><td>0.1</td><td>79.8</td></tr><tr><td>190Q</td><td>0</td><td>-</td><td>190Q</td><td>0</td><td>-</td></tr><tr><td>Other</td><td>27.6</td><td>100</td><td>Other</td><td>20.2</td><td>100</td></tr></tbody></table>

**Fig 1.** Prevalence of major NRTI and NNRTI resistance mutations in individuals with transmitted drug resistance. Absolute and cumulative prevalence of each major nucleoside (NRTI) and nonnucleoside RT Inhibitor (NNRTI) drug-resistance mutation (DRM) in individuals with intermediate or high-level transmitted NRTI or NNRTI resistance from a meta-analysis of 287 studies published between 2000 and 2013 are shown. Low- and middle-income countries include Countries of Sub-Saharan Africa, South / Southeast Asia, and Latin America and Caribbean. Upper-Income Countries: Countries of North America and Europe, and upper-income countries in Southeast Asia. Major NRTI DRMs include those with an HIVDB score ≥30. There were no insertions or deletions between codons 67 and 70. Major NNRTI DRMs include those with an HIVDB score ≥60. Absolute %: number of individuals with DRM / number of individuals with intermediate or high-level transmitted NRTI or NNRTI resistance. Cumulative %: number of individuals with one or more of the preceding major DRMs in the list / number of individuals with intermediate or high-level transmitted NRTI or NNRTI resistance.

doi:10.1371/journal.pone.0145772.g001
NNRTI DRMs. V106M was significantly more common in subtype C viruses and was the fourth most common NNRTI DRM in this subtype.

## Most common major NRTI- and NNRTI-resistance mutations in individuals with first-line VF

S4 Table summarizes the number of sequences and corresponding individuals receiving NRT/ NNRTI first-line ART according to regimen and HIV-1 subtype. Fifty-five percent, 27%, 16% and 2% of individuals received a d4T-, AZT-, TDF- or ABC-containing regimen, respectively. Fifty-four percent received EFV and 46% received NVP. The most common subtypes were C (46%), circulating recombinant form (CRF) 01_AE (15%), B (11%), A (8%), G (8%) and CRF02_AG (7%). Seventy-three percent of individuals had one or more major NRTI DRM and one or more major NNRTI DRM. Nine percent had a major NNRTI DRM but no major NRTI DRM; 2% percent had a major NRTI DRM but no major NNRTI DRM; and 16% had no major NRTI or NNRTI DRM.

Fig 2 shows that in viruses from individuals in LMICs with intermediate or high-level NRTI resistance following VF on a first-line NRTI/NNRTI-containing regimen, the most common major DRMs were M184V (91.5%) and M184I (3.7%), K65R (9.8%), and the TAMs K70R (14.6%), T215Y (11.0%) and T215F (9.3%). About one-half of the viruses with K65R did not have M184V, making K65R the second largest contributor to the cumulative proportion of viruses with a major NRTI DRM. K65R also occurred in 48% of 467 individuals with VF on a first-line TDF-containing regimen (S5 Table). The TAMs nearly always occurred in combination with M184V and contributed less to the cumulative proportion of viruses with a major NRTI DRM than did K65R.

The spectrum of DRMs in 712 children was similar to adults with the exception that L74V/I occurred more often in children because a higher proportion of children received an ABC-containing regimen (S6 and S7 Tables). Indeed, among both adults and children receiving ABC, L74V/I were the second most common major NRTI DRMs associated with acquired NRTI resistance after M184V [20, 21]. L74V/I rarely occurred in the absence of M184V.

Fig 2 shows that the most common NNRTI DRMs in viruses from individuals in LMICs with intermediate or high-level resistance on a first-line NRTI/NNRTI-containing regimen were K103N (45.5%), Y181C (27.0%), G190A (21.0%), and V106M (18.7%). One or more of these four DRMs occurred in 88.8% of viruses with intermediate or high-level acquired NNRTI resistance. V106M was the second-most common NNRTI DRM in subtype C viruses, occurring in 33% of individuals with a major NNRTI DRM. The two next most common NNRTI DRMs—Y188L and G190S—accounted for an additional 5.7% of viruses with acquired intermediate or high-level NNRTI resistance.

## The sensitivity of combined NRTI and NNRTI-resistance mutations for detecting TDR and ADR

Of the six DRMs with the highest cumulative sensitivity for detecting intermediate or high-level resistance to an NRTI or NNRTI on a first-line NRTI/NNRTI-containing regimen (K65R, M184V, K103N, V106M, Y181C, G190A), all but K65R and V106M were also the most common DRMs occurring in individuals with TDR. In LMICs, this set of six DRMs was 98.8% sensitive for detecting ADR on a first-line NRTI/NNRTI regimen and 61.2% sensitive for detecting TDR in ART-naïve individuals (Fig 3). No significant differences in sensitivity were observed for the subset of children with ADR on a first-line NRTI/NNRTI-containing regimen or the subset of adult individuals with ADR on a first-line TDF-containing regimen (Fig 3).
<table><thead><tr><th colspan="4">Low- and Middle-Income Countries<br>(n=3,981 individuals)</th><th colspan="4">Upper-Income Countries<br>(n=945 individuals)</th></tr><tr><th></th><th>DRM</th><th>Absolute<br>%</th><th>Cumulative<br>%</th><th></th><th>DRM</th><th>Absolute<br>%</th><th>Cumulative<br>%</th></tr></thead><tbody><tr><td rowspan="14">Major<br>NRTI DRM<br>in Viruses<br>with NRTI<br>Resistance<br>(n=3,136)</td><td>184V</td><td>91.5</td><td>91.5</td><td rowspan="14">Major<br>NRTI DRM<br>in Viruses<br>with NRTI<br>Resistance<br>(n=514)</td><td>184V</td><td>87.4</td><td>87.4</td></tr><tr><td>65R</td><td>9.8</td><td>96.6</td><td>65R</td><td>16.7</td><td>94.2</td></tr><tr><td>184I</td><td>3.7</td><td>98.7</td><td>184I</td><td>8.0</td><td>97.9</td></tr><tr><td>215Y</td><td>11.0</td><td>99.2</td><td>115F</td><td>4.9</td><td>98.4</td></tr><tr><td>70R</td><td>14.6</td><td>99.5</td><td>215Y</td><td>5.6</td><td>99.0</td></tr><tr><td>215F</td><td>9.3</td><td>99.6</td><td>70R</td><td>8.9</td><td>99.4</td></tr><tr><td>151M</td><td>3.6</td><td>99.7</td><td>74I</td><td>3.7</td><td>99.6</td></tr><tr><td>115F</td><td>3.0</td><td>99.8</td><td>151M</td><td>0.4</td><td>99.8</td></tr><tr><td>74I</td><td>2.3</td><td>99.8</td><td>74V</td><td>5.4</td><td>100.0</td></tr><tr><td>67d</td><td>0</td><td>-</td><td>67d</td><td>0</td><td>-</td></tr><tr><td>69i</td><td>0</td><td>-</td><td>69i</td><td>0</td><td>-</td></tr><tr><td>74V</td><td>0</td><td>-</td><td>215F</td><td>0</td><td>-</td></tr><tr><td>Other</td><td>0.2</td><td>100</td><td>Other</td><td>0</td><td>-</td></tr><tr><td rowspan="14">Major<br>NNRTI DRM<br>in Viruses<br>with NNRTI<br>Resistance<br>(n=3,363)</td><td>103N</td><td>45.5</td><td>45.5</td><td rowspan="14">Major<br>NNRTI DRM<br>in Viruses<br>with NNRTI<br>Resistance<br>(n=630)</td><td>103N</td><td>63.0</td><td>63.0</td></tr><tr><td>181C</td><td>27.0</td><td>66.6</td><td>181C</td><td>18.8</td><td>77.3</td></tr><tr><td>106M</td><td>18.7</td><td>79.4</td><td>190A</td><td>13.3</td><td>82.5</td></tr><tr><td>190A</td><td>21.1</td><td>88.8</td><td>190S</td><td>6.5</td><td>87.2</td></tr><tr><td>188L</td><td>5.7</td><td>92.3</td><td>188L</td><td>5.2</td><td>91.1</td></tr><tr><td>190S</td><td>2.9</td><td>94.5</td><td>106M</td><td>4.5</td><td>93.3</td></tr><tr><td>106A</td><td>1.7</td><td>95.7</td><td>190E</td><td>1.6</td><td>95.0</td></tr><tr><td>181V</td><td>1.1</td><td>96.6</td><td>106A</td><td>1.9</td><td>96.3</td></tr><tr><td>190E</td><td>0.9</td><td>97.4</td><td>188C</td><td>1.8</td><td>96.8</td></tr><tr><td>181I</td><td>0.8</td><td>98.0</td><td>188H</td><td>1.3</td><td>97.2</td></tr><tr><td>190Q</td><td>0.6</td><td>98.6</td><td>190Q</td><td>0.5</td><td>97.6</td></tr><tr><td>188C</td><td>2.0</td><td>99.0</td><td>230L</td><td>2.9</td><td>97.9</td></tr><tr><td>103S</td><td>2.8</td><td>99.2</td><td>181V</td><td>0.5</td><td>98.2</td></tr><tr><td>230L</td><td>4.9</td><td>99.4</td><td>181I</td><td>0.5</td><td>98.5</td></tr><tr><td>188H</td><td>1.2</td><td>99.4</td><td>100I</td><td>6.3</td><td>98.7</td></tr><tr><td>100I</td><td>2.2</td><td>99.5</td><td>103S</td><td>0</td><td>-</td></tr><tr><td>Other</td><td>0.5</td><td>100</td><td>Other</td><td>1.3</td><td>100</td></tr></tbody></table>

**Fig 2.** Prevalence of major NRTI and NNRTI resistance mutations in individuals with acquired drug resistance. Absolute and cumulative prevalence of each major nucleoside (NRTI) and nonnucleoside RT inhibitor (NNRTI) drug-resistance mutation (DRM) in 4,926 individuals with virological failure and intermediate or high-level acquired NRTI or NNRTI resistance while receiving a first-line NRTI/NNRTI-containing regimen are shown. Regimens include four AZT/d4T-containing regimens—AZT/d4T+3TC+EFV/NVP (n = 4,020), four TDF-containing regimens—TDF+3TC/FTC+EFV/NVP (n = 772), and two ABC-containing regimens—ABC+3TC+NVP/EFV (n = 134). Low- and Middle-Income Countries: Countries of Sub-Saharan Africa, South / Southeast Asia, and Latin America and Caribbean; Upper-Income Countries: Countries of North America and Europe, and upper-income countries in Southeast Asia. NRTI DRM with an HIVDB score ≥30. There were no insertions or deletions between codons 67 and 70. NNRTI DRMs with an HIVDB score ≥60. Absolute %: number of individuals with DRM / number of individuals with intermediate or high-level NRTI or NNRTI resistance. Cumulative %: number of individuals with one or more of the preceding DRMs in the list / number of individuals with intermediate or high-level NRTI or NNRTI resistance.

doi:10.1371/journal.pone.0145772.g002
<table><thead><tr><th>DRM</th><th>TDR</th><th colspan="3">First-Line ADR</th></tr></thead><tbody><tr><td colspan="5"><strong>All Regions, All Subtypes</strong></td></tr><tr><td></td><td>Total<br>(n=2,591)</td><td>Total<br>(n=4,091)</td><td>Children<br>(n=735)</td><td>TDF<br>(n=561)</td></tr><tr><td>K103N</td><td>35.9</td><td>47.2</td><td>49</td><td>47.1</td></tr><tr><td>M184V</td><td>47.1</td><td>91.1</td><td>94.7</td><td>78.8</td></tr><tr><td>Y181C</td><td>53.7</td><td>94.8</td><td>97.8</td><td>87</td></tr><tr><td>G190A</td><td>57.6</td><td>95.9</td><td>98.2</td><td>88.4</td></tr><tr><td>V106M</td><td>58.1</td><td>97.4</td><td>98.8</td><td>92.5</td></tr><tr><td>K65R</td><td>58.8</td><td>98.2</td><td>99.2</td><td>96.4</td></tr><tr><td colspan="5"><strong>LMICs, All Subtypes</strong></td></tr><tr><td></td><td>Total<br>(n=538)</td><td>Total<br>(n=3,282)</td><td>Children<br>(n=726)</td><td>TDF<br>(n=292)</td></tr><tr><td>K103N</td><td>32</td><td>44.9</td><td>49.3</td><td>40.4</td></tr><tr><td>M184V</td><td>42.6</td><td>91.8</td><td>95</td><td>78.8</td></tr><tr><td>Y181C</td><td>54.5</td><td>95.4</td><td>97.8</td><td>87.3</td></tr><tr><td>G190A</td><td>59.3</td><td>96.5</td><td>98.2</td><td>88.7</td></tr><tr><td>V106M</td><td>60.2</td><td>98.2</td><td>98.8</td><td>95.5</td></tr><tr><td>K65R</td><td>61.2</td><td>98.8</td><td>99.2</td><td>98.6</td></tr><tr><td colspan="5"><strong>All Regions, Subtype C</strong></td></tr><tr><td></td><td>Total<br>(n=243)</td><td>Total<br>(n=1,911)</td><td>Children<br>(n=473)</td><td>TDF<br>(n=242)</td></tr><tr><td>K103N</td><td>29.6</td><td>51.1</td><td>56.7</td><td>38.8</td></tr><tr><td>M184V</td><td>36.6</td><td>91.9</td><td>96.2</td><td>75.6</td></tr><tr><td>Y181C</td><td>46.1</td><td>94.5</td><td>97.5</td><td>83.5</td></tr><tr><td>G190A</td><td>51.9</td><td>95.4</td><td>97.9</td><td>85.1</td></tr><tr><td>V106M</td><td>53.5</td><td>98.4</td><td>98.7</td><td>94.2</td></tr><tr><td>K65R</td><td>54.3</td><td>99.3</td><td>99.4</td><td>98.8</td></tr></tbody></table>

**Fig 3.** Sensitivity of Six Tier 1 RTI resistance mutations for detecting transmitted or acquired drug resistance. Cumulative prevalence or sensitivity of the Six Tier 1 RTI inhibitor (RTI) drug-resistance mutations (DRMs) for detecting transmitted or acquired drug resistance in viruses from individuals with intermediate or high-level NRTI or NNRTI resistance is shown. Transmitted drug resistance (TDR) and acquired drug resistance (ADR) were defined as being associated with > intermediate NRTI or NNRTI resistance. Major NRTI-associated DRMs (HIVDB score ≥30) included K65R, D67 deletion, T69 insertion, K70R, L74V/I, Y115F, Q151M, M184I/V, and T215F/Y. Major NNRTI-associated DRMs (HIVDB score ≥60) included: L100I, K101P, K103N/S, V106A/M, Y181C/I/V, Y188L/H/C, G190A/S/E/Q, and M230L. Abbreviations: LMICs (Low- and Middle-Income Countries), TDF (tenofovir).

doi:10.1371/journal.pone.0145772.g003

Based on the clinical significance of these DRMs and their sensitivity and specificity for ADR and, to a lesser extent TDR, these DRMs were classified as tier 1 POC DRMs.

Y188L and G190S were the most common major non-tier 1 NNRTI DRMs associated with ADR on a first-line NRTI/NNRTI-containing regimen and among the most common non-tier 1 NNRTI DRMs associated with TDR. K70R, L74V/I, Y115F, M184I, and T215Y/F were the most common major non-tier 1 DRMs associated with ADR on a first-line NRTI/NNRTI-containing regimen and with TDR. Compared to an assay that detected just tier 1 RTI DRMs, an
assay that detected tier 1 and the aforementioned nine additional non-tier 1 DRMs would have an increased sensitivity for detecting intermediate or high-level TDR of 67.9% (compared with 61.2%) and for detecting dual NRTI/NNRTI resistance in individuals with ADR of 94.2% (compared with 84.9%). However, an assay with tier 1 and the nine non-tier 1 RTI DRMs would not have a meaningful effect on the sensitivity for detecting intermediate or high-level ADR resistance to either NRTIs or NNRTIs (99.5% compared with 98.8%).

## DRMs emerging in previously PI-naïve individuals receiving LPV/r, ATV/r, and DRV/r

Table 1 shows the most common major LPV-associated DRMs in published protease sequences from 1,214 previously PI-naïve individuals with VF on an LPV/r-containing regimen. Of these 1,214 individuals, 203 (17%) had viruses with predicted intermediate or high-level LPV resistance. The most common major PI DRMs were V82A, I76V, I84V and L47A. One or more of these four DRMs occurred in 88% of viruses with intermediate or high-level LPV/r resistance. The next two most common major LPV DRMs—I50V and V82F—accounted for an additional 4% of viruses with predicted intermediate or high-level LPV resistance. The remaining 8% of viruses with predicted intermediate or high-level LPV resistance had a combination of two or more PI DRMs with lower mutation scores, including V32I, M46I, I54M/L/V, I47V, V82S/T/M and L90M. The most common subtypes of these 203 viruses were C (49%), CRF01_AE (14%), CRF01_AG (12%), B (8%), G (7%) and A (5%). Overall 170 (84%) of the 203 LPV-resistant viruses had predicted intermediate or high-level cross-resistance to ATV/r; 36 (18%) had predicted intermediate or high-level cross-resistance to DRV/r.

Few protease sequences are available from PI-naïve individuals with VF on ATV/r- or DRV/r-containing regimens. Published reports of aggregated data indicate that I50L and N88S are the main DRMs developing in PI-naïve individuals with VF on an ATV- or ATV/r-

<table><caption>**Table 1.** Absolute and Cumulative Prevalence of Major Lopinavir-Associated Mutations in 203 Viruses with Intermediate or High-Level Lopinavir (LPV) Resistance from 1,214 Previously PI-Naïve Individuals with Virological Failure on a Ritonavir-Boosted LPV (LPV/r)-Containing Regimen.</caption><thead><tr><th rowspan="2">DRM</th><th colspan="2">Prevalence of Major LPV/r DRMs (n = 203 Viruses with Intermediate or High-Level LPV Resistance)</th></tr><tr><th>Absolute %<sup>a</sup></th><th>Cumulative %<sup>b</sup></th></tr></thead><tbody><tr><td>V82A</td><td>59.6</td><td>59.6</td></tr><tr><td>L76V</td><td>32.5</td><td>74.9</td></tr><tr><td>I84V</td><td>15.3</td><td>82.8</td></tr><tr><td>I47A</td><td>8.4</td><td>88.2</td></tr><tr><td>V82F</td><td>2.5</td><td>90.1</td></tr><tr><td>I50V</td><td>4.9</td><td>91.6</td></tr><tr><td>Other <sup>c</sup></td><td>8.4</td><td>100</td></tr></tbody></table>

doi:10.1371/journal.pone.0145772.t001

<footnote><sup>a</sup>Absolute %: number of individuals with major DRM / number of individuals with intermediate or high-level LPV resistance.</footnote>

<footnote><sup>b</sup>Cumulative %: number of individuals with one or more of the preceding major LPV/r DRMs in the list / number of individuals with intermediate or high-level LPV resistance.</footnote>

<footnote><sup>c</sup>Other includes viruses with intermediate or high-level resistance arising from an accumulation of mutations with an HIVDB penalty score <30 including: M46I/I54V/V82S (n = 4), I54V/V82M (n = 3), I54V/L90M (n = 1), V32I/M46I/I47V/I54M/L90M (n = 1), I54V/V82T/L90M (n = 1), M46I/I54V/V82T (n = 1), I54V/V82T (n = 1), I54V/V82S/V82T (n = 1), L90M (n = 1), M46I/L90M (n = 1), M46I/I47V/I54V/V82S (n = 1).</footnote>
containing regimen [22–24]. These DRMs do not confer cross-resistance to LPV or DRV [25]. In fact, I50L is associated with increased susceptibility to LPV, DRV and other PIs [26].

## Discussion

### Clinical scenarios in which POC genotypic resistance testing would be most useful

In regions where surveillance indicates elevated levels of drug resistance in individuals beginning ART, pre-therapy POC genotypic resistance testing would identify those individuals who should receive standard first-line therapy and those who should instead receive a boosted PI-containing regimen. Genotypic resistance testing would also be particularly useful in the management of the increasing proportion of individuals presenting for care with reported or unreported prior exposure to ARVs and to ensure that HIV-1-infected pregnant women with drug-resistant viruses receive the optimal regimen for themselves and to prevent mother-to-child transmission.

POC genotypic resistance testing would also be useful in the management of patients receiving an initial NRTI/NNRTI containing regimens. As there is an expanding pipeline of POC and near-POC assays for measuring HIV-1 virus load [27–30], coupling a POC genotypic resistance test with a POC viral load test will help HIV care providers determine in a single visit which individuals require further adherence support and which individuals should switch regimens [15, 31, 32].

The current WHO algorithm for the management of VF includes an adherence intervention after the first detected VF and a repeated virus load test three months thereafter. If the second virus load test confirms VF, a switch to second-line ART is recommended. Despite this recommendation, HIV care providers are often uncertain as to when to switch individuals to the more costly second-line ARVs out of concerns that VF resulted from nonadherence. A POC genotypic resistance test would provide confidence and empower care providers to make timely treatment decisions. Same day treatment decisions would eliminate the risk of loss to follow-up between the first and second virus load visits, minimize the risk of specimen mishandling, and allow adherence support strategies to be informed by the results of genotypic resistance testing.

### Selection of DRMs for POC genotypic resistance testing

One or more of the six tier 1 RT inhibitor DRMs was present in 61.2% of ARV-naïve individuals with intermediate or high-level resistance and in 98.8% of ARV-experienced individuals with intermediate or high-level resistance following VF on a first-line NRTI/NNRTI-containing regimen. These six DRMs include two NRTI-associated DRMs (K65R and M184V) and four NNRTI-associated DRMs (K103N, V106M, Y181C, and G190A). These DRMs are specific indicators of drug resistance in that they each cause clinically significant reduced susceptibility to one or more of the ARVs used in LMICs and rarely occur in the absence of selective ARV pressure. A POC genotypic resistance assay that reliably detected these six DRMs would therefore be moderately sensitive and highly specific for detecting TDR and highly sensitive and specific for detecting NRTI or NNRTI resistance in individuals with VF on a first-line NRTI/NNRTI-containing regimen.

In an ART-naïve individual, the presence of each of the tier 1 DRMs except K65R may be considered an indication for starting an initial PI-containing regimen or closer virological monitoring based on cost-effectiveness or country policy. The presence of K65R would be an indication for using an AZT/3TC nucleoside backbone. In individuals with VF on a 1st-line NRTI/NNRTI-containing regimen, the presence of a tier 1 DRM indicates that the regimen
has reduced antiviral activity. Although the presence of a tier 1 DRM in individuals with VF on a first-line NRTI/NNRTI regimen would not preclude a virological response to continued therapy with improved adherence [33–35], continued therapy is expected to result in a higher rate of immunological and clinical deterioration than would occur if the individual is switched to a second-line PI-based therapy.

The most common additional major NNRTI-resistance mutations included Y188L and G190S, both of which are usually two-base pair mutations that cause very high levels of resistance to NVP and EFV. The next most common additional major NRTI-resistance mutations include M184I, which often precedes M184V in individuals receiving 3TC and FTC, L74V/I, which occurs most commonly in individuals receiving ABC, and the TAMs K70R and T215Y/F. A POC genotypic resistance assay able to detect additional RTI-associated DRMs would have increased sensitivity for TDR and for detecting dual NRTI/NNRTI resistance in individuals with VF on a first-line NRTI/NNRTI-containing regimen. However, considering the technical challenges associated with the inclusion of each additional DRM in a point mutation assay, the inclusion of non-tier 1 RTI-associated mutations in a POC assay was considered a lower priority.

PI DRMs develop much less often in individuals receiving a potent ritonavir-boosted PI-containing regimen such as do NRTI and NNRTI DRMs in individuals receiving NRTI/NNRTI-containing regimens [20, 24, 36–39]. The reduced risk of resistance associated with boosted PIs is likely due to the narrow drug concentration range in which PI levels are both low enough to allow virus replication and high enough to exert selective drug pressure [40]. Indeed, most individuals without PI DRMs who experience VF while on an initial PI-containing regimen achieve virologic suppression with improved adherence [41]. The possibility that mutations outside of protease may also be primary causes of VF is an area of active investigation [42, 43].

Our analysis suggests that the four mutations V82A, L76V, I84V, and I47A would have a sensitivity approaching 90% for detecting intermediate or high-level LPV resistance and that I50L and N88S are the most common major PI-associated DRMs to develop in individuals with VF and intermediate or high-level ATV resistance on an initial ATV/r-associated regimen. However, considering the recent addition of ATV/r to the WHO treatment guidelines and the absence of recommended third-line treatment options [44], it would be useful to have additional data on the genetic mechanisms of PI resistance in LMICs before making firm recommendations on an optimal set of POC DRMs for use in individuals receiving an initial boosted PI-containing regimen.

## Limitations of POC genotypic resistance testing

Although the analyses in this manuscript show that a carefully chosen set of DRMs provides useful information for the most common treatment scenarios in LMICs, a POC genotypic resistance test would not detect many DRMs that would be detected by standard sequencing. The added information provided by sequencing would be most useful in individuals with VF who have received multiple ARV regimens and in situations in which the extent of drug resistance was important. The usefulness of a POC assay that detected a limited set of mutations would also depend on active surveillance systems to identify emerging trends in the prevalence of transmitted and acquired clinically significant DRMs.

Standard genotypic resistance testing using dideoxyterminator Sanger sequencing is becoming less expensive and can be performed for under $100 if the sequence is limited to the most relevant part of the RT gene [45, 46]. Next-generation sequencing using the Illumina MiSeq platform can be performed for an even lower cost if large numbers of samples are multiplexed
in a single sequencing reaction [47]. The extensive batching of samples required to obtain this
cost reduction, however, is a disadvantage in settings where timeliness is important.

Although many allele-specific point mutation assays for HIV-1 drug resistance have been
developed for research purposes, only a few have been developed and studied for their reliabil-
ity and applicability in routine individual management [48–50]. The main challenge in devel-
oping such assays is that HIV-1 sequence variability at and surrounding each DRM
complicates the hybridization steps required for mutation detection. Overall 42 codons at posi-
tions 65, 103, 106, 181, 184, and 190 occur in 1% or more sequences of the seven most common
subtypes (A, B, C, D, G, CRF01_AE, and CRF02_AG). Thirteen of these 42 codons encode the
six major DRMs proposed in this manuscript [51].

The sequence variability surrounding each drug-resistance position may present a more for-
midable challenge than the variability at the codons of interest. Flanking sequence variability
interfered with the clinical uptake of two previously developed hybridization-based assays, the
Affymetrix GeneChip HIV PRT 440 and the Innogenetics INNO-LiPA HIV-1 RT assays [52,
53]. It has also influenced the design of newer point mutation assays that are currently being
developed for clinical use in LMICs [48–50]. S8 and S9 Tables indicate the extent of this vari-
ability at and surrounding codon 103 for sequences from a combination of 26,358 ARV-naïve
and ARV-experienced individuals in six LMIC regions obtained from HIVDB [51]. It is beyond
the scope of this manuscript, however, to describe the various strategies being used to maxi-
mize the stringency for DRM discrimination while accommodating for one or more flanking
sequence mismatches.

Evolution of ARV treatment strategies

The extent to which ATV/r will be used for second-line therapy and the potential availability of
DRV/r and the integrase strand transfer inhibitors (INSTIs) are key areas of uncertainty.
Although LPV/r and ATV/r-containing regimens are equally effective for initial ART [54, 55],
ATV/r-containing regimens may be less efficacious for second-line therapy. ATV/r has a lower
genetic barrier to resistance than LPV/r and ATV/r monotherapy has been less effective than
LPV/r for regimen simplification [56–58] suggesting that ATV/r may be less effective than
LPV/r in treating individuals with extensive NRTI resistance. Therefore, the extent of NRTI
resistance following initial therapy may have greater implications for the use of ATV/r- than
for LPV/r-containing second-line regimens.

However, if ATV/r-containing second-line regimens prove effective, their use would have
favorable implications for both POC testing and third-line treatment. I50L and N88S are the
most commonly occurring major DRMs in PI-naïve individuals receiving ATV/r. Identifying
clinically relevant ATV resistance would therefore be simpler than identifying the more complex
patterns of DRMs associated with LPV resistance. In addition, most individuals with VF on a
second-line ATV/r-containing regimen are expected to have viruses that are fully susceptible to
LPV and DRV making it possible to create a highly effective third-line regimen using these PIs.

Although the NNRTI rilpivirine (RPV) has recently been approved in upper-income coun-
tries for use in a fixed-dose combination with TDF and FTC, further studies would be necessary
before it could be considered a standard first-line treatment option in LMICs. In particular,
RPV is approved only for individuals with plasma HIV-1 RNA levels below 100,000 copies/ml.
A POC test for RPV resistance would also require a different set of NNRTI-associated DRMs
than those described here because K101E, E138K, and Y181C appear to be the DRMs occurring
most commonly in individuals receiving first-line RPV-containing regimens [19, 59].

It is difficult to predict how the introduction of INSTIs will influence the development of
POC genotypic resistance testing strategies because such strategies depend on which INSTIs
will be introduced and on whether they will be used for first-, second- or third-line therapy [60]. However, if INSTIs will be used beyond the first line of therapy and in combination with NRTIs, it may become important to identify the NRTI DRMs most likely to increase the risk of VF on an NRTI/INSTI-containing regimen.

Ongoing population-level surveillance of both ARV-naïve and experienced individuals using standard genotypic resistance testing will be important to detect changing patterns in the molecular epidemiology of HIV-1 drug resistance resulting either from changing ARV selection pressures and/or transmission dynamics. The cost-effectiveness of POC genotypic resistance testing will depend on the evolving molecular epidemiology of ADR and TDR, the clinical uptake of POC virus load testing, and the number of available regional treatment options. Although the technology required to reliably detect HIV-1 DRMs on a POC platform is challenging, it would have widespread applications for the POC detection of critical drug-resistance, vaccine-escape, and gain-of-function mutations in other rapidly evolving epidemic viruses.

## Supporting Information

<caption>S1 Table. Prevalence of Nucleoside RT Inhibitor (NRTI) Drug-Resistance Mutations (DRMs) in Antiretroviral (ARV)-Naïve and -Treated Individuals and Their Estimated Contributions to Reduced NRTI Susceptibility.</caption>

(DOCX)

<caption>S2 Table. Prevalence of Non-Nucleoside RT Inhibitor (NNRTI) Drug-Resistance Mutations (DRMs) in Antiretroviral (ARV)-Naïve and -Treated Individuals and Their Estimated Contributions to Reduced NNRTI Susceptibility.</caption>

(DOCX)

<caption>S3 Table. Prevalence of Protease Inhibitor (PI) Drug-Resistance Mutations (DRMs) in PI-Naïve and -Treated Individuals and Their Estimated Contributions to Reduced PI Susceptibility.</caption>

(DOCX)

<caption>S4 Table. Summary of Sequences from Individuals Receiving NRTI/NNRTI First-Line Regimens.</caption>

(DOCX)

<caption>S5 Table. Absolute and Cumulative Percent of Each Major Nucleoside (NRTI) Drug-Resistance Mutation (DRM) in 467 Individuals with Virological Failure and Intermediate or High-Level Acquired NRTI Drug Resistance while Receiving a First-Line TDF Containing Regimen.</caption>

(DOCX)

<caption>S6 Table. Absolute and Cumulative Percent of Each Major Nucleoside (NRTI) Drug-Resistance Mutation (DRM) in 712 Children with Virological Failure and Intermediate or High-Level Acquired NRTI Drug Resistance while Receiving a First-Line NRTI/NNRTI Regimen.</caption>

(DOCX)

<caption>S7 Table. Absolute and Cumulative Percent of Each Major Nonnucleoside (NNRTI) Drug-Resistance Mutation (DRM) in 721 Children with Virological Failure and Intermediate or High-Level Acquired NNRTI Drug Resistance while Receiving a First-Line NRTI/NNRTI Regimen.</caption>

(DOCX)
S8 Table. Proportion of Different Codons at Position 103 in HIV-1 RT Sequences from 26,358 Individuals in the Stanford HIV Drug Resistance Database From Six Low- and Middle-Income Country Regions.

(DOCX)

S9 Table. Proportion of Different 24 Nucleotide Sequences Flanking Position 103 in HIV-1 RT Sequences from 26,358 Individuals in the Stanford HIV Drug Resistance Database From Six Low- and Middle-Income Country Regions.

(DOCX)

## Acknowledgments

RWS and SYR were supported in part by a grant from the Bill and Melinda Gates Foundation and from the NIH (AI068581). NP was supported by a grant from the Bill and Melinda Gates Foundation. MRJ was supported in part by CFAR 1P30A142853. This project has been supported in part by the President's Emergency Plan for AIDS Relief (PEPFAR) through the Centers for Disease Control and Prevention (CDC). SB is a staff member of the World Health Organization. MJ is a consultant with the World Health Organization. The authors alone are responsible for the views expressed in this publication, which do not necessarily represent the decisions or stated policies of the World Health Organization.

The findings and conclusions in this report are those of the author(s) and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

## Author Contributions

Conceived and designed the experiments: RWS SYR. Performed the experiments: RWS SYR. Analyzed the data: AC CY ER MRJ NP RWS SB SYR. Contributed reagents/materials/analysis tools: GUV MT RKG RLH TFR. Wrote the paper: AC AFA AMJW CLW CY CZ DDR DK ER GUV IM JEF JEG JF JMS LMF MAW MCH MRJ MS MT NN NP RK RKG RLH RWS SB SC SYR TD TFR.

## References

1. Chi BH, Bolton-Moore C, Holmes CB. Prevention of mother-to-child HIV transmission within the continuum of maternal, newborn, and child health services. Curr Opin HIV AIDS. 2013; 8(5):498–503. Epub 2013/07/23. doi: 10.1097/COH.0b013e3283637f7a PMID: 23872611.

2. Eaton JW, Johnson LF, Salomon JA, Barnighausen T, Bendavid E, Bershteyn A, et al. HIV treatment as prevention: systematic comparison of mathematical models of the potential impact of antiretroviral therapy on HIV incidence in South Africa. PLoS Med. 2012; 9(7):e1001245. Epub 2012/07/18. doi: 10.1371/journal.pmed.1001245 PMID: 22802730; PubMed Central PMCID: PMC3393664.

3. Bor J, Herbst AJ, Newell ML, Barnighausen T. Increases in adult life expectancy in rural South Africa: valuing the scale-up of HIV treatment. Science. 2013; 339(6122):961–5. Epub 2013/02/23. doi: 10.1126/science.1230413 PMID: 23430655; PubMed Central PMCID: PMC3860268.

4. Tanser F, Barnighausen T, Grapsa E, Zaidi J, Newell ML. High coverage of ART associated with decline in risk of HIV acquisition in rural KwaZulu-Natal, South Africa. Science. 2013; 339(6122):966–71. Epub 2013/02/23. doi: 10.1126/science.1228160 PMID: 23430656.

5. Holmes CB, Coggin W, Jamieson D, Mihm H, Granich R, Savio P, et al. Use of generic antiretroviral agents and cost savings in PEPFAR treatment programs. JAMA. 2010; 304(3):313–20. Epub 2010/07/20. doi: 10.1001/jama.2010.993 PMID: 20639565.

6. HIV/AIDS Programme World Health Organization. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection. 2013.

7. HIV/AIDS Programme World Health Organization. WHO HIV Drug Resistance Report 2012. 2012.

8. Bertagnolio S, Perno CF, Vella S, Pillay D. The Impact of HIV Drug Resistance on the Selection of First- and Second-Line ART in Resource-Limited Settings. J Infect Dis. 2013; 207 Suppl 2:S45–8. doi: 10.1093/infdis/jit121 PMID: 23687288.
9. Barth RE, van der Loeff MF, Schuurman R, Hoepelman AI, Wensing AM. Virological follow-up of adult patients in antiretroviral treatment programmes in sub-Saharan Africa: a systematic review. Lancet Infect Dis. 2010; 10(3):155-66. Epub 2010/02/27. doi: 10.1016/S1473-3099(09)70328-7 PMID: 20185094.

10. McMahon JH, Elliott JH, Bertagnolio S, Kubiak R, Jordan MR. Viral suppression after 12 months of anti-retroviral therapy in low- and middle-income countries: a systematic review. Bull World Health Organ. 2013; 91(5):377-85E. Epub 2013/05/17. doi: 10.2471/BLT.12.112946 PMID: 23678201; PubMed Central PMCID: PMC3646348.

11. Aghokeng AF, Monleau M, Eymard-Duvernay S, Dagnra A, Kania D, Ngo-Giang-Huong N, et al. Extraordinary heterogeneity of virological outcomes in patients receiving highly antiretroviral therapy and monitored with the World Health Organization public health approach in sub-saharan Africa and southeast Asia. Clin Infect Dis. 2014; 58(1):99-109. doi: 10.1093/cid/cit627 PMID: 24076968.

12. Stadeli KM, Richman DD. Rates of emergence of HIV drug resistance in resource-limited settings: a systematic review. Antivir Ther. 2013; 18(1):115-23. Epub 2012/10/12. doi: 10.3851/IMP2437 PMID: 23052978.

13. Gupta RK, Hill A, Sawyer AW, Cozzi-Lepri A, von Wyl V, Yerly S, et al. Virological monitoring and resistance to first-line highly active antiretroviral therapy in adults infected with HIV-1 treated under WHO guidelines: a systematic review and meta-analysis. Lancet Infect Dis. 2009; 9(7):409-17. doi: 10.1016/S1473-3099(09)70136-7 PMID: 19555900.

14. Frentz D, Boucher CA, van de Vijver DA. Temporal changes in the epidemiology of transmission of drug-resistant HIV-1 across the world. AIDS Rev. 2012; 14(1):17-27. Epub 2012/02/03. PMID: 22297501.

15. Gupta RK, Jordan MR, Sultan BJ, Hill A, Davis DH, Gregson J, et al. Global trends in antiretroviral resistance in treatment-naive individuals with HIV after rollout of antiretroviral treatment in resource-limited settings: a global collaborative study and meta-regression analysis. Lancet. 2012; 380(9849):1250-8. Epub 2012/07/26. doi: 10.1016/S0140-6736(12)61038-1 PMID: 22828485.

16. Rhee SY, Blanco JL, Jordan MR, Taylor J, Lemey P, Varghese V, et al. Geographic and temporal trends in the molecular epidemiology and genetic mechanisms of transmitted HIV-1 drug resistance: an individual patient and sequence-level meta-analysis. PLoS Med. 2015;(In press).

17. Hamers RL, Siwale M, Wallis CL, Labib M, van Hasselt R, Stevens WS, et al. HIV-1 drug resistance mutations are present in six percent of persons initiating antiretroviral therapy in Lusaka, Zambia. J Acquir Immune Defic Syndr. 2010; 55(1):95-101. Epub 2010/06/30. doi: 10.1097/QAI. 0b013e3181e544e0 PMID: 20585262.

18. Hamers RL, Wallis CL, Kityo C, Siwale M, Mandaliya K, Conradie F, et al. HIV-1 drug resistance in anti-retroviral-naive individuals in sub-Saharan Africa after rollout of antiretroviral therapy: a multicentre observational study. Lancet Infect Dis. 2011; 11(10):750-9. Epub 2011/08/02. doi: 10.1016/S1473-3099(11)70149-9 PMID: 21802367.

19. Wensing AM, Calvez V, Gunthard HF, Johnson VA, Paredes R, Pillay D, et al. 2014 Update of the drug resistance mutations in HIV-1. Top Antivir Med. 2014; 22(3):642-50. PMID: 25101529.

20. Van Zyl GU, Liu TF, Claassen M, Engelbrecht S, de Oliveira T, Preiser W, et al. Trends in Genotypic HIV-1 Antiretroviral Resistance between 2006 and 2012 in South African Patients Receiving First- and Second-Line Antiretroviral Treatment Regimens. PLoS One. 2013; 8(6):e67188. doi: 10.1371/journal.pone.0067188 PMID: 23840622.

21. Rivadeneira E, Devos J, Dzioban E, Ngeno B, Zhang G, Sebatier J, et al. High prevalence of L74V/I mutations in Kenyan children with virological failure (abstract 52). International Workshop on Antiviral Drug Resistance: Meeting the Global Challenge, June 3-7, 2014, Berlin, Germany. 2014.

22. Malan DR, Krantz E, David N, Rong Y, Mathew M, Iloeue UH, et al. 96-week efficacy and safety of atazanavir, with and without ritonavir, in a HAART regimen in treatment-naive patients. J Int Assoc Physicians AIDS Care (Chic). 2010; 9(1):34-42. doi: 10.1177/1545109709355828 PMID: 20071596.

23. Malan DR, Krantz E, David N, Wirtz V, Hammond J, McGrath D, et al. Efficacy and safety of atazanavir, with or without ritonavir, as part of once-daily highly active antiretroviral therapy regimens in antiretroviral-naive patients. J Acquir Immune Defic Syndr. 2008; 47(2):161-7. doi: 10.1097/QAI. 0b013e31815ace6a PMID: 17971713.

24. Mollan K, Daar ES, Sax PE, Balamane M, Collier AC, Fischl MA, et al. HIV-1 amino acid changes among participants with virologic failure: associations with first-line efavirenz or atazanavir plus ritonavir and disease status. J Infect Dis. 2012; 206(12):1920-30. doi: 10.1093/infdis/jis613 PMID: 23148287; PubMed Central PMCID: PMC3502379.

25. Rhee SY, Taylor J, Fessel WJ, Kaufman D, Towner W, Troia P, et al. HIV-1 protease mutations and protease inhibitor cross-resistance. Antimicrob Agents Chemother. 2010; 54(10):4253-61. Epub 2010/07/28. doi: 10.1128/AAC.00574-10 PMID: 20660676; PubMed Central PMCID: PMC2944562.
26. Weinheimer S, Discotto L, Friborg J, Yang H, Colonno R. Atazanavir signature I50L resistance substitution accounts for unique phenotype of increased susceptibility to other protease inhibitors in a variety of human immunodeficiency virus type 1 genetic backbones. Antimicrob Agents Chemother. 2005; 49(9):3816-24. doi: 10.1128/AAC.49.9.3816-3824.2005 PMID: 16127058; PubMed Central PMCID: PMC1195397.

27. Ritchie AV, Ushiro-Lumb I, Edemaga D, Joshi HA, De Ruiter A, Szumilin E, et al. SAMBA HIV semi-quantitative test, a new point-of-care viral-load-monitoring assay for resource-limited settings. J Clin Microbiol. 2014; 52(9):3377-83. doi: 10.1128/JCM.00593-14 PMID: 25031444.

28. Murtagh M, for UNITAID. HIV/AIDS Diagnostic Technology Landscape 2014, 4th Edition. http://unitaidorg/images/marketdynamics/publications/UNITAID-HIV_Diagnostic_Landscape-4th_edition.pdf. 2014.

29. Rowley CF. Developments in CD4 and viral load monitoring in resource-limited settings. Clin Infect Dis. 2014; 58(3):407-12. doi: 10.1093/cid/cit733 PMID: 24218101; PubMed Central PMCID: PMC3890339.

30. Scott L, Gous N, Carmona S, Stevens W. Laboratory evaluation of the Liat HIV Quant (IQuum) whole-blood and plasma HIV-1 viral load assays for point-of-care testing in South Africa. J Clin Microbiol. 2015; 53(5):1616-21. doi: 10.1128/JCM.03325-14 PMID: 25740777; PubMed Central PMCID: PMC4400747.

31. Bonner K, Mezochow A, Roberts T, Ford N, Cohn J. Viral load monitoring as a tool to reinforce adherence: a systematic review. J Acquir Immune Defic Syndr. 2013; 64(1):74-8. Epub 2013/06/19. doi: 10.1097/QAI.0b013e31829f05ac PMID: 23774877.

32. Johnston V, Fielding KL, Charalambous S, Churchyard G, Phillips A, Grant AD. Outcomes following virological failure and predictors of switching to second-line antiretroviral therapy in a South African treatment program. J Acquir Immune Defic Syndr. 2012; 61(3):370-80. doi: 10.1097/QAI.0b013e318266ee3f PMID: 22820803; PubMed Central PMCID: PMC3840925.

33. Hoffmann CJ, Charalambous S, Sim J, Ledwaba J, Schwikkard G, Chaisson RE, et al. Viremia, resuppression, and time to resistance in human immunodeficiency virus (HIV) subtype C during first-line antiretroviral therapy in South Africa. Clin Infect Dis. 2009; 49(12):1928-35. Epub 2009/11/17. PMID: 19911963; PubMed Central PMCID: PMC2789416.

34. Hoffmann CJ, Charalambous S, Grant AD, Morris L, Churchyard GJ, Chaisson RE. Durable HIV RNA resuppression after virologic failure while remaining on a first-line regimen: a cohort study. Trop Med Int Health. 2014; 19(2):236-9. Epub 2014/03/04. PMID: 24588012; PubMed Central PMCID: PMC4070658.

35. Gupta RK, Goodall RL, Ranopa M, Kityo C, Munderi P, Lyagoba F, et al. High Rate of HIV Resuppression After Viral Failure on First-line Antiretroviral Therapy in the Absence of Switch to Second-line Therapy. Clin Infect Dis. 2014; 58(7):1023-6. doi: 10.1093/cid/cit933 PMID: 24352348; PubMed Central PMCID: PMC3952602.

36. Llibre JM, Imaz A, Clotet B. From TMC114 to darunavir: five years of data on efficacy. AIDS Rev. 2013; 15(2):112-21. PMID: 23708741.

37. Siliciano JD, Siliciano RF. Recent trends in HIV-1 drug resistance. Curr Opin Virol. 2013; 3(5):487-94. doi: 10.1016/j.coviro.2013.08.007 PMID: 24021560; PubMed Central PMCID: PMC3963152.

38. Barber TJ, Harrison L, Asboe D, Williams I, Kirk S, Gilson R, et al. Frequency and patterns of protease gene resistance mutations in HIV-infected patients treated with lopinavir/ritonavir as their first protease inhibitor. J Antimicrob Chemother. 2012; 67(4):995-1000. Epub 2012/01/20. doi: 10.1093/jac/dkr569 PMID: 22258921.

39. Dolling DI, Dunn DT, Sutherland KA, Pillay D, Mbisa JL, Parry CM, et al. Low frequency of genotypic resistance in HIV-1-infected patients failing an atazanavir-containing regimen: a clinical cohort study. J Antimicrob Chemother. 2013; 68(10):2339-43. Epub 2013/05/29. doi: 10.1093/jac/dkt199 PMID: 23711895; PubMed Central PMCID: PMC3772741.

40. Rosenbloom DI, Hill AL, Rabi SA, Siliciano RF, Nowak MA. Antiretroviral dynamics determines HIV evolution and predicts therapy outcome. Nat Med. 2012; 18(9):1378-85. doi: 10.1038/nm.2892 PMID: 22941277; PubMed Central PMCID: PMC3490032.

41. Zheng Y, Hughes MD, Lockman S, Benson CA, Hosseinipour MC, Campbell TB, et al. Antiretroviral therapy and efficacy after virologic failure on first-line boosted protease inhibitor regimens. Clin Infect Dis. 2014; 59(6):888-96. doi: 10.1093/cid/ciu367 PMID: 24842909; PubMed Central PMCID: PMC4155445.

42. Fun A, Wensing AM, Verheyen J, Nijhuis M. Human Immunodeficiency Virus Gag and protease: partners in resistance. Retrovirology. 2012; 9:63. Epub 2012/08/08. doi: 10.1186/1742-4690-9-63 PMID: 22867298; PubMed Central PMCID: PMC3422997.

43. Rabi SA, Laird GM, Durand CM, Laskey S, Shan L, Bailey JR, et al. Multi-step inhibition explains HIV-1 protease inhibitor pharmacodynamics and resistance. J Clin Invest. 2013; 123(9):3848-60. Epub 2013/08/28. doi: 10.1172/JCI67399 PMID: 23979165.
44. World Health Organization HIV/AIDS Programme. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection. 2013.

45. Bronze M, Aitken SC, Wallis CL, Steegen K, Stuyver LJ, de Wit TF, et al. Evaluation of an affordable HIV-1 virological failure assay and antiretroviral drug resistance genotyping protocol. J Virol Methods. 2013. Epub 2013/09/03. doi: 10.1016/j.jviromet.2013.08.015 PMID: 23994150.

46. Aitken SC, Bronze M, Wallis CL, Stuyver L, Steegen K, Balinda S, et al. A pragmatic approach to HIV-1 drug resistance determination in resource-limited settings by use of a novel genotyping assay targeting the reverse transcriptase-encoding region only. J Clin Microbiol. 2013; 51(6):1757-61. Epub 2013/03/ 29. doi: 10.1128/JCM.00118-13 PMID: 23536405; PubMed Central PMCID: PMC3716103.

47. Lapointe HR, Dong W, Lee GQ, Bangsberg DR, Martin JN, Mocello AR, et al. HIV Drug Resistance Testing by High-Multiplex "Wide" Sequencing on the MiSeq Instrument. Antimicrob Agents Chemother. 2015; 59(11):6824-33. doi: 10.1128/AAC.01490-15 PMID: 26282425; PubMed Central PMCID: PMC4604392.

48. Chung MH, Beck IA, Dross S, Tapia K, Kiarie JN, Richardson BA, et al. Oligonucleotide Ligation Assay Detects HIV Drug Resistance Associated With Virologic Failure Among Antiretroviral-Naive Adults in Kenya. J Acquir Immune Defic Syndr. 2014; 67(3):246-53. doi: 10.1097/QAI.0000000000000312 PMID: 25140907; PubMed Central PMCID: PMC4197120.

49. MacLeod I, Rowley CF, Essex M. Pan degenerate amplification and adaptation for highly sensitive detection of ARV drug resistance [abstract 606]. Conference on Retroviruses and Opportunistic Infections. 2014.

50. Zhang G, Cai F, Zhou Z, Devos J, Wagar N, Diallo K, et al. Simultaneous Detection of Major Drug Resistance Mutations in the Protease and Reverse Transcriptase Genes for HIV-1 Subtype C Using a Multiplex Allele-specific (MAS) Assay. J Clin Microbiol. 2013. Epub 2013/08/30. doi: 10.1128/JCM. 01669-13 PMID: 23985909.

51. Clutter DS, Sánchez PR, Rhee SY, Shafer RW. Genetic Variability of HIV-1 for Drug Resistance Assay Development. PLoS One, under review. 2015.

52. Servais J, Lambert C, Fontaine E, Plesseria JM, Robert I, Arendt V, et al. Comparison of DNA sequencing and a line probe assay for detection of human immunodeficiency virus type 1 drug resistance mutations in patients failing highly active antiretroviral therapy. J Clin Microbiol. 2001; 39(2):454-9. doi: 10.1128/JCM.39.2.454-459.2001 PMID: 11158089; PubMed Central PMCID: PMC87758.

53. Vahey M, Nau ME, Barrick S, Cooley JD, Sawyer R, Sleeker AA, et al. Performance of the Affymetrix GeneChip HIV PRT 440 platform for antiretroviral drug resistance genotyping of human immunodeficiency virus type 1 clades and viral isolates with length polymorphisms. J Clin Microbiol. 1999; 37(8):2533-7. PMID: 10405396; PubMed Central PMCID: PMC85275.

54. Molina JM, Andrade-Villanueva J, Echevarria J, Chetchotisakd P, Corral J, David N, et al. Once-daily atazanavir/ritonavir versus twice-daily lopinavir/ritonavir, each in combination with tenofovir and emtricitabine, for management of antiretroviral-naive HIV-1-infected patients: 48 week efficacy and safety results of the CASTLE study. Lancet. 2008; 372(9639):646-55. doi: 10.1016/S0140-6736(08)61081-8 PMID: 18722869.

55. The H. I. V. Causal Collaboration. Boosted Lopinavir- Versus Boosted Atazanavir-Containing Regimens and Immunologic, Virologic, and Clinical Outcomes: A Prospective Study of HIV-Infected Individuals in High-Income Countries. Clin Infect Dis. 2015. doi: 10.1093/cid/ciu1167 PMID: 25567330.

56. Karlstrom O, Josephson F, Sonnerborg A. Early virologic rebound in a pilot trial of ritonavir-boosted atazanavir as maintenance monotherapy. J Acquir Immune Defic Syndr. 2007; 44(4):417-22. doi: 10.1097/QAI.0b013e31802e2940 PMID: 17159658.

57. Guiguet M, Ghosn J, Duvivier C, Meynard JL, Gras G, Partisani M, et al. Boosted protease inhibitor monotherapy as a maintenance strategy: an observational study. AIDS. 2012; 26(18):2345-50. doi: 10.1097/QAD.0b013e32835646e0 PMID: 22695301.

58. Castagna A, Spagnuolo V, Galli L, Vinci C, Nozza S, Carini E, et al. Simplification to atazanavir/ritonavir monotherapy for HIV-1 treated individuals on virological suppression: 48-week efficacy and safety results. AIDS. 2014; 28(15):2269-79. doi: 10.1097/QAD.0000000000000407 PMID: 25058680.

59. Rimsky L, Vingerhoets J, Van Eygen V, Eron J, Clotet B, Hoogstoel A, et al. Genotypic and phenotypic characterization of HIV-1 isolates obtained from patients on rilpivirine therapy experiencing virologic failure in the phase 3 ECHO and THRIVE studies: 48-week analysis. J Acquir Immune Defic Syndr. 2012; 59(1):39-46. doi: 10.1097/QAI.0b013e31823df4da PMID: 22067667.

60. Barnhart M, Shelton JD. ARVs: The next generation. Going boldly together to new frontiers of HIV treatment. Global Health Science and Practice. 2015; http://www.ghspjournal.org/content/early/2015/01/28/GHSP-D-14-00243.full.pdf+html.