www.nature.com/scientificreports www.nature.com/scientificreports/ In this study, we describe the optimisation, validation and implementation of an automated cell-based, homogeneous luminescence assay to profile antiviral activity of picornavirus inhibitors against several different EV serotypes, clinical isolates and related picornaviruses.
Design of automated HTS assay platform. We implemented an automated platform (Fig. 1) , which took advantage of the homogeneous assay format and ATP/luminescence readout. Small-footprint liquid handlers and reagent dispensers allowed the use of our existing biosafety cabinets. Minimal change to current laboratory space was needed. User-friendly software and custom-written scripts helped the end user in the steep learning curve. A significant component of this platform was the use of the SOLO single-channel robotic workstation and the Bravo Liquid Handling Platform, both of which allowed miniaturisation of the assay from the 300 μL-96-well to the 30 µL-384-well format. This reduced reagent cost and facilitated HTS. Small volume transfers and 384-well serial dilutions were performed with greater accuracy and precision than manual transfers, without the concern of user error (data not shown).
Assay optimisation. We explored the optimisation of the automated assay ( Fig. 1 ) with acceptable accuracy, precision and sensitivity that would be amenable to a high-throughput setting. Accuracy expresses the closeness of agreement between the value accepted as either a conventional true value or an accepted reference value, and the actual measured value. It is typically measured as percent coefficient of variation (%CV).
The accuracy was determined by replicate analysis of samples containing a known concentration of rupintrivir. Food and Drug Administration guidelines recommend that the %CV should be within +/−15% at all concentrations (http://www.fda.gov/downloads/ucm070107.pdf).
Precision describes the closeness or scatter of individual measures of an analyte obtained for replicate samplings of a homogeneous sample. It is typically measured as %CV. The %CV should be within +/−15% at all 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 www.nature.com/scientificreports www.nature.com/scientificreports/ concentrations, except for the lower limit of quantitation, where it should not exceed 20% of the CV. (http://www. fda.gov/downloads/ucm070107.pdf).
Sensitivity is defined as the lowest concentration that can be measured with an acceptable limit of accuracy and precision (http://www.fda.gov/downloads/ucm070107.pdf).
optimisation of cell density. Cell seeding density in 384-well plates was optimised to prevent possible cell overgrowth, which may affect assay sensitivity, and to establish a consistently strong luminescent signal. RD (human rhabdomyosarcoma) cells were seeded in the 384-well microplates at different densities (Fig. 2) . The cells were allowed to grow for 72 hours post-seeding, and cell viability was evaluated by adding the ATPlite reagent and reading the luminescence signal. A cell density of 5000 RD cells/well was chosen for the assay because this density gave a consistent and strong luminescence signal, with a good signal-to-background ratio (S/B) ratio and low variability (Fig. 2) . Optimal densities for Vero (African green monkey kidney) cells and HeLa (human cervical adenocarcinoma) cells were determined in a similar manner and using the same optimal seeding density. optimisation of virus titre. Virus stocks were titrated to determine the dilution that gave optimal sensitivity in the assay. For each virus, the titre was determined by the endpoint dilution method using half-log dilutions in 96-well microplates. A panel of enterovirus and parechovirus strains was established with cell selection and incubation times based on previous experiments 18 . Twelve-point, half-log 10 serial dilutions of each virus (Fig. 3 ) were made to determine the starting dilution for use in the automated 384-well assay and to ensure a full dynamic range of the CPE. The starting virus dilutions were selected based on the initial linear portion of the curve for each virus. To induce CPE in at least 80% of the cells, a viral dilution of 100 CCID 50 was used.
Validation of automated assay for use in HTS. We evaluated whether the automated assay was suitable for use in a high-throughput setting. The liquid handling instrumentation was configured and the assay robustness was determined using the Z′-factor 19 . The Z′-factor is a coefficient that takes into account the assay signal dynamic range and data variability. Assays with a Z′-factor ≥ 0.5 are considered robust for HTS 19 . During assay development, we defined the optimal assay parameters, including cell density, linear range of detection, Z′-factor [Zʹ = 1 − 3 (SD DMSO + SD compound )/|mean DMSO − mean compound |], %CV [SD (signal)/average (signal) × 100], and S/B (fold-increase) [signal (cell control)/background (virus control)]. Lower %CV and higher S/B values can contribute to increased assay robustness. Our assay demonstrated robustness, with a high degree of reproducibility, low deviation (including a reproducible Z′-factor between 0.75 and 0.82), and a %CV between 0.33 and 1.45, with S/B ratios ranging from 6.92 to 22.6 ( Fig. 4 ) when using different EV-A71 isolates ( Table 1 ). The additional viruses tested also met these criteria for robustness, with similar results obtained (data not shown).
We explored the ability of two documented antiviral compounds (pleconaril and rupintrivir) to inhibit EV isolates and clinical samples (Table 1) . Neither compound exhibited cytotoxicity at 10 µM in the automated 384-well luminescent ATP-readout assay or a 96-well assay using a crystal violet readout (Fig. 5) . Although a very small subset of EVs was tested, some trends were observed. Pleconaril had more potent 50% effective concentration (EC 50 ) values against PV Sabin strains 1 and 2 (0.048 and 0.063 µM, respectively) compared to those of rupintrivir (0.221 and 0.289 µM, respectively). Both compounds had significantly higher antiviral activity against a clinical isolate of coxsackievirus B strain than against a coxsackievirus A strain (0.345 and 0.156 µM compared to 3.15 and 6.52 µM, respectively). Neither compound exhibited antiviral activity against the two types of parechovirus tested. A very pronounced difference was observed when comparing the activities against EV-D68 (strain Fermon). Pleconaril displayed antiviral activity at 0.36 µM, whereas rupintrivir exhibited low, nanomolar antiviral activity of 0.003 µM. This may be due to the targeting of different viral proteins. We tested pleconaril and rupintrivir against four EV-A71 strains. Interestingly, pleconaril had no antiviral activity against any EV-A71 strain (Fig. 6 ). Rupintrivir exhibited antiviral activity of 0.332, 0.423, and 0.359 µM for three strains circulating in mainland of China (HuN13-1, AH-FY-04 and SH-17, respectively). www.nature.com/scientificreports www.nature.com/scientificreports/
Most conventional cell-based antiviral drug screening assays were developed based on cell viability assays (ATPase, kinase activity, and cytotoxicity). The introduction of CPE-based assays using an ATP/luminescence readout of antiviral activity has been recently reported for influenza virus, severe acute respiratory syndrome coronavirus, yellow fever virus, and coxsackievirus [20] [21] [22] [23] . This approach measures ATP levels in live cells protected from virus-induced CPE by the presence of antiviral compounds using an ATP-specific luminescent reagent. The advantages of assays with an ATP/luminescence readout are their high-throughput and homogenous (mix and measure) assay format. Homogeneous assays also have the advantage that non-adherent cell lines can be used if desired, and they are amenable to high-density plate formats that can be easily automated. In initial work with RD cells, we observed that these cells did not adhere well to plastic 96-well plates and were easily washed off by our automated system (data not shown). This excluded the use of RD cells in CPE assays requiring adherence of cells prior to staining, which was a distinct disadvantage because RD cells are the optimal cell line for many EVs. In addition, Vero cells do not wash off the plastic cleanly, so reagents like crystal violet stain cell debris that remains adherent, making it difficult to differentiate dead cells from live ones. luminescence of ATPlight www.nature.com/scientificreports www.nature.com/scientificreports/ Our CPE-based enterovirus antiviral assay used the ATPlite reagent, as the ATP/luminescence readout was easily adapted for use with automation platforms. This assay is also adaptable for use with other cytolytic picornaviruses, using a variety of cell lines in 384-well plates.
Here, an automated, high-throughput, cell-based assay was developed, validated and implemented to profile the efficacy of antiviral compounds against EVs in cell culture. Cell viability measured by ATP detection with a luminescent readout was used as the endpoint. The antiviral compounds pleconaril, a capsid inhibitor, and rupintrivir, a 3C protease inhibitor, were evaluated as model drugs for the inhibition of representative EVs and human parechoviruses. This HTS-suitable assay performed consistently and accurately in an automation-friendly format. This assay is suitable for use to profile other picornavirus inhibitors. Automated luminescent antiviral assay. A multichannel pipette was used to transfer 5 µL of 2 mM stock compounds from the stock compound plate (Fig. 1) to rows A and B of a 96-well flat-bottom polystyrene plate (Corning, Corning, NY) containing 245 µL MEM containing 2% FBS (dilution plate). The MicroFlo Select dispenser (BioTek, Winooski, VT), equipped with a rotational wrist and 30-plate stackers, was used to add 60 µL MEM with 2% FBS medium to all wells of a 384-well white flat-bottom plate (Perkin-Elmer, Waltham, MA). The SOLO single-channel robotic workstation (Hudson Robotics Inc., Springfield, NJ) was used to transfer 30 µL of the compound dilutions in quadruplicate into the 384-well serial dilution plates (Fig. 1) . The Bravo Liquid Handling Platform (Agilent Technologies, Inc., Santa Clara, CA) executed 30 µL half-log 10 serial dilutions in the serial dilution plate and then transferred 5 µL of the diluted compounds into multiple assay plates (Fig. 1) . Cells were diluted to 2.5 × 10 5 cells/mL in MEM with 2% FBS, and 20 µL were added to each well of the assay plates using the MicroFlo Select reagent dispenser. The assay plates containing compound dilutions and cells were incubated for 1 hour at room temperature prior to adding 100 CCID 50 dilutions of viruses. The MicroFlo Select reagent dispenser was used to dispense 5 µL of virus in MEM (Gibco) with 2% FBS (HyClone, Thermo Fisher Scientific, Waltham, MA) to 384-well assay plates. Viruses were added to the entire plate, including virus control wells that did not contain test compound. The assay plates were covered with a plate lid, wrapped in plastic wrap www.nature.com/scientificreports www.nature.com/scientificreports/ with a wet paper towel placed at the bottom of the stack and incubated at 37 °C in a 5% CO 2 atmosphere for 3-7 days, depending on the virus and cell line 18, 24 . The final assay volume was 30 µL.
After the appropriate incubation period of the cell-virus combination, 15 µL of cell lysis buffer followed by 15 µL of reconstituted substrate solution were added to each well using the MicroFlo Select reagent dispenser. After incubation for 10 minutes in the dark, the resulting luminescence was read on a Victor X4 plate reader with a 0.1 second integration for each well. Raw luminescence counts were exported in Excel software (Microsoft, Redmond, WA) to custom spreadsheets that calculated the percent inhibition of CPE in each well. The definition of the percent inhibition of CPE was calculated as:
Colorimetric antiviral assay. An in vitro CPE assay (signal-to-noise ratio >5) was used to calculate the EC 50 , expressed in µM, for a given virus isolate. Compound and virus were combined with cells (2 × 10 5 cells/ well) in 96-well plates, starting at 10 µM of the compound. To ensure that endpoints from compound and virus titrations were reached, 11 seven-point titration curves were performed in 0.5 log 10 steps with duplicate wells for each compound-virus concentration. Three replicate tests were run for each virus, unless otherwise stated. After appropriate incubation at 37 °C, cells were stained with crystal violet (0.05% crystal violet, 0.5% Tween-20 and 50% ethanol in deionized water) and washed three times with deionized water. Plates were air-dried and viral CPE was measured by determining the absorbance at 590 nm. www.nature.com/scientificreports www.nature.com/scientificreports/ each virus-compound combination. If the results of the five tests fell within one half-log 10 drug dilution, the mean EC 50 value with the standard deviation of the mean was reported. If the results were not within one drug dilution, another five tests were conducted, and the results were averaged. If the virus dilution did not achieve the desired >80% destruction of cells, the virus was passaged to increase the titre. If the virus was inhibited at all compound concentrations, the test was repeated starting at a 10-fold lower concentration of the compound.
The data used to support the findings of this study are included within the article.