BACKGROUND
mycobacterium avium subsp.
paratuberculosis  causes granulomatous enteritis in ruminants that can lead to weight loss and emaciation, as well as diarrhoea in certain species  <cit> .
map has been detected in wild ruminant species worldwide, and it is thought that all ruminant species are susceptible to map infection  <cit> .
although clinical disease, known as johne’s disease, has only occasionally been described in wildlife, its impact may be under-estimated due to incomplete knowledge of the clinical progression of map infection in these species, non-specific clinical signs, and limited testing in these populations.
determining the infection status of wildlife is important to reduce the disease risks associated with translocation, to certify infection status for importation/exportation purposes, to limit sources of infection for humans and livestock, and to establish baseline values for future monitoring or surveillance  <cit> .
for the detection of current or prior map infection in wild ruminants, serological methods such as enzyme-linked immunosorbent assay  may be preferred over alternative methods such as faecal culture, as elisa is less expensive, fast and easy to perform, and collected serum can be used to screen for other infections.
serum elisa kits marketed for the detection of map-specific antibodies in domestic ruminant species are generally not validated for use with sera from other species  <cit> .
it is unlikely that these tests give equivalent results for other, even closely related species  <cit> .
inter-species variations in test outcomes are due in part to the specificity of certain reagents included in commercial kits; for example, the labelled secondary antibodies or conjugates may have varying capacity to bind immunoglobulin g  from different species  <cit> .
the level of non-specific binding of serum proteins to components of the elisa assay may also be difficult to predict, and can potentially result in a reduction of the signal-to-noise ratio, which is the ratio of the optic density  of a positive control and a negative control at a given sample and conjugate concentration  <cit> .
kits generally recommend cut-off values to classify samples as ‘negative’, ‘positive’ or ‘suspect’.
cut-off values are selected based on a set of parameters, in particular the species being tested, the target condition , and the testing objectives   <cit> .
when using a commercial kit for wildlife samples, changes in these parameters need to be reflected by adapting the cut-off values.
guidelines for conducting a complete diagnostic validation have been thoroughly outlined  <cit> , and detailed recommendations for the design and reporting of diagnostic evaluation studies for chronic diseases have been developed  <cit> .
however, it is not always possible or appropriate to undertake such a full evaluation in wildlife studies due to time and budget constraints as well as sample availability, in particular accessing known positive and negative controls.
in these cases, certain modification and evaluation steps may reduce the level of uncertainty in the test results if a complete validation is impossible.
the objectives of this paper were first, to assess current practices in testing and reporting of map serum elisa for wildlife samples, and second, to modify and evaluate a commercial elisa kit  for detecting current or prior map infection in elk , bison  and caribou .
methods
literature review
a systematic search of peer-reviewed articles and proceedings related to the development or use of elisa tests in wildlife was performed.
the keywords “serology”, “elisa”, “wildlife”, “ruminant”, “cervid”, “deer”, “elk”, “bison”, “caribou”, “rangifer”, “diagnostic”, “paratuberculosis” and “johne’s disease” were used in pubmed, isi web of knowledge, sciencedirect, and google scholar in january  <dig>  papers found during the initial search were carefully examined for additional relevant citations.
we included any papers that used map elisa to test for naturally infected animals in ruminant species other than cattle, sheep and goats; experimental infections were excluded.
among the papers that fit the above-mentioned selection criteria, the following information was collected: type of elisa , modifications to the materials or procedure, and reporting of cut-off values and test performance.
conjugate affinity
in order to determine which conjugates could be appropriate for testing elk, bison, and caribou sera, we first evaluated the binding affinity of the anti-bovine conjugate included in the idexx kita to purified igg from each species; cattle igg were included for comparison.
protein gb, a recombinant bacterial protein that binds igg from a wide variety of species, was also tested for all four species.
a second anti-bovine conjugatec  was tested against cattle and bison, and an anti-deer conjugated against elk and caribou as more specific alternatives.
for each species, igg was purified from a pooled serum sample of four individuals, using the melon gel igg spin purification kit , following manufacturer’s instructions.
the protein concentration of each purified igg product was determined using the bradford titration method .
the purified igg products from the four species were adjusted to a concentration of  <dig> μg/ml by addition of phosphate-buffered saline .
eight two-fold serial dilutions of the purified igg product were made in a coating buffer , from a starting concentration of  <dig> μg/ml.
subsequently,  <dig> μl of each dilution of purified igg was incubated on an immulon  <dig> hbx microtitre 96-well plate  for  <dig>  hours at 37°c.
wells were washed three times with washing buffer , and blocked with 1% bovine serum albumin  in pbs-t  for one hour at 37°c.
to ensure that there was no interaction between the conjugate and the blocking reagent, and to verify that a 1% solution was an optimal blocking concentration, control wells with different concentrations of the blocking solution  were included on the plate.
after repeating the previous wash protocol,  <dig> μl of the conjugate being tested was added to each well and incubated for  <dig> minutes at room temperature.
preliminary testing was conducted to determine the conjugate concentrations that would give an optical density  of approximately  <dig>  for at least one of the species being tested in order to obtain a sufficient range of ods allowing between-species comparisons.
these were determined to be 1: <dig>  1: <dig>  1: <dig>  1: <dig> for protein g, idexx kit anti-bovine, anti-deer and kpl anti-bovine, respectively, diluted in pbs-t  <dig> % bsa .
following incubation with the conjugate, the plate was washed three times, and wells were revealed by the addition of  <dig> μl of tetramethyl benzidine  included in the idexx kit.
the reaction was stopped after five minutes with the “stop solution” provided in the kit.
the od of each well was measured using a spectrophotometer at  <dig> nm .
we plotted the od on the y-axis and the serial dilutions of igg on the x-axis, and the area under the curve  was calculated  as an index of binding affinity for comparison between species within each conjugate.
optimization
a checkerboard test  was performed using protein g with all three species, as well as anti-deer for elk and caribou, to find the optimal concentrations of sample and conjugate that would provide the best signal-to-noise ratio.
appropriate ranges of serum and conjugate dilutions were identified by preliminary testing , and all combinations within these ranges were tested with a positive and negative control sample, using a separate microtitre plate for each.
for both bison and elk, high sero-reactors  were selected for use as positive controls from among individuals that had tested positive for map by either faecal or tissue culture.
for these two species, negative control samples were available from farmed herds that had repeatedly tested negative by faecal culture over several years.
for caribou, it was not possible to obtain samples from animals of known infection status; however, serum from an animal with a high map antibody titre was available, and this was used as a positive control  <cit> .
serum from a caribou with a low od on preliminary testing was selected as a negative control in the cbt.
a 96-well microtitre plate provided in the idexx kit was used for each of the positive and negative control samples.
these plates are pre-coated with map antigen.
eight two-fold dilutions of the sample were plated onto eight columns, starting at a 1: <dig> dilution.
samples were diluted in the sample diluent provided in the idexx kit, allowing the m. phlei adsorption step to partially remove cross-reacting antibodies  <cit> .
after plating the samples, manufacturer’s instructions were followed until conjugate was added.
at this step, eight two-fold dilutions of the conjugate were prepared in order to include approximately four dilutions above and below the concentration recommended by each conjugate manufacturer.
conjugate dilutions ranged from 1: <dig> to 1: <dig> for protein g and from 1: <dig> to 1: <dig> for anti-deer.
each conjugate dilution was plated onto one of the eight rows of the assay plate.
wells containing conjugate diluted in pbs-t  <dig> % bsa instead of the conjugate diluent from the idexx kit were included as a control for non-specific binding.
the final steps of the elisa were performed according to the manufacturer’s instructions, except for the length of revelation with the tmb substrate when using the protein g conjugate, which based on visual observation was judged to be optimal at  <dig>  minutes +/−  <dig> seconds.
the interpretation of the checkerboard test was done according to crowther et al.
<cit> .
the negative cbt was used to find the acceptable range of conjugate dilutions that minimized the background noise, i.e.
the od of a negative sample.
on the positive cbt, we selected the range of conjugate dilutions that gave appropriate titration curves, i.e.
the curve displayed a sigmoid shape from the highest to the lowest sample dilution, reaching the level of background signal.
the final conjugate concentration was selected based on the overlap between these two ranges.
to select the sample dilution, the binding ratio  was calculated for each combination of conjugate and sample dilution.
the sample dilution was chosen to maximize this ratio, and as a secondary criterion, minimize the amount of serum required.
determination of cut-off value and sensitivity/specificity
samples from animals of known infection status
the optimal way to establish cut-off values is to test a panel of samples from animals of known infection status  <cit> .
this was possible for both elk and bison, as reference samples were available.
for elk, the reference panel consisted of  <dig> negative and  <dig> positive samples.
negative samples were from individual farmed elk that tested negative to either faecal or tissue culture and serology done at the johne’s information center, university of wisconsin, madison.
these elk were from herds in montana, usa that had no clinical evidence of johne’s disease and were negative by repeated serum elisa testing over several years.e positive samples were from individuals that tested positive by elisa and by tissue and/or faecal culture at this same diagnostic centre, and were from herds with clinical cases of johne’s disease.
for bison, the panel contained  <dig> negative and five positive samples.
negative samples were from individual free-ranging bison that were negative by faecal culture, from herds with no evidence of infection over a five-year testing period.
positive samples were from clinically affected animals confirmed to be infected by tissue culture and that tested positive by elisa and agarose gel immunodiffusion .
these control samples were tested with the idexx kit using the optimal concentrations of sample and conjugate defined in the previous step.
protein g was tested for both species, and anti-deer was also tested for elk.
sample-to-positive  ratios were calculated for each sample using the idexx kit positive and negative controls as the reference .
from the results obtained from these panels, the optimal cut-off value, sensitivity and specificity were determined using roc analysis, calculated using stata  <dig>  .
alternative cut-off calculation
as a panel of reference samples was not available for caribou, an alternative means for defining a cut-off was used.
this method was also used for elk and bison to provide a comparison with the reference panel.
for each species, a bank of serum from individual animals of unknown infection status, independent from the panel samples, was available.
sera from adult caribou  were obtained from herds in western greenland  and northern quebec, canada .
these samples were collected between  <dig> and  <dig> through the circumarctic rangifer monitoring and assessment network  <cit> .
a total of  <dig> serum samples from yearling and adult elk were obtained from ten herds in western alberta, canada, through capture efforts of multiple projects occurring in the region between  <dig> and  <dig> .
serum samples from  <dig> individual adult bison were collected by various collaborators from northern alberta and british columbia, and the northwest territories, canada, between  <dig> and  <dig>  the approach used to define the cut-off value and test performances for these samples was modified from desquesnes et al.
<dig>  <cit> .
briefly, the samples were tested according to the conditions determined in the previous steps, and s/p ratios calculated using the controls included in the idexx kit .
positive and negative controls from the species being tested were also included on each plate.
the cut-off value suggested by the kit for negative samples  was taken as the preliminary cut-off value for selecting presumed negative samples.
the mean s/p value from this presumed negative pool was calculated, and a new cut-off value was defined ).
RESULTS
literature review
the literature search yielded a total of  <dig> papers;  <dig> were retained as relevant to the scope of this article  <cit> , four of which were proceedings.
ten papers reported the use of in-house elisa,  <dig> used commercial kits, and one article made a comparison of an in-house procedure and a commercial kit.
it is noteworthy that in four papers it was impossible to identify which kit or procedure was used, and in some publications the procedure and modifications were insufficiently documented to allow for the experimental conditions to be reproduced.
of the studies that used commercial kits,  <dig> did not perform any modifications to account for testing a different species.
overall, only five papers reported any kind of test evaluation or referred to studies that had done so.
eleven papers failed to discuss the cut-off value used to distinguish between positive and negative results.
only one paper reported the sensitivity and specificity values of their modified test for the species for which the test was applied  <cit> .
conjugate affinity
the affinity of the idexx kit anti-bovine conjugate was high for cow igg  =  <dig> ), low for elk , and insignificant for bison and caribou .
similarly, the kpl anti-bovine conjugate had a very high affinity for cow igg  and a much lower affinity for bison igg .
protein g had a comparable affinity for elk , caribou  and bison , but a higher affinity for cow igg .
finally, the anti-deer conjugate showed comparable affinity between elk  and caribou .
no background signal was detected in any of the control wells coated with blocking solution.
optimization
the optimal conjugate and sample dilutions determined for each species are presented in table  <dig>  no significant difference in od was observed between the conjugate diluted in pbs-t versus the conjugate diluent provided in the idexx kit, ensuring the absence of non-specific binding between the kit conjugate diluent and the new conjugates.
concentration not available from manufacturer.
<dig>  μg/ml.
<dig>  μg/ml.
optimal dilutions of protein g and anti-deer conjugates when used with serum from elk, caribou or bison, and optimal species-specific serum dilutions for use with the idexx mycobacterium paratuberculosis antibody test.
nt: not tested.
determination of cut-off value and sensitivity/specificity
samples from animals of known infection status
elisa test parameters for elk serum using either the protein g or anti-deer conjugate are given in table  <dig>  since protein g and anti-deer conjugates resulted in the correct classification of a similar number of animals, and since protein g is more readily available to end-users, we selected this conjugate to proceed with further testing.
a cut-off value could not be established using the panel of known bison samples due to the nature of the positive samples in the panel, which were from animals with advanced clinical disease.
these sera had very high s/p ratios, and were unlikely representative of subclinically infected animals; we would not expect animals at earlier stages of infection to have such high antibody concentrations.
given this biased distribution of s/p ratios in our positive control group, we determined that this method would result in an inappropriate cut-off for our target population.
sample-to-positive  ratio cut-off values as determined by receiver operational curve  analysis, the area under the curve , and the resulting sensitivity , specificity , positive predictive value  and negative predictive value .
alternative cut-off calculation
of the  <dig> elk samples of unknown status,  <dig> were presumed negative as defined by the preliminary cut-off of s/p =  <dig> .
s/p ratios of the presumed negative samples were averaged  and a new cut-off value was calculated as m +  <dig> sd =  <dig> .
using this method with bison sera,  <dig> of  <dig> samples of unknown status were presumed negative with the preliminary cut-off.
after calculating the average s/p ratio  and standard deviation  of these samples, the new cut-off was defined as  <dig> .
among  <dig> adult caribou serum samples,  <dig> samples were presumed negative, yielding a final cut-off of  <dig>  .
discussion
literature review
we found that elisa is commonly used for testing for map infection in different wild and semi-domestic ruminant species, but discrepancies exist in terms of the quality of the data reported.
in many of the papers we reviewed, the methods were incompletely described, limiting the ability of the reader to reproduce the test conditions or to critically interpret the results of these studies.
despite inherent challenges in wildlife diagnostics, appropriate test modification and validation steps are necessary.
we have presented a range of experiments that can be undertaken to reach this objective.
conjugate affinity
we found that the choice of conjugate has an important impact on the test performance due to species-associated differences in affinity.
although it was impossible to directly compare the binding affinity of the different conjugates due to the inaccessibility of information about the concentration of these products , it was possible to compare the affinity of each conjugate between species.
protein g would be a suitable conjugate for igg from any of the three species of interest, and anti-deer is an appropriate alternative for elk and caribou samples.
the low affinity of the idexx kit anti-bovine conjugate for elk, bison and caribou immunoglobulin makes it inappropriate for testing samples from these species.
in this study, the binding affinity of protein g for elk and caribou was similar, although lower than it was for cattle; the same trend was previously shown for red deer  and reindeer  in comparison to cattle  <cit> .
our results differed slightly from those reported by kramsky et al., who found that the protein g binding affinity was similar for bison and cattle, although similarly to this study, they found that elk had a lower binding affinity than cattle  <cit> .
our findings also confirmed these authors’ observation that it is impossible to infer binding affinity between closely related species.
optimization
table  <dig> contains the recommended sample and conjugate dilutions for using the idexx kit with elk, caribou and bison sera.
aside from using these modified dilutions and alternate conjugates, we recommend that the protocol be followed according to the manufacturer’s recommendations.
we observed considerable variations in test results associated with the duration of incubation with the tetramethyl benzidine  substrate; it is important that this time be kept consistent between test development steps and sample runs.
even when keeping the incubation time consistent, there were small differences between runs of the panel of samples.
this variability may in part be attributed to the very low concentration of protein g used in our assay, as concentrations may be difficult to reproduce exactly between tests.
determination of cut-off value and sensitivity/specificity
it has been suggested that to establish a cut-off value and subsequently calculate the test accuracy with a high level of precision, a panel of  <dig> positive and negative control samples should be tested  <cit> .
other authors suggest using thousands for validation prior to commercialization  <cit> .
meeting these recommendations becomes even more challenging for wildlife when selection criteria for appropriate control samples are considered.
in an ideal scenario, samples should reflect the target population in terms of the age and sex ratio, the geographic location, and the distribution of animals between different stages of infection  <cit> .
they should also reflect the target condition that has been defined by the researcher; for example, the three target conditions that are described for map are infected, infectious, and affected  <cit> .
our panel of known-status elk samples included animals of all three target conditions: clinically affected; seropositive and tissue culture positive ; and seropositive and faecal culture positive .
this panel is therefore compatible with our objective of detecting infected animals regardless of their disease stage.
however, the proportion of animals in each category may not reflect what is seen in a free-ranging population.
the high number of clinically diseased animals among the positive control elk samples in our study likely means that we overestimate this elisa’s ability to detect infected animals.
due to the relatively small number of known elk samples in our panel, our sensitivity and specificity estimates had large confidence intervals.
the panel of known bison samples were even less representative of the target population since all positive animals were clinically diseased, making inferences about test sensitivity and specificity for infected animals impossible.
another limitation of the panel of reference samples is that an elisa test of unknown performance was used to confirm some of the negative control samples.
the johne’s information center used an older version of the idexx test that employed an anti-ruminant conjugate as opposed to an anti-bovine conjugate.
although we are certain that this test was capable of detecting positive animals, the sensitivity is unknown.
if there were animals falsely classified as negative in our panel, the result would be an underestimation of the specificity of our modified test.
when recommended numbers of appropriate control samples are unavailable, a cut-off value may be established either by using a panel with fewer samples of known status , or by using alternate methods for calculating a cut-off value .
a commonly-used alternative is to identify and test a group of confirmed uninfected animals and to use the mean s/p +  <dig> sd of this group as the cut-off  <cit> .
in this paper, we illustrated the worst-case scenario in which no reference samples for the species of interest were available and a presumed negative group had to be created.
with this method, the final cut-off value is very sensitive to variations in the initial cut-off value selected.
however in our study, the s/p cut-off values calculated for elk using both a panel of known control samples  and this alternative method  were quite similar.
since this was the only method that could be used for establishing a cut-off value for bison and caribou sera, sensitivity and specificity estimates could not be generated for this elisa test for these species.
testing objectives are important for the selection of the cut-off value, as researchers may wish to prioritize either a higher sensitivity or specificity.
although not the scope of this paper, our end-goal of adapting elisa for these different species was to use it as a screening method to identify individual animals that are more likely to be infected.
this would be confirmed using more specific map diagnostic methods such as faecal culture.
based on this objective, we wanted to select a cut-off that would optimize both sensitivity and specificity and give the highest percentage of correctly classified samples.
if this test were to be used as a more definitive diagnostic test, for example in a test-and-cull strategy, the cut-off for a “positive result” needs to be selected to give a very high specificity.
using the roc curve from our panel of elk samples using the protein g conjugate, the cut-off value that gave 100% specificity was  <dig> .
the range of s/p values between our screening cut-off and this cut-off for positive samples could be designated as “suspect” results .
alternatively, the anti-deer conjugate could be selected over protein g at the recommended dilution if the test objectives required a higher specificity.
CONCLUSIONS
in conclusion, despite the abundant literature that exists on test development and validation, diagnostic tests validated only for livestock species are frequently applied for wildlife samples.
as we illustrated, unmodified commercial tests may fail to detect the immunoglobulins of other species.
from a wildlife management perspective, this can have serious implications for epidemiological surveillance.
in this study we adapted a commercial elisa kit for use with other species: we evaluated the binding affinity of different conjugates to igg of the target species, ensured the absence of non-specific binding after modifications, performed a checkerboard test to recommend optimal sample and conjugate dilutions, and determined appropriate cut-off values.
such modification and evaluation steps enable valuable data to be generated from serological surveys for map in wildlife that can be critically appraised and interpreted with greater confidence.
endnotes
aidexx mycobacterium paratuberculosis antibody test, westbrook, maine, usa; manufactured by institut pourquier, montpellier, france.
bhrp-recombinant-protein g, invitrogen, camarillo, california, usa.
cperoxidase-labeled antibody to bovine igg, kirkegaard & perry laboratories  inc., gaithersburg, maryland, usa.
dperoxidase-labeled affinity purified antibody to deer igg, kpl inc.
ethe johne’s information center used the idexx map elisa kit manufactured in  <dig> .
competing interests
the authors declare that they have no competing interests.
authors’ contributions
mp and tf contributed equally to the study design and in drafting the manuscript.
mp took the lead on the assay evaluation and modification, as well as in evaluating the test performance.
tf assisted with the assay evaluation and modification steps, and formatted the manuscript.
js assisted in the study design, in carrying out the serologic testing, and provided feedback on the manuscript.
sk, jdb, fvdm and ko participated in the study design and provided critical feedback on the manuscript.
all authors read and approved the final manuscript.

 mycobacterium avium subsp. paratuberculosis causes granulomatous enteritis in ruminants that can lead to weight loss and emaciation, as well as diarrhoea in certain species. map has been detected in wild ruminant species worldwide, and it is thought that all ruminant species are susceptible to map infection. although clinical disease, known as johne’s disease, has only occasionally been described in wildlife, its impact may be under-estimated due to incomplete knowledge of the clinical progression of map infection in these species, non-specific clinical signs, and limited testing in these populations. determining the infection status of wildlife is important to reduce the disease risks associated with translocation, to certify infection status for importation/exportation purposes, to limit sources of infection for humans and livestock, and to establish baseline values for future monitoring or surveillance. for the detection of current or prior map infection in wild ruminants, serological methods such as enzyme-linked immunosorbent assay may be preferred over alternative methods such as faecal culture, as elisa is less expensive, fast and easy to perform, and collected serum can be used to screen for other infections. serum elisa kits marketed for the detection of map-specific antibodies in domestic ruminant species are generally not validated for use with sera from other species. it is unlikely that these tests give equivalent results for other, even closely related species. inter-species variations in test outcomes are due in part to the specificity of certain reagents included in commercial kits; for example, the labelled secondary antibodies or conjugates may have varying capacity to bind immunoglobulin g from different species. the level of non-specific binding of serum proteins to components of the elisa assay may also be difficult to predict, and can potentially result in a reduction of the signal-to-noise ratio, which is the ratio of the optic density of a positive control and a negative control at a given sample and conjugate concentration. kits generally recommend cut-off values to classify samples as ‘negative’, ‘positive’ or ‘suspect’. cut-off values are selected based on a set of parameters, in particular the species being tested, the target condition, and the testing objectives. when using a commercial kit for wildlife samples, changes in these parameters need to be reflected by adapting the cut-off values. guidelines for conducting a complete diagnostic validation have been thoroughly outlined, and detailed recommendations for the design and reporting of diagnostic evaluation studies for chronic diseases have been developed. however, it is not always possible or appropriate to undertake such a full evaluation in wildlife studies due to time and budget constraints as well as sample availability, in particular accessing known positive and negative controls. in these cases, certain modification and evaluation steps may reduce the level of uncertainty in the test results if a complete validation is impossible. the objectives of this paper were first, to assess current practices in testing and reporting of map serum elisa for wildlife samples, and second, to modify and evaluate a commercial elisa kit for detecting current or prior map infection in elk, bison and caribou. methods literature review a systematic search of peer-reviewed articles and proceedings related to the development or use of elisa tests in wildlife was performed. the keywords “serology”, “elisa”, “wildlife”, “ruminant”, “cervid”, “deer”, “elk”, “bison”, “caribou”, “rangifer”, “diagnostic”, “paratuberculosis” and “johne’s disease” were used in pubmed, isi web of knowledge, sciencedirect, and google scholar in january papers found during the initial search were carefully examined for additional relevant citations. we included any papers that used map elisa to test for naturally infected animals in ruminant species other than cattle, sheep and goats; experimental infections were excluded. among the papers that fit the above-mentioned selection criteria, the following information was collected: type of elisa, modifications to the materials or procedure, and reporting of cut-off values and test performance. conjugate affinity in order to determine which conjugates could be appropriate for testing elk, bison, and caribou sera, we first evaluated the binding affinity of the anti-bovine conjugate included in the idexx kita to purified igg from each species; cattle igg were included for comparison. protein gb, a recombinant bacterial protein that binds igg from a wide variety of species, was also tested for all four species. a second anti-bovine conjugatec was tested against cattle and bison, and an anti-deer conjugated against elk and caribou as more specific alternatives. for each species, igg was purified from a pooled serum sample of four individuals, using the melon gel igg spin purification kit, following manufacturer’s instructions. the protein concentration of each purified igg product was determined using the bradford titration method. the purified igg products from the four species were adjusted to a concentration of μg/ml by addition of phosphate-buffered saline. eight two-fold serial dilutions of the purified igg product were made in a coating buffer, from a starting concentration of μg/ml. subsequently, μl of each dilution of purified igg was incubated on an immulon hbx microtitre 96-well plate for hours at 37°c. wells were washed three times with washing buffer, and blocked with 1% bovine serum albumin in pbs-t for one hour at 37°c. to ensure that there was no interaction between the conjugate and the blocking reagent, and to verify that a 1% solution was an optimal blocking concentration, control wells with different concentrations of the blocking solution were included on the plate. after repeating the previous wash protocol, μl of the conjugate being tested was added to each well and incubated for minutes at room temperature. preliminary testing was conducted to determine the conjugate concentrations that would give an optical density of approximately for at least one of the species being tested in order to obtain a sufficient range of ods allowing between-species comparisons. these were determined to be 1: 1: 1: 1: for protein g, idexx kit anti-bovine, anti-deer and kpl anti-bovine, respectively, diluted in pbs-t % bsa. following incubation with the conjugate, the plate was washed three times, and wells were revealed by the addition of μl of tetramethyl benzidine included in the idexx kit. the reaction was stopped after five minutes with the “stop solution” provided in the kit. the od of each well was measured using a spectrophotometer at nm. we plotted the od on the y-axis and the serial dilutions of igg on the x-axis, and the area under the curve was calculated as an index of binding affinity for comparison between species within each conjugate. optimization a checkerboard test was performed using protein g with all three species, as well as anti-deer for elk and caribou, to find the optimal concentrations of sample and conjugate that would provide the best signal-to-noise ratio. appropriate ranges of serum and conjugate dilutions were identified by preliminary testing, and all combinations within these ranges were tested with a positive and negative control sample, using a separate microtitre plate for each. for both bison and elk, high sero-reactors were selected for use as positive controls from among individuals that had tested positive for map by either faecal or tissue culture. for these two species, negative control samples were available from farmed herds that had repeatedly tested negative by faecal culture over several years. for caribou, it was not possible to obtain samples from animals of known infection status; however, serum from an animal with a high map antibody titre was available, and this was used as a positive control. serum from a caribou with a low od on preliminary testing was selected as a negative control in the cbt. a 96-well microtitre plate provided in the idexx kit was used for each of the positive and negative control samples. these plates are pre-coated with map antigen. eight two-fold dilutions of the sample were plated onto eight columns, starting at a 1: dilution. samples were diluted in the sample diluent provided in the idexx kit, allowing the m. phlei adsorption step to partially remove cross-reacting antibodies. after plating the samples, manufacturer’s instructions were followed until conjugate was added. at this step, eight two-fold dilutions of the conjugate were prepared in order to include approximately four dilutions above and below the concentration recommended by each conjugate manufacturer. conjugate dilutions ranged from 1: to 1: for protein g and from 1: to 1: for anti-deer. each conjugate dilution was plated onto one of the eight rows of the assay plate. wells containing conjugate diluted in pbs-t % bsa instead of the conjugate diluent from the idexx kit were included as a control for non-specific binding. the final steps of the elisa were performed according to the manufacturer’s instructions, except for the length of revelation with the tmb substrate when using the protein g conjugate, which based on visual observation was judged to be optimal at minutes +/− seconds. the interpretation of the checkerboard test was done according to crowther et al.. the negative cbt was used to find the acceptable range of conjugate dilutions that minimized the background noise, i.e. the od of a negative sample. on the positive cbt, we selected the range of conjugate dilutions that gave appropriate titration curves, i.e. the curve displayed a sigmoid shape from the highest to the lowest sample dilution, reaching the level of background signal. the final conjugate concentration was selected based on the overlap between these two ranges. to select the sample dilution, the binding ratio was calculated for each combination of conjugate and sample dilution. the sample dilution was chosen to maximize this ratio, and as a secondary criterion, minimize the amount of serum required. determination of cut-off value and sensitivity/specificity samples from animals of known infection status the optimal way to establish cut-off values is to test a panel of samples from animals of known infection status. this was possible for both elk and bison, as reference samples were available. for elk, the reference panel consisted of negative and positive samples. negative samples were from individual farmed elk that tested negative to either faecal or tissue culture and serology done at the johne’s information center, university of wisconsin, madison. these elk were from herds in montana, usa that had no clinical evidence of johne’s disease and were negative by repeated serum elisa testing over several years.e positive samples were from individuals that tested positive by elisa and by tissue and/or faecal culture at this same diagnostic centre, and were from herds with clinical cases of johne’s disease. for bison, the panel contained negative and five positive samples. negative samples were from individual free-ranging bison that were negative by faecal culture, from herds with no evidence of infection over a five-year testing period. positive samples were from clinically affected animals confirmed to be infected by tissue culture and that tested positive by elisa and agarose gel immunodiffusion. these control samples were tested with the idexx kit using the optimal concentrations of sample and conjugate defined in the previous step. protein g was tested for both species, and anti-deer was also tested for elk. sample-to-positive ratios were calculated for each sample using the idexx kit positive and negative controls as the reference. from the results obtained from these panels, the optimal cut-off value, sensitivity and specificity were determined using roc analysis, calculated using stata. alternative cut-off calculation as a panel of reference samples was not available for caribou, an alternative means for defining a cut-off was used. this method was also used for elk and bison to provide a comparison with the reference panel. for each species, a bank of serum from individual animals of unknown infection status, independent from the panel samples, was available. sera from adult caribou were obtained from herds in western greenland and northern quebec, canada. these samples were collected between and through the circumarctic rangifer monitoring and assessment network. a total of serum samples from yearling and adult elk were obtained from ten herds in western alberta, canada, through capture efforts of multiple projects occurring in the region between and. serum samples from individual adult bison were collected by various collaborators from northern alberta and british columbia, and the northwest territories, canada, between and the approach used to define the cut-off value and test performances for these samples was modified from desquesnes et al.. briefly, the samples were tested according to the conditions determined in the previous steps, and s/p ratios calculated using the controls included in the idexx kit. positive and negative controls from the species being tested were also included on each plate. the cut-off value suggested by the kit for negative samples was taken as the preliminary cut-off value for selecting presumed negative samples. the mean s/p value from this presumed negative pool was calculated, and a new cut-off value was defined ).  literature review the literature search yielded a total of papers; were retained as relevant to the scope of this article, four of which were proceedings. ten papers reported the use of in-house elisa, used commercial kits, and one article made a comparison of an in-house procedure and a commercial kit. it is noteworthy that in four papers it was impossible to identify which kit or procedure was used, and in some publications the procedure and modifications were insufficiently documented to allow for the experimental conditions to be reproduced. of the studies that used commercial kits, did not perform any modifications to account for testing a different species. overall, only five papers reported any kind of test evaluation or referred to studies that had done so. eleven papers failed to discuss the cut-off value used to distinguish between positive and negative results. only one paper reported the sensitivity and specificity values of their modified test for the species for which the test was applied. conjugate affinity the affinity of the idexx kit anti-bovine conjugate was high for cow igg  =  ), low for elk, and insignificant for bison and caribou. similarly, the kpl anti-bovine conjugate had a very high affinity for cow igg and a much lower affinity for bison igg. protein g had a comparable affinity for elk, caribou and bison, but a higher affinity for cow igg. finally, the anti-deer conjugate showed comparable affinity between elk and caribou. no background signal was detected in any of the control wells coated with blocking solution. optimization the optimal conjugate and sample dilutions determined for each species are presented in table  no significant difference in od was observed between the conjugate diluted in pbs-t versus the conjugate diluent provided in the idexx kit, ensuring the absence of non-specific binding between the kit conjugate diluent and the new conjugates. concentration not available from manufacturer. μg/ml. μg/ml. optimal dilutions of protein g and anti-deer conjugates when used with serum from elk, caribou or bison, and optimal species-specific serum dilutions for use with the idexx mycobacterium paratuberculosis antibody test. nt: not tested. determination of cut-off value and sensitivity/specificity samples from animals of known infection status elisa test parameters for elk serum using either the protein g or anti-deer conjugate are given in table  since protein g and anti-deer conjugates resulted in the correct classification of a similar number of animals, and since protein g is more readily available to end-users, we selected this conjugate to proceed with further testing. a cut-off value could not be established using the panel of known bison samples due to the nature of the positive samples in the panel, which were from animals with advanced clinical disease. these sera had very high s/p ratios, and were unlikely representative of subclinically infected animals; we would not expect animals at earlier stages of infection to have such high antibody concentrations. given this biased distribution of s/p ratios in our positive control group, we determined that this method would result in an inappropriate cut-off for our target population. sample-to-positive ratio cut-off values as determined by receiver operational curve analysis, the area under the curve, and the resulting sensitivity, specificity, positive predictive value and negative predictive value. alternative cut-off calculation of the elk samples of unknown status, were presumed negative as defined by the preliminary cut-off of s/p =. s/p ratios of the presumed negative samples were averaged and a new cut-off value was calculated as m +  sd = . using this method with bison sera, of samples of unknown status were presumed negative with the preliminary cut-off. after calculating the average s/p ratio and standard deviation of these samples, the new cut-off was defined as. among adult caribou serum samples, samples were presumed negative, yielding a final cut-off of. discussion literature review we found that elisa is commonly used for testing for map infection in different wild and semi-domestic ruminant species, but discrepancies exist in terms of the quality of the data reported. in many of the papers we reviewed, the methods were incompletely described, limiting the ability of the reader to reproduce the test conditions or to critically interpret the results of these studies. despite inherent challenges in wildlife diagnostics, appropriate test modification and validation steps are necessary. we have presented a range of experiments that can be undertaken to reach this objective. conjugate affinity we found that the choice of conjugate has an important impact on the test performance due to species-associated differences in affinity. although it was impossible to directly compare the binding affinity of the different conjugates due to the inaccessibility of information about the concentration of these products, it was possible to compare the affinity of each conjugate between species. protein g would be a suitable conjugate for igg from any of the three species of interest, and anti-deer is an appropriate alternative for elk and caribou samples. the low affinity of the idexx kit anti-bovine conjugate for elk, bison and caribou immunoglobulin makes it inappropriate for testing samples from these species. in this study, the binding affinity of protein g for elk and caribou was similar, although lower than it was for cattle; the same trend was previously shown for red deer and reindeer in comparison to cattle. our results differed slightly from those reported by kramsky et al., who found that the protein g binding affinity was similar for bison and cattle, although similarly to this study, they found that elk had a lower binding affinity than cattle. our findings also confirmed these authors’ observation that it is impossible to infer binding affinity between closely related species. optimization table  contains the recommended sample and conjugate dilutions for using the idexx kit with elk, caribou and bison sera. aside from using these modified dilutions and alternate conjugates, we recommend that the protocol be followed according to the manufacturer’s recommendations. we observed considerable variations in test results associated with the duration of incubation with the tetramethyl benzidine substrate; it is important that this time be kept consistent between test development steps and sample runs. even when keeping the incubation time consistent, there were small differences between runs of the panel of samples. this variability may in part be attributed to the very low concentration of protein g used in our assay, as concentrations may be difficult to reproduce exactly between tests. determination of cut-off value and sensitivity/specificity it has been suggested that to establish a cut-off value and subsequently calculate the test accuracy with a high level of precision, a panel of positive and negative control samples should be tested. other authors suggest using thousands for validation prior to commercialization. meeting these recommendations becomes even more challenging for wildlife when selection criteria for appropriate control samples are considered. in an ideal scenario, samples should reflect the target population in terms of the age and sex ratio, the geographic location, and the distribution of animals between different stages of infection. they should also reflect the target condition that has been defined by the researcher; for example, the three target conditions that are described for map are infected, infectious, and affected. our panel of known-status elk samples included animals of all three target conditions: clinically affected; seropositive and tissue culture positive; and seropositive and faecal culture positive. this panel is therefore compatible with our objective of detecting infected animals regardless of their disease stage. however, the proportion of animals in each category may not reflect what is seen in a free-ranging population. the high number of clinically diseased animals among the positive control elk samples in our study likely means that we overestimate this elisa’s ability to detect infected animals. due to the relatively small number of known elk samples in our panel, our sensitivity and specificity estimates had large confidence intervals. the panel of known bison samples were even less representative of the target population since all positive animals were clinically diseased, making inferences about test sensitivity and specificity for infected animals impossible. another limitation of the panel of reference samples is that an elisa test of unknown performance was used to confirm some of the negative control samples. the johne’s information center used an older version of the idexx test that employed an anti-ruminant conjugate as opposed to an anti-bovine conjugate. although we are certain that this test was capable of detecting positive animals, the sensitivity is unknown. if there were animals falsely classified as negative in our panel, the result would be an underestimation of the specificity of our modified test. when recommended numbers of appropriate control samples are unavailable, a cut-off value may be established either by using a panel with fewer samples of known status, or by using alternate methods for calculating a cut-off value. a commonly-used alternative is to identify and test a group of confirmed uninfected animals and to use the mean s/p +  sd of this group as the cut-off. in this paper, we illustrated the worst-case scenario in which no reference samples for the species of interest were available and a presumed negative group had to be created. with this method, the final cut-off value is very sensitive to variations in the initial cut-off value selected. however in our study, the s/p cut-off values calculated for elk using both a panel of known control samples and this alternative method were quite similar. since this was the only method that could be used for establishing a cut-off value for bison and caribou sera, sensitivity and specificity estimates could not be generated for this elisa test for these species. testing objectives are important for the selection of the cut-off value, as researchers may wish to prioritize either a higher sensitivity or specificity. although not the scope of this paper, our end-goal of adapting elisa for these different species was to use it as a screening method to identify individual animals that are more likely to be infected. this would be confirmed using more specific map diagnostic methods such as faecal culture. based on this objective, we wanted to select a cut-off that would optimize both sensitivity and specificity and give the highest percentage of correctly classified samples. if this test were to be used as a more definitive diagnostic test, for example in a test-and-cull strategy, the cut-off for a “positive result” needs to be selected to give a very high specificity. using the roc curve from our panel of elk samples using the protein g conjugate, the cut-off value that gave 100% specificity was. the range of s/p values between our screening cut-off and this cut-off for positive samples could be designated as “suspect” results. alternatively, the anti-deer conjugate could be selected over protein g at the recommended dilution if the test objectives required a higher specificity.  in conclusion, despite the abundant literature that exists on test development and validation, diagnostic tests validated only for livestock species are frequently applied for wildlife samples. as we illustrated, unmodified commercial tests may fail to detect the immunoglobulins of other species. from a wildlife management perspective, this can have serious implications for epidemiological surveillance. in this study we adapted a commercial elisa kit for use with other species: we evaluated the binding affinity of different conjugates to igg of the target species, ensured the absence of non-specific binding after modifications, performed a checkerboard test to recommend optimal sample and conjugate dilutions, and determined appropriate cut-off values. such modification and evaluation steps enable valuable data to be generated from serological surveys for map in wildlife that can be critically appraised and interpreted with greater confidence. endnotes aidexx mycobacterium paratuberculosis antibody test, westbrook, maine, usa; manufactured by institut pourquier, montpellier, france. bhrp-recombinant-protein g, invitrogen, camarillo, california, usa. cperoxidase-labeled antibody to bovine igg, kirkegaard & perry laboratories inc., gaithersburg, maryland, usa. dperoxidase-labeled affinity purified antibody to deer igg, kpl inc. ethe johne’s information center used the idexx map elisa kit manufactured in. competing interests the authors declare that they have no competing interests. authors’ contributions mp and tf contributed equally to the study design and in drafting the manuscript. mp took the lead on the assay evaluation and modification, as well as in evaluating the test performance. tf assisted with the assay evaluation and modification steps, and formatted the manuscript. js assisted in the study design, in carrying out the serologic testing, and provided feedback on the manuscript. sk, jdb, fvdm and ko participated in the study design and provided critical feedback on the manuscript. all authors read and approved the final manuscript. 
protein g showed good affinity for igg of all three species, while anti-deer conjugate also bound elk and caribou igg. using protein g with elk serum, a cut-off sample-to-positive value of was selected, resulting in a sensitivity and specificity of 73% and 90%, respectively, whereas, using an anti-deer conjugate with elk serum, an s/p cut-off value of gave a sensitivity of 68%, with 100% specificity. cut-off values for bison and caribou using the protein g conjugate were and respectively. due to incomplete reporting and a lack of test validation, it is difficult to critically appraise results of many sero-surveys that have previously been done for map in wildlife. in order to generate reliable test results, it is essential to evaluate the test and perform modifications if deemed necessary. despite the challenges inherent to wildlife diagnostics, we have shown that several methods can be used to improve confidence in test results. we tested the affinity of different conjugates for immunoglobulin g isolated from these species, performed checkerboard tests to determine the optimal dilutions of samples and conjugates, and established cut-off values using two different methods: a receiver operational curve on a panel of known samples for elk, and an alternate method involving a panel of unknown serum samples for the three species. a literature review was performed to document the current use of map serum elisa in wild and semi-domestic ruminants. however, commercially available kits are only validated for use with domestic ruminant species. enzyme-linked immunosorbent assay is often used to test wildlife samples for mycobacterium avium subsp. we then modified and evaluated a commercial elisa kit for use with species for which it was not originally developed: elk, bison and caribou. commercial elisa kits may have limited or no capacity to detect antibodies from species other than for which they were developed. we found that the anti-bovine conjugate included in the idexx elisa kit has limited affinity for elk, bison, and caribou igg.
 enzyme-linked immunosorbent assay is often used to test wildlife samples for mycobacterium avium subsp. paratuberculosis infection. however, commercially available kits are only validated for use with domestic ruminant species. a literature review was performed to document the current use of map serum elisa in wild and semi-domestic ruminants. we then modified and evaluated a commercial elisa kit for use with species for which it was not originally developed: elk, bison and caribou. we tested the affinity of different conjugates for immunoglobulin g isolated from these species, performed checkerboard tests to determine the optimal dilutions of samples and conjugates, and established cut-off values using two different methods: a receiver operational curve on a panel of known samples for elk, and an alternate method involving a panel of unknown serum samples for the three species.  we found that the anti-bovine conjugate included in the idexx elisa kit has limited affinity for elk, bison, and caribou igg. protein g showed good affinity for igg of all three species, while anti-deer conjugate also bound elk and caribou igg. using protein g with elk serum, a cut-off sample-to-positive value of was selected, resulting in a sensitivity and specificity of 73% and 90%, respectively, whereas, using an anti-deer conjugate with elk serum, an s/p cut-off value of gave a sensitivity of 68%, with 100% specificity. cut-off values for bison and caribou using the protein g conjugate were and respectively.  due to incomplete reporting and a lack of test validation, it is difficult to critically appraise results of many sero-surveys that have previously been done for map in wildlife. commercial elisa kits may have limited or no capacity to detect antibodies from species other than for which they were developed. in order to generate reliable test results, it is essential to evaluate the test and perform modifications if deemed necessary. despite the challenges inherent to wildlife diagnostics, we have shown that several methods can be used to improve confidence in test results. bisoncaribouelisaelkevaluationmycobacterium avium subsp. paratuberculosissensitivity/specificityserologyvaliditywildlife 