While some of the methods described below are potentially more powerful, this comes at the price of making assumptions which may or may not be true. The simplicity of the nonparametric tests lends persuasiveness to their results. A mild limitation is that these tests apply only for comparisons of two raters. Let d' denote the true population value of d . The method above is merely an example.
Many variations are possible within the framework of bootstrap and jackknife methods.
An advantage of bootstrap and jackknife methods is their flexibility. For example, one could potentially adapt them for simultaneous comparisons among more than two raters. A potential disadvantage of these methods is that the user may need to write a computer program to apply them. If one is using a loglinear, association or quasi-symmetry model to analyze agreement data, one can adapt the model to test marginal homogeneity. For each type of model the basic approach is the same.