Modified profile likelihood approach for certain intraclass correlation coefficients
In this paper we consider the problem of constructing confidence intervals and confidence lower bounds for the intraclass correlation coefficient in an interrater reliability study where the raters are randomly selected from a population of raters. The likelihood function of the interrater reliability is derived and simplified, and the profile likelihood based approach is readily available for computing the confidence intervals of the interrater reliability. Unfortunately, the confidence intervals computed by using the profile likelihood function are in general too narrow to have the desired coverage probabilities. From the practical point of view, a conservative approach, if at least as precise as any existing method, is preferred since it gives the correct results with a probability higher than claimed. Under this rationale, we propose the so-called modified profile likelihood approach in this paper. Simulation study shows that, the proposed method in general has better performance than currently used methods.
profile likelihood confidence intervals interrater reliability generalized pivots modified large-sample approach