# Inter-day test-retest reliability and feasibility of isokinetic, isometric, and isotonic measurements to assess quadriceps endurance in people with chronic obstructive pulmonary disease: A multicenter study

Erik Frykholm, Sarah Gephine, Didier Saey, Hieronymus van Hees, Arthur

Lemson, Peter Klijn, François Maltais, André Nyberg

► To cite this version:

Erik Frykholm, Sarah Gephine, Didier Saey, Hieronymus van Hees, Arthur Lemson, et al. Inter-day test-retest reliability and feasibility of isokinetic, isometric, and isotonic measurements to assess quadriceps endurance in people with chronic obstructive pulmonary disease: A multicenter study. Chronic Respiratory Disease, 2018, 16, pp.1-9. 10.1177/1479973118816497. hal-02530662

HAL Id: hal-02530662

https://hal.univ-lille.fr/hal-02530662

Submitted on 3 Apr 2020

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Inter-day test-retest reliability and feasibility of isokinetic, isometric, and isotonic measurements to assess quadriceps endurance in people with chronic obstructive pulmonary disease: A multicenter study

Erik Frykholm<fnref n="1" />, Sarah Géphine<fnref n="2" />, Didier Saey<fnref n="2" />, Hieronymus van Hees<fnref n="3" />, Arthur Lemson<fnref n="3" />, Peter Klijn<fnref n="4" />,<fnref n="5" />, François Maltais<fnref n="2" /> and André Nyberg<fnref n="1" />

## Abstract

The aims were to determine reliability and feasibility of measurements to assess quadriceps endurance in people with chronic obstructive pulmonary disease. Sixty participants (forced expiratory volume in one second (mean ± standard deviation) 55 ± 18% of predicted, age 67 ± 8 years) were tested in an inter-day, test-retest design. Isokinetic, isometric, and isotonic protocols were performed using a computerized dynamometer. Test-retest relative and absolute reliability was determined via intraclass correlation coefficient (ICC), coefficient of variation (CV%), and limits of agreement (LoA%). Isokinetic total work demonstrated very high relative reliability (ICC: [95% confidence interval] = 0.98 [0.94–0.99]) and the best absolute reliability (CV% (LoA%) = 6.5% (18.0%)). Isokinetic fatigue index, isometric, and isotonic measures demonstrated low-to-high relative reliability (ICC = 0.64 [0.46–0.77], 0.88 [0.76–0.94], 0.91 [0.85–0.94]), and measures of absolute reliability (CV% (LoA%)) were 20.3% (56.4%), 14.9% (40.8%), and 15.8% (43.1%). For isokinetic total work and isometric measurements, participants performed better on retest (4.8% and 10.0%, respectively). The feasibility was similar across protocols with an average time consumption of less than 7.5 minutes. In conclusion, isokinetic, isometric, and isotonic measurements of quadriceps endurance were feasible to a similar extent and presented low-to-very high relative reliability. Absolute reliability seems to favor isokinetic total work measurements.

## Keywords

Intra-rater agreement, reproducibility, COPD, leg extension, lower limb muscle endurance

Date received: 24 July 2018; accepted: 31 October 2018

## Corresponding author:

Erik Frykholm, Department of Community Medicine and Rehabilitation, Unit of Physiotherapy, Umeå University, Umeå 901 87, Sweden.

Email: erik.frykholm@umu.se

<figure><img src="image_2.png" /></figure>

Creative Commons CC BY: This article is distributed under the terms of the Creative Commons Attribution 4.0 License (http://www.creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).

<footnote n="1">¹ Department of Community Medicine and Rehabilitation, Unit of Physiotherapy, Umeå University, Umeå, Sweden</footnote>

<footnote n="2">² Quebec Heart and Lung Institute Research Centre, Faculty of medicine, Laval University, Quebec city, Canada</footnote>

<footnote n="3">³ Department of Pulmonary Diseases, Radboud University Medical Center, Nijmegen, the Netherlands</footnote>

<footnote n="4">⁴ Department of Pulmonology, Pulmonary Rehabilitation Centre Merem, Hilversum, the Netherlands</footnote>

<footnote n="5">⁵ Department of Pulmonary Medicine, Amsterdam University Medical Center, Amsterdam, the Netherlands</footnote>
Introduction

Impaired limb muscle function as evidenced by a reduction in strength¹ and/or endurance² of the quadriceps muscle is a common secondary consequence of chronic obstructive pulmonary disease (COPD), intimately associated with important clinical outcomes such as reduced quality of life, exercise intolerance, greater healthcare utilization, and premature mortality.³ A corollary of the prognostic and clinical importance of quadriceps function in COPD is that its assessment in clinical practice is highly recommended.³,⁴ The assessment could be performed using either static (isometric) or dynamic muscle contractions including isokinetic (constant pace) or isotonic (constant load) contractions.⁴ Isometric (sustained) contractions have been recommended for measuring quadriceps strength.³,⁵ Several protocols (including different measurements within isokinetic, isometric, and isotonic protocols) have been used to assess quadriceps endurance in the COPD population,² but there is still no consensus on which protocol and outcome measure that is preferable in this context.³ Before the use of any protocol could become a reality in clinical practice several aspects, including but not limited to, the feasibility and reliability of measurement protocols needs to be determined. The reliability assessment should preferably include both relative and absolute reliability, where relative reliability is the degree to which individuals maintain their position in a sample with repeated assessments and absolute reliability is the degree to which repeated assessments vary for individuals.⁶ In people with COPD, one study has evaluated the reliability of an isokinetic protocol to assess quadriceps endurance using measurements of total work and fatigability (fatigue index) over 30 maximal repetitions.⁷ The authors report intraclass correlation coefficients (ICCs; relative reliability) of 0.93 and 0.92 and a minimal detectable change (absolute reliability) of 10% and 13%, respectively.⁷ Another study that compared quadriceps endurance between healthy subjects and people with COPD using an isotonic protocol, with measurements of time to exertion, reported high relative reliability (ICC > 0.74) for both groups.⁸ We could not find any previous report of the reliability of isometric quadriceps endurance protocols in people with COPD. However, in healthy adults, the relative reliability of an isometric quadriceps endurance protocol was high (ICC = 0.87).⁹ Neither could we identify any study investigating

feasibility aspects of quadriceps muscle endurance assessments in people with COPD.

The primary aim of this study was, therefore, to determine the relative and absolute inter-day reliability of isokinetic, isometric and isotonic protocols for evaluating quadriceps endurance in people with COPD, including measures of isokinetic total work, isokinetic fatigue index, isometric time to exhaustion, and isotonic repetitions to exhaustion. A secondary aim was to examine the feasibility of conducting the three protocols. We hypothesized that the ICCs would be very high for isokinetic total work and isokinetic fatigue index (ICC > 0.90)⁷ and high for isometric time to exhaustion (ICC > 0.85)⁹ and isotonic repetitions to exhaustion (ICC > 0.70).⁸ In addition, we hypothesized that each protocol would be highly feasible, requiring less than 20 minutes for completion and being associated with little/no adverse events, apart from the discomfort associated with the procedure.

Method

Study design and participants

This was a multicenter inter-day reliability study with a test-retest design following the Guidelines for Reporting Reliability and Agreement Studies.¹⁰ The study was conducted at Umeå University, Umeå, Sweden; Université Laval, Québec city, Canada; and two pulmonary rehabilitation centers in the Netherlands: Radboud University medical center, Nijmegen, and Pulmonary Rehabilitation Centre Merem, Hilversum. Participants were enrolled at each center using a convenience sampling method if they were at least 40 years of age with a spirometrically confirmed diagnosis of mild to very severe COPD.¹¹ Exclusion criteria consisted of recent COPD exacerbation (within the preceding 4 weeks); muscular-, rheumatic-, or cardiac disorders impacting testing procedures; and practicing regular exercise specifically aimed to strengthen the quadriceps. The study was approved by the respective local ethical boards (Umeå: DNR: 2015-426-31 M, 2016-379-32 M; Québec: CER: 21322; Arnhem/Nijmegen: CMO: NL59926.091.16) and all participants gave a written informed consent before the study commenced.

Procedure

Each participant attended one inclusion visit followed by test and retest visits separated by 5–9 days. At the inclusion visit, the participants performed the COPD
<figure><img src="image_3.png" /><figcaption>**Figure 1.** Setting for the isokinetic endurance test of 30 maximal repetitions at 90°/second (a), the isotonic endurance test of repetitions to exhaustion at 30% of the MVC (b), and the isometric test of time to exhaustion (c). For isokinetic (a) and isotonic (b) measurements, the range of movement in the knee joint was set from 90° to full extension (−5°), while for the isometric measurements (c), the knee was placed at 90° angle. During the isotonic test (b), a string was mounted on a movable construction to provide visual feedback on the desired ROM. During the isometric test, the display for visual feedback showed a bar of the applied force and three markers corresponding to 50, 55, and 65% of the participant's MVC. The instruction was to keep the force between the 65% and 55% markers for as long as possible. The test was ended when the applied force fell below 50% MVC. Neutral feedback was given if the force dropped lower than 55% of MVC. MVC: maximal voluntary contraction; ROM: range of motion.</figcaption></figure>

assessment test, the modified British medical research council questionnaire on breathlessness, the 6-minute walk test (6MWT), spirometry,¹² and a quadriceps strength test (maximal voluntary contraction (MVC) test). Quadriceps strength was assessed isometrically with a computerized dynamometer (Biodex System Pro 3 or 4 (which can be used interchangeably), Biodex Medical Systems, Shirley, New York, USA) on the dominant leg stated by the participant. If there was uncertainty, the test was performed on the right leg. Participants were positioned with the knee placed at 90° angle, the center of movement at the knee joint as close as possible to the center of movement of the machine, and the lever arm firmly attached approximately 3 cm above the lateral malleolus. The arms were crossed over the chest and straps were used over the pelvis and thigh. The test consisted of five maximal isometric contractions of 5 seconds, separated by 1 minute of rest. Strong verbal encouragement was given to motivate maximal effort. Maximum torque in newton meter (Nm) was noted and the mean of the two highest reproducible (within 10% difference) contractions was used.³

## Quadriceps endurance measurements

Test and retest visits included quadriceps endurance assessments using isokinetic, isometric, and isotonic protocols of leg extension, with each protocol performed once at test and once at retest (Figure 1(a)

to (d)). The order of testing was randomized by a computer program and the same randomized order was used in both test and retest visits. Participants were positioned using the same settings as for the MVC test, for the dynamic tests the range of motion (ROM) was from 90° knee flexion to the individuals' maximal extension -5°.¹³ All protocols included a standardized warm-up specific to the test being performed: 5 isokinetic contractions with progressing force (last contraction maximal), 3 sustained 5-second isometric contractions (separated by 30 second rest) at 20%, 40%, and 60% of MVC, and 10 isotonic repetitions at 15% of MVC. The specific warm-up was followed by 2 minutes of rest, and each test was separated by 30 minutes of rest. For the assessment of feasibility, the revised category-ratio 0–10 scale (Borg CR10)¹⁴ was used before and after each test for ratings of dyspnea and leg fatigue; the total time from start of instructions to postexercise Borg CR10 ratings was noted as the execution time, and any adverse event was noted and described.

Test of isokinetic endurance was performed using a protocol consisting of 30 maximal contractions at a pace of 90°/second. During the test, strong verbal encouragement was given on every contraction. Measurements were total work reported in joule and a fatigue index based on the difference in work performed during the first and last third of the test.⁷ The isometric endurance test protocol was performed by asking participants to maintain, for as long as
possible, an isometric quadriceps contraction representing 60% of the individual isometric MVC force. The participants had visual feedback from a computer screen showing their applied force, described further in Figure 1. The test was ended if the force of the contraction was less than 50% of the MVC for three consecutive seconds. Measurement of time (in seconds) during which the contraction was maintained higher than 50% of the MVC was used for analysis.¹⁵ The isotonic endurance test protocol was performed by doing as many repetitions as possible using a resistance of 30% of isometric MVC maintaining an externally set pace by a metronome at 60 beats per minute (i.e. 30 repetitions/minute). The test was ended when the participant, in three consecutive repetitions, failed to reach full ROM, or failed to maintain the accurate pace. The ROM was individualized for each patient; a string was mounted on a movable construction to provide visual feedback on the desired ROM (see Figure 1). Neutral feedback was given concerning ROM and pace. Number of repetitions performed was used as measurement of endurance.⁸

## Sample size calculation and statistical analysis

Fifty-one participants assessed two times were needed to detect an ICC with the lower limit of the 95% confidence interval (CI) > 0.70 for the isotonic test, according to Wolak's estimation of sample sizes for reliability analyses.¹⁶ Bland-Altman plots were used to visualize original test-retest data using reference lines at the mean difference (MD) and at 1.96 standard deviation (SD) of the MD, known as the limits of agreement (LoA).¹⁷ Heteroscedasticity was evaluated by plots of the absolute difference to the mean and by a Kendall's Tau test for correlation. Heteroscedasticity was present for three variables (isokinetic total work, isometric, and isotonic measurements, range r = 0.251-0.371, p < 0.05). Since the heteroscedasticity was reduced (and were no longer significant) after base-10 logarithmic transformation (range r = 0.033-0.086, p > 0.05), the logarithmic values were used for further analyses of these variables.⁶,¹⁸ Normal distribution of the differences between test and retest was then confirmed by a Shapiro-Wilk test with p > 0.05.

Test-retest relative reliability was assessed using an ICC 3.1 procedure presented with 95% CI and was proceeded by a paired t test to test for systematic bias.¹⁹ Munro's descriptors were applied to the lower limit of the 95% CI²⁰: very low = 0.15-0.24, low =

0.25-0.49, moderate = 0.50-0.69, high = 0.70-0.89, and very high = 0.90-1.00.²¹ To describe test-retest absolute reliability for logarithmic transformed variables, the coefficient of variation (CV%) and 95% LoA% were used as described by Euser et al.²² Where the CV% estimates the precision of a single measure, and the LoA% estimates the minimum amount of change that could be considered a true change between repeated measurements, both expressed in percent of individual mean values. Briefly, the mean within-individual standard deviation (wSD), calculated as the square root of the mean within-individual variance, was used to present CV% and LoA% using the formulas:

$$CV\% = \ln(10) \times wSD \times 100$$

$$LoA\% = 2(10^a - 1)/(10^a + 1) \times 100$$

$$\text{where } a = 1.96 \times \sqrt{2} \times wSD$$

For fatigue index, whose distribution was homoscedastic, CV% and LoA% were calculated using the formulas:

$$CV\% = wSD/grand mean \times 100$$

$$LoA\% = 1.96 \times \sqrt{2} \times wSD/grand mean \times 100$$

The feasibility aspects (mean values of dyspnea; leg fatigue; and time to perform the isokinetic, isometric, and isotonic protocols) were tested for differences between the three protocols using a repeated measures analysis of variance, with post hoc analyses using Bonferroni correction for multiple comparisons. Dyspnea and leg fatigue were also compared using paired sample t tests within each protocol. Occurrence of adverse events was descriptively reported.

The Statistical Package for the Social Sciences (version 24, IBM SPSS Statistics, Armonk, New York, USA) was used with a 5% α level for statistical significance set a priori.

## Results

Characteristics of study participants are shown in Table 1. Bland-Altman plots of the original data are shown in Figure 2(a) to (d), visualizing the heteroscedasticity (i.e. the amount of error increased as the measured values increased) that was present for three variables (isokinetic total work, isometric, and isotonic measurements).

Table 2 presents mean values and reliability aspects of original and log-transformed data of the
<table><caption>**Table 1.** Participant characteristics.ª</caption><thead><tr><th></th><th></th></tr></thead><tbody><tr><td>N</td><td>60</td></tr><tr><td>Age (years)</td><td>67 ± 8</td></tr><tr><td>Body mass index</td><td>26.6 ± 5.0</td></tr><tr><td>Male/female</td><td>36/24 (60/40)</td></tr><tr><td>FEV<sub>1</sub> (L)</td><td>1.5 ± 0.6</td></tr><tr><td>FEV<sub>1</sub> (percentage of predicted)</td><td>55 ± 18</td></tr><tr><td>FVC (L)</td><td>3.4 ± 0.9</td></tr><tr><td>FVC (percentage of predicted)</td><td>99 ± 22</td></tr><tr><td>FEV<sub>1</sub>/FVC (%)</td><td>44 ± 13</td></tr><tr><td>mMRC</td><td></td></tr><tr><td>0</td><td>1 (1.7)</td></tr><tr><td>1</td><td>24 (40.0)</td></tr><tr><td>2</td><td>11 (18.3)</td></tr><tr><td>3</td><td>6 (10.0)</td></tr><tr><td>4</td><td>18 (30.0)</td></tr><tr><td>CAT (1–40)</td><td>17 ± 7</td></tr><tr><td>6MWT (m)</td><td>453 ± 116</td></tr><tr><td>6MWT (percentage of predicted)</td><td>81 ± 21</td></tr><tr><td>Isometric MVC (Nm)</td><td>130 ± 45</td></tr><tr><td>Isometric MVC (percentage of predicted)</td><td>76 ± 22</td></tr></tbody></table>

FVC: forced vital capacity; FEV₁: forced expiratory volume in one second; mMRC: modified medical research council dyspnea scale, higher values indicates more dyspnea; CAT: COPD assessment test, higher values indicates higher impact of COPD; 6MWT: 6-minute walk test; MVC: maximal voluntary contraction; SD: standard deviation.

test and retest occasions. Isokinetic total work demonstrated very high test–retest relative reliability (ICC: [95% CI] = 0.98 [0.94 to 0.99]), isokinetic fatigue index low relative reliability (0.64 [0.46 to 0.77]), while the isometric time to exhaustion and isotonic repetitions to exhaustion demonstrated high relative reliability (0.88 [0.76 to 0.94] and 0.91 [0.85 to 0.94], respectively). The best absolute reliability was found for isokinetic total work (CV% (LoA%) = 6.5% (18.0%)), whereas the other measurements presented higher absolute reliability (CV% (LoA%) range 14.9–20.3% (40.8–56.4%)). The participants performed significantly better on retest in measurements of isokinetic total work and isometric time to exhaustion (differences of 4.8% and 10.0%, respectively, both *p* < 0.001).

The feasibility of the measurement protocols is shown in Table 3. In brief, the average time to perform either of the three endurance protocols was less than 7.5 minutes. Leg fatigue was consistently rated higher than dyspnea (*p* < 0.001 for all comparisons), irrespective of protocol. Dyspnea was rated highest in the isokinetic protocol (both comparisons *p* < 0.001).

In addition, three patients reported pain (in the knee) during the isometric protocol, two of which terminated one or both test occasions due to pain and were therefore excluded from the reliability analyses. One participant was excluded from the isotonic protocol due to technical issues. No other adverse event was reported.

## Discussion

To the best of our knowledge, this is the first study to investigate the reliability properties of different protocols and measurements to assess quadriceps endurance in COPD. Overall, measures obtained by isokinetic, isometric, and isotonic protocols present high to very high relative reliability with the exception of measurements of isokinetic fatigue index that present low relative reliability. CV% ranged from 6.5% to 20.3%. The three protocols display similar feasibility with minor differences in perception of symptoms, time to complete the measurements, and adverse events.

The relative reliability results from the present study are consistent with earlier studies⁵,⁷,⁹ and our hypothesis for isokinetic total work (very high), isometric time to exhaustion (high), and isotonic repetitions to exhaustion (high). However, relative reliability for the isokinetic fatigue index was lower than previously reported for a protocol using 30 repetitions at a speed of 90°/second but higher than a protocol using 180°/second.⁷ This could be due to difficulties to follow the instructions of performing maximal effort on each isokinetic contraction. Indeed, three participants displayed none to a very slight decline over time on the test occasion (–5.3% to 1.8%), indicating a failure of the protocol to cause fatigue. Excluding these three participants affect both the relative and absolute reliability of the measurement (ICC = 0.70, 95% CI [0.54–0.81], CV% = 15.5, LoA% = 42.8). Also, at the test occasion, the group range was –5.3 to 79.5, and at the retest occasion it was 12.7–66.4, indicating group regression toward the mean. A familiarization session, modification of instructions, and/or modification on the calculation of the fatigue index could possibly improve reliability. The absolute reliability of the isokinetic measurement total work (CV% = 6.5%) was substantially better than for the other protocols and measurements (CV% range = 14.9–20.3%). In addition, the LoA% indicated the smallest detectable change for the measurement total work of the isokinetic protocol

<footnote>ªValues are shown as the mean ± SD or category n (%).</footnote>
<figure><img src="image_4.png" /><figcaption>**Figure 2.** Bland–Altman plots of individual variation between test–retest measurements using the original data for isokinetic total work in joule (a), isokinetic fatigue index calculated as the ratio of the decline in work during the last 10 repetitions to the first 10 repetitions of the total 30 maximal isokinetic repetitions (b), isometric time in seconds to exhaustion above 50% of MVC (c), and isotonic repetitions to exhaustion at 30% of MVC (d) measurement results. Mean values of the test and retest measurements are displayed on the x-axis and the difference between retest and test on the y-axis (positive values indicates a higher result on retest). Reference lines at the mean difference and LoA (mean difference ± 1.96 SD of the mean difference). MVC: maximal voluntary contraction; LoA: limits of agreement; SD: standard deviation.</figcaption></figure>

<table><caption>**Table 2.** Reliability results of the four endurance measurements.ª</caption><thead><tr><th rowspan="2"></th><th rowspan="2">N</th><th colspan="4">Original data</th><th colspan="5">Log10-transformed data</th></tr><tr><th>Test</th><th>Retest</th><th>MD</th><th>LoA</th><th>MD%</th><th>P</th><th>CV%</th><th>LoA%</th><th>ICC [95% CI]</th></tr></thead><tbody><tr><td>Isokinetic joules</td><td>60</td><td>2078 ± 876</td><td>2174 ± 906</td><td>96</td><td>327</td><td>4.8</td><td>&lt;0.001</td><td>6.5</td><td>18.0</td><td>0.98 [0.94, 0.99]</td></tr><tr><td>Isokinetic fatigue index %</td><td>60</td><td>39.8 ± 15.4</td><td>41.9 ± 11.9</td><td>2.1</td><td>22.9</td><td>5.1<sup>b</sup></td><td>0.17<sup>b</sup></td><td>20.3<sup>b</sup></td><td>56.4<sup>b</sup></td><td>0.64 [0.46, 0.77]<sup>b</sup></td></tr><tr><td>Isometric seconds</td><td>58<sup>c</sup></td><td>47 ± 22</td><td>52 ± 21</td><td>4.3</td><td>18.5</td><td>10.0</td><td>&lt;0.001</td><td>15.8</td><td>43.1</td><td>0.88 [0.76, 0.94]</td></tr><tr><td>Isotonic repetitions</td><td>59<sup>d</sup></td><td>27 ± 13</td><td>29 ± 15</td><td>2</td><td>12</td><td>5.1</td><td>0.06</td><td>14.9</td><td>40.8</td><td>0.91 [0.85, 0.94]</td></tr></tbody></table>

MD: mean difference, difference between test and retest positive values indicating higher values at retest; CI: confidence interval; LoA: limits of agreement, smallest difference to be considered real with 95% CI; MD%: relative mean difference between test and retest; CV%: coefficient of variation; LoA%: smallest difference to be considered real with 95% CI; ICC: intraclass correlation coefficient (3.1); SD: standard deviation.

approximated around 20%, while for the other protocols and measurements it was above 40%. These observed differences in absolute reliability might affect the applicability of the measurements to clinical trials and practice—a lower absolute reliability indicates that the measurement is more sensitive to

true changes in performance. However, this needs to be further evaluated by investigating the measurements responsiveness to change and determining the minimal clinically important change. For example, in a recent review, the magnitude of improvement of limb muscle endurance seemed to differ depending

<footnote>ªValues are shown as the mean ± SD or 95% CI.</footnote>

<footnote>ᵇOriginal data used for all analyses.</footnote>

<footnote>ᶜTwo participants excluded as knee pain/discomfort affected test performance.</footnote>

<footnote>ᵈOne participant excluded due to technical issues.</footnote>
<table><caption>**Table 3.** Feasibility results of the three endurance protocols.<sup>a</sup></caption><thead><tr><th rowspan="2"></th><th rowspan="2">N</th><th colspan="2">Time</th><th rowspan="2">Dyspnea</th><th rowspan="2">Leg fatigue</th></tr><tr><th>(minute:second)</th><th>6:16 ± 1:14<sup>b</sup></th><th>3.4 ± 1.7<sup>c</sup></th><th>4.5 ± 1.7<sup>d</sup></th></tr></thead><tbody><tr><td>Isokinetic</td><td>60</td><td>7:05 ± 1:35</td><td>2.5 ± 1.5</td><td>4.1 ± 1.9<sup>d,f</sup></td><td></td></tr><tr><td>Isometric</td><td>58<sup>e</sup></td><td>7:17 ± 1:29</td><td>2.7 ± 1.6</td><td>4.6 ± 1.8<sup>d</sup></td><td></td></tr><tr><td>Isotonic</td><td>59<sup>g</sup></td><td></td><td></td><td></td><td></td></tr></tbody></table>

SD: standard deviation.

<sup>a</sup>Values shown are means and SD; execution time measured in seconds including instructions, warm-up, rest, test, and Borg ratings; dyspnea and leg fatigue rated on Borg CR10.

<sup>b</sup>The isokinetic protocol took less time than the isometric and isotonic protocols, for both comparisons *p* < 0.001.

<sup>c</sup>The mean rating of dyspnea was higher in the isokinetic protocol than in the isometric and isotonic protocols, for both comparisons *p* < 0.001.

<sup>d</sup>Leg fatigue was rated higher than dyspnea for each protocol, *p* < 0.001 for all comparisons.

<sup>e</sup>Two participants excluded as knee pain/discomfort affected test performance.

<sup>f</sup>The mean rating of leg fatigue was lower in the isometric protocol compared to the isotonic protocol *p* = 0.01.

<sup>g</sup>One participant missing due to technical issues.

on the measurement used.<sup>23</sup> In that review, the mean improvement was 16% following isokinetic total work endurance measurements, while corresponding values were 42% for isometric and 71% for isotonic endurance protocols. This would indicate that even though the measures of absolute reliability seem to differ between protocols and measurements, this does not automatically mean that the ability of detecting changes is different.

Participants performed better on retest during isokinetic total work and isometric measurements (by 4.8% and 10.0%, respectively, *p* < 0.001). This could be due to a learning effect in performing the tests. A familiarization session and/or performing additional tests at each visit would most likely reduce the possible learning effect.<sup>7,24</sup>

The isokinetic, isometric, and isotonic endurance protocols display similar feasibility; the average time needed to complete the measurements was less than 7.5 minutes for each protocol. This can be compared to the 6MWT, the gold standard for measuring functional capacity in people with COPD, which takes a minimum of 16 minutes including instructions and rest, to complete.<sup>25</sup> The actual time for each test, excluding instructions, was for the majority of participants similar to the 1 minute sit to stand test.<sup>26</sup> Indicating that the test may measure similar aspects of functional capacity. How these tests are related

should be further investigated. Regarding perceived symptoms, the participants rated leg fatigue higher than dyspnea. We interpret this information as a validation that the participants perceived performance limited by quadriceps function and not by cardiopulmonary function, although we acknowledge that cardiopulmonary responses during the tests were not assessed. During the isometric protocol, two participants stopped because of knee pain/discomfort and one additional participant reported knee pain/discomfort post assessment. These were judged as minor adverse events, considering that these participants could continue with other quadriceps muscle endurance tests after the 30-minute rest or could walk unaffected if it was the last endurance protocol. Noticeably, neither of these participants reported knee pain during the dynamic tests.

One strength of the present study was the multicenter design that provided a diverse sample of people with COPD with sufficient power for narrow 95% CI; another was that heteroscedasticity was examined and the analyses adjusted accordingly, that is, data were logarithmic transformed where appropriate before further analyses. Providing the result from logarithmic transformed variables increases the transferability of result to the heterogenic population of people with COPD by providing a relative measure of absolute reliability that can be applied at an individual level. Indeed, the individual mean value of isokinetic total work during 30 repetitions in the study was between 613 and 4345 joules, and the absolute difference between 0 and 431 joules (significantly associated (*r* = 0.321, *p* < 0.001)), indicating that the measurement error increases with greater mean values and should, therefore, be expressed relative to the mean.

However, even though logarithmic transformation is recommended when addressing heteroscedastic data,<sup>6,18</sup> it reduces the ability to report results in common units for absolute reliability such as standard error of the measurement and minimal detectable change on the original scale.<sup>6</sup> In addition, the criteria used for ending isotonic test (the test was ended when the participant, in three consecutive reps, failed to reach full ROM or failed to maintain the accurate pace) leave room for interpretation. Thus, the test–retest reliability results of this trial are valid only if the same assessor is used at test and retest occasions. The inter-rater agreement could not be assessed due to the multicenter design of the study but should be a goal of future trials. Furthermore, to improve usability
in clinical settings and reduce the burden on partici-
pants, the present study did not use a familiarization
session, and only one test at each test occasion was
performed. But since there was a significant systema-
tic bias in two measurements, the lack of additional
tests/familiarization session reduces our ability to
draw firm conclusions on how test procedures should
be designed to maximize reliability for the individual
patient. Furthermore, even though an isokinetic pro-
tocol measuring total work seems to be the most reli-
able to measure quadriceps endurance, the protocol
demands a computerized dynamometer whose costs
and limited availability may impede its use in clinical
settings.⁴ The present study used a computerized
dynamometer for all protocols, and this was done to
ensure identical positioning of the participants across
protocols and involved recruitment sites. The iso-
metric and isotonic protocols could, however, be used
with other equipment. For example, the isometric pro-
tocol can be performed with a cheaper strain-gauge
system or a fixed hand dynamometer.⁵,²⁷ Neverthe-
less, further research is needed to evaluate the proto-
cols and measurements construct validity, strategies
to reduce the systematic bias, and responsiveness to
change.

Conclusion

In the assessment of quadriceps endurance among
people with COPD, measures obtained by isokinetic,
isometric, and isotonic protocols present high to very
high relative reliability with the exception of mea-
surements of isokinetic fatigue index that present low
relative reliability. CV% ranged from 6.5% to 20.3%.
A familiarization session/test might be needed before
actual assessment is performed due to changes in per-
formance over time. The three protocols display sim-
ilar feasibility with acceptable time consumption,
limited perceived dyspnea compared to leg fatigue,
and no major adverse advents.

Acknowledgement

The authors thank the participants for their efforts.

Author contributions

EF, DS, HVH, PK, FM, and AN have contributed to the
design and planning of the study; EF, SG, and AL per-
formed data collection; and EF and AN performed statisti-
cal analyses and wrote the manuscript. SG, DS, HVH, PK,
and FM critically revised the manuscript. All authors
approved the final version of the manuscript. EF and SG
contributed equally.

**Declaration of conflicting interests**

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Swedish Research Council, the Swedish Heart and Lung Association (dnr: 2016-01802), the Canadian Lung Association, and Stichting Gooiskinderziekenhuis Huizen, the Netherlands. The funders had no role in the design, or reporting of results from this study.

ORCID iD

Erik Frykholm https://orcid.org/0000-0002-3212-4708

References

1. Seymour JM, Spruit MA, Hopkinson NS, et al. The prevalence of quadriceps weakness in COPD and the relationship with disease severity. *Eur Respir J* 2010; 36(1): 81–88. DOI: 10.1183/09031936.00104909

2. Evans RA, Kaplovitch E, Beauchamp MK, et al. Is quadriceps endurance reduced in COPD? A systematic review. *Chest* 2015; 147(3): 673–684. 2014/10/24. DOI: 10.1378/chest.14-1079

3. Maltais F, Decramer M, Casaburi R, et al; ATS/ERS Ad Hoc Committee on Limb Muscle Dysfunction in COPD. An official American Thoracic Society/ European Respiratory Society statement: update on limb muscle dysfunction in chronic obstructive pulmonary disease. *Am J Respir Crit Care Med* 2014; 189(9): e15–e62. 2014/05/03. DOI: 10.1164/rccm. 201402-0373ST

4. Nyberg A, Saey D, and Maltais F. Why and how limb muscle mass and function should be measured in patients with chronic obstructive pulmonary disease. *Ann Am Thorac Soc* 2015; 12(9): 1269–1277. 2015/ 07/25. DOI: 10.1513/AnnalsATS.201505-278PS

5. Machado Rodrigues F, Demeyer H, Hornikx M, et al. Validity and reliability of strain gauge measurement of volitional quadriceps force in patients with COPD. *Chron Respir Dis* 2017; 14(3):289–297. 1479972316687210. DOI: 10.1177/1479972316687210

6. Atkinson G and Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. *Sports Med* 1998; 26(4): 217–238. 1998/11/20

7. Ribeiro F, Lepine PA, Garceau-Bolduc C, et al. Test-retest reliability of lower limb isokinetic
endurance in COPD: a comparison of angular velocities. *Int J Chron Obstruct Pulmon Dis* 2015; 10: 1163-1172. 2015/07/01. DOI: 10.2147/copd.s81806

8. Van't Hul A, Harlaar J, Gosselink R, et al. Quadriceps muscle endurance in patients with chronic obstructive pulmonary disease. *Muscle Nerve* 2004; 29(2): 267-274. 2004/02/03. DOI: 10.1002/mus.10552

9. Zech A, Witte K, and Pfeifer K. Reliability and performance- dependent variations of muscle function variables during isometric knee extension. *J Electromyogr Kinesiol* 2008; 18(2): 262-269. DOI: 10.1016/j.jelekin.2006.08.013

10. Kottner J, Audige L, Brorson S, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. *Int J Nurs Stud* 2011; 48(6): 661-671. DOI: 10.1016/j.ijnurstu.2011.01.016

11. Global Strategy for the Diagnosis, Management and Prevention of COPD. From the Global Strategy for the Diagnosis, Management and Prevention of COPD, Global Initiative for Chronic Obstructive Lung Disease (GOLD) 2017. Available from: http://goldcopd.org.

12. Standardization of Spirometry, 1994 Update. American Thoracic Society. *Am J Respir Crit Care Med* 1995; 152: 1107.

13. Nyberg A, Saey D, Martin M, and Maltais F. Muscular and functional effects of partitioning exercising muscle mass in patients with chronic obstructive pulmonary disease - a study protocol for a randomized controlled trial. *Trials* 2015; 16. DOI: 10.1186/s13063-015-0698-x

14. Borg G. *Perceived exertion and pain scales*. Campaign, Ill: Human Kinetics, 1998.

15. Allaire J, Maltais F, Doyon JF, et al. Peripheral muscle endurance and the oxidative profile of the quadriceps in patients with COPD. *Thorax* 2004; 59(8): 673-678. 2004/07/30. DOI: 10.1136/thx.2003.020636

16. Wolak ME, Fairbairn DJ, and Paulsen YR. Guidelines for estimating repeatability. *Methods Ecol Evolution* 2012; 3: 129-137. DOI: 10.1111/j.2041-210X.2011.00125.x

17. Bland JM and Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. *Lancet* 1986; 1(8476): 307-310.

18. Bland JM and Altman DG. Measurement error proportional to the mean. *BMJ* 1996; 313(7049): 106.

19. Shrout PE and Fleiss JL. Intraclass correlations: uses in assessing rater reliability. *Psychol Bullet* 1979; 86(2): 420-428. 1979/03/01.

20. Koo TK and Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. *J Chiropr Med* 2016; 15(2): 155-163. DOI: 10.1016/j.jcm.2016.02.012

21. Munro BH. Statistical methods for health care research. 5th ed. Philadelphia: Lippincott Williams & Wilkins, 2004, p. s. 249.

22. Euser AM, Dekker FW, and Le Cessie S. A practical approach to Bland-Altman plots and variation coefficients for log transformed variables. *J Clin Epidemiol* 2008; 61(10): 978-982. DOI: 10.1016/j.jclinepi.2007.11.003

23. De Brandt J, Spruit MA, Hansen D, et al. Changes in lower limb muscle function and muscle mass following exercise-based interventions in patients with chronic obstructive pulmonary disease: a review of the English-language literature. *Chron Respir Dis* 2017. 1479972317709642. 2017/06/06. DOI: 10.1177/1479972317709642

24. Jenkins NDM and Cramer JT. Reliability and minimum detectable change for common clinical physical function tests in sarcopenic men and women. *J Am Geriatr Soc* 2017; 65(4): 839-846.

25. Holland AE, Spruit MA, Troosters T, et al. An official European Respiratory Society/American Thoracic Society technical standard: field walking tests in chronic respiratory disease. *Eur Respir J* 2014; 44(6): 1428. DOI: 10.1183/09031936.00150314

26. Crook S, Busching G, Schultz K, et al. A multicentre validation of the 1-min sit-to-stand test in patients with COPD. *Eur Respir J* 2017; 49(3). 2017/03/04. DOI: 10.1183/13993003.01871-2016

27. Beaumont M, Kerautret G, Peran L, et al. Reproducibility of strength and endurance measurements of the quadriceps in patients with COPD. *Rev Mal Respir* 2017; 34(9): 1000-1006. 2017/10/17. DOI: 10.1016/j.rmr.2016.11.004