Assessing the effectiveness of Compare Assistant for improving intra-rater reliability of ultrasound-measured muscle thickness

PURPOSE

Muscle thickness measured via ultrasound is commonly used to assess muscle size. The purpose of this study was to determine if the reliability of this measurement will improve if using the Compare Assistant tool, and whether this depends on technician experience and the muscle being assessed.

METHODS

Individuals came to the laboratory for two visits each separated by 24 h. On day 1, two ultrasound images were taken on the individual's anterior upper arm (elbow flexors) and anterior lower leg (tibialis anterior) by two inexperienced and one experienced ultrasound technician. On day 2, three images were taken: (1) without looking at the previous images taken on day 1; (2) after re-examining the images taken on day 1, and (3) side-by-side with the images taken on day 1 via Compare Assistant. Bayes Factors (BF10) were used to provide evidence for the null (< 0.33) or alternative (> 3) hypotheses.

RESULTS

There was no rater by measurement technique interaction (upper body: BF10 = 0.04, lower body: BF10 = 0.138), nor was there a main effect of measurement technique (upper body: BF10 = 0.052, lower body: BF10 = 0.331), indicating that reliability measures were not improved for either the upper body (CV%, no look: 2.92 vs. Compare Assistant: 2.87) or lower body (CV%, no look: 1.81 vs. Compare Assistant: 1.34) as a result of using Compare Assistant.

CONCLUSION

The results of this study suggest that day-to-day reliability of muscle thickness measurement may be limited by random biological variability as opposed to technician error.

Improving the reliability of measurements in orthopaedics and sports medicine

A large space still exists for improving the measurements used in orthopaedics and sports medicine, especially as we face rapid technological progress in devices used for diagnostic or patient monitoring purposes. For a specific measure to be valuable and applicable in clinical practice, its reliability must be established. Reliability refers to the extent to which measurements can be replicated, and three types of reliability can be distinguished: inter-rater, intra-rater, and test-retest. The present article aims to provide insights into reliability as one of the most important and relevant properties of measurement tools. It covers essential knowledge about the methods used in orthopaedics and sports medicine for reliability studies. From design to interpretation, this article guides readers through the reliability study process. It addresses crucial issues such as the number of raters needed, sample size calculation, and breaks between particular trials. Different statistical methods and tests are presented for determining reliability depending on the type of gathered data, with particular attention to the commonly used intraclass correlation coefficient.

Intramuscular coherence enables robust assessment of modulated supra-spinal input in human gait: an inter-dependence study of visual task and walking speed

Intramuscular high-frequency coherence is increased during visually guided treadmill walking as a consequence of increased supra-spinal input. The influence of walking speed on intramuscular coherence and its inter-trial reproducibility need to be established before adoption as a functional gait assessment tool in clinical settings. Here, fifteen healthy controls performed a normal and a target walking task on a treadmill at various speeds (0.3 m/s, 0.5 m/s, 0.9 m/s, and preferred) during two sessions. Intramuscular coherence was calculated between two surface EMG recordings sites of the Tibialis anterior muscle during the swing phase of walking. The results were averaged across low-frequency (5-14 Hz) and high-frequency (15-55 Hz) bands. The effect of speed, task, and time on mean coherence was assessed using three-way repeated measures ANOVA. Reliability and agreement were calculated with the intra-class correlation coefficient and Bland-Altman method, respectively. Intramuscular coherence during target walking was significantly higher than during normal walking across all walking speeds in the high-frequency band as obtained by the three-way repeated measures ANOVA. Interaction effects between task and speed were found for the low- and high-frequency bands, suggesting that task-dependent differences increase at higher walking speeds. Reliability of intramuscular coherence was moderate to excellent for most normal and target walking tasks in all frequency bands. This study confirms previous reports of increased intramuscular coherence during target walking, while providing first evidence for reproducibility and robustness of this measure as a requirement to investigate supra-spinal input.Trial registration Registry number/ClinicalTrials.gov Identifier: NCT03343132, date of registration 2017/11/17.

Weight-bearing cone-beam CT: the need for standardised acquisition protocols and measurements to fulfill high expectations-a review of the literature

Weight bearing CT (WBCT) of the lower extremity is gaining momentum in evaluation of the foot/ankle and knee. A growing number of international studies use WBCT, which is promising for improving our understanding of anatomy and biomechanics during natural loading of the lower extremity. However, we believe there is risk of excessive enthusiasm for WBCT leading to premature application of the technique, before sufficiently robust protocols are in place e.g. standardised limb positioning and imaging planes, choice of anatomical landmarks and image slices used for individual measurements. Lack of standardisation could limit benefits from introducing WBCT in research and clinical practice because useful imaging information could become obscured. Measurements of bones and joints on WBCT are influenced by joint positioning and magnitude of loading, factors that need to be considered within a 3-D coordinate system. A proportion of WBCT studies examine inter- and intraobserver reproducibility for different radiological measurements in the knee or foot with reproducibility generally reported to be high. However, investigations of test-retest reproducibility are still lacking. Thus, the current ability to evaluate, e.g. the effects of surgery or structural disease progression, is questionable. This paper presents an overview of the relevant literature on WBCT in the lower extremity with an emphasis on factors that may affect measurement reproducibility in the foot/ankle and knee. We discuss the caveats of performing WBCT without consensus on imaging procedures and measurements.

A descriptive study of samples sizes used in agreement studies published in the PubMed repository

INTRODUCTION

A sample size justification is required for all studies and should give the minimum number of subjects to be recruited for the study to achieve its primary objective. The aim of this review is to describe sample sizes from agreement studies with continuous or categorical endpoints and different methods of assessing agreement, and to determine whether sample size justification was provided.

METHODS

Data were gathered from the PubMed repository with a time interval of 28^th September 2018 to 28^th September 2020. The search returned 5257 studies of which 82 studies were eligible for final assessment after duplicates and ineligible studies were excluded.

RESULTS

We observed a wide range of sample sizes. Forty-six studies (56%) used a continuous outcome measure, 28 (34%) used categorical and eight (10%) used both. Median sample sizes were 50 (IQR 25 to 100) for continuous endpoints and 119 (IQR 50 to 271) for categorical endpoints. Bland-Altman limits of agreement (median sample size 65; IQR 35 to 124) were the most common method of statistical analysis for continuous variables and Kappa coefficients for categorical variables (median sample size 71; IQR 50 to 233). Of the 82 studies assessed, only 27 (33%) gave justification for their sample size.

CONCLUSIONS

Despite the importance of a sample size justification, we found that two-thirds of agreement studies did not provide one. We recommend that all agreement studies provide rationale for their sample size even if they do not include a formal sample size calculation.

Measuring Spiritual Needs in a Secular Society: Validation and Clinimetric Properties of the Danish 20-Item Spiritual Needs Questionnaire

In secular cultures, such as Denmark, tools to measure spiritual needs are warranted to guide existential and spiritual care. We examined the clinimetric properties of the Danish version of the Spiritual Needs Questionnaire (DA-SpNQ-20) based on a digital survey in a test-retest setup. A convenience sample was reached via social media and student platforms. A total of 325 (148 for retest) respondents were included in the analysis. The sample was randomly split into two groups (A and B) and used for exploratory (EFA) and confirmatory factor analysis (CFA) by structural equation modeling, respectively. SpNQ dimensions had an internal consistency with Cronbach's alpha between 0.73 and 0.93. The four factors of the SpNQ were supported by both EFA and CFA as follows: religious needs, existential needs, inner peace needs, and generativity needs. The instrument showed good internal consistency, good test-retest reliability, and acceptable structural validity in the sample of relatively young and healthy persons.

Reliability of walking and stair climbing kinematics in a young obese population using a standard kinematic and the CGM2 model

BACKGROUND

Recently, the successor of the Conventional Gait Model, the CGM2 was introduced. Even though achievable reliability of gait kinematics is a well-assessed topic in gait analysis for several models, information about reliability in difficult study samples with high amount of subcutaneous fat is scarce and to date, not available for the CGM2. Therefore, this study evaluated the test-retest reliability of the CGM2 model for difficult data with high amount of soft tissue artifacts.

RESEARCH QUESTION

What is the test-retest reliability of the CGM2 during level walking and stair climbing in a young obese population? Is there a clinically relevant difference in reliability between a standard direct kinematic model and the CGM2?

METHODS

A retrospective test-retest dataset from eight male and two female volunteers was used. It comprised standard 3D gait analysis data of three walking conditions: level walking, stair ascent and descent. To quantify test-retest reliability the Standard Error of Measurement (SEM) was calculated for each kinematic waveform for a direct kinematic model (Cleveland clinic marker set) and the CGM2.

RESULTS

Both models showed an acceptable level of test-retest reliability in all three walking conditions. However, SEM ranged between two and five degrees (^∘) for both models and, thus, needs consideration during interpretation. The choice of model did not affect reliability considerably. Differences in SEM between stair climbing and level walking were small and not clinically relevant (<1°).

SIGNIFICANCE

Results showed an acceptable level of reliability and only small differences between the models. It is noteworthy, that the SEM was increased during the first half of swing in all walking conditions. This might be attributed to increased variability resulting for example from inaccurate knee and ankle axis definitions or increased variability in the gait pattern and needs to be considered during data interpretation.

Picture naming yields highly consistent cortical activation patterns: Test-retest reliability of magnetoencephalography recordings

Reliable paradigms and imaging measures of individual-level brain activity are paramount when reaching from group-level research studies to clinical assessment of individual patients. Magnetoencephalography (MEG) provides a direct, non-invasive measure of cortical processing with high spatiotemporal accuracy, and is thus well suited for assessment of functional brain damage in patients with language difficulties. This MEG study aimed to identify, in a delayed picture naming paradigm, source-localized evoked activity and modulations of cortical oscillations that show high test-retest reliability across measurement days in healthy individuals, demonstrating their applicability in clinical settings. For patients with a language disorder picture naming can be a challenging task. Therefore, we also determined whether a semantic judgment task ('Is this item living?') with a spoken response ("yes"/"no") would suffice to induce comparably consistent activity within brain regions related to language production. The MEG data was collected from 19 healthy participants on two separate days. In picture naming, evoked activity was consistent across measurement days (intraclass correlation coefficient (ICC)>0.4) in the left frontal (400-800 ms after image onset), sensorimotor (200-800 ms), parietal (200-600 ms), temporal (200-800 ms), occipital (400-800 ms) and cingulate (600-800 ms) regions, as well as the right temporal (600-800 ms) region. In the semantic judgment task, consistent evoked activity was spatially more limited, occurring in the left temporal (200-800 ms), sensorimotor (400-800 ms), occipital (400-600 ms) and subparietal (600-800 ms) regions, and the right supramarginal cortex (600-800 ms). The delayed naming task showed typical beta oscillatory suppression in premotor and sensorimotor regions (800-1200 ms) but other consistent modulations of oscillatory activity were mostly observed in posterior cortical regions that have not typically been associated with language processing. The high test-retest consistency of MEG evoked activity in the picture naming task testifies to its applicability in clinical evaluations of language function, as well as in longitudinal MEG studies of language production in clinical and healthy populations.

Evaluation of [13N]ammonia positron emission tomography as a potential method for quantifying glutamine synthetase activity in the human brain

PURPOSE

The conversion of synaptic glutamate to glutamine in astrocytes by glutamine synthetase (GS) is critical to maintaining healthy brain activity and may be disrupted in several brain disorders. As the GS catalysed conversion of glutamate to glutamine requires ammonia, we evaluated whether [13N]ammonia positron emission tomography (PET) could reliability quantify GS activity in humans.

METHODS

In this test-retest study, eight healthy volunteers each received two dynamic [13N]ammonia PET scans on the morning and afternoon of the same day. Each [13N]ammonia scan was preceded by a [15O]water PET scan to account for effects of cerebral blood flow (CBF).

RESULTS

Concentrations of radioactive metabolites in arterial blood were available for both sessions in five of the eight subjects. Our results demonstrated that kinetic modelling was unable to reliably distinguish estimates of the kinetic rate constant k3 (related to GS activity) from K1 (related to [13N]ammonia brain uptake), and indicated a non-negligible back-flux of [13N] to blood (k2). Model selection favoured a reversible one-tissue compartmental model, and [13N]ammonia K1 correlated reliably (r2 = 0.72-0.92) with [15O]water CBF.

CONCLUSION

The [13N]ammonia PET method was unable to reliably estimate GS activity in the human brain but may provide an alternative index of CBF.

Day-to-day variability of [68Ga]Ga-PSMA-11 accumulation in primary prostate cancer: effects on tracer uptake and visual interpretation

PURPOSE

Prostate-specific membrane antigen (PSMA) agents, such as [⁶⁸Ga]Ga-PSMA-11, have an unprecedented accuracy in staging prostate cancer (PCa) and detecting disease recurrence. PSMA PET/CT may also be used for response monitoring by displaying molecular changes, instead of morphological changes alone. However, there are still limited data available on the variability in biodistribution and intra-prostatic uptake of PSMA targeting radiotracers. Therefore, the aim of this study was to assess the repeatability of [⁶⁸Ga]Ga-PSMA-11 uptake in primary PCa patients in a 4-week interval.

METHODS

Twenty-four primary PCa patients were prospectively included, who already were scheduled for [⁶⁸Ga]Ga-PSMA-11 PET/CT scan on clinical indication (≥ cT3, Gleason score ≥ 7 or PSA ≥ 20 ng/mL). These patients received two [⁶⁸Ga]Ga-PSMA-11 PET/CT scans with a 4-week interval. No treatment was started in between the scans. Semiquantitative measurements (SUL_max, SUL_mean, and SUL_peak) were determined in the prostate tumor, normal tissues, and blood pool. The repeatability coefficient of every region was determined. All scans were visually analyzed by two nuclear medicine physicians.

RESULTS

Within-subject coefficient of variation of [⁶⁸Ga]Ga-PSMA-11 uptake between the two scans was on average 10% in the prostate tumor, normal tissues (liver, kidney, parotid), and blood pool. The repeatability coefficient of the prostate tumor was 18% for SUL_peak and 22% for SUL_max. Lesion uptake was visually different in 5 patients, though not clinically relevant.

CONCLUSION

Results of test-retest [⁶⁸Ga]Ga-PSMA-11 PET/CT scans in a 4-week interval show that [⁶⁸Ga]Ga-PSMA-11 uptake is repeatable, with a clinical irrelevant variation in tumor and physiological distribution. Based on the presented repeatable uptake, [⁶⁸Ga]Ga-PSMA-11 PET/CT scans can potentially be used for disease surveillance and therapy response monitoring. Changes in uptake larger than the RC are therefore likely to reflect actual biological changes in PSMA expression. Trial registration NL8263 at Trialregister.nl retrospectively registered on 03-01-2020. https://www.trialregister.nl/trial/8263.

Test-Retest Performance of a 1-Hour Multiparametric MR Image Acquisition Pipeline With Orthotopic Triple-Negative Breast Cancer Patient-Derived Tumor Xenografts

Preclinical imaging is critical in the development of translational strategies to detect diseases and monitor response to therapy. The National Cancer Institute Co-Clinical Imaging Resource Program was launched, in part, to develop best practices in preclinical imaging. In this context, the objective of this work was to develop a 1-hour, multiparametric magnetic resonance image-acquisition pipeline with triple-negative breast cancer patient-derived xenografts (PDXs). The 1-hour, image-acquisition pipeline includes T1- and T2-weighted scans, quantitative T1, T2, and apparent diffusion coefficient (ADC) parameter maps, and dynamic contrast-enhanced (DCE) time-course images. Quality-control measures used phantoms. The triple-negative breast cancer PDXs used for this study averaged 174 ± 73 μL in volume, with region of interest–averaged T1, T2, and ADC values of 1.9 ± 0.2 seconds, 62 ± 3 milliseconds, and 0.71 ± 0.06 μm²/ms (mean ± SD), respectively. Specific focus was on assessing the within-subject test–retest coefficient-of-variation (CV_WS) for each of the magnetic resonance imaging metrics. Determination of PDX volume via manually drawn regions of interest is highly robust, with ∼1% CV_WS. Determination of T2 is also robust with a ∼3% CV_WS. Measurements of T1 and ADC are less robust with CV_WS values in the 6%–11% range. Preliminary DCE test–retest time-course determinations, as quantified by area under the curve and K^trans from 2-compartment exchange (extended Tofts) modeling, suggest that DCE is the least robust protocol, with ∼30%–40% CV_WS.

Reproducibility of objectively measured physical activity: Reconsideration needed

Reliability of accelerometer-determined physical activity (PA), and thus the required length of a monitoring period, appears to depend on the analytic approach used for its calculation. We compared reliability of objectively measured PA using different resolution of data in a sample of 221 Norwegian 2-6-year-old children providing 2-3 valid 14-day periods of accelerometer monitoring (ActiGraph GT3X+) during September-October, January-February, and May-June 2015-2016. Reliability (intra-class correlation [ICC]) was measured for 1-14 days of monitoring across the measurement periods using linear mixed effect modelling. These results were compared to reliability estimated using different resolution of data using the Spearman-Brown formula. The measured reliability improved only marginally with increased monitoring length and levelled off after 5-6 days. Estimated reliability differed substantially when derived from different resolution of data: 3.9-5.4, 6.7-9.2, 13.4-26.7 and 26.3-87.7 days of monitoring was required to achieve an ICC = 0.80 using an hour-by-hour, a day-by-day, a week-by-week and a period-by-period approach, respectively. Reliability could not be correctly estimated from any single resolution of data. We conclude that reconsideration is needed with regard to how reproducibility of objectively measured PA is analysed and interpreted.

Test-retest reliability of ICECAP-A in the adult Danish population

PURPOSE

To investigate the test-retest reliability of Investigating Choice Experiments Capability measure for Adults (ICECAP-A) in the adult Danish population.

METHODS

The original English ICECAP-A was translated into Danish by forward-backwards translation using the guidelines by Beaton et al. Three hundred and-thirty-two participants with mean age of 57 years participated in a Web-based study. Data concerning relative and absolute agreement were analysed by the intra-class correlation coefficient and Bland-Altman plot with limits of agreement. The overall and item consistency was investigated by weighted kappa statistics from baseline to 2-week follow-up. Logistic regression was used to study the effect of the sociodemographic characteristics with inconsistent responses as the dependent binary variable. The independent variables were age, sex, education, income, and region of residence at baseline.

RESULTS

The baseline ICECAP-A preference-based index score was 0.84, and at follow-up, 0.83. The ICC was 0.86 (95% CI 0.826-0.884), and limits of agreement were 0.164 and - 0.151. The kappa coefficient ranges from 45 to 65%, between random and perfect agreement. The logistic regression to analyse inconsistent responses showed no significant association between the overall index score and sociodemographic characteristics, and no clear pattern was found concerning the individual item inconsistency.

CONCLUSIONS

Evidence regarding the reliability of the Danish version of ICECAP-A is satisfactory for both the index score agreement and the individual item consistency and is a reliable measure to be used in a Danish context and future health economic evaluations.

Repeatable and reproducible measurements of myocardial oxidative metabolism, blood flow and external efficiency using 11C-acetate PET

BACKGROUND

Non-invasive approaches to investigate myocardial efficiency can help track the progression of heart failure (HF). This study evaluates the repeatability and reproducibility of 11C-acetate positron emission tomography (PET) imaging of oxidative metabolism.

METHODS AND RESULTS

Dynamic 11C-acetate PET scans were performed at baseline and followup (47 ± 22 days apart) in 20 patients with stable HF with reduced ejection fraction. Two observers blinded to patients' clinical data used FlowQuant® to evaluate test-retest repeatability, as well as intra- and inter-observer reproducibility of 11C-acetate tracer uptake and clearance rates, for the measurement of myocardial oxygen consumption (MVO2), myocardial external efficiency (MEE), work metabolic index (WMI), and myocardial blood flow. Reproducibility and repeatability were evaluated using intra-class-correlation (ICC) and Bland-Altman coefficient-of-repeatability (CR). Test-retest correlations and repeatability were better for MEE and WMI compared to MVO2. All intra- and inter-observer correlations were excellent (ICC = 0.95-0.99) and the reproducibility values (CR = 3%-6%) were significantly lower than the test-retest repeatability values (22%-54%, P < 0.001). Repeatability was improved for all parameters using a newer PET-computed tomography (CT) scanner compared to older PET-only instrumentation.

CONCLUSION

11C-acetate PET measurements of WMI and MEE exhibited excellent test-retest repeatability and operator reproducibility. Newer PET-CT scanners may be preferred for longitudinal tracking of cardiac efficiency.

Reliable Change on Memory Tests is Common in Healthy Children and Adolescents

Objective

Neuropsychologists interpret a large number of scores in their assessments, including numerous retest scores to determine change over time. The rate at which healthy children and adolescents obtain reliably improved or declined memory scores when retested has yet to be explored. The purpose of this study was to illustrate the prevalence of reliable change scores on memory test batteries in healthy children and adolescents.

Methods

Participants were children and adolescents from test-retest samples from two published memory test batteries (ChAMP and CMS). Reliable change scores (RCI with 90% confidence interval and practice effects) were calculated for the indexes and subtests of each battery. Multivariate base rates involved considering all change scores simultaneously within each battery and calculating the frequencies of healthy children obtaining one or more reliably declined or one or more reliably improved scores.

Results

Across both memory batteries, one or more reliably changed index or subtest score was common; however, reliable change on three or more scores was uncommon (i.e., found in <5% of the samples). Base rates of change scores did not differ by parent education.

Conclusions

Having a single reliably changed score on retest is common when interpreting these memory batteries. Multivariate interpretation is necessary when determining cognitive decline and cognitive recovery. Further research is warranted with other measures, other samples, and different retest intervals.

Repeatability and Safety of the Functional Capacity Evaluation-One-Handed for Individuals with Upper Limb Reduction Deficiency and Amputation

Purpose To assess repeatability and safety of the functional capacity evaluation-one-handed (FCE-OH), a FCE-OH individuals, consisting of eight items. Method The FCE-OH protocol was administered twice to 23 individuals with upper limb absence (87% male; median age 46 years; median 2 days between sessions). To examine repeatability, test-retest reliability and agreement were assessed with the intraclass correlations coefficient (ICC) and limits of agreement (LoA), respectively. Reliability was considered acceptable when ICC-values were ≥0.75. Widths of LoA of four tests were compared with those of healthy adults. Safety and pain response were assessed with a questionnaire. Results After controlling for stability of construct, ICC-values ranged between 0.23 and 0.96, and widths of LoA ranged between 16 and 79%. Intertrial (learning) effects were present in three test items. No serious adverse reactions were reported. A pain response was reported by 30% of the participants. Conclusion Good or excellent reliability was observed in five tests, while three items showed poor or moderate test-retest reliability. Interpretation of agreement was possible for four tests, of which three showed widths of LoA similar to those reported in healthy adults. Learning effects were present; therefore, interpretation at the individual level should be performed with care. As the CI of several items were wide, confirmation of results in a larger sample is warranted. Safety was confirmed.

Unilateral lower limb strength assessed using the Nintendo Wii Balance Board: a simple and reliable method

BACKGROUND

Lower limb weakness is an important risk factor for fall accidents and a predictor for all-cause mortality among older adults. Unilateral whole-lower limb strength may be a better measure of fall risk than the bilateral measure. In addition, a number of clinical conditions affect only one leg, and thus this type of assessment is relevant in clinical settings.

AIM

To explore the intra-rater reproducibility of the Nintendo Wii Balance Board (WBB) to measure unilateral whole-lower limb strength and to compare the method with stationary isometric muscle apparatus (SID).

METHOD

Intra-rater test-retest design with 1 week between sessions. Thirty community-dwelling older adults (69 ± 4.2 years) were enrolled and examined for maximum lower limb strength in their dominant and non-dominant leg. Intraclass correlation coefficient (ICC) was calculated to describe relative reproducibility, while standard error of measurement (SEM), limits of agreement (LOA) and smallest real difference (SRD) were calculated to describe absolute reproducibility between test sessions. Concurrent validity with the SID was explored using the Pearson product-moment correlation coefficient (PCC).

RESULTS

No systematic difference was observed between test sessions. ICC was 0.919-0.950 and SEM, LOA and SRD was 2.9-4.1 kg, 24.1-28.3 kg and 7.6-11.3 kg, respectively. Further, the PCC was 0.755 and 0.730 for the dominant limb and the non-dominant limb, respectively.

CONCLUSION

A high relative and an acceptable absolute reproducibility was seen when using the Nintendo Wii Balance Board for testing unilateral lower limb strength in community-dwelling older adults. The WBB correlated strongly with the SID.

Test-retest measurements of dopamine D1-type receptors using simultaneous PET/MRI imaging

PURPOSE

The role of dopamine D₁-type receptor (D₁R)-expressing neurons in the regulation of motivated behavior and reward prediction has not yet been fully established. As a prerequisite for future research assessing D₁-mediated neuronal network regulation using simultaneous PET/MRI and D₁R-selective [¹¹C]SCH23390, this study investigated the stability of central D₁R measurements between two independent PET/MRI sessions under baseline conditions.

METHODS

Thirteen healthy volunteers (7 female, age 33 ± 13 yrs) underwent 90-min emission scans, each after 90-s bolus injection of 486 ± 16 MBq [¹¹C]SCH23390, on two separate days within 2-4 weeks using a PET/MRI system. Parametric images of D₁R distribution volume ratio (DVR) and binding potential (BP_ND) were generated by a multi-linear reference tissue model with two parameters and the cerebellar cortex as receptor-free reference region. Volume-of-interest (VOI) analysis was performed with manual VOIs drawn on consecutive transverse MRI slices for brain regions with high and low D₁R density.

RESULTS

The DVR varied from 2.5 ± 0.3 to 2.9 ± 0.5 in regions with high D₁R density (e.g. the head of the caudate) and from 1.2 ± 0.1 to 1.6 ± 0.2 in regions with low D₁R density (e.g. the prefrontal cortex). The absolute variability of the DVR ranged from 2.4% ± 1.3% to 5.1% ± 5.3%, while Bland-Altman analyses revealed very low differences in mean DVR (e.g. 0.013 ± 0.17 for the nucleus accumbens). Intraclass correlation (one-way, random) indicated very high agreement (0.93 in average) for both DVR and BP_ND values. Accordingly, the absolute variability of BP_ND ranged from 7.0% ± 4.7% to 12.5% ± 10.6%; however, there were regions with very low D₁R content, such as the occipital cortex, with higher mean variability.

CONCLUSION

The test-retest reliability of D₁R measurements in this study was very high. This was the case not only for D₁R-rich brain areas, but also for regions with low D₁R density. These results will provide a solid base for future joint PET/MRI data analyses in stimulation-dependent mapping of D₁R-containing neurons and their effects on projections in neuronal circuits that determine behavior.

Resting-state test-retest reliability of a priori defined canonical networks over different preprocessing steps

Resting-state functional connectivity analysis has become a widely used method for the investigation of human brain connectivity and pathology. The measurement of neuronal activity by functional MRI, however, is impeded by various nuisance signals that reduce the stability of functional connectivity. Several methods exist to address this predicament, but little consensus has yet been reached on the most appropriate approach. Given the crucial importance of reliability for the development of clinical applications, we here investigated the effect of various confound removal approaches on the test-retest reliability of functional-connectivity estimates in two previously defined functional brain networks. Our results showed that gray matter masking improved the reliability of connectivity estimates, whereas denoising based on principal components analysis reduced it. We additionally observed that refraining from using any correction for global signals provided the best test-retest reliability, but failed to reproduce anti-correlations between what have been previously described as antagonistic networks. This suggests that improved reliability can come at the expense of potentially poorer biological validity. Consistent with this, we observed that reliability was proportional to the retained variance, which presumably included structured noise, such as reliable nuisance signals (for instance, noise induced by cardiac processes). We conclude that compromises are necessary between maximizing test-retest reliability and removing variance that may be attributable to non-neuronal sources.

Test-retest reliability of the Test of Infant Motor Performance Screening Items in infants at risk for impaired functional motor performance

OBJECTIVE

To examine test-retest reliability of the TIMPSI in infants at risk for impaired functional motor performance.

METHODS

The TIMPSI was administered twice to 51 infants from two different hospitals in Norway.

RESULTS

The intra-class correlation coefficient was 0.99.

CONCLUSION

Test-retest reliability of the TIMPSI was excellent.

An instrument to collect data on frequency and intensity of symptoms in older palliative cancer patients: A development and validation study

PURPOSE

To develop and validate an instrument to collect data on symptoms (frequency/intensity) in older palliative cancer patients.

METHODS

A four-phase instrument development and validation study was performed. A preliminary version of the instrument was developed through a literature review. Face- and content validity were assessed in a Delphi-procedure with eleven experts. Cognitive interviewing with 24 older cancer patients was performed to enhance content validity of the instrument. Test-retest was performed to assess the stability.

RESULTS

An 40-item instrument was developed. The Assessment Symptoms Palliative Elderly (ASPE) collects data on frequency and intensity of 24 physical, 10 psychological, 3 functional, 1 spiritual and 2 social symptoms. Content validity was excellent (I-CVI 81.8%-100.0% and S-CVI 92.9%). Cognitive interviewing allowed to improve the content validity. Test-retest showed substantial to almost perfect agreement for 87.5% of the items. No item had poor or fair agreement.

CONCLUSION

This study resulted in the development of the ASPE which reflects good properties for face- and content validity and reliability. Cognitive interviewing has a valuable contribution in the validation process. The instrument can be used to gain insight in symptoms in older palliative cancer patients.

Test-retest reliability of the scale of participation in organized activities among adolescents in the Czech Republic and Slovakia

OBJECTIVES

Participation in organized activities is related with a range of positive outcomes, but the way such participation is measured has not been scrutinized. Test-retest reliability as an important indicator of a scale's reliability has been assessed rarely and for "The scale of participation in organized activities" lacks completely. This test-retest study is based on the Health Behaviour in School-aged Children study and is consistent with its methodology.

METHODS

We obtained data from 353 Czech (51.9 % boys) and 227 Slovak (52.9 % boys) primary school pupils, grades five and nine, who participated in this study in 2013. We used Cohen's kappa statistic and single measures of the intraclass correlation coefficient to estimate the test-retest reliability of all selected items in the sample, stratified by gender, age and country.

RESULTS

We mostly observed a large correlation between the test and retest in all of the examined variables (κ ranged from 0.46 to 0.68). Test-retest reliability of the sum score of individual items showed substantial agreement (ICC = 0.64).

CONCLUSIONS

The scale of participation in organized activities has an acceptable level of agreement, indicating good reliability.

Test-retest reproducibility of [(11)C]PBR28 binding to TSPO in healthy control subjects

PURPOSE

The PET radioligand [(11)C]PBR28 binds to the translocator protein (TSPO), a marker of brain immune activation. We examined the reproducibility of [(11)C]PBR28 binding in healthy subjects with quantification on a regional and voxel-by-voxel basis. In addition, we performed a preliminary analysis of diurnal changes in TSPO availability.

METHODS

Twelve subjects were examined using a high-resolution research tomograph and [(11)C]PBR28, six in the morning and afternoon of the same day, and six in the morning on two separate days. Regional volumes of distribution (V T) were derived using a region-of-interest based two-tissue compartmental analysis (2TCM), as well as a parametric approach. Metabolite-corrected arterial plasma was used as input function.

RESULTS

For the whole sample, the mean absolute variability in V T in the grey matter (GM) was 18.3 ± 12.7 %. Intraclass correlation coefficients in GM regions ranged from 0.90 to 0.94. Reducing the time of analysis from 91 to 63 min yielded a variability of 16.9 ± 14.9 %. There was a strong correlation between the parametric and 2TCM-derived GM values (r = 0.99). A significant increase in GM V T was observed between the morning and afternoon examinations when using secondary methods of quantification (p = 0.028). In the subjects examined at the same time of the day, the absolute variability was 15.9 ± 12.2 % for the 91-min 2TCM data.

CONCLUSION

V T of [(11)C]PBR28 binding showed medium reproducibility and high reliability in GM regions. Our findings support the use of parametric approaches for determining [(11)C]PBR28 V T values, and indicate that the acquisition time could be shortened. Diurnal changes in TSPO binding in the brain may be a potential confounder in clinical studies and should be investigated further.

Agreement of objectively measured physical activity and sedentary time in preschool children

OBJECTIVE

To determine the intra-individual agreement for objectively measured physical activity (PA) and sedentary behavior (SED) over two subsequent weeks in preschool children.

METHOD

Ninety-one children aged 3 to 5 years (49% boys) from three preschools in Sogn og Fjordane, Norway, provided 14 consecutive days of accelerometer data (Actigraph GT3X +) during the autumn of 2014. Week-by-week reliability was assessed using intraclass correlation (ICC), Bland-Altman plots and 95% limits of agreement for different wear time criteria (≥ 6, 8 and 10 h/day and ≥ 3 and 5 days/week).

RESULTS

The week-by-week ICC was ≥ 0.75 for all variables across all wear criteria applied, except for absolute sedentary time (ICC 0.61-0.81). Using a ≥ 8 h/day and ≥ 3 days/week criterion (n = 78), limits of agreement were ± 209.5 cpm for overall PA, ± 68.6 min/day for SED, ± 43.8 min/day for light PA, ± 20.2 min/day for moderate-to-vigorous PA, and ± 55.9 min/day for light-to-vigorous PA, equaling 1.0-1.6 standard deviation units.

CONCLUSION

Considerable week-by-week variability was found for all variables. Researchers need to be aware of substantial intra-individual variability in accelerometer-measurements and take necessary actions according to the hypothesis under study, as noise in any measurement will preclude researchers' ability to arrive at valid conclusions in epidemiology.

Reliability of handgrip strength test in elderly subjects with unilateral thumb carpometacarpal osteoarthritis

BACKGROUND

The grip strength test is widely used; however, little has been investigated about its reliability when used in elderly with subjects thumb carpometacarpal (CMC) osteoarthritis (OA). The purpose of this study was to examine the test-retest reliability of the grip strength test in elderly subjects with thumb CMC OA.

METHODS

A total of 78 patients with unilateral thumb CMC OA, 84.6 % female (mean ± SD age 83 ± 5 years), were recruited. Each patient performed three pain free maximal isometric contractions on each hand in two occasions, 1 week apart. Intraclass correlation coefficient (ICC), standard error of measurement (SEM), and 95 % limits of agreement (LOA) were calculated.

RESULTS

Test-retest reliability was excellent for side affected (ICC = 0.947; p = 0.001) and contralateral (ICC = 0.96; p = 0.001) thumb CMC OA.

CONCLUSIONS

The present results indicate that maximum handgrip strength can be measured reliably, using the Jamar hand dynamometer, in patients with thumb CMC OA, which enables its use in research and in the clinic to determine the effect of interventions on improving grip.

Reproducibility of multiphase pseudo-continuous arterial spin labeling and the effect of post-processing analysis methods

Arterial spin labeling (ASL) is an emerging MRI technique for non-invasive measurement of cerebral blood flow (CBF). Compared to invasive perfusion imaging modalities, ASL suffers from low sensitivity due to poor signal-to-noise ratio (SNR), susceptibility to motion artifacts and low spatial resolution, all of which limit its reliability. In this work, the effects of various state of the art image processing techniques for addressing these ASL limitations are investigated. A processing pipeline consisting of motion correction, ASL motion correction imprecision removal, temporal and spatial filtering, partial volume effect correction, and CBF quantification was developed and assessed. To further improve the SNR for pseudo-continuous ASL (PCASL) by accounting for errors in tagging efficiency, the data from multiphase (MP) acquisitions were analyzed using a novel weighted-averaging scheme. The performances of each step in terms of SNR and reproducibility were evaluated using test-retest ASL data acquired from 12 young healthy subjects. The proposed processing pipeline was shown to improve the within-subject coefficient of variation and regional reproducibility by 17% and 16%, respectively, compared to CBF maps computed following motion correction but without the other processing steps. The CBF measurements of MP-PCASL compared to PCASL had on average 23% and 10% higher SNR and reproducibility, respectively.

Voxel-based morphometry at ultra-high fields. a comparison of 7T and 3T MRI data

Recent technological progress enables MRI recordings at ultra-high fields of 7 T and above leading to brain images of higher resolution and increased signal-to-noise ratio. Despite these benefits, imaging at 7 T exhibits distinct challenges due to B1 field inhomogeneities, causing decreased image quality and problems in data analysis. Although several strategies have been proposed, a systematic investigation of bias-corrected 7 T data for voxel-based morphometry (VBM) is still missing and it is an ongoing matter of debate if VBM at 7 T can be carried out properly. Here, an optimized VBM study was conducted, evaluating the impact of field strength (3T vs. 7 T) and pulse sequence (MPRAGE vs. MP2RAGE) on gray matter volume (GMV) estimates. More specifically, twenty-two participants were measured under the conditions 3T MPRAGE, 7 T MPRAGE and 7 T MP2RAGE. Due to the fact that 7 T MPRAGE data exhibited strong intensity inhomogeneities, an alternative preprocessing pipeline was proposed and applied for that data. VBM analysis revealed higher GMV estimates for 7 T predominantly in superior cortical areas, caudate nucleus, cingulate cortex and the hippocampus. On the other hand, 3T yielded higher estimates especially in inferior cortical areas of the brain, cerebellum, thalamus and putamen compared to 7 T. Besides minor exceptions, these results were observed for 7 T MPRAGE as well for the 7 T MP2RAGE measurements. Results gained in the inferior parts of the brain should be taken with caution, as native GM segmentations displayed misclassifications in these regions for both 7 T sequences. This was supported by the test-retest measurements showing highest variability in these inferior regions of the brain for 7 T and also for the advanced MP2RAGE sequence. Hence, our data support the use of 7 T MRI for VBM analysis in cortical areas, but direct comparison between field strengths and sequences requires careful assessment. Similarly, analysis of the inferior cortical regions, cerebellum and subcortical regions still remains challenging at 7 T even if the advanced MP2RAGE sequence is used.

Validation and reliability of two activity monitors for energy expenditure assessment

OBJECTIVES

This study explores the reliability and validity of the SenseWear Armband (SWA) and Actical (ACT) for free-living total energy expenditure, and energy expenditure during rest and light-to-moderate exercises (walking, ergocycling).

DESIGN

Participants wore the 2 devices during 7 days (free-living) and then participated to 3 days of testing in our laboratory.

METHODS

SWA and ACT estimates of total energy expenditure was compared to the doubly labeled water technique (7 days), and energy expenditure during rest (60min), treadmill (45min; intensities ∼22% to ∼41% VO2peak) and ergocycling (45min; ∼50% VO2peak) were compared to indirect calorimetry over the following 3 days. Paired T-tests and intra-class correlation coefficient (ICC) with 95% confidence interval (CI95) were computed.

RESULTS

Twenty adults were recruited (BMI 23.1±2.3kg/m(2)). Compared to doubly labelled water, SWA overestimated energy expenditure by 94kcal/d (±319; P=0.2) and ACT underestimated by -244kcal/d (±258; P=0.001). Energy expenditure during rest (SWA 210±116, ACT 124±133kcal/d; p<0.05) and treadmill (according on intensity: SWA 54±46 to 67±38, ACT 68±25 to 84±40kcal; p<0.05) were overestimated and underestimated during ergocycling (SWA -93±65, ACT -269±111kcal; p<0.05) compared to indirect calorimetry. High ICC were observed at rest (SWA 0.994 CI95 0.987-0.997; ACT 0.998 CI95 0.996-0.999) and during ergocycling (SWA 0.941 CI95 0.873-0.975; ACT 0.854 CI95 0.687-0.939).

CONCLUSION

Acceptable estimation of total energy expenditure was observed with the SWA. Both devices were reliable but not accurate for energy expenditure's estimations during rest and for specific exercises.

Evaluation of the agonist PET radioligand [¹¹C]GR103545 to image kappa opioid receptor in humans: kinetic model selection, test-retest reproducibility and receptor occupancy by the antagonist PF-04455242

INTRODUCTION

Kappa opioid receptors (KOR) are implicated in several brain disorders. In this report, a first-in-human positron emission tomography (PET) study was conducted with the potent and selective KOR agonist tracer, [(11)C]GR103545, to determine an appropriate kinetic model for analysis of PET imaging data and assess the test-retest reproducibility of model-derived binding parameters. The non-displaceable distribution volume (V(ND)) was estimated from a blocking study with naltrexone. In addition, KOR occupancy of PF-04455242, a selective KOR antagonist that is active in preclinical models of depression, was also investigated.

METHODS

For determination of a kinetic model and evaluation of test-retest reproducibility, 11 subjects were scanned twice with [(11)C]GR103545. Seven subjects were scanned before and 75 min after oral administration of naltrexone (150 mg). For the KOR occupancy study, six subjects were scanned at baseline and 1.5 h and 8 h after an oral dose of PF-04455242 (15 mg, n=1 and 30 mg, n=5). Metabolite-corrected arterial input functions were measured and all scans were 150 min in duration. Regional time-activity curves (TACs) were analyzed with 1- and 2-tissue compartment models (1TC and 2TC) and the multilinear analysis (MA1) method to derive regional volume of distribution (V(T)). Relative test-retest variability (TRV), absolute test-retest variability (aTRV) and intra-class coefficient (ICC) were calculated to assess test-retest reproducibility of regional VT. Occupancy plots were computed for blocking studies to estimate occupancy and V(ND). The half maximal inhibitory concentration (IC50) of PF-04455242 was determined from occupancies and drug concentrations in plasma. [(11)C]GR103545 in vivo K(D) was also estimated.

RESULTS

Regional TACs were well described by the 2TC model and MA1. However, 2TC VT was sometimes estimated with high standard error. Thus MA1 was the model of choice. Test-retest variability was ~15%, depending on the outcome measure. The blocking studies with naltrexone and PF-04455242 showed that V(T) was reduced in all regions; thus no suitable reference region is available for the radiotracer. V(ND) was estimated reliably from the occupancy plot of naltrexone blocking (V(ND)=3.4±0.9 mL/cm(3)). The IC50 of PF-04455242 was calculated as 55 ng/mL. [(11)C]GR103545 in vivo K(D) value was estimated as 0.069 nmol/L.

CONCLUSIONS

[(11)C]GR103545 PET can be used to image and quantify KOR in humans, although it has slow kinetics and variability of model-derived kinetic parameters is higher than desirable. This tracer should be suitable for use in receptor occupancy studies, particularly those that target high occupancy.

Inter-machine reliability of the Biodex and Cybex isokinetic dynamometers for knee flexor/extensor isometric, concentric and eccentric tests

OBJECTIVES

To assess the inter-machine reliability of the Biodex System 3 Pro and Cybex Humac Norm Model 770 dynamometers for knee extensor and knee flexor peak torque measurements in isometric, concentric and eccentric tests.

DESIGN

Randomized/crossover.

SETTING

Exercise Research Laboratory, Federal University of Rio Grande do Sul (Brazil).

PARTICIPANTS

25 healthy male subjects.

MAIN OUTCOME MEASURES

Isometric, concentric and eccentric knee extensor and knee flexor peak torques recorded in the same test procedure performed on both isokinetic dynamometers. One-way ANOVA, intraclass correlation coefficient (ICC), standard error of measurement (SEM) and coefficient of variation (CV) were used to verify significant differences, relative and absolute reliability between devices.

RESULTS

No significant differences were found between tests performed on Biodex and Cybex (p > 0.05). ICC values indicated a high to very high reproducibility for isometric, concentric and eccentric peak torques (0.88-0.92), and moderate to high reliability for agonist-antagonist strength ratios (0.62-0.73). Peak torque did not show great difference between dynamometers for SEM (3.72-11.27 Nm) and CV (5.27-7.77%). Strength ratios presented CV values of 8.57-10.72%.

CONCLUSION

Maximal knee extensor and knee flexor tests performed in isometric (60° of knee flexion), concentric and eccentric modes at 60°/s in Biodex and Cybex dynamometers present similar values.

Test-retest reliability and comparability of paper and computer questionnaires for the Finnish version of the Tampa Scale of Kinesiophobia

OBJECTIVES

To estimate the internal consistency, test-retest reliability and comparability of paper and computer versions of the Finnish version of the Tampa Scale of Kinesiophobia (TSK-FIN) among patients with chronic pain. In addition, patients' personal experiences of completing both versions of the TSK-FIN and preferences between these two methods of data collection were studied.

DESIGN

Test-retest reliability study. Paper and computer versions of the TSK-FIN were completed twice on two consecutive days.

PARTICIPANTS

The sample comprised 94 consecutive patients with chronic musculoskeletal pain participating in a pain management or individual rehabilitation programme. The group rehabilitation design consisted of physical and functional exercises, evaluation of the social situation, psychological assessment of pain-related stress factors, and personal pain management training in order to regain overall function and mitigate the inconvenience of pain and fear-avoidance behaviour.

RESULTS

The mean TSK-FIN score was 37.1 [standard deviation (SD) 8.1] for the computer version and 35.3 (SD 7.9) for the paper version. The mean difference between the two versions was 1.9 (95% confidence interval 0.8 to 2.9). Test-retest reliability was 0.89 for the paper version and 0.88 for the computer version. Internal consistency was considered to be good for both versions. The intraclass correlation coefficient for comparability was 0.77 (95% confidence interval 0.66 to 0.85), indicating substantial reliability between the two methods.

CONCLUSION

Both versions of the TSK-FIN demonstrated substantial intertest reliability, good test-retest reliability, good internal consistency and acceptable limits of agreement, suggesting their suitability for clinical use. However, subjects tended to score higher when using the computer version. As such, in an ideal situation, data should be collected in a similar manner throughout the course of rehabilitation or clinical research.

Test-retest reliability of structural brain networks from diffusion MRI

Structural brain networks constructed from diffusion MRI (dMRI) and tractography have been demonstrated in healthy volunteers and more recently in various disorders affecting brain connectivity. However, few studies have addressed the reproducibility of the resulting networks. We measured the test-retest properties of such networks by varying several factors affecting network construction using ten healthy volunteers who underwent a dMRI protocol at 1.5T on two separate occasions. Each T1-weighted brain was parcellated into 84 regions-of-interest and network connections were identified using dMRI and two alternative tractography algorithms, two alternative seeding strategies, a white matter waypoint constraint and three alternative network weightings. In each case, four common graph-theoretic measures were obtained. Network properties were assessed both node-wise and per network in terms of the intraclass correlation coefficient (ICC) and by comparing within- and between-subject differences. Our findings suggest that test-retest performance was improved when: 1) seeding from white matter, rather than grey; and 2) using probabilistic tractography with a two-fibre model and sufficient streamlines, rather than deterministic tensor tractography. In terms of network weighting, a measure of streamline density produced better test-retest performance than tract-averaged diffusion anisotropy, although it remains unclear which is a more accurate representation of the underlying connectivity. For the best performing configuration, the global within-subject differences were between 3.2% and 11.9% with ICCs between 0.62 and 0.76. The mean nodal within-subject differences were between 5.2% and 24.2% with mean ICCs between 0.46 and 0.62. For 83.3% (70/84) of nodes, the within-subject differences were smaller than between-subject differences. Overall, these findings suggest that whilst current techniques produce networks capable of characterising the genuine between-subject differences in connectivity, future work must be undertaken to improve network reliability.

Assessment of the test-retest reliability of a foot placement accuracy protocol in assisted-living older adults

INTRODUCTION

This study assessed the test-retest reliability of a foot placement accuracy protocol in a population of assisted-living elderly. The goal was to evaluate the execution of foot placement performance with increasing complexity of the walking condition.

METHODS

Twenty-five elderly participants (5 males, 20 females, 80.4±8.6 years) were assessed by one observer in two sessions with 48 h between the measurements. Participants walked at self-selected pace along a pathway with three different walking conditions composed of two rectangular foam target locations and an obstacle on the walking surface. The main outcome measures were foot placement distance error, intra-class correlation coefficients (ICC), and the smallest detectable difference (SDD).

RESULTS

Mean absolute values of the foot placement distance errors were 14.0±4.5 mm for medio-lateral deviation and 27.2±2.1 mm for anterior-posterior deviation, respectively. ICC values for test-retest reliability showed 'fair to good' to 'excellent' reliability across all conditions with values ranging from 0.63 to 0.94. SDD values were between 3.6 and 37.3mm.

CONCLUSION

The protocol showed good reliability for test-retest measurements of foot placement accuracy, thus making this protocol a reliable and location-independent tool to assess performance of foot placement in elderly in assisted-living settings. In the future, measurements with elderly fallers and non-fallers should be conducted to assess validity of the protocol.

Is gait variability reliable? An assessment of spatio-temporal parameters of gait variability during continuous overground walking

The assessment of gait variability has become an important indicator for quantifying motor performance. However, the use of treadmills is known to influence the temporal rhythm of gait, while non-continuous (i.e. stop-start) overground walking alters gait variability, leading to erroneous results. Through establishing the "8-walk", an overground walking protocol that allows the collection of a high number of consecutive gait cycles, the aim of this study was to determine the conditions under which gait variability can be assessed reliably. Twelve healthy subjects performed continuous barefoot walking at their preferred speed in a path shaped as an "8". Kinematic data of the dominant foot was collected while subjects walked along the straight 10 m sections of the 8-walk during sessions on two different days. Mean spatio-temporal parameters of gait and gait variability were computed for 10, 20, 30, 40, 50 and 60 consecutive cycles. All mean parameters of gait showed excellent reliability (ICC: 0.88-0.98) with only 10 cycles included in the analysis. However, the reliability of spatial and temporal parameters of gait variability improved with increasing number of cycles (ICC: 0.60-0.90) but levelled-off after 50 consecutive cycles, revealing an inter-day test-retest variability of ≈ 13%. To reliably assess gait variability and evaluate human motor performance, we propose the collection of at least 50 cycles and the use of an 8-walk protocol, which avoids the limitations of treadmill and non-consecutive walking protocols.

Quantifying the test-retest reliability of cerebral blood flow measurements in a clinical model of on-going post-surgical pain: A study using pseudo-continuous arterial spin labelling

Arterial spin labelling (ASL) is increasingly being applied to study the cerebral response to pain in both experimental human models and patients with persistent pain. Despite its advantages, scanning time and reliability remain important issues in the clinical applicability of ASL. Here we present the test–retest analysis of concurrent pseudo-continuous ASL (pCASL) and visual analogue scale (VAS), in a clinical model of on-going pain following third molar extraction (TME). Using ICC performance measures, we were able to quantify the reliability of the post-surgical pain state and ΔCBF (change in CBF), both at the group and individual case level. Within-subject, the inter- and intra-session reliability of the post-surgical pain state was ranked good-to-excellent (ICC > 0.6) across both pCASL and VAS modalities. The parameter ΔCBF (change in CBF between pre- and post-surgical states) performed reliably (ICC > 0.4), provided that a single baseline condition (or the mean of more than one baseline) was used for subtraction. Between-subjects, the pCASL measurements in the post-surgical pain state and ΔCBF were both characterised as reliable (ICC > 0.4). However, the subjective VAS pain ratings demonstrated a significant contribution of pain state variability, which suggests diminished utility for interindividual comparisons. These analyses indicate that the pCASL imaging technique has considerable potential for the comparison of within- and between-subjects differences associated with pain-induced state changes and baseline differences in regional CBF. They also suggest that differences in baseline perfusion and functional lateralisation characteristics may play an important role in the overall reliability of the estimated changes in CBF. Repeated measures designs have the important advantage that they provide good reliability for comparing condition effects because all sources of variability between subjects are excluded from the experimental error. The ability to elicit reliable neural correlates of on-going pain using quantitative perfusion imaging may help support the conclusions derived from subjective self-report.

•

Test-retest reliability of pCASL is considered in a post-surgical pain model.

•

Pain-state and ∆CBF measurements were reliable at the group and individual level.

•

Single or average baseline measurements improve reliability of ∆CBF.

•

pCASL is a reliable technique for detecting cerebral responses to on-going pain.