Reliability of specific physical examination tests for the diagnosis of shoulder pathologies: a systematic review and meta-analysis

Validity and Reliability of POM-Checker for Measuring Shoulder Range of Motion in Healthy Participants: A Pilot Single-Center Comparative Study

BACKGROUND

The aim of this study was to compare shoulder movement measurements between a Kinect-based markerless ROM assessment device (POM-Checker) and a 3D motion capture analysis system (BTS SMART DX-400).

METHODS

This was a single-visit clinical trial designed to evaluate the validity and reliability of the POM-Checker. The primary outcome was to assess the equivalence between two measurement devices within the same set of participants, aiming to evaluate the validity of the POM-Checker compared to the gold standard device (3D Motion Analysis System). As this was a pilot study, six participants were included.

RESULTS

The intraclass correlation coefficient (ICC) and the corresponding 95% confidence intervals (CIs) were used to assess the reproducibility of the measurements. Among the 18 movements analyzed, 16 exhibited ICC values of >0.75, indicating excellent reproducibility.

CONCLUSION

The results showed that the POM-checker is reliable and validated to measure the range of motion of the shoulder joint.

Interrater reliability of physical examination tests in the acute phase of shoulder injuries

BACKGROUND

The physical examination is one of the cornerstones of the diagnostic process in patients with acute shoulder injuries. The discriminative properties of a given examination test depend both on its validity and reliability. The aim of the present study was to assess the interrater reliability of 13 physical examination manoeuvres for acute rotator cuff tears in patients with acute soft tissue shoulder injuries.

METHODS

In a large walk-in orthopaedic emergency department, 120 consecutive patients ≥40 years of age were included in a diagnostic study. Patients who had follow-up within three weeks of an acute shoulder injury without fracture on radiographs were eligible. Four emergency department physicians participated as examiners. In a subset of 48 patients, the physical examination tests were performed by two physicians, randomly chosen by their work rotation. The physicians were blinded to the findings of each other and the results of the ultrasound screening. The interrater reliability was assessed by Cohen's kappa, intraclass correlation coefficient (ICC), standard error of measurement (SEM) and Bland-Altman plots depending on whether the examination test result was registered as a binary, ordered categorical or continuous numerical variable.

RESULTS

The median age was 55.5 years, 46% were female. Twenty-seven percent had a rotator cuff full-thickness tear on ultrasound screening; all but one involved the supraspinatus tendon. Cohen's kappa for binary tests ranged from excellent to fair. Excellent agreement (kappa > 0.8) was found for the inability to abduct above 90° and abduction strength. External rotation strength expressed substantial agreement (kappa 0.7). The lowest scores were registered for Hawkins` test and the external rotation lag sign (kappa 0.25 and 0.40, respectively). The ICCs for active range of abduction and external rotation were 0.93 (0.88-0.96) and 0.84 (0.72-0.91), whereas the SEM was 15 and 9, respectively.

CONCLUSIONS

The results indicate that examination manoeuvres assessing abduction and external rotation range of motion and strength are more reliable than manoeuvres assessing pain in patients in the acute phase of traumatic shoulder injury. The poor agreement observed is likely to limit the validity in the present setting of two commonly used tests.

TRIAL REGISTRATION

The Norwegian Regional Ethics Committee South East ( 2015/195 ).

Correlation of magnetic resonance and arthroscopy in the diagnosis of shoulder injury

BACKGROUND

Advances in shoulder magnetic resonance imaging (MRI) and arthrography (MRA) have revolutionised musculoskeletal diagnosis and surgical planning. Despite this, the overall accuracy of MRI, with or without intra-articular contrast, can be variable.

METHODS

In this prospective non-randomised analysis, 200 participants (74.5% males) with suspected shoulder injuries underwent MRI (41.0%) or MRA followed by arthroscopy. A study specific proforma was developed to ensure consistency of reporting by radiologists and surgeons. The reports were compared to assess the predictive power of MRI/MRA. Specific assessment of rotator cuff tendon appearance, long head of biceps (LHB) tendon appearance, position and anchor, subacromial space, glenoid labrum and humeral cartilage grade were included.

RESULTS

Shoulder MRA demonstrated a higher agreement with arthroscopy than MRI for supraspinatus, infraspinatus and subscapularis tendon appearance (κ = 0.77 vs. κ = 0.61, κ = 0.55 vs. κ = 0.53 and κ = 0.58 vs. κ = 0.46 respectively). There were also superior agreement rates with MRA compared to MRI for LHB tendon appearance (κ = 0.70 vs. κ =0.54) and position (κ = 0.89 vs. κ = 0.72). As an overall assessor of shoulder pathology we found significantly higher total agreement scores when MRA was used (p = 0.002).

DISCUSSION

Whilst magnetic resonance imaging with arthrography is an extremely useful tool to assess underlying pathological shoulder states it does not confer 100% accuracy. In cases whereby this modality is inconclusive, an examination under anaesthesia and diagnostic arthroscopic assessment for the detection of intra-articular shoulder pathology may be considered.

Machine learning for identifying relevant publications in updates of systematic reviews of diagnostic test studies

Updating systematic reviews is often a time-consuming process that involves a lot of human effort and is therefore not conducted as often as it should be. The aim of our research project was to explore the potential of machine learning methods to reduce human workload. Furthermore, we evaluated the performance of deep learning methods in comparison to more established machine learning methods. We used three available reviews of diagnostic test studies as the data set. In order to identify relevant publications, we used typical text pre-processing methods. The reference standard for the evaluation was the human-consensus based on binary classification (inclusion, exclusion). For the evaluation of the models, various scenarios were generated using a grid of combinations of data preprocessing steps. Moreover, we evaluated each machine learning approach with an approach-specific predefined grid of tuning parameters using the Brier score metric. The best performance was obtained with an ensemble method for two of the reviews, and by a deep learning approach for the other review. Yet, the final performance of approaches strongly depends on data preparation. Overall, machine learning methods provided reasonable classification. It seems possible to reduce human workload in updating systematic reviews by using machine learning methods. Yet, as the influence of data preprocessing on the final performance seems to be at least as important as choosing the specific machine learning approach, users should not blindly expect a good performance by solely using approaches from a popular class, such as deep learning.

Shoulder Pain of Spinal Source in the Military: A Case Series

Musculoskeletal injury (MSI) presents the greatest threat to military mission readiness. Atraumatic shoulder pain is a common military MSI that often results in persistent functional limitations. Shoulder orthopedic evaluation presents many diagnostic challenges, due in part to the possibility of a spinal source of symptoms. This case series outlines the use of mechanical diagnosis and therapy to screen the cervical and thoracic spine in active duty (AD) service members (SMs) with a chief complaint of unchanging or worsening shoulder pain. All three SMs previously received shoulder-specific diagnoses from experienced clinicians, yet repeated movements revealed a possible spinal nociceptive driver that guided targeted intervention. Treatment directed only at the cervical spine resulted in a clinically important improvement within an average of 10 days from the initial evaluation, return to duty (RTD) within an average of 32 days, and continued resolution at 3 months. SMs can independently complete the screening process with guidance from healthcare providers, ultimately shaping the treatment strategy and possibly facilitating self-management of future recurrence. This case series demonstrates that identification of shoulder pain of spinal source in the military population may be an important step in facilitating timely RTD. These cases also highlight the use of a standardized, systematic method to screen the cervical and thoracic spine that concurrently reveals the indicated treatment. Further research to determine the prevalence of shoulder pain of spinal source in the AD population and its impact on RTD rates has the potential to reduce the substantial burden of MSI in the military.

Clinical Tests of the Shoulder: Accuracy and Extension Using Dynamic Ultrasound

Shoulder pain is a common musculoskeletal disorder that has a significant impact on the patient's quality of life and functional health. Because the shoulder joint is a complex structure, the relevant symptoms of shoulder pain may not directly reflect the underlying pathology. Hence, several shoulder tests have been developed to examine shoulder problems, and their diagnostic accuracy varies. Familiarization with the performance of those physical tests and their strength and limitation are of utmost importance for physicians dealing with shoulder disorders. Therefore, the present narrative review focuses on summarizing the most commonly used tests in physical examination and their diagnostic performance on several shoulder pathologies. This article also discusses how ultrasound imaging can serve as an extension of those tests.

Subacromial impingement syndrome: a survey of Italian physiotherapists and orthopaedics on diagnostic strategies and management modalities

BACKGROUND AND AIM

The subacromial impingement syndrome (SIS) represents a common cause of disability in approximately 74% of patients with Shoulder Pain (SP). Even if contemporary research suggests that this mechanism is not (always) the dominant driver in SP, SIS is still a source of debate among scholars and clinicians. From a clinical point of view, evidence has suggested that clinicians can use both medical and physiotherapy approaches as effective methods to treat SIS.This survey aims to investigate models of management of patients with SIS in a sample of Italian physiotherapist specialists (Orthopaedic Manipulative Physical Therapists, -OMPTs-) and orthopaedic surgeons.

MATERIALS AND METHODS

An online survey with 29-item questionnaire was administered to assess the knowledge of OMPTs and orthopaedic surgeons about: a) strategies of clinical examination; b) the role of imaging in the diagnostic process; c) the physiotherapy management; and d) the pharmacological and surgical management in patients with SIS.

RESULTS

Six-hundred and twenty-nine respondents completed the survey (511 OMPTs (79.97%) and 128 orthopaedic surgeons (20.03%)). Ninety-two percent (n = 470) of the OMPTs and 80.5% (n = 103) of orthopaedic surgeons stated that in patients with SIS, a combination of diagnostic tests produced better accuracy (p = < 0.001). Twenty point seven % of OMPTs (n = 106) and 4.7% of orthopaedic surgeon (n = 6) stated that the Lift off was the most specific test (p = < 0.001). Four-hundred-and-twenty-four OMPTs (83%) and 40 orthopaedic surgeons (31.3%) answered that the gold standard for diagnosis of a patient with SIS are history and clinical examination (p < 0.001).

CONCLUSION

OMPTs and orthopaedic surgeons approach patients with SIS differently during both the assessment and the treatment. OMPTs appear to be appropriate in planning and managing clinical examination and therapeutic strategies to use with patients with SIS.

Interobserver Reliability in Imaging-Based Fracture Union Assessment-Two Systematic Reviews

OBJECTIVES

(A) To investigate the specialty of observers involved in imaging-based assessment of bone fracture union in recent orthopaedic trials and (B) to provide a general overview of observer differences (in terms of interobserver reliability) in radiologic fracture union assessment that have been reported between surgeons and radiologists.

DATA SOURCES

Two separate systematic reviews (A, B) of English-, German-, and French-language articles in MEDLINE and Embase databases using the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines were done, with the following time frames: (A) January 2016-August 2017 and (B) through November 2017.

STUDY SELECTION

(A) Clinical trials of surgical fracture treatment evaluating radiologic (non) union. (B) Interobserver studies reporting kappa-values or intraclass correlation coefficients as reliability coefficient for radiologic fracture union assessment. Inclusion criteria for both reviews were fractures of the appendicular skeleton and the use of radiographs or computed tomography.

DATA EXTRACTION

Data were independently retrieved by 2 reviewers.

DATA SYNTHESIS

Descriptive statistics and percentages were reported.

RESULTS

(A) Forty-eight trials were included, whereof 33 (68%) did not report the observer's specialty. Six trials (13%) reported surgeon observers only, and 6 (13%) reported radiologist observers only. The median number of observers is 1 (interquartile range, 1-2). (B) Thirty-one interobserver studies were included, whereof 11 (35%) included at least 1 surgeon and 1 radiologist. Interobserver reliability varied considerably across the various fracture types studied and outcome scale used and was often unsatisfactory (kappa or intraclass correlation coefficients of <0.7).

CONCLUSIONS

In most trials providing observer's characteristics, radiologic fracture union was either rated by 1 surgeon or 1 radiologist. As interobserver reliability can be unsatisfactory, we recommend surgeons and radiologists to further intensify collaboration and trials to include at least 2 observers and associated reliability statistics.

Medical Diagnostic Tests: A Review of Test Anatomy, Phases, and Statistical Treatment of Data

Diagnostic tests are approaches used in clinical practice to identify with high accuracy the disease of a particular patient and thus to provide early and proper treatment. Reporting high-quality results of diagnostic tests, for both basic and advanced methods, is solely the responsibility of the authors. Despite the existence of recommendation and standards regarding the content or format of statistical aspects, the quality of what and how the statistic is reported when a diagnostic test is assessed varied from excellent to very poor. This article briefly reviews the steps in the evaluation of a diagnostic test from the anatomy, to the role in clinical practice, and to the statistical methods used to show their performances. The statistical approaches are linked with the phase, clinical question, and objective and are accompanied by examples. More details are provided for phase I and II studies while the statistical treatment of phase III and IV is just briefly presented. Several free online resources useful in the calculation of some statistics are also given.

A prospective study of patients with shoulder pain and Mechanical Diagnosis and Therapy (MDT)

Objectives: A prospective observational cohort study was conducted to (1) determine the prevalence of Mechanical Diagnosis and Therapy (MDT) syndromes for patients with shoulder impairments and (2) report the interaction between MDT classification and clinical outcomes, including pain intensity and disability, at discharge.Methods: Clinical outcome measures were completed at intake and discharge by 115 patients. A two-way mixed model analysis of variance with subsequent pairwise comparisons was done to examine differences in clinical outcomes between the following MDT classifications: Shoulder Derangement, Shoulder Dysfunction, and Other.Results: The primary findings were that (1) 44.3 (35.3, 53.4), 40.0 (31.0, 48.9), and 15.6 (9.0, 22.3) percent of patients' conditions were classified as Shoulder Derangement, Shoulder Dysfunction, and Other, respectively, (2) all groups managed via MDT methods made clinically significant improvements in disability and pain intensity at discharge, (3) a statistically significant difference in pain intensity at discharge was observed between the Shoulder Derangement and the Shoulder Dysfunction classifications (p = 0.01), and (4) patients with the Shoulder Derangement classification were discharged, on average, 35.3 days earlier than the Shoulder Dysfunction classification and 28.3 days earlier than the Other classification.Discussion: This study confirms previous reports that the Shoulder Derangement and Shoulder Dysfunction classifications are common and represent distinct clinical trajectories when assessed and managed via MDT methods.

Work participation and working life expectancy after a disabling shoulder lesion

Objective

To examine the impact of a disabling non-traumatic shoulder lesion on work participation and working life expectancy.

Methods

From a 70% random sample of the Finnish population, we selected 30–59-year-old wage earners with prolonged sickness absence due to a shoulder lesion (n=7644). We followed the persons from 2006 to 2014 and calculated the proportion of time a person spent in different work participation statuses. The associations of potential determinants with a preterm exit from paid employment were tested using Cox regression. Years expected to be spent in different work participation statuses were estimated applying the Sullivan method for healthy life expectancy.

Results

During 9 years of follow-up time spent at work was reduced from 77.7% to 46.7%, and 15.8% of the persons were granted disability retirement, mostly due to shoulder and other musculoskeletal diseases. Compared with the general population persons with a disabling shoulder disease are expected to lose from 1.8 to 8.1 years of working life, depending on their age. Age, gender, education, duration of initial sickness absence due to the shoulder lesion, not being able to return to work sustainably and participation in vocational rehabilitation predicted preterm exit from work. Heavy lifting increased the risk of preterm exit marginally.

Conclusions

Working life expectancy is markedly reduced in persons with a disabling shoulder lesion, mainly because of disability retirement due to musculoskeletal problems. Clinicians should consider interventions targeted at improving musculoskeletal functioning and necessary work modifications before shoulder problems become chronic or the persons develop disabling comorbid musculoskeletal conditions.

Interrater agreement and reliability of clinical tests for assessment of patients with shoulder pain in primary care

Background: There is limited information about the agreement and reliability of clinical shoulder tests. Objectives: To assess the interrater agreement and reliability of clinical shoulder tests in patients with shoulder pain treated in primary care. Methods: Patients with a primary report of shoulder pain underwent a set of 21 clinical shoulder tests twice on the same day, by pairs of independent physical therapists. The outcome parameters were observed and specific interrater agreement for positive and negative scores, and interrater reliability (Cohen's kappa (κ)). Positive and negative interrater agreement values of ≥0.75 were regarded as sufficient for clinical use. For Cohen's κ, the following classification was used: <0.20 poor, 0.21-0.40 fair, 0.41-0.60 moderate, 0.61-0.80 good, 0.81-1.00 very good reliability. Participating clinics were randomized in two groups; with or without a brief practical session on how to conduct the tests. Results: A total of 113 patients were assessed in 12 physical therapy practices by 36 physical therapists. Positive and negative interrater agreement values were both sufficient for 1 test (the Full Can Test), neither sufficient for 5 tests, and only sufficient for either positive or negative agreement for 15 tests. Interrater reliability was fair for 11 tests, moderate for 9 tests, and good for 1 test (the Full Can Test). An additional brief practical session did not result in better agreement or reliability. Conclusion: Clinicians should be aware that interrater agreement and reliability for most shoulder tests is questionable and their value in clinical practice limited.

YouTube as a learning tool for four shoulder tests

AIM

To analyze the use of YouTube videos as educational tools for four physical examinations of the shoulder: the Neer, Hawkins, empty can, and drop arm tests.

BACKGROUND

Video-based education, which is accompanied by text-based education, can be an effective education method, especially in learning medical skills. Medical students and doctors in training often use YouTube videos to share medical education materials, and more systematic review of the reliability of these videos is required.

METHODS

A search of YouTube was conducted using four keywords: 'Neer test,' 'Hawkins test,' 'empty can test,' and 'drop arm test.' Two physicians reviewed each video and recorded a variety of characteristics (date uploaded, number of views, likes and dislikes, and upload source). In addition, they scored and categorized the videos into four groups: 'very useful,' 'somewhat useful,' 'not useful,' and 'misleading.' Videos containing inappropriate content were classified as 'misleading.' Finally, the correlations of each video's usefulness with viewers' preferences and the upload source were analyzed.

RESULTS

A total of 400 videos were assessed and 200 videos were adopted which yield eligible criteria. Out of 200 videos, 51 videos were very useful and 32 were misleading. Significant correlations were observed between the video's usefulness and the uploaded source, as well as between the video's usefulness and viewers' preferences, such as the number of views, views per day, and number of likes. The proportion of videos classified as 'very useful' was highest (58.6%) among those uploaded by physicians and lowest (12.7%) among those uploaded by individuals. Videos uploaded by individuals had significantly lower values reflecting viewer preferences than did videos uploaded by physicians.

CONCLUSION

YouTube videos could be used as learning sources for shoulder physical examinations after the application of appropriate filtering processes, such as review of the upload source and viewers' preferences.

The management of shoulder impingement and related disorders: A systematic review on diagnostic accuracy of physical tests and manual therapy efficacy

BACKGROUND

Diagnostic accuracy of physical tests and effectiveness of musculoskeletal rehabilitation of shoulder disorders are still debated.

OBJECTIVES

To investigate diagnostic accuracy of physical tests, efficacy of physiotherapy and coherence between target of assessment and intervention for shoulder impingement and related disorders like bursitis, rotator cuff and long head biceps tendinopathy and labral lesions.

METHODS

A systematic search of four databases was conducted, including RCTs and cross-sectional studies. Cochrane Risk of Bias and QUADAS-2 were adopted for critical appraisal and a narrative synthesis was undertaken.

RESULTS

6 RCTs and 2 cross-sectional studies were appraised. Studies presented low to moderate risk of bias. There is a lack of evidence to support the mechanical construct guiding the choice of physical tests for diagnosis of impingement. Manual techniques appear to yield better results than placebo and ultrasounds, but not better than exercise therapy alone. Discrepancy between the goal of assessment strategies and the relative proposed treatments were present together with high heterogeneity in terms of selection of patients, type of endpoints and follow-ups.

CONCLUSIONS

Musculoskeletal physiotherapy seems to be an effective treatment for patients with shoulder pain although it is still based on weak diagnostic clinical instruments. The adoption of more functional and prognostic assessment strategies is advisable to improve coherence between evaluation and treatment.

Consistency of commonly used orthopedic special tests of the shoulder when used with the McKenzie system of mechanical diagnosis and therapy

BACKGROUND

Shoulder Orthopedic Special Tests (OSTs) are used to assist with diagnosis in shoulder disorders. Issues with reliability and validity exist, making their interpretation challenging. Exploring OST results on repeated testing within Mechanical Diagnosis and Therapy (MDT) shoulder classifications may offer insight into the poor performance of these tests.

OBJECTIVES

To investigate in patients with shoulder complaints, whether MDT classifications affect the agreement of OST results over the course of treatment.

METHODS

An international group of MDT clinicians recruited 105 patients with shoulder problems. Three commonly used OSTs (Empty Can, Hawkins-Kennedy, and Speed's tests) were utilized. Results of the OSTs were collected at sessions 1, 3, 5 and 8, or at discharge from an MDT classification-based treatment. The Kappa statistic was utilized to determine the agreement of the OST results over time for each of the MDT classifications.

RESULTS

The overall Kappa values for Empty Can, Hawkins-Kennedy and Speed's tests were 0.28 (SE = 0.07), 0.28 (SE = 0.07) and 0.29 (SE = 0.07), respectively. The highest level of agreement was for Articular Dysfunction for the Empty Can test (0.84, SE = 0.19). For shoulder Derangements, there was no agreement for any of the OSTs (P values > 0.05).

CONCLUSION

The lack of agreement when the OSTs were consecutively tested in the presence of the MDT Derangement classification contrasted with the other MDT classifications. The presence of Derangement was responsible for reducing the overall agreement of commonly used OSTs and may explain the poor consistency for OSTs.