1
|
Warneke K, Siegel SD, Drabow J, Lohmann LH, Jochum D, Freitas SR, Afonso J, Konrad A. Examiner experience moderates reliability of human lower extremity muscle ultrasound measurement - a double blinded measurement error study. Ultrasound J 2025; 17:20. [PMID: 40138073 PMCID: PMC11947354 DOI: 10.1186/s13089-025-00424-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2025] [Accepted: 02/27/2025] [Indexed: 03/29/2025] Open
Abstract
Structural muscle properties are critical in health and athletic settings, with magnetic resonance imaging considered the gold standard assessment procedure under static conditions due to its reliability and objectivity. Practical limitations, including cost and accessibility, have led to the increasing use of ultrasound as an alternative for skeletal muscle morphological parameters. However, ultrasound measurements are sensitive to evaluation conditions and assessor experience, which has not been sufficiently explored, yet. Therefore, this study investigated the influence of assessor experience on the reliability of ultrasound measurements. A double-blind design was used, involving an experienced assessor (> 12,000 images for several years) and multiple inexperienced assessors (< 100 images) to collect data from 39 recreationally active participants. Measurements of muscle architecture were conducted in the leg muscles over two consecutive days, generating 1,248 ultrasound images. Relative and absolute reliability were analyzed using intraclass correlation coefficients (ICCs), standard error of measurement, minimal detectable change, mean absolute error (MAE), mean absolute percentage error (MAPE) and Bland-Altman analyses. Relative reliability was good to excellent in all measurement spots and time-points for muscle thickness (ICC = 0.76-0.98) irrespective of assessor experience, except for the inter-day comparison for the gastrocnemius lateralis by the inexperienced assessors, (ICC = 0.58). The pennation angle assessment ranged from insufficient to excellent reliability (ICC = 0.18-0.94) and experience contributed greatly to better results. The random error for the inexperienced assessors was reflected in two- to three-times higher MAEs/MAPEs and limits of agreement in the Bland-Altman analyses, respectively. The findings emphasize the importance of experience and standardization in achieving reliable ultrasound data, particularly for (a) sensitive parameters like the pennation angle and/or (b) inter-day, intra-subject comparisons.
Collapse
Affiliation(s)
- Konstantin Warneke
- Department for Movement Science and Exercise Physiology, Friedrich Schiller University Jena, Jena, Germany.
- Institute of Human Movement Science, Sport and Health, University of Graz, Graz, Austria.
- Institute of Psychology, Leuphana University Lüneburg, Lüneburg, Germany.
| | - Stanislav D Siegel
- Department for Movement Science and Exercise Physiology, Friedrich Schiller University Jena, Jena, Germany
| | - Jonas Drabow
- Department for Movement Science and Exercise Physiology, Friedrich Schiller University Jena, Jena, Germany
| | - Lars H Lohmann
- Department for Movement Science and Exercise Physiology, Friedrich Schiller University Jena, Jena, Germany
| | - Daniel Jochum
- Department of Health Science and Technology, ETH Zürich, Zürich, Switzerland
| | - Sandro R Freitas
- Neuromuscular Research Lab, Faculty of Human Kinetics, University of Lisbon, Lisbon, Portugal
| | - José Afonso
- Centre of Research, Education, Innovation, and Intervention in Sport (CIFI 2 D), Faculty of Sport, University of Porto, Porto, Portugal
| | - Andreas Konrad
- Institute of Human Movement Science, Sport and Health, University of Graz, Graz, Austria
| |
Collapse
|
2
|
Lohmann LH, Hillebrecht M, Schiemann S, Warneke K. Stressing the Relevance of Differentiating between Systematic and Random Measurement Errors in Ultrasound Muscle Thickness Diagnostics. SPORTS MEDICINE - OPEN 2024; 10:89. [PMID: 39147945 PMCID: PMC11327229 DOI: 10.1186/s40798-024-00755-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 07/22/2024] [Indexed: 08/17/2024]
Abstract
BACKGROUND The majority of studies that explore changes in musculature following resistance training interventions or examine atrophy due to immobilization or sarcopenia use ultrasound imaging. While most studies assume acceptable to excellent reliability, there seems to be unawareness of the existing absolute measurement errors. As early as 1998, methodological research addressed a collective unawareness of the random measurement error and its practical indications. Referring to available methodological approaches, within this work, we point out the limited value of focusing on relative, correlation-based reliability indices for the interpretability in scientific research but also for clinical application by assessing 1,512 muscle thickness values from more than 400 ultrasound images. To account for intra- and inter-day repeatability, data were collected on two consecutive days within four testing sessions. Commonly-stated reliability values (ICC, CV, SEM and MDC) were calculated, while evidence-based agreement analyses were applied to provide the accompanied systematic and random measurement error. RESULTS While ICCs in the range of 0.832 to 0.998 are in accordance with the available literature, the mean absolute percentage error ranges from 1.34 to 20.38% and the mean systematic bias from 0.78 to 4.01 mm (all p ≤ 0.013), depending on the measurement time points chosen for data processing. CONCLUSIONS In accordance with prior literature, a more cautious interpretation of relative reliability values should be based on included systematic and random absolute measurement scattering. Lastly, this paper discusses the rationale for including different measurement error statistics when determining the validity of pre-post changes, thus, accounting for the certainty of evidence.
Collapse
Affiliation(s)
- Lars Hubertus Lohmann
- University Sport Center, Carl von Ossietzky University Oldenburg, Oldenburg, Germany.
- Department of Human Movement Science and Exercise Physiology, Institute of Sport Science, Friedrich Schiller University, Jena, Germany.
| | - Martin Hillebrecht
- University Sport Center, Carl von Ossietzky University Oldenburg, Oldenburg, Germany
| | - Stephan Schiemann
- Institute of Exercise, Sport and Health, Leuphana University, Lüneburg, Germany
| | - Konstantin Warneke
- Institute of Exercise, Sport and Health, Leuphana University, Lüneburg, Germany
- Institute of Sport Sciences, University of Klagenfurt, Klagenfurt am Wörthersee, Austria
| |
Collapse
|
3
|
Orsso CE, Vieira FT, Basuray N, Duke RL, Pakseresht M, Rubin DA, Ajamian F, Ball GDC, Field CJ, Heymsfield SB, Siervo M, Prado CM, Haqq AM. The metabolic load-capacity model and cardiometabolic health in children and youth with obesity. Pediatr Obes 2024; 19:e13098. [PMID: 38263541 DOI: 10.1111/ijpo.13098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 11/20/2023] [Accepted: 12/15/2023] [Indexed: 01/25/2024]
Abstract
BACKGROUND The metabolic load-capacity index (LCI), which represents the ratio of adipose to skeletal muscle tissue-containing compartments, is potentially associated with cardiometabolic diseases. OBJECTIVES To examine the associations between the LCI and cardiometabolic risk factors in children and youth with obesity. METHODS This is a cross-sectional study including 10-18 years-old participants with a BMI of ≥95th . LCI by air-displacement plethysmography (ADP) was calculated as fat mass divided by fat-free mass, and LCI by ultrasound (US) as subcutaneous adipose tissue divided by skeletal muscle thickness. Sex-specific medians stratified participants into high versus low LCI. Single (inflammation, insulin resistance, dyslipidemia and hypertension) and clustered cardiometabolic risk factors were evaluated. Linear and logistic regression models tested the associations between these variables, adjusted for sexual maturation. RESULTS Thirty-nine participants (43.6% males; 59% mid-late puberty) aged 12.5 (IQR: 11.1-13.5) years were included. LCI by ADP was positively associated with markers of inflammation and dyslipidemia; having a higher LCI predicted dyslipidemia in logistic regression. Similarly, LCI by US was positively associated with markers of dyslipidemia and blood pressure. In mid-late pubertal participants, LCI by US was positively associated with markers of insulin resistance and inflammation. CONCLUSIONS Participants with unfavourable cardiometabolic profile had higher LCI, suggesting its potential use for predicting and monitoring cardiometabolic health in clinical settings.
Collapse
Affiliation(s)
- Camila E Orsso
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
| | - Flavio T Vieira
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
- Department of Pediatrics, University of Alberta, Edmonton, Alberta, Canada
| | - Nandini Basuray
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
| | - Reena L Duke
- Department of Pediatrics, University of Alberta, Edmonton, Alberta, Canada
| | - Mohammadreza Pakseresht
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
- Cancer Research & Analytics, Cancer Care Alberta, Alberta Health Services, Edmonton, Alberta, Canada
| | - Daniela A Rubin
- Department of Kinesiology, California State University Fullerton, Fullerton, California, USA
| | - Faria Ajamian
- Department of Pediatrics, University of Alberta, Edmonton, Alberta, Canada
| | - Geoff D C Ball
- Department of Pediatrics, University of Alberta, Edmonton, Alberta, Canada
| | - Catherine J Field
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
| | - Steven B Heymsfield
- Pennington Biomedical Research Center Baton Rouge, Baton Rouge, Louisiana, USA
| | - Mario Siervo
- School of Population Health, Curtin University, Perth, Australia
- Curtin Dementia Centre of Excellence, enAble Institute, Curtin University, Perth, Australia
| | - Carla M Prado
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
| | - Andrea M Haqq
- Department of Agricultural, Food & Nutritional Science, University of Alberta, Edmonton, Alberta, Canada
- Department of Pediatrics, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
4
|
Liu W, Wu HD, Ling YT, Shea QTK, Nazari V, Zheng YP, Ma CZH. Reliability and validity of assessing lower-limb muscle architecture of patients with cerebral palsy (CP) using ultrasound: A systematic review. JOURNAL OF CLINICAL ULTRASOUND : JCU 2023; 51:1212-1222. [PMID: 37334435 DOI: 10.1002/jcu.23498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2023] [Revised: 05/11/2023] [Accepted: 05/16/2023] [Indexed: 06/20/2023]
Abstract
AIMS To investigate the reliability, validity, and level of evidence of applying ultrasound in assessing the lower-limb muscles of patients with cerebral palsy (CP). METHOD Publications in Medline, PubMed, Web of Science, and Embase were searched on May 10, 2023, to identify and examine relevant studies investigating the reliability/validity of ultrasound in evaluating the architecture of CP lower-limb muscles systematically, following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis 2020 guidelines. RESULTS Out of 897 records, 9 publications with 111 CP participants aged 3.8-17.0 years were included (8 focused on intra-rater and inter-rater reliability, 2 focused on validity, and 4 were with high quality). The ultrasound-based measurements of muscle thickness (intra-rater only), muscle length, cross-sectional area, muscle volume, fascicle length, and pennation angle showed high reliability, with the majority of intraclass correlation coefficient (ICC) values being larger than 0.9. Moderate-to-good correlations between ultrasound and magnetic resonance imaging measurements existed in muscle thickness and cross-sectional area (0.62 ≤ ICC ≤ 0.82). INTERPRETATION Generally, ultrasound has high reliability and validity in evaluating the CP muscle architecture, but this is mainly supported by moderate and limited levels of evidence. More high-quality future studies are needed.
Collapse
Affiliation(s)
- Wei Liu
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China
- Department of Prosthetic and Orthotic Engineering, School of Rehabilitation, Kunming Medical University, Kunming, China
| | - Hui Dong Wu
- Department of Prosthetic and Orthotic Engineering, School of Rehabilitation, Kunming Medical University, Kunming, China
| | - Yan To Ling
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Queenie Tsung Kwan Shea
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Vaheh Nazari
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China
| | - Yong-Ping Zheng
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| | - Christina Zong-Hao Ma
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong, China
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
5
|
Klawitter F, Walter U, Axer H, Ehler J. [Intensive care unit-acquired weakness-Diagnostic value of neuromuscular ultrasound]. DIE ANAESTHESIOLOGIE 2023; 72:543-554. [PMID: 37310449 DOI: 10.1007/s00101-023-01300-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/25/2023] [Indexed: 06/14/2023]
Abstract
Intensive care unit-acquired weakness (ICUAW) is one of the most common neuromuscular complications in intensive care medicine. The clinical diagnosis and assessment of the severity using established diagnostic methods (e.g., clinical examination using the Medical Research Council Sum Score or electrophysiological examination) can be difficult or even impossible, especially in sedated, ventilated and delirious patients. Neuromuscular ultrasound (NMUS) has increasingly been investigated in ICUAW as an easy to use noninvasive and mostly patient compliance-independent diagnostic alternative. It has been shown that NMUS appears to be a promising tool to detect ICUAW, to assess the severity of muscular weakness and to monitor the clinical progression. Further studies are needed to standardize the methodology, to evaluate the training effort and to optimize outcome predication. The formulation of an interdisciplinary neurological and anesthesiological training curriculum is warranted to establish NMUS as a complementary diagnostic method of ICUAW in daily clinical practice.
Collapse
Affiliation(s)
- Felix Klawitter
- Klinik und Poliklinik für Anästhesiologie, Intensivmedizin und Schmerztherapie, Universitätsmedizin Rostock, Schillingallee 35, 18057, Rostock, Deutschland
| | - Uwe Walter
- Klinik und Poliklinik für Neurologie, Universitätsmedizin Rostock, Gehlsheimer Str. 20, 18147, Rostock, Deutschland
| | - Hubertus Axer
- Klinik für Neurologie, Universitätsklinikum Jena, Am Klinikum 1, 07747, Jena, Deutschland
| | - Johannes Ehler
- Klinik für Anästhesiologie und Intensivmedizin, Universitätsklinikum Jena, Am Klinikum 1, 07747, Jena, Deutschland.
| |
Collapse
|