Inter-rater reliability of seven neurolaryngologists in laryngeal EMG signal interpretation

Reliability and Diagnostic Accuracy of Semi-Automated and Automated Acoustic Quantification of Vocal Tremor Characteristics

PURPOSE

This study compared three methods of acoustic algorithm-supported extraction and analysis of vocal tremor properties (i.e., rate, extent, and regularity of intensity level and fundamental frequency modulation): (a) visual perception and manual data extraction, (b) semi-automated data extraction, and (c) fully automated data extraction.

METHOD

Forty-five midvowel sustained [a:] and [i:] audio recordings were collected as part of a scientific project to learn about the physiologic substrates of vocal tremor. This convenience data set contained vowels with a representative variety in vocal tremor severity. First, the vocal tremor properties in intensity level and fundamental frequency tracks were visually inspected and manually measured using Praat software. Second, the vocal tremor properties were determined using two Praat scripts: automated with the script of Maryn et al. (2019) and semi-automated with an adjusted version of this script to enable the user to intervene with the signal processing. The reliability of manual vocal tremor property measurement was assessed using the intraclass correlation coefficient. The properties as measured with the two scripts (automated vs. semi-automated) were compared with the manually determined properties using correlation and diagnostic accuracy statistical methods.

RESULTS

With intraclass correlation coefficients between .770 and .914, the reliability of the manual method was acceptable. The semi-automated method correlated with manual property measures better and was more accurate in diagnosing vocal tremor than the automated method.

DISCUSSION

Manual acoustic measurement of vocal tremor properties can be laborious and time-consuming. Automated or semi-automated acoustic methods may improve efficiency in vocal tremor property measurement in clinical as well as research settings. Although both Praat script-supported methods in this study yielded acceptable validity with the manual data measurements as a referent, the semi-automated method showed the best outcomes.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.28873088.

Utility of laryngeal electromyography for establishing prognosis and individualized treatment after laryngeal neuropathies

Laryngeal electromyography (LEMG) is a technique used to characterize neuropathic injuries to the recurrent laryngeal nerve (RLN) and superior laryngeal nerve (SLN). The RLN and SLN innervate the laryngeal muscles to produce vocal fold (VF) motion and elongation, respectively. VF motion deficiencies can affect voice, swallowing, and breathing, which can greatly affect a patient's quality of life. Neuropathy-related VF motion deficiencies most often result from surgical interventions to the skull base, neck, or chest likely due to the circuitous route of the RLN. LEMG is ideally conducted by an electromyographer and an otolaryngologist using a team-approach. LEMG is a powerful diagnostic tool to better characterize the extent of neuropathic injury and thus clarify the prognosis for VF motion recovery. This updated review discusses current techniques to improve the positive and negative predictive values of LEMG using laryngeal synkinesis and quantitative LEMG. Synkinesis can be diagnosed by comparing motor unit potential amplitude during vocalization and sniff maneuvers when recording within adductor muscles. Quantitative turns analysis can measure motor unit recruitment to avoid subjective descriptions of reduced depolarization during vocalization, and normal values are >400 turns/s. By integrating qualitative, quantitative, and synkinetic data, a robust prognosis can help clinicians determine if VF weakness will recover. Based on LEMG interpretation, patient-centered treatment can be developed to include watchful waiting, temporary VF augmentation, or definitive medialization procedures and laryngeal reinnervation.

Current opinion on laryngeal electromyography

PURPOSE

This study evaluates expert opinion on laryngeal electromyography (LEMG).

METHODS

A cross-sectional design was used to conduct an online survey of LEMG experts in 2021. They were questioned about the number LEMG performed annually, type of electrodes used, sector worked in, pain during the test, placement of the needle electrodes, interpretation of electrical muscle parameters, diagnosis of neuromuscular injury, prognostic sensitivity in vocal fold paralysis (VFP), laryngeal dystonia, tremor and synkinesis and quantifying LEMG.

RESULTS

Thirty-seven professionals answered (23 Spanish and 14 from other countries), with a response rate of 21.56%. All physicians used LEMG. 91.9% had one- or two-years' experience and 56.8% performed 10-40 LEMG per year. 70.3% were otolaryngologists and 27%, neurologists. In 89.1% of cases, a team of electrodiagnostic physician and otolaryngologist performed LEMG. 91.3% of Spanish respondents worked in Public Health, 7.14% of other nationalities; 37.8% in a university department. Bipolar concentric needles electrodes were used by 45.9% and monopolar concentric by 40.5%. 57% professionals considered good patients' tolerance to the test. LEMG sensitivity was regarded as strong, median and interquartile range were 80.0 [60.0;90.0] to diagnose peripheral nerve injuries, less for other levels of lesions, and strong to evaluate prognosis, 70.0 [50.0;80.0]. Respondents believe locate the thyroarytenoid and the cricothyroid muscles with the needle, 80.0 [70.0;90.0], as opposed to 20.0 [0.00;60.0] the posterior cricoarytenoid. The interpretation of the electrical parts of the LEMG was strong, 80.0 [60.0;90.0]. LEMG identify movements disorders, 60.0 [20.0;80.0], and synkinesis, 70.0 [30.0;80.0]. The professionals prefer quantitative LEMG, 90.0 [60.0;90.0].

CONCLUSIONS

The experts surveyed consider LEMG that is well tolerated by patients. The insertional and spontaneous activity, recruitment and waveform morphology can be assessed easily. LEMG is mainly useful in the study of peripheral nerve injuries, and its value in VFP prognosis is considered strong.

Vocal Fold Motion Impairment in Neurodegenerative Diseases

Vocal fold motion impairment (VFMI) is the inappropriate movement of the vocal folds during respiration, leading to vocal fold adduction and/or abduction problems and causing respiratory and vocal impairments. Neurodegenerative diseases (NDDs) are a wide range of disorders characterized by progressive loss of neurons and deposition of altered proteins in the brain and peripheral organs. VFMI may be unrecognized in patients with NDDs. VFMI in NDDs is caused by the following: laryngeal muscle weakness due to muscular atrophy, caused by brainstem and motor neuron degeneration in amyotrophic lateral sclerosis; hyperactivity of laryngeal adductors in Parkinson's disease; and varying degrees of laryngeal adductor hypertonia and abductor paralysis in multiple system atrophy. Management of VFMI depends on whether there is a presence of glottic insufficiency or insufficient glottic opening with/without severe dysphagia. VFMI treatment options for glottic insufficiency range from surgical interventions, including injection laryngoplasty and medialization thyroplasty, to behavioral therapies; for insufficient glottic opening, various options are available based on the severity and underlying cause of the condition, including continuous positive airway pressure therapy, botulinum toxin injection, tracheostomy, vocal fold surgery, or a combination of interventions. In this review, we outline the mechanisms, clinical features, and management of VFMI in NDDs and provide a guide for physicians who may encounter these clinical features in their patients. NDDs are always progressive; hence, timely evaluation, proper diagnosis, and appropriate management of the patient will greatly affect their vocal, respiratory, and swallowing functions as well as their quality of life.

Simulating and estimating agreement in the presence of multiple raters and covariates

Cohen's and Fleiss's kappa are popular estimators for assessing agreement among two and multiple raters, respectively, for a binary response. While additional methods have been developed to account for multiple raters and covariates, they are not always applicable, rarely used, and none simplify to Cohen's kappa. Furthermore, there are no methods to simulate Bernoulli observations under the kappa agreement structure such that the developed methods could be adequately assessed. This manuscript overcomes these shortfalls. First, we developed a model-based estimator for kappa that accommodates multiple raters and covariates through a generalized linear mixed model and encompasses Cohen's kappa as a special case. Second, we created a framework to simulate dependent Bernoulli observations that upholds all 2-tuple pair of rater's kappa agreement structure and includes covariates. We used this framework to assess our method when kappa was nonzero. Simulations showed that Cohen's and Fleiss's kappa estimates were inflated unlike our model-based kappa. We analyzed an Alzheimer's disease neuroimaging study and the classic cervical cancer pathology study. The proposed model-based kappa and advancement in simulation methodology demonstrates that the popular approaches of Cohen's and Fleiss's kappa are poised to yield invalid conclusions while our work overcomes shortfalls, leading to improved inferences.

Evaluation of Early Concrete Damage Caused by Chloride-Induced Steel Corrosion Using a Deep Learning Approach Based on RNN for Ultrasonic Pulse Waves

The objective of this study is to explore the feasibility of using ultrasonic pulse wave measurements as an early detection method for corrosion-induced concrete damages. A series of experiments are conducted using concrete cube specimens, at a size of 200 mm, with a reinforcing steel bar (rebar) embedded in the center. The main variables include the water-to-cement ratio of the concrete (0.4, 0.5, and 0.6), the diameter of the rebar (10 mm, 13 mm, 19 mm, and 22 mm), and the corrosion level (ranging from 0% to 20% depending on rebar diameter). The impressed current technique is used to accelerate corrosion of rebars in concrete immersed in a 3% NaCl solution. Ultrasonic pulse waves are collected from the concrete specimens using a pair of 50 kHz P-wave transducers in the through-transmission configuration before and after the accelerated corrosion test. Deep learning techniques, specifically three recurrent neural network (RNN) models (long short-term memory, gated recurrent unit, and bidirectional long short-term memory), are utilized to develop a classification model for early detection of concrete damage due to rebar corrosion. The performance of the RNN models is compared to conventional ultrasonic testing parameters, namely ultrasonic pulse velocity and signal consistency. The results demonstrate that the RNN method outperforms the other two methods. Among the RNN methods, the bidirectional long short-term memory RNN model had the best performance, achieving an accuracy of 74% and a Cohen's kappa coefficient of 0.48. This study establishes the potentiality of utilizing deep learning of ultrasonic pulse waves with RNN models for early detection of concrete damage associated with steel corrosion.

Xpert MTB/RIF Ultra assay for the detection of Mycobacterium tuberculosis in people with negative conventional Xpert MTB/RIF but chest imaging suggestive of tuberculosis in Dhaka, Bangladesh: Xpert Ultra for M. tuberculosis detection in Xpert-negative PTB presumptives

BACKGROUND

World Health Organization is considering substitution of Xpert MTB/RIF (Xpert) by Xpert MTB/RIF Ultra (Ultra) for tuberculosis (TB) diagnosis, but supportive evidence is scarce, particularly among people more likely to have paucibacillary pulmonary TB (PTB).

METHODS

During January-July 2018, PTB presumptives visiting TB Screening and Treatment Centres of Dhaka for routine chest X-ray (CXR) and conventional Xpert were enrolled. Sputum specimens were additionally tested with microscopy, culture and Ultra. Specimens with "Trace call" by Ultra (Ultra-trace) were retested. Yield and diagnostic accuracy using various approaches to Ultra-trace and concordance of Ultra with bacteriological-positive PTB were assessed.

RESULTS

1,083 participants (104 'Xpert-positive'; 979 'Xpert-negative and CXR-suggestive') were enrolled. All Xpert-positives and 900 (92%) Xpert-negatives displayed concordance with Ultra. Seventy-nine (8.1%) Xpert-negative specimens tested positive with Ultra, of which 37 (46.8%) were categorically positives and 42 (53.2%) were Ultra-trace. Sixteen of 42 were retested, of whom eight (50.1%) Ultra-trace turned categorically positive, leading to 45 (4.6%) additionally detected by Ultra. Ultra sensitivity and specificity was 93.9% and 94.6%, and it additionally detected 5.4% more TB patients with concordance 94.6% (kappa, ꓗ=0.78) compared to any bacteriologically positive specimen (microscopy, culture or Xpert).

CONCLUSION

Ultra exhibited improved detection and accuracy among Xpert-negatives in a cohort with a high likelihood of PTB.

[Neurolaryngology]

Neurological and neurophysiological knowledge of neuromuscular diseases is combined in neurolaryngology with experience from laryngology. Laryngeal electromyography (LEMG) is the most important diagnostic and prognostic tool in neurolaryngology. It can be combined with diagnostic electrostimulation. Interest in LEMG today extends beyond the thyroarytenoid muscle to all accessible laryngeal muscles. LEMG should be performed and interpreted according to a standardized protocol. Main applications of LEMG are confirmation, topodiagnostic and prognostic assessment of vocal fold paralysis. It is possible to differentiate fresh from old recurrent laryngeal nerve lesions as well as mechanical vocal fold fixations from paralysis. Needle guidance for botulinum toxin injections in spasmodic dysphonia and for augmentation laryngoplasty can be supported by LEMG, but also by laryngeal ultrasound. The timing of therapy for temporary and permanent augmentations, thyroplasty and reinnervation surgery may be better defined with experience from neurolaryngology. The use of diagnostic neurostimulation can reveal any remaining active movement potential of a vocal fold and thus help identify candidates for future laryngeal pacemaker treatments. Other topics in neurolaryngology include spasmodic dysphonia and underlying neurological diseases such as stroke, central vocal fold paralysis, essential tremor and Parkinson's disease. Laryngoscopic, clinical and LEMG characteristics of these diseases are presented.

Objectivation of laryngeal electromyography (LEMG) data: turn number vs. qualitative analysis

Purpose

This paper describes a first attempt to quantify LEMG data based on turn number calculation. The results obtained for both healthy and ailing thyroarytenoid (TA) muscles of patients with unilateral vocal fold immobility (UVFI) were compared with the respective qualitative evaluation concerning volitional activity to determine whether the two types of analyses deliver similar results.

Methods

LEMG data obtained from 44 adults with UVFI were considered for the study. Semiquantitative evaluation of TA volitional activity and turn number were assessed for the ailing and the healthy TA and the difference in percentage was calculated. Paired data were compared with the Wilcoxon signed-rank test. The volitional activity assessment and the turn number evaluation were compared with the Kruskal–Wallis test, and their relationship was tested with the Kendall rank correlation.

Results

Datasets of 27 patients were considered compatible with turns/s calculation. The results showed that complete paralysis correlated with no turns; single fiber volitional activity with 62–208 turns/s, strongly decreased volitional activity with 198–501 turns/s; and dense volitional activity with 441–1234 turns/s. On the ailing VF only, the Kruskal–Wallis test showed a statistically significant difference (p = 0.0001), and the Kendall rank correlation a positive relationship (r = 0.853,p ≤ 0.0001) between the volitional activity rating and the turn number assessment.

Conclusions

Our preliminary results showed that turn number evaluation is an effective tool to confirm LEMG qualitative analysis, and that, in combination with laryngostroboscopy and voice assessment, can help improving the accuracy of the diagnosis and prognosis and the effectiveness of the chosen therapy.