Does the Accuracy of Medical Diagnoses Affect Novice Listeners' Auditory-Perceptual Judgments of Dysphonia Severity?

Are Auditory-Perceptual Evaluations of Dysphonia by Experienced Voice Clinicians Affected by Knowledge of Speaker Race?

PURPOSE

The purpose of this study was to investigate implicit racial bias in auditory-perceptual evaluations of dysphonic voices completed by experienced voice-focused speech-language pathologists (SLPs).

METHOD

Thirty SLPs specializing in voice disorders listened to audio files of 20 Black speakers and 20 White speakers of General American English with voice disorders. The SLPs rated the overall severity of dysphonia (OS) of each voice heard using a 100-unit visual analog scale and then completed the Harvard Implicit Association Test (IAT) to estimate their implicit racial bias.

RESULTS

There were no significant main effects of speaker race or labeled race on OS ratings; however, there was a small but significant interaction effect between them: Race labeling resulted in a minimizing effect for Black speakers, but not White speakers. No significant relationship was found between Harvard IAT scores and differences in OS ratings by race-labeling condition.

CONCLUSIONS

These findings suggest that experienced, voice-focused SLPs demonstrated a minimizing bias in their auditory-perceptual ratings of dysphonia of Black speakers. This bias is small and may not be clinically significant but, in some cases, could contribute to worse clinical care of Black people with voice disorders.

Can Resident Auditory-Perceptual Voice Assessments Predict Medical Urgency of Voice Disorders?

BACKGROUND/OBJECTIVES

Growing reliance on telemedicine has created new triaging challenges. This study investigated how effectively otolaryngology resident auditory-perceptual voice assessments performed via telemedicine determined the need for urgent in-person clinic visits.

METHODS

Twelve otolaryngology resident physicians (PGY1-PGY5) performed auditory-perceptual assessments on 25 voice samples recorded during initial voice evaluations. Voice samples were balanced in severity and taken in equal numbers from patients with the following diagnoses: benign laryngeal lesions, laryngeal cancer, functional voice disorders, laryngeal edema (associated with LPR), and laryngeal paralysis/paresis. Urgent diagnoses were defined as laryngeal cancer and severe unilateral laryngeal paralysis. For each voice sample, residents were initially blinded to patient medical history. Residents rated severity of voice disorder, predicted patient diagnosis, and determined the urgency of seeing the patient in clinic. Residents then reviewed information from the patient's medical history and again rated urgency of voice disorder.

RESULTS

On average, residents identified urgent voice disorders in 56% of cases. After reviewing medical history, this number significantly increased to 77% (P = 0.001). Voice severity, smoking history, time since onset, and course of symptoms were considered most influential when determining medical urgency of voice patients. Year in residency program had no effect on rating accuracy. As expected, diagnostic accuracy of auditory-perceptual assessments was low, ranging from 40% for laryngeal paralysis/paresis to 5% for laryngeal edema.

CONCLUSION

Auditory-perceptual voice assessment, combined with medical history, predicted most medically urgent voice disorders. Further work should investigate if task-specific training might improve these results and which medical history items are most critical. Until accuracy of auditory-perceptual assessment of medical urgency is improved, these data underscore the importance of laryngeal examination in identifying medical urgency and etiology of dysphonia.

Does Implicit Racial Bias Affect Auditory-Perceptual Evaluations of Dysphonic Voices?

PURPOSE

The purpose of this study was to understand the role of implicit racial bias in auditory-perceptual evaluations of dysphonic voices by determining if a biasing effect exists for novice listeners in their auditory-perceptual ratings of Black and White speakers.

METHOD

Thirty speech-language pathology graduate students at Boston University listened to audio files of 20 Black speakers and 20 White speakers of General American English with voice disorders. Listeners rated the overall severity of dysphonia of each voice heard using a 100-unit visual analog scale and completed the Harvard Implicit Association Test (IAT) to measure their implicit racial bias.

RESULTS

Both Black and White speakers were rated as less severely dysphonic when their race was labeled as Black. No significant relationship was found between Harvard IAT scores and differences in severity ratings by race labeling condition.

CONCLUSIONS

These findings suggest a minimizing bias in the evaluation of dysphonia for Black patients with voice disorders. These results contribute to the understanding of how a patient's race may impact their visit with a clinician. Further research is needed to determine the most effective interventions for implicit bias retraining and the additional ways that implicit racial bias impacts comprehensive voice evaluations.

The effect of the auditory signal on videolaryngostroboscopy ratings and interpretation

OBJECTIVE

The primary aim of this study was to examine the effect of the videolaryngostroboscopic auditory signal on videolaryngostroboscopy (VLS) ratings and interpretation in normophonic and dysphonic speakers.

STUDY DESIGN

Prospective repeated measures design METHOD: Eight speech-language pathologists evaluated rigid VLS exams obtained from 12 dysphonic speakers with vocal fold pathology and 4 normophonic speakers with normal VLS exams. VLS exams were evaluated with the auditory signal present and absent with a washout period between rating sessions. VLS measures were obtained using the Voice-vibratory Assessment of Laryngeal Imaging (VALI) and a 100mm visual analog scale (VAS). The effects of the auditory signal and its interaction with voice quality severity on 9 VLS ratings, diagnostic billing codes, and treatment recommendations were examined.

RESULTS

There was no effect of auditory information on VLS measures or overall severity of laryngeal function evaluated using the VAS (ps > 0.05). There was a main effect of auditory information and a significant interaction with voice quality severity for only one VLS measure (non-vibrating portion-left) evaluated using the VALI (P = 0.05). Post-hoc analysis for this rating showed significant increases (t-test adjusted P < 0.05) when voice quality severity was moderate-severe (M = 4.8%; SD = 1.65%) and auditory information was present. Agreement in individual clinician's selection of diagnostic codes (73%) and treatment recommendations (65.6%) when auditory cues were present and absent was moderate to high.

CONCLUSION

The presence of the videolaryngostroboscopic auditory signal had a minimal effect on VLS ratings, treatment recommendations, or diagnostic billing codes.

Repetition of anchor stimuli and nature of vocal samples in the perceptual auditory judgment performed by speech-language pathology students

PURPOSE

Verify the effect of anchor repetition in the perceptual auditory judgement of the type of vocal deviation performed by speech-language pathology (SLP) students; analyze the correlation between the amount of different vocal dimensions in the same stimuli and accuracy; investigate the correlation between type of vocal deviation and accuracy.

METHODS

54 SLP students were divided in two groups: Group with repetition (GwR), 28 students; and, Group with no repetition (GnR), 26 students. The analyzed sample counted with 220 dysphonic human voices, vowel /ε/. The GwR heard three anchor stimuli before the judgement and every 20 voices during the assessment. The GnR heard the anchor only before beginning the judgement. The anchor stimuli counted with one rough, one breathy and one strain voice. These classifications were compared with reference judgements from three expert SLPs. The intra and inter-rater reliability, the correlation between the amount of different vocal dimensions in the same stimuli and type of vocal deviation with accuracy were assessed.

RESULTS

The accuracy between type of deviation was similar among groups. The GwR presented slightly higher intra and inter-rater reliability. The student's accuracy was inversely proportional to the amount of different vocal dimensions in the stimuli. Breathiness presented the highest accuracy and strain presented the lowest accuracy.

CONCLUSION

The repetition of anchor stimuli improved intra and inter-rater reliability. However, it was not effective in the accuracy of the type of vocal deviation. The amount of different vocal dimensions in the stimuli have influence in the students' accuracy.

Determining Medical Urgency of Voice Disorders Using Auditory-Perceptual Voice Assessments Performed by Speech-Language Pathologists

OBJECTIVE

This study examined whether speech-language pathologist auditory-perceptual voice assessments can predict the medical urgency of voice disorders.

METHODS

Twenty speech-language pathologists (SLPs) evaluated 25 voice samples recorded during initial voice evaluations. Voice samples represented a range of dysphonia severity (mild-severe) balanced across patient diagnoses. Diagnoses included: benign lesions, laryngeal cancer, non-organic voice disorders, laryngeal edema (associated with LPR), and laryngeal paralysis or paresis. Laryngeal cancer and severe unilateral laryngeal paralysis were considered urgent disorders. While blinded to patient information, SLPs rated severity of voice quality, predicted patient diagnosis, and determined whether the patient should be seen urgently by a laryngologist. SLPs were then given basic medical history information and rated medical urgency of voice disorder a second time.

RESULTS

On average, SLPs correctly identified 65% of urgent voices and 87% of nonurgent voices when blinded to patient information. Accuracy improved significantly to 86% for urgent voices with medical history information (P < .001) and decreased to 77% for nonurgent voices. Accuracy was better when severity of voice quality was severe for urgent voices and mild for nonurgent voices (P < .001). SLPs indicated that patient smoking history and severity of dysphonia were most influential in their decision making. Diagnostic accuracy of auditory-perceptual assessments was poor.

CONCLUSIONS

SLPs identified 86% of medically urgent voice disorders when auditory perceptual assessments were combined with medical history information. Further work is needed to determine what medical history information is most crucial to rating accuracy and what speech tasks might best separate urgent and nonurgent patients.