Effect of Auditory-Perceptual Training With Natural Voice Anchors on Vocal Quality Evaluation

Auditory Training With Synthesized Voice Anchors: Effects on Rater Agreement

PURPOSE

To investigate the effects of auditory training with synthesized voices on intra- and inter-rater agreement of the auditory-perceptual voice analysis of roughness and breathiness.

METHODS

This was an experimental study consisting of four auditory training sessions. The sample consisted of twenty raters, students from a Speech-Language Pathology course, who had previous experience with auditory-perceptual assessment. The raters participated in the four training sessions with a seven-day break in between sessions. Each training consisted of three tasks: 1) Pre-training activity: Participants were asked to rate 20 natural voices, normal and dysphonic, from zero to three, according to the parameters of roughness and breathiness; 2) Training activity: Synthesized voice anchor stimuli were presented, and participants were asked to rate them from zero to three. Four stimuli were related to roughness and four to breathiness. Participants heard 20 voice stimuli and were instructed to pair the natural voice with the synthesized anchor stimulus that most resembled it; and 3) Post-training activity: the 20 voices from the pre-training activity were randomized and participants rated the same voices, without prior knowledge that these were repeated. Statistical analysis of data was performed using the AC2 test, to assess the extent of agreement between raters, and the Friedman test to compare the training sessions. A 5% significance level was considered.

RESULTS

For the auditory-perceptual voice analysis of roughness, intra-rater agreement results ranged from 79% to 86% between the first and fourth auditory training session, with improvement in intra-rater agreement from the fourth session forward (P = 0.005). For the analysis of breathiness, results ranged from 88% to 92% between the first and fourth auditory training sessions, with improvement from the fourth session forward (P = 0.036). Inter-rater agreement results for the auditory-perceptual analysis of roughness ranged from 23% to 34%, and from 48% to 61% for breathiness, with no differences regarding training (P = 0.855).

CONCLUSION

The auditory-perceptual breathiness parameter had a higher AC2 indicator compared to the roughness parameter, suggesting better agreement. The intra-rater agreement showed improvement starting from the fourth auditory training session for the assessment of roughness and breathiness. The auditory training program did not show a positive inter-rater agreement impact.

Effect of Anchor Voices and Listener Expertise on Auditory-Perceptual Judgments of Voice Quality Using the GRBAS Scale

OBJECTIVES

This study aimed to determine the effect of anchor voices and listener expertise on auditory-perceptual judgment of voice quality using the GRBAS scale.

METHODS

This study utilized a modified crossover design with counterbalancing. Anchor voices for each parameter of the GRBAS scale were chosen based on expert consensus. A total of 28 participants were divided into three groups based on their expertise. The first and second groups consisted of nine undergraduate (UG) and nine postgraduate (PG) students of speech-language pathology. The third group consisted of 10 practicing speech-language pathologists (SLPs). These participants carried out auditory-perceptual judgment of 60 dysphonic voice samples under two counterbalanced experimental conditions (with and without anchor voices). Each of the three groups was randomly divided into two subgroups to balance the experimental conditions. Interrater reliability for each subgroup was calculated using Krippendorff's α and 95% confidence intervals.

RESULTS

For all the groups involved in the study, interrater reliability was higher when anchor voices aided perceptual judgment for most parameters of the GRBAS scale. For the different parameters of GRBAS, interrater reliability for the UG group varied from fair (20 < α ≤ 40) to moderate (40 < α ≤ 60). In contrast, it was fair (20 < α ≤ 40) to substantial (60 < α ≤ 80) for the PG group and moderate (40 < α ≤ 60) to substantial (60 < α ≤ 80) for the SLP group. Variations in reliability were the least for the SLP group compared to the UG and PG groups. However, there were overlaps in interrater reliability between the groups, as revealed by the 95% confidence intervals.

CONCLUSIONS

Anchor voices help improve the auditory-perceptual judgment of voice quality, especially interrater reliability. Listener expertise is also shown to influence the interrater reliability of auditory-perceptual judgment of voice quality.

Validation of the Acoustic Breathiness Index in Speakers of Finnish Language

Breathiness (perception of turbulence noise in the voice) is one of the major components of hoarseness in dysphonic voices. This study aims to validate a multiparameter analysis tool, the Acoustic Breathiness Index (ABI), for quantification of breathiness in the speaking voice, including both sustained vowels and continuous speech. One hundred and eight speakers with dysphonia (28 M, 80 F, mean age 50, SD 15.4 years) and 87 non-dysphonic controls (18 M, 69 F, mean age 42, SD 14 years) volunteered as participants. They read a standard text and sustained vowel /a:/. Acoustic recordings were made using a head-mounted microphone. Acoustic samples were evaluated perceptually by nine voice experts of different backgrounds (speech therapists, vocologists and laryngologists). Breathiness (B) from the GRBAS scale was rated. Headphones were used in the perceptual analysis. The dysphonic and non-dysphonic speakers differed significantly from each other in the auditory perceptual evaluation of breathiness. A significant difference was also found for ABI, which had a mean value of 2.26 (SD 1.15) for non-dysphonic and 3.07 (SD 1.75) for dysphonic speakers. ABI correlated strongly with B (rs = 0.823, p = 0.01). ABI's power to distinguish the groups was high (88.6%). The highest sensitivity and specificity of ABI (80%) was obtained at threshold value 2.68. ABI is a valid tool for differentiating breathiness in non-dysphonic and dysphonic speakers of Finnish.

Construction of an Anchor and Training Sample Set for Auditory-Perceptual Voice Evaluation With the GRBAS-scale

OBJECTIVE

The aim of this study is to construct a representative and comprehensive set of reliable anchor and training voice samples for all parameters and grades of the GRBAS-scale, in order to develop a standardized online training tool for perceptual voice evaluation.

METHODS

140 voice samples varying from normal to severely dysphonic, consisting of the vowel /a/ and a Dutch standard text, were recorded. Samples were duplicated and added to a data folder in random order. A panel of five highly experienced judges rated GRBAS parameters for each voice sample. Intra- and interrater reliability were determined using intraclass correlation coefficient (ICC) and percentage agreement. Samples with agreement percentages of >0.90 for at least one parameter were qualified as anchor voices, whereas samples with a percentage agreement between 0.70 and 0.80 were considered valid training samples.

RESULTS

Intrarater reliability was moderate to good for all raters and parameters. Interrater reliability was good for parameter G and moderate for R, B, A and S. 83 samples were found to be valid anchor samples with 90-100% expert agreement for at least one parameter, covering all of the GRBAS parameter/score combinations. An additional 37 samples fulfilled the criteria for adoption in the online tool as a training sample, showing 70-80% agreement for one or more parameters.

CONCLUSION

Based on well-defined and stringent selection criteria, this study identifies a substantial number of valid anchor and training voices that qualify for implementation in a standardized multi-level training tool for the auditory-perceptual evaluation of voice by means of the GRBAS scale.

Improving Perceptual Speech Ratings: The Effects of Auditory Training on Judgments of Dysarthric Speech

PURPOSE

Auditory training has been shown to reduce rater variability in perceptual voice assessment. Because rater variability is also a central issue in the auditory-perceptual assessment of dysarthria, this study sought to determine if training produces a meaningful change in rater reliability, criterion validity, and scaling magnitude of four features: overall speech impairment, articulatory imprecision, monotony, and slow rate.

METHOD

Forty-four nonexperts randomized to training and nontraining listener groups completed a pretest and posttest. Only the former group underwent auditory training between pre- and posttests. For both testing and training, listeners rated samples from speakers with amyotrophic lateral sclerosis (ALS), speakers with Parkinson's disease (PD), and neurologically healthy control speakers using separate visual analog scales (VASs) for each of the four features. Intraclass correlation coefficients were used to compare inter- and intrarater reliability between pre- and posttest for both listener groups. For criterion validity, severity ratings from the two nonexpert listener groups were compared to those of two experienced listeners for all four features. To determine changes in scaling magnitude, raw VAS scores for each feature were compared from pre- to posttest within the two nonexpert listener groups. Scaling changes were also compared between the two listener groups for the pre- and posttest conditions.

RESULTS AND CONCLUSIONS

In the training group, a meaningful improvement in interrater reliability was observed for some features in all three speaker groups, but not in the nontraining group. In contrast, for intrarater reliability, in the nontraining group, a meaningful improvement was observed for many features in all three speaker groups, but only for PD monotony and slow rate in the training group. All ratings from the nonexpert listeners were valid except for monotony. Raw VAS scores did not meaningfully change from pre- to posttest for any of the features, but there was a trend toward lower scores posttraining, mainly for the ALS samples. Modifications to the auditory training paradigm to further improve reliability and validity, along with future goals for optimizing training, are discussed.

Proposal of requirements for the development of a training simulator for the auditory-perceptual judgment of voice

PURPOSE

to identify a set of requirements for the development of an auditory-perceptual training simulator (APT) based on the experience of professors who provide APT.

METHODS

This is a cross-sectional, descriptive study with a quantitative approach. Twenty-two professors answered an online questionnaire containing 31 items related to APT, involving items about the professional profile, conditions for APT in undergraduate and postgraduate courses in Speech Therapy, APT structure, and evaluation of the APT effect.

RESULT

it was observed that there is a variation in APT procedures performed in Brazil. The main requirements indicated by the respondents for the APT involve the use of synthesized voices in the initial moments, followed by human voices later; the use of speech tasks with sustained vowels and connected speech; the insertion of complementary information such as gender, age, the profession of the speaker and the spectrography of the vocal signal; training with a minimum time of six hours; the evaluation of the training effect by comparing intra- and inter-judge agreement before and after training; the addition of the parameters of general degree of vocal deviation, roughness, breathiness, and strain; the use of validated continuous and numerical scales; and offering it from the second year of the undergraduate program.

CONCLUSION

although there is variability in the response of experts, a minimum set of requirements indicated for performing APT with new judges was identified.

Preliminary Perceptual Findings of Singing After Flow Phonation Voice Exercises for Singers in Training

INTRODUCTION

Goals of voice therapy and vocal pedagogy share similar principles and therefore, therapy approaches designed to improve the disordered voice may be equally effective when used to enhance healthy voice and vice versa. The purpose of this study was to investigate the effects of flow phonation voice exercises on vocal characteristics of students in undergraduate vocal music training programs and examine their potential use in vocal pedagogy.

METHODS

A total of 10 cis females were recruited and were randomized into two groups: an experimental group (group 1, n = 6) receiving five sessions of flow phonation intervention across 5 weeks; and a control group (group 2, n = 4) that did not receive any direct intervention other than vocal hygiene education. Participants provided data pertaining to auditory perception, subjective respiratory measures, voice-related quality of life, and vocal fatigue before and after 5 weeks. Flow phonation exercises consisted of cup bubble blowing, gargling, and stretch and flow. Wilcoxon signed ranks test was administered to compare outcomes across time points and between groups.

RESULTS

Data indicate statistically significant changes in auditory perception of the singing voice, and voice-related quality of life for the group that received flow phonation exercises alone. No other measures showed statistical significance.

DISCUSSION AND CONCLUSION

Overall, this study indicates that the use of flow phonation voice exercises has the potential to improve voice instruction within the voice studio. While our target enrollments were not met to achieve optimal statistical power, our hypotheses were at least partially supported. In particular, positive intervention-related changes were observed in self-perceived voice handicap, and auditory perception of singing which were not observed in the control group.

Harnessing Machine Learning in Vocal Arts Medicine: A Random Forest Application for "Fach" Classification in Opera

Vocal arts medicine provides care and prevention strategies for professional voice disorders in performing artists. The issue of correct "Fach" determination depending on the presence of a lyric or dramatic voice structure is of crucial importance for opera singers, as chronic overuse often leads to vocal fold damage. To avoid phonomicrosurgery or prevent a premature career end, our aim is to offer singers an improved, objective fach counseling using digital sound analyses and machine learning procedures. For this purpose, a large database of 2004 sound samples from professional opera singers was compiled. Building on this dataset, we employed a classic ensemble learning method, namely the Random Forest algorithm, to construct an efficient fach classifier. This model was trained to learn from features embedded within the sound samples, subsequently enabling voice classification as either lyric or dramatic. As a result, the developed system can decide with an accuracy of about 80% in most examined voice types whether a sound sample has a lyric or dramatic character. To advance diagnostic tools and health in vocal arts medicine and singing voice pedagogy, further machine learning methods will be applied to find the best and most efficient classification method based on artificial intelligence approaches.

Auditory-Perceptual Assessments of Cough: Characterizing Rater Reliability and the Effects of a Standardized Training Protocol

INTRODUCTION

Auditory-perceptual assessments of cough are commonly used by speech-language pathologists working with people with swallowing disorders with emerging evidence beginning to demonstrate their validity; however, their reliability among novice clinicians is unknown. Therefore, the primary aim of this study was to characterize the reliability of auditory-perceptual assessments of cough among a group of novice clinicians. As a secondary aim, we assessed the effects of a standardized training protocol on the reliability of auditory-perceptual assessments of cough.

METHODS

Twelve novice clinicians blindly rated ten auditory-perceptual cough descriptors for 120 cough audio clips. Standardized training was then completed by the group of clinicians. The same cough audio clips were then re-randomized and blindly rated. Reliability was analyzed pre- and post-training within each clinician (intra-rater), between each unique pair of raters (dyad-level inter-rater), and for the entire group of raters (group-level inter-rater) using intraclass correlation coefficients and Cohen's Kappa.

RESULTS

Pre-training reliability was greatest for measures of strength, effectiveness, and normality and lowest when judging the type of expiratory maneuver (cough, throat clear, huff, other). The measures that improved the most with training were ratings of perceived crispness, amount of voicing, and type of expiratory maneuver. Intra-rater reliability coefficients ranged from 0.580 to 0.903 pre-training and 0.756-0.904 post-training. Dyad-level inter-rater reliability coefficients ranged from 0.295 to 0.745 pre-training and 0.450-0.804 post-training. Group-level inter-rater reliability coefficients ranged from 0.454 to 0.919 pre-training and 0.558-0.948 post-training.

CONCLUSION

Reliability of auditory-perceptual assessments varied across perceptual cough descriptors, but all appeared within the range of what has been historically reported for auditory-perceptual assessments of voice and visual-perceptual assessments of swallowing and cough airflow. Reliability improved for most cough descriptors following 30-60 min of standardized training. Future research is needed to examine the validity of auditory-perceptual assessments of cough by assessing the relationship between perceptual cough descriptors and instrumental measures of cough effectiveness to better understand the role of perceptual assessments in clinical practice.

Development and Validation of a Single-Variable Comparison Stimulus for Matching Strained Voice Quality Using a Psychoacoustic Framework

PURPOSE

Acoustic and perceptual quantification of vocal strain has been a vexing problem for years. To increase measurement rigor, a suitable single-variable matching stimulus for strain was developed and validated, based on the matching stimulus used previously for breathy and rough voice qualities.

METHOD

A set of 21 comparison stimuli for a single-variable matching task (SVMT) was synthesized based on a speech-shaped sawtooth waveform mixed with speech-shaped noise. Variable bandpass filter gain in mid-to-high frequencies achieved a wide range of computed sharpness (in constant sharpness steps) and served as the independent variable for the SVMT. Ten natural /ɑ/ stimuli with a wide range of the primary voice quality of strain and a minimum of breathiness or roughness were selected and assessed using the SVMT. Natural voice samples and synthetic comparison stimuli were also assessed using a perceptual magnitude estimation (ME) task.

RESULTS

ME data validated the correspondence of the set of comparison stimuli to varying perceived strain. Perceived strain magnitudes of the comparison stimuli increased significantly and linearly with computed sharpness (r ² = .99). A linear regression revealed that strain matching values were significantly predicted by computed sharpness (r ² = .96) and perceived strain magnitudes (r ² = .95) of the natural voice stimuli.

CONCLUSION

The perception of vocal strain is strongly associated with computed sharpness and is captured accurately and precisely using an SVMT, in which the independent variable is the bandpass filter gain (in steps of equal sharpness) applied to the comparison stimuli.

Interactions Between Breathy and Rough Voice Qualities and Their Contributions to Overall Dysphonia Severity

PURPOSE

Dysphonic voices typically present multiple voice quality dimensions. This study investigated potential interactions between perceived breathiness and roughness and their contributions to overall dysphonia severity.

METHOD

Synthetic stimuli based on four talkers were created to systematically map out potential interactions. For each talker, a stimulus matrix composed of 49 stimuli (seven breathiness steps × seven roughness steps) was created by varying aspiration noise and open quotient to manipulate breathiness and superimposing amplitude modulation of varying depths to simulate roughness. One-dimensional matching (1DMA) and magnitude estimation (1DME) tasks were used to measure perceived breathiness, roughness, their potential interactions, and overall dysphonia severity. Additional 1DME tasks were used to assess a set of natural stimuli that varied along both breathiness and roughness.

RESULTS

For the synthetic stimuli, the 1DMA task indicated little interaction between the two voice qualities. For the 1DME task, breathiness magnitude was influenced by roughness step to a greater extent than roughness magnitude was influenced by breathiness step. The additive contributions of breathiness and roughness to overall severity gradually diminished with increasing breathiness and roughness steps, possibly reflecting a ceiling effect in the 1DME task. For the natural stimuli, little consistent interaction was observed between breathiness and roughness.

CONCLUSIONS

The matching task revealed minimal interaction between perceived breathiness and roughness, whereas the magnitude estimation task revealed some interaction between the two qualities and their cumulative contributions to overall dysphonia severity. Task differences are discussed in terms of differences in response bias and the role of perceptual anchors.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21313701.

Validity of intraoperative voice monitoring undergoing type 2 thyroplasty with titanium bridges for adductor spasmodic dysphonia

Objectives

The success of type 2 thyroplasty (TP2) for adductor spasmodic dysphonia (AdSD) depends on the selection of optimally sized titanium bridges, which requires accurate assessment of intraoperative vocal changes. While this procedure has traditionally been performed according to the laryngologist's experience, the most appropriate method for voice monitoring and selection of titanium bridge size remains to be determined. This study aimed to investigate evaluation parameters useful for voice monitoring, as these may allow less experienced surgeons to perform TP2 properly.

Methods

In this prospective study, voice monitoring was performed in 18 patients with AdSD patients undergoing TP2. Evaluations were performed preoperatively, intraoperatively, 13 weeks postoperatively, and 52 weeks postoperatively using GRBAS (grade, roughness, breathiness, asthenia, and strain), as well as perceptual judgment and acoustic analyses.

Results

Preoperative and intraoperative assessments of the G, R, B, and S parameters, perceptual judgment, and harmonic‐to‐noise ratio (HNR) were in moderate or better agreement. Intraoperative and 13‐ or 52‐week postoperative measurements of the R, B, and G parameters and strangulation, tremor, and HNR were also in high agreement. When two different sizes of titanium bridges were compared (unselected vs. selected), ratings for G, R, S, strangulation, tremor, jitter, shimmer, HNR, standard deviation of F0, and degree of voice breaks were better for the selected width than the unselected width.

Conclusion

The candidate items for intraoperative voice monitoring during TP2 for AdSD are G, R, strangulation, tremor, and HNR. The use of these items may help to ensure successful TP2 and contribute to the advancement of laryngeal framework surgery.

Level of evidence

Level 4.

Reducing the GAP between science and clinic: lessons from academia and professional practice - part A: perceptual-auditory judgment of vocal quality, acoustic vocal signal analysis and voice self-assessment

During the XXVIII Brazilian Congress of SBFa, 24 specialists met and, from a leading position on scientific research as a tool for connecting laboratory and clinic, five fronts of knowledge of the voice specialty were discussed as following: Perceptual-auditory judgment of vocal quality; 2. Acoustic analysis of the vocal signal; 3. Voice self-assessment; 4. Traditional techniques of therapy; 5. Modern techniques of electrostimulation and photobiomodulation (PBMT) in voice. Part "a" of this publication was associated with the consolidation of the analyses of the first three aspects. The trend in the perceptual-auditory judgment of vocal quality was related to the use of standard protocols. The acoustic evaluation of the vocal signal is accessible and can be done descriptively or by extraction of parameters, thus preferring multiparametric measures. Finally, the analysis of the individual himself closes this triad of voice documentation, which will be the basis for the conclusion of the evaluation, reference for monitoring progress, and evaluation of treatment results.

Repetition of anchor stimuli and nature of vocal samples in the perceptual auditory judgment performed by speech-language pathology students

PURPOSE

Verify the effect of anchor repetition in the perceptual auditory judgement of the type of vocal deviation performed by speech-language pathology (SLP) students; analyze the correlation between the amount of different vocal dimensions in the same stimuli and accuracy; investigate the correlation between type of vocal deviation and accuracy.

METHODS

54 SLP students were divided in two groups: Group with repetition (GwR), 28 students; and, Group with no repetition (GnR), 26 students. The analyzed sample counted with 220 dysphonic human voices, vowel /ε/. The GwR heard three anchor stimuli before the judgement and every 20 voices during the assessment. The GnR heard the anchor only before beginning the judgement. The anchor stimuli counted with one rough, one breathy and one strain voice. These classifications were compared with reference judgements from three expert SLPs. The intra and inter-rater reliability, the correlation between the amount of different vocal dimensions in the same stimuli and type of vocal deviation with accuracy were assessed.

RESULTS

The accuracy between type of deviation was similar among groups. The GwR presented slightly higher intra and inter-rater reliability. The student's accuracy was inversely proportional to the amount of different vocal dimensions in the stimuli. Breathiness presented the highest accuracy and strain presented the lowest accuracy.

CONCLUSION

The repetition of anchor stimuli improved intra and inter-rater reliability. However, it was not effective in the accuracy of the type of vocal deviation. The amount of different vocal dimensions in the stimuli have influence in the students' accuracy.

Reducing the GAP between science and clinic: lessons from academia and professional practice - part A: perceptual-auditory judgment of vocal quality, acoustic vocal signal analysis and voice self-assessment

ABSTRACT During the XXVIII Brazilian Congress of SBFa, 24 specialists met and, from a leading position on scientific research as a tool for connecting laboratory and clinic, five fronts of knowledge of the voice specialty were discussed as following: Perceptual-auditory judgment of vocal quality; 2. Acoustic analysis of the vocal signal; 3. Voice self-assessment; 4. Traditional techniques of therapy; 5. Modern techniques of electrostimulation and photobiomodulation (PBMT) in voice. Part “a” of this publication was associated with the consolidation of the analyses of the first three aspects. The trend in the perceptual-auditory judgment of vocal quality was related to the use of standard protocols. The acoustic evaluation of the vocal signal is accessible and can be done descriptively or by extraction of parameters, thus preferring multiparametric measures. Finally, the analysis of the individual himself closes this triad of voice documentation, which will be the basis for the conclusion of the evaluation, reference for monitoring progress, and evaluation of treatment results.

Effect of synthesized voice anchors on auditory-perceptual voice evaluation

PURPOSE

To analyze if the use of synthesized voice anchor emissions in auditory-perceptual evaluation improves intra- and inter-rater agreement.

METHODS

This is a quantitative study. Thirty-two inexperienced evaluators were selected and performed two activities on a Programming Interface created by the authors: Active Calibrator Activity - auditory-perceptual evaluation of the roughness and breathiness parameters as 0-no deviation, 1-slight deviation, 2-moderate deviation, or 3-intense deviation of 25 voices with the support of anchored emissions of synthesized voices; and Inactive Calibrator Activity - auditory-perceptual evaluation of these same voices without the support of anchored vocal emissions. The voices were randomized for each activity, and the order of the activities was drawn randomly for each evaluator. The second activity was performed 15 days after the first. The Kappa coefficient was used to analyze intra- and inter-rater agreement, and the confidence interval (CI) was employed to compare concordances.

RESULTS

Inter-rater agreement was higher for the intense degree of the breathiness parameter in the Active Calibrator Activity when compared to the Inactive Calibrator Activity, as well as the intra-rater agreement of the roughness parameter.333.

CONCLUSION

Use of anchor emissions of synthesized voices directly in the evaluation improves intra- and inter-rater agreement in auditory-perceptual voice analysis.

Effect of Training With Anchors on Auditory-Perceptual Evaluation of Dysphonia in Speech-Language Pathology Students

Purpose Auditory-perceptual evaluation is essential for the clinical assessment of voice disorders. Unstable perceptual voice evaluation has been shown for inexperienced listeners as compared to expert listeners. We examined the effects of perceptual training with external auditory anchors with and without immediate feedback on the evaluation of roughness and breathiness of natural, nonsynthesized speech stimuli (reading of a standard passage) in speech-language pathology students. Method Perceptual voice evaluation and training with anchors using a visual analog scale was implemented with a computer software. Forty-eight speech-language pathology students were randomly assigned into three groups, feedback group (Group F), no feedback group (Group NF), and control group (Group C), attending one training session and four assessment sessions (before training, immediately after training, and 1 and 7 weeks after training). Group F received training with anchors with immediate feedback, Group NF received training without immediate feedback, and Group C received sham training (exposure session). Results Training with anchors significantly increased the rating accuracy (agreement with expert ratings) on both roughness and breathiness for Group F, with the effects lasting for 7 weeks. No significant changes in rating accuracy with training were observed for Group NF and Group C. No improvements in intra- and interrater reliability as well as intrarater agreement were observed in all three groups, whereas interrater agreement on breathiness (but not roughness) significantly increased for all groups, with the effect lasting for 7 weeks only for Group F. Conclusions These findings suggested that perceptual training with external auditory anchors and the use of immediate feedback could be effective for facilitating the development of perceptual voice evaluation skills in speech-language pathology students. Further studies involving more extensive training with stimuli covering a full range of dysphonia severity categories and improvements in design of the training protocol are recommended to verify these results.

The Use of Auditory-Perceptual Training as a Research Method: A Summary Review

OBJECTIVE

The purpose of this descriptive review was to document the current state of training to perform auditory-perceptual analysis as reported in the voice literature.

METHODS

A review of the literature was performed.

RESULTS

Thirty-six articles were included in the review. The theoretical basis of training, specific training methods employed, duration of training, stimuli used to train, vocal qualities trained, and the type of listeners used are reported.

CONCLUSION

There is wide variation to training procedures used in research including auditory-perceptual evaluation of voice quality. In order to begin to discover how to best train listeners for research and clinical settings, attention to the training methods used in research is necessary. Further, these training methods must be explicitly acknowledged and described to allow for adequate evaluation of research findings, comparison across studies, and to determine for which populations results might be applicable. The conceptual framework outlined in this study is a starting point to review voice quality research and to design future studies for which auditory-perceptual evaluation is taught to listeners.