1
|
Anikin A, Herbst CT. How to analyse and manipulate nonlinear phenomena in voice recordings. Philos Trans R Soc Lond B Biol Sci 2025; 380:20240003. [PMID: 40176526 PMCID: PMC11966163 DOI: 10.1098/rstb.2024.0003] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 07/22/2024] [Accepted: 10/01/2024] [Indexed: 04/04/2025] Open
Abstract
We address two research applications in this methodological review: starting from an audio recording, the goal may be to characterize nonlinear phenomena (NLP) at the level of voice production or to test their perceptual effects on listeners. A crucial prerequisite for this work is the ability to detect NLP in acoustic signals, which can then be correlated with biologically relevant information about the caller and with listeners' reaction. NLP are often annotated manually, but this is labour-intensive and not very reliable, although we describe potentially helpful advanced visualization aids such as reassigned spectrograms and phasegrams. Objective acoustic features can also be useful, including general descriptives (harmonics-to-noise ratio, cepstral peak prominence, vocal roughness), statistics derived from nonlinear dynamics (correlation dimension) and NLP-specific measures (depth of modulation and subharmonics). On the perception side, playback studies can greatly benefit from tools for directly manipulating NLP in recordings. Adding frequency jumps, amplitude modulation and subharmonics is relatively straightforward. Creating biphonation, imitating chaos or removing NLP from a recording are more challenging, but feasible with parametric voice synthesis. We describe the most promising algorithms for analysing and manipulating NLP and provide detailed examples with audio files and R code in supplementary material.This article is part of the theme issue 'Nonlinear phenomena in vertebrate vocalizations: mechanisms and communicative functions'.
Collapse
Affiliation(s)
- Andrey Anikin
- Division of Cognitive Science, Lund University, Lund, Sweden
- ENES Bioacoustics Research Laboratory, Université Jean Monnet Saint-Étienne, Saint-Étienne, France
| | - Christian T. Herbst
- University of Vienna, Vienna, Austria
- Department of Communication Sciences and Disorders, College of Liberal Arts and Sciences, University of Iowa, Iowa City, Iowa, USA
| |
Collapse
|
2
|
Wujian Y, Yingcong Z, Yuehai C, Yijun L, Zhiwei M. Post-Stroke Dysarthria Voice Recognition based on Fusion Feature MSA and 1D. Comput Methods Biomech Biomed Engin 2024:1-11. [PMID: 39422438 DOI: 10.1080/10255842.2024.2410228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Revised: 09/04/2024] [Accepted: 09/20/2024] [Indexed: 10/19/2024]
Abstract
Post-stroke Dysarthria (PSD) is one of the common sequelae of stroke. PSD can harm patients' quality of life and, in severe cases, be life-threatening. Most of the existing methods use frequency domain features to recognize the pathological voice, which makes it hard to completely represent the characteristics of pathological voice. Although some results have been achieved, there is still a long way to go for practical applications. Therefore, an improved deep learning-based model is proposed to classify between the pathological voice and the normal voice, using a novel fusion feature (MSA) and an improved 1D ResNet network hybrid bi-directional LSTM with dilated convolution (named 1D DRN-biLSTM). The experimental results show that our fusion features bring greater improvement in pathological speech recognition than the method that only analyzes the MFCC features, and can better synthesize the hidden features that characterize pathological speech. In terms of model structure, the introduction of dilated convolution and LSTM can further improve the performance of the 1D Resnet network, compared to ordinary networks such as CNN and LSTM. The accuracy of this method reaches 82.41% and 100% at the syllable level and speaker level, respectively. Our scheme outperforms other existing methods in terms of feature learning capability and recognition rate, and will help to play an important role in the assessment and diagnosis of PSD in China.
Collapse
Affiliation(s)
- Ye Wujian
- School of Integrated Circuit, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Zheng Yingcong
- School of Integrated Circuit, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Chen Yuehai
- School of Integrated Circuit, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Liu Yijun
- School of Integrated Circuit, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Mou Zhiwei
- Department of Rehabilitation, Guangzhou Red Cross Hospital of Jinan University, Guangzhou 510240, China
| |
Collapse
|
3
|
Kashyap B, Pathirana PN, Horne M, Power L, Szmulewicz DJ. Machine Learning-Based Scoring System to Predict the Risk and Severity of Ataxic Speech Using Different Speech Tasks. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4839-4850. [PMID: 37983150 DOI: 10.1109/tnsre.2023.3334718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
The assessment of speech in Cerebellar Ataxia (CA) is time-consuming and requires clinical interpretation. In this study, we introduce a fully automated objective algorithm that uses significant acoustic features from time, spectral, cepstral, and non-linear dynamics present in microphone data obtained from different repeated Consonant-Vowel (C-V) syllable paradigms. The algorithm builds machine-learning models to support a 3-tier diagnostic categorisation for distinguishing Ataxic Speech from healthy speech, rating the severity of Ataxic Speech, and nomogram-based supporting scoring charts for Ataxic Speech diagnosis and severity prediction. The selection of features was accomplished using a combination of mass univariate analysis and elastic net regularization for the binary outcome, while for the ordinal outcome, Spearman's rank-order correlation criterion was employed. The algorithm was developed and evaluated using recordings from 126 participants: 65 individuals with CA and 61 controls (i.e., individuals without ataxia or neurotypical). For Ataxic Speech diagnosis, the reduced feature set yielded an area under the curve (AUC) of 0.97 (95% CI 0.90-1), the sensitivity of 97.43%, specificity of 85.29%, and balanced accuracy of 91.2% in the test dataset. The mean AUC for severity estimation was 0.74 for the test set. The high C-indexes of the prediction nomograms for identifying the presence of Ataxic Speech (0.96) and estimating its severity (0.81) in the test set indicates the efficacy of this algorithm. Decision curve analysis demonstrated the value of incorporating acoustic features from two repeated C-V syllable paradigms. The strong classification ability of the specified speech features supports the framework's usefulness for identifying and monitoring Ataxic Speech.
Collapse
|
4
|
Rong P, Benson J. Intergenerational choral singing to improve communication outcomes in Parkinson's disease: Development of a theoretical framework and an integrated measurement tool. INTERNATIONAL JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2023; 25:722-745. [PMID: 36106430 DOI: 10.1080/17549507.2022.2110281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Purpose: This study presented an initial step towards developing the evidence base for intergenerational choral singing as a communication-focussed rehabilitative approach for Parkinson's disease (PD).Method: A theoretical framework was established to conceptualise the rehabilitative effect of intergenerational choral singing on four domains of communication impairments - motor drive, timing mechanism, sensorimotor integration, higher-level cognitive and affective functions - as well as activity/participation, and quality of life. A computer-assisted multidimensional acoustic analysis was developed to objectively assess the targeted domains of communication impairments. Voice Handicap Index and the World Health Organization's Quality of Life assessment-abbreviated version were used to obtain patient-reported outcomes at the activity/participation and quality of life levels. As a proof of concept, a single subject with PD was recruited to participate in 9 weekly 1-h intergenerational choir rehearsals. The subject was assessed before, 1 week post, and 8 weeks post-choir.Result: Notable trends of improvement were observed in multiple domains of communication impairments at 1 week post-choir. Some improvements were maintained at 8 weeks post-choir. Patient-reported outcomes exhibited limited pre-post changes.Conclusion: This study provided the theoretical groundwork and an empirical measurement tool for future validation of intergenerational choral singing as a novel rehabilitation for PD.
Collapse
Affiliation(s)
- Panying Rong
- Department of Speech-Language-Hearing: Sciences & Disorders, University of Kansas, Lawrence, KS, USA and
| | | |
Collapse
|
5
|
Kuo HC, Hsieh YP, Tseng HH, Wang CT, Fang SH, Tsao Y. Toward Real-World Voice Disorder Classification. IEEE Trans Biomed Eng 2023; 70:2922-2932. [PMID: 37099463 DOI: 10.1109/tbme.2023.3270532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/27/2023]
Abstract
OBJECTIVE Voice disorders significantly compromise individuals' ability to speak in their daily lives. Without early diagnosis and treatment, these disorders may deteriorate drastically. Thus, automatic classification systems at home are desirable for people who are inaccessible to clinical disease assessments. However, the performance of such systems may be weakened due to the constrained resources and domain mismatch between the clinical data and noisy real-world data. METHODS This study develops a compact and domain-robust voice disorder classification system to identify the utterances of health, neoplasm, and benign structural diseases. Our proposed system utilizes a feature extractor model composed of factorized convolutional neural networks and subsequently deploys domain adversarial training to reconcile the domain mismatch by extracting domain-invariant features. RESULTS The results show that the unweighted average recall in the noisy real-world domain improved by 13% and remained at 80% in the clinic domain with only slight degradation. The domain mismatch was effectively eliminated. Moreover, the proposed system reduced the usage of both memory and computation by over 73.9%. CONCLUSION By deploying factorized convolutional neural networks and domain adversarial training, domain-invariant features can be derived for voice disorder classification with limited resources. The promising results confirm that the proposed system can significantly reduce resource consumption and improve classification accuracy by considering the domain mismatch. SIGNIFICANCE To the best of our knowledge, this is the first study that jointly considers real-world model compression and noise-robustness issues in voice disorder classification. The proposed system is intended for application to embedded systems with limited resources.
Collapse
|
6
|
Carrón J, Campos-Roca Y, Madruga M, Pérez CJ. A mobile-assisted voice condition analysis system for Parkinson's disease: assessment of usability conditions. Biomed Eng Online 2021; 20:114. [PMID: 34802448 PMCID: PMC8607631 DOI: 10.1186/s12938-021-00951-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Accepted: 11/04/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND AND OBJECTIVE Automatic voice condition analysis systems to detect Parkinson's disease (PD) are generally based on speech data recorded under acoustically controlled conditions and professional supervision. The performance of these approaches in a free-living scenario is unknown. The aim of this research is to investigate the impact of uncontrolled conditions (realistic acoustic environment and lack of supervision) on the performance of automatic PD detection systems based on speech. METHODS A mobile-assisted voice condition analysis system is proposed to aid in the detection of PD using speech. The system is based on a server-client architecture. In the server, feature extraction and machine learning algorithms are designed and implemented to discriminate subjects with PD from healthy ones. The Android app allows patients to submit phonations and physicians to check the complete record of every patient. Six different machine learning classifiers are applied to compare their performance on two different speech databases. One of them is an in-house database (UEX database), collected under professional supervision by using the same Android-based smartphone in the same room, whereas the other one is an age, sex and health-status balanced subset of mPower study for PD, which provides real-world data. By applying identical methodology, single-database experiments have been performed on each database, and also cross-database tests. Cross-validation has been applied to assess generalization performance and hypothesis tests have been used to report statistically significant differences. RESULTS In the single-database experiments, a best accuracy rate of 0.92 (AUC = 0.98) has been obtained on UEX database, while a considerably lower best accuracy rate of 0.71 (AUC = 0.76) has been achieved using the mPower-based database. The cross-database tests provided very degraded accuracy metrics. CONCLUSION The results clearly show the potential of the proposed system as an aid for general practitioners to conduct triage or an additional tool for neurologists to perform diagnosis. However, due to the performance degradation observed using data from mPower study, semi-controlled conditions are encouraged, i.e., voices recorded at home by the patients themselves following a strict recording protocol and control of the information about patients by the medical doctor at charge.
Collapse
Affiliation(s)
- Javier Carrón
- Departamento de Matemáticas, Universidad de Extremadura, Cáceres, Spain
| | - Yolanda Campos-Roca
- Departamento de Tecnología de los Computadores y las Comunicaciones, Universidad de Extremadura, Cáceres, Spain
| | - Mario Madruga
- Departamento de Matemáticas, Universidad de Extremadura, Cáceres, Spain
| | - Carlos J Pérez
- Departamento de Matemáticas, Universidad de Extremadura, Cáceres, Spain.
| |
Collapse
|
7
|
Madruga M, Campos-Roca Y, Pérez CJ. Impact of noise on the performance of automatic systems for vocal fold lesions detection. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
8
|
Serry MA, Stepp CE, Peterson SD. Physics of phonation offset: Towards understanding relative fundamental frequency observations. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2021; 149:3654. [PMID: 34241131 PMCID: PMC8163514 DOI: 10.1121/10.0005006] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Revised: 04/15/2021] [Accepted: 04/21/2021] [Indexed: 05/26/2023]
Abstract
Relative fundamental frequency (RFF) is a promising assessment technique for vocal pathologies. Herein, we explore the underlying laryngeal factors dictating RFF behaviours during phonation offset. To gain physical insights, we analyze a simple impact oscillator model and follow that with a numerical study using the well-established body-cover model of the vocal folds (VFs). Study of the impact oscillator suggests that the observed decrease in fundamental frequency during offset is due, at least in part, to the increase in the neutral gap between the VFs during abduction and the concomitant decrease in collision forces. Moreover, the impact oscillator elucidates a correlation between sharper drops in RFF and increased stiffness of the VFs, supporting experimental RFF studies. The body-cover model study further emphasizes the correlation between the drops in RFF and collision forces. The numerical analysis also illustrates the sensitivity of RFF to abduction initiation time relative to the phase of the phonation cycle, and the abduction period length. In addition, the numerical simulations display the potential role of the cricothyroid muscle to mitigate the RFF reduction. Last, simplified models of phonotraumatic vocal hyperfunction are explored, demonstrating that the observed sharper drops in RFF are associated with increased pre-offset collision forces.
Collapse
Affiliation(s)
- Mohamed A Serry
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada
| | - Cara E Stepp
- Department of Speech, Language & Hearing Sciences, Boston University, Boston, Massachusetts 02215, USA
| | - Sean D Peterson
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, Ontario N2L 3G1, Canada
| |
Collapse
|
9
|
Selvam V S, Devi S S. Nonlinear analysis of scalp EEGs from normal and brain tumour subjects. BIOMED ENG-BIOMED TE 2021; 66:115-123. [PMID: 33768765 DOI: 10.1515/bmt-2020-0035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Accepted: 09/28/2020] [Indexed: 11/15/2022]
Abstract
Measurement of features from the chaos theory or as popularly known, the concept of nonlinear dynamics, as indicatives of several pathological conditions and cognition states using the electroencephalography (EEG) signal is very popular. In this paper, the analysis of scalp EEG signals of normal subjects and brain tumour patients using the nonlinear dynamic features has been presented. The nonlinear dynamic features that represent the dimensional and waveform complexities of the signal being analyzed have been considered. The statistical analysis of the selected nonlinear dynamic features has been presented. The results show that the nonlinear dynamic features significantly discriminate the brain tumour group from the normal group.
Collapse
Affiliation(s)
- Salai Selvam V
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Chennai, 600 025, Tamil Nadu, India
| | - Shenbaga Devi S
- Department of Electronics and Communication Engineering, College of Engineering, Guindy, Anna University, Chennai, 600 025, Tamil Nadu, India
| |
Collapse
|
10
|
Robust Detection of COVID-19 in Cough Sounds: Using Recurrence Dynamics and Variable Markov Model. SN COMPUTER SCIENCE 2021; 2:34. [PMID: 33458700 PMCID: PMC7802616 DOI: 10.1007/s42979-020-00422-6] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Accepted: 12/08/2020] [Indexed: 01/31/2023]
Abstract
COVID-19, otherwise known as the coronavirus, has precipitated the world into a pandemic that has infected, as of the time of writing, more than 10 million persons worldwide and caused the death of more than 500,000 persons. Early symptoms of the virus include trouble breathing, fever and fatigue and over 60% of people experience a dry cough. Due to the devastating impact of COVID-19 and the tragic loss of lives, it is of the utmost urgency to develop methods for the early detection of the disease that may help limit its spread as well as aid in the development of targeted solutions. Coughs and other vocal sounds contain pulmonary health information that can be used for diagnostic purposes, and recent studies in chaotic dynamics have shown that nonlinear phenomena exist in vocal signals. The present work investigates the use of symbolic recurrence quantification measures with MFCC features for the automatic detection of COVID-19 in cough sounds of healthy and sick individuals. Our performance evaluation reveals that our symbolic dynamics measures capture the complex dynamics in the vocal sounds and are highly effective at discriminating sick and healthy coughs. We apply our method to sustained vowel 'ah' recordings, and show that our model is robust for the detection of the disease in sustained vowel utterances as well. Furthermore, we introduce a robust novel method of informative undersampling using information rate to deal with the imbalance in our dataset, due to the unavailability of an equal number of sick and healthy recordings. The proposed model achieves a mean classification performance of 97% and 99%, and a mean F 1 -score of 91% and 89% after optimization, for coughs and sustained vowels, respectively.
Collapse
|
11
|
Performance of Different Acoustic Measures to Discriminate Individuals With and Without Voice Disorders. J Voice 2020; 36:487-498. [PMID: 32798120 DOI: 10.1016/j.jvoice.2020.07.008] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2020] [Revised: 07/11/2020] [Accepted: 07/13/2020] [Indexed: 11/20/2022]
Abstract
The goal of this study is to compare and combine different acoustic features in discriminating subjects with and without voice disorders. A database of 484 adult patients participated in the research. All subjects recorded a sustained vowel /Ɛ/ and underwent a laryngoscopic examination of the larynx. From the results of the laryngeal examination performed by a physician and the auditory-perceptual judgment performed by a Speech-Language Pathologist, the subjects were allocated to the group with (n = 52) and without (n = 432) voice disorder. Four types of acoustic features were used: traditional measures, cepstral measures, nonlinear measures, and recurrence quantification measures. Recordings comprised the emission of the vowel /ε/. Quadratic discriminant analysis was used as classifier. Individual features in the context of traditional, cepstral, and recurrence quantification measures achieved an acceptable performance of ≥70%. Combination of measures improved the classifier performance. The best classification result (86.43% accuracy) was obtained by combining traditional linear and recurrence quantification measures. Results shown that Traditional, Cepstral, and recurrence quantification measures are promising features that capture meaningful information about voice production, which provides good classification performances. The findings of this study can be used to develop a computational tool for voice disorders diagnosis and monitoring.
Collapse
|
12
|
Teixeira JP, Alves N, Fernandes PO. Vocal Acoustic Analysis. INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS 2020. [DOI: 10.4018/ijehmc.2020010103] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Vocal acoustic analysis is becoming a useful tool for the classification and recognition of laryngological pathologies. This technique enables a non-invasive and low-cost assessment of voice disorders, allowing a more efficient, fast, and objective diagnosis. In this work, ANN and SVM were experimented on to classify between dysphonic/control and vocal cord paralysis/control. A vector was made up of 4 jitter parameters, 4 shimmer parameters, and a harmonic to noise ratio (HNR), determined from 3 different vowels at 3 different tones, with a total of 81 features. Variable selection and dimension reduction techniques such as hierarchical clustering, multilinear regression analysis and principal component analysis (PCA) was applied. The classification between dysphonic and control was made with an accuracy of 100% for female and male groups with ANN and SVM. For the classification between vocal cords paralysis and control an accuracy of 78,9% was achieved for female group with SVM, and 81,8% for the male group with ANN.
Collapse
Affiliation(s)
- João Paulo Teixeira
- Research Centre in Digitalization and Intelligent Robotics (CEDRI) and Applied Management Research Unit (UNIAG), Instituto Politécnico de Bragança, Bragança, Portugal
| | - Nuno Alves
- Instituto Politécnico de Bragança, Bragança, Portugal
| | - Paula Odete Fernandes
- Applied Management Research Unit (UNIAG), Instituto Politécnico de Bragança, Bragança, Portugal
| |
Collapse
|
13
|
On the design of automatic voice condition analysis systems. Part I: Review of concepts and an insight to the state of the art. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2018.12.024] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
14
|
Upadhya SS, Cheeran A, Nirmal J. Thomson Multitaper MFCC and PLP voice features for early detection of Parkinson disease. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.07.019] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
15
|
Paniagua MS, Pérez CJ, Calle-Alonso F, Salazar C. An Acoustic-Signal-Based Preventive Program for University Lecturers' Vocal Health. J Voice 2018; 34:88-99. [PMID: 30072204 DOI: 10.1016/j.jvoice.2018.05.011] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2018] [Revised: 05/22/2018] [Accepted: 05/24/2018] [Indexed: 10/28/2022]
Abstract
INTRODUCTION Professional activities of university lecturers involve continued and sustained use of the voice, leading in many cases to increased risk of developing voice disorders. Risk identification followed by the fast application of preventive or corrective measures is a key issue in this context. OBJECTIVE Define and implement a preventive program for the vocal health of university lecturers by using acoustic features automatically extracted from voice recordings to identify risk groups and manage preventive or corrective actions MATERIAL AND METHODS: A total of 170 subjects, aged between 18 and 65, were recruited at the San Pedro de Alcántara Hospital and at the University of Extremadura in Cáceres (Spain). They formed three groups-one of 25 people suffering from vocal fold nodules, another of 25 healthy people, and the third of 120 university lecturers. Medical history and voice status assessment was performed, and voice recordings were made following a research protocol. A feature extraction, selection, and classification procedure was applied to the voice recordings to provide the best predictors for discriminating between pathological and healthy voices. The model parameters were then used to determine the lecturers' probability of suffering vocal fold nodules or other pathologies with similar dysphonic speech. These probabilities were used to classify the lecturers into three risk groups-low, medium, and high. These groups were taken as the basis to assign the lecturers to a primary, secondary, or tertiary prevention level. Different preventive or corrective actions were applied for each prevention level. RESULTS The best set of predictors comprised sample entropy, correlation dimension, pitch period entropy, glottal noise excitation, and sex, achieving an overall accuracy of 92% with a random forest classifier. They all showed statistically significant differences between vocal fold nodules and healthy groups (P < 0.05). Three out of the four best acoustic features were nonlinear, showing the importance of nonlinear dynamics for clinical practice. The model parameters were applied to the predictors of the lecturers so as to assign them to the different risk groups, leading to 60.8% (73 out of 120) of the lecturers in the low-risk group, 29.2% (35 out of 120) in the medium-risk group, and 10% (12 out of 120) in the high-risk group. The prevention levels were assigned on the basis of this classification and the medical history and laryngological evaluation of some specific subjects. A statistically significant association was found between the voice status and the assigned prevention level (P < 0.001), with there being a clear dependence relationship (Cramér's V = 0.630). CONCLUSION It is feasible to develop and apply a preventive voice program for university lecturers that is aided by features automatically extracted from voice recordings. As the program progresses, it is expected that the information automatically provided for the assignment to prevention levels will become ever more precise. The method proposed can be extended to other voice professionals and other voice disorders.
Collapse
Affiliation(s)
- M Sandra Paniagua
- Departamento de Enfermería, Universidad de Extremadura, Mérida, Spain
| | - Carlos J Pérez
- Departamento de Matemáticas, Universidad de Extremadura, Cáceres, Spain.
| | | | - Carmen Salazar
- Servicio de Otorrinolaringología, Hospital San Pedro de Alcántara, Cáceres, Spain
| |
Collapse
|
16
|
Upadhya SS, Cheeran A. Discriminating Parkinson and Healthy People Using Phonation and Cepstral Features of Speech. ACTA ACUST UNITED AC 2018. [DOI: 10.1016/j.procs.2018.10.376] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
17
|
Borsky M, Mehta DD, Van Stan JH, Gudnason J. Modal and non-modal voice quality classification using acoustic and electroglottographic features. IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING 2017; 25:2281-2291. [PMID: 33748320 PMCID: PMC7971071 DOI: 10.1109/taslp.2017.2759002] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The goal of this study was to investigate the performance of different feature types for voice quality classification using multiple classifiers. The study compared the COVAREP feature set; which included glottal source features, frequency warped cepstrum and harmonic model features; against the mel-frequency cepstral coefficients (MFCCs) computed from the acoustic voice signal, acoustic-based glottal inverse filtered (GIF) waveform, and electroglottographic (EGG) waveform. Our hypothesis was that MFCCs can capture the perceived voice quality from either of these three voice signals. Experiments were carried out on recordings from 28 participants with normal vocal status who were prompted to sustain vowels with modal and non-modal voice qualities. Recordings were rated by an expert listener using the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V), and the ratings were transformed into a dichotomous label (presence or absence) for the prompted voice qualities of modal voice, breathiness, strain, and roughness. The classification was done using support vector machines, random forests, deep neural networks and Gaussian mixture model classifiers, which were built as speaker independent using a leave-one-speaker-out strategy. The best classification accuracy of 79.97% was achieved for the full COVAREP set. The harmonic model features were the best performing subset, with 78.47% accuracy, and the static+dynamic MFCCs scored at 74.52%. A closer analysis showed that MFCC and dynamic MFCC features were able to classify modal, breathy, and strained voice quality dimensions from the acoustic and GIF waveforms. Reduced classification performance was exhibited by the EGG waveform.
Collapse
|
18
|
A Transparent Decision Support Tool in Screening for Laryngeal Disorders Using Voice and Query Data. APPLIED SCIENCES-BASEL 2017. [DOI: 10.3390/app7101096] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
19
|
Sodre B, Rosa M, Dassie-Leite A. Evaluating the use of neural networks and acoustic measurements to identify laryngeal pathologies. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2017:4590-4593. [PMID: 29060919 DOI: 10.1109/embc.2017.8037878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Nineteen acoustical measurements were related to 23 larynx conditions by artificial neural networks (ANNs) and principal component analysis. An exhaustive analysis (combining all possible sets of acoustical measurements as ANN inputs) showed a performance of 99.4% for accuracy and 90.3% for sensitivity and specificity in classifying voice signals into normal and non-normal larynx conditions. In the case of individual larynx condition identification, the general sensitivity drop significantly (6.4%), although some conditions were better identified (including "vocal nodules" and "cysts") then others, reaching 99.8% of sensitivity. We also identified the acoustical measurements that produced the best classification results.
Collapse
|
20
|
Enhanced Living by Assessing Voice Pathology Using a Co-Occurrence Matrix. SENSORS 2017; 17:s17020267. [PMID: 28146069 PMCID: PMC5336070 DOI: 10.3390/s17020267] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2016] [Revised: 01/14/2017] [Accepted: 01/25/2017] [Indexed: 11/16/2022]
Abstract
A large number of the population around the world suffers from various disabilities. Disabilities affect not only children but also adults of different professions. Smart technology can assist the disabled population and lead to a comfortable life in an enhanced living environment (ELE). In this paper, we propose an effective voice pathology assessment system that works in a smart home framework. The proposed system takes input from various sensors, and processes the acquired voice signals and electroglottography (EGG) signals. Co-occurrence matrices in different directions and neighborhoods from the spectrograms of these signals were obtained. Several features such as energy, entropy, contrast, and homogeneity from these matrices were calculated and fed into a Gaussian mixture model-based classifier. Experiments were performed with a publicly available database, namely, the Saarbrucken voice database. The results demonstrate the feasibility of the proposed system in light of its high accuracy and speed. The proposed system can be extended to assess other disabilities in an ELE.
Collapse
|
21
|
Speech disorders in Parkinson’s disease: early diagnostics and effects of medication and brain stimulation. J Neural Transm (Vienna) 2017; 124:303-334. [PMID: 28101650 DOI: 10.1007/s00702-017-1676-0] [Citation(s) in RCA: 116] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2016] [Accepted: 01/04/2017] [Indexed: 01/31/2023]
|
22
|
Muhammad G, Alsulaiman M, Ali Z, Mesallam TA, Farahat M, Malki KH, Al-nasheri A, Bencherif MA. Voice pathology detection using interlaced derivative pattern on glottal source excitation. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2016.08.002] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
23
|
Voice Disorder Classification Based on Multitaper Mel Frequency Cepstral Coefficients Features. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:956249. [PMID: 26681977 PMCID: PMC4670637 DOI: 10.1155/2015/956249] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/18/2015] [Revised: 10/27/2015] [Accepted: 10/28/2015] [Indexed: 11/18/2022]
Abstract
The Mel Frequency Cepstral Coefficients (MFCCs) are widely used in order to extract essential information from a voice signal and became a popular feature extractor used in audio processing. However, MFCC features are usually calculated from a single window (taper) characterized by large variance. This study shows investigations on reducing variance for the classification of two different voice qualities (normal voice and disordered voice) using multitaper MFCC features. We also compare their performance by newly proposed windowing techniques and conventional single-taper technique. The results demonstrate that adapted weighted Thomson multitaper method could distinguish between normal voice and disordered voice better than the results done by the conventional single-taper (Hamming window) technique and two newly proposed windowing methods. The multitaper MFCC features may be helpful in identifying voices at risk for a real pathology that has to be proven later.
Collapse
|
24
|
Orozco-Arroyave JR, Belalcazar-Bolanos EA, Arias-Londono JD, Vargas-Bonilla JF, Skodda S, Rusz J, Daqrouq K, Honig F, Noth E. Characterization Methods for the Detection of Multiple Voice Disorders: Neurological, Functional, and Laryngeal Diseases. IEEE J Biomed Health Inform 2015; 19:1820-8. [DOI: 10.1109/jbhi.2015.2467375] [Citation(s) in RCA: 79] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
25
|
Mekyska J, Janousova E, Gomez-Vilda P, Smekal Z, Rektorova I, Eliasova I, Kostalova M, Mrackova M, Alonso-Hernandez JB, Faundez-Zanuy M, López-de-Ipiña K. Robust and complex approach of pathological speech signal analysis. Neurocomputing 2015. [DOI: 10.1016/j.neucom.2015.02.085] [Citation(s) in RCA: 77] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
26
|
Ghasemzadeh H, Tajik Khass M, Khalil Arjmandi M, Pooyan M. Detection of vocal disorders based on phase space parameters and Lyapunov spectrum. Biomed Signal Process Control 2015. [DOI: 10.1016/j.bspc.2015.07.002] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
27
|
Uloza V, Padervinskis E, Vegiene A, Pribuisiene R, Saferis V, Vaiciukynas E, Gelzinis A, Verikas A. Exploring the feasibility of smart phone microphone for measurement of acoustic voice parameters and voice pathology screening. Eur Arch Otorhinolaryngol 2015; 272:3391-9. [DOI: 10.1007/s00405-015-3708-4] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2015] [Accepted: 06/30/2015] [Indexed: 10/23/2022]
|
28
|
|
29
|
Cirugeda-Roldán EM, Cuesta-Frau D, Miró-Martínez P, Oltra-Crespo S, Vigil-Medina L, Varela-Entrecanales M. A new algorithm for quadratic sample entropy optimization for very short biomedical signals: application to blood pressure records. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2014; 114:231-239. [PMID: 24685244 DOI: 10.1016/j.cmpb.2014.02.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2013] [Revised: 01/03/2014] [Accepted: 02/15/2014] [Indexed: 06/03/2023]
Abstract
This paper describes a new method to optimize the computation of the quadratic sample entropy (QSE) metric. The objective is to enhance its segmentation capability between pathological and healthy subjects for short and unevenly sampled biomedical records, like those obtained using ambulatory blood pressure monitoring (ABPM). In ABPM, blood pressure is measured every 20-30 min during 24h while patients undergo normal daily activities. ABPM is indicated for a number of applications such as white-coat, suspected, borderline, or masked hypertension. Hypertension is a very important clinical issue that can lead to serious health implications, and therefore its identification and characterization is of paramount importance. Nonlinear processing of signals by means of entropy calculation algorithms has been used in many medical applications to distinguish among signal classes. However, most of these methods do not perform well if the records are not long enough and/or not uniformly sampled. That is the case for ABPM records. These signals are extremely short and scattered with outliers or missing/resampled data. This is why ABPM Blood pressure signal screening using nonlinear methods is a quite unexplored field. We propose an additional stage for the computation of QSE independently of its parameter r and the input signal length. This enabled us to apply a segmentation process to ABPM records successfully. The experimental dataset consisted of 61 blood pressure data records of control and pathological subjects with only 52 samples per time series. The entropy estimation values obtained led to the segmentation of the two groups, while other standard nonlinear methods failed.
Collapse
Affiliation(s)
- E M Cirugeda-Roldán
- Technological Institute of Informatics (ITI), Polytechnic University of Valencia, Campus Alcoi (EPSA-UPV), Plaza Ferrándiz y Carbonell, 2, 03801 Alcoi, Spain
| | - D Cuesta-Frau
- Technological Institute of Informatics (ITI), Polytechnic University of Valencia, Campus Alcoi (EPSA-UPV), Plaza Ferrándiz y Carbonell, 2, 03801 Alcoi, Spain.
| | - P Miró-Martínez
- Statistics Department at Polytechnic University of Valencia, Campus Alcoi, Plaza Ferrándiz y Carbonell, 2, 03801 Alcoi, Spain.
| | - S Oltra-Crespo
- Technological Institute of Informatics (ITI), Polytechnic University of Valencia, Campus Alcoi (EPSA-UPV), Plaza Ferrándiz y Carbonell, 2, 03801 Alcoi, Spain
| | - L Vigil-Medina
- Hypertension Unit of Internal Medicine Service at the University Hospital of Móstoles, Río Júcar s/n, 28935 Móstoles, Madrid, Spain.
| | - M Varela-Entrecanales
- Internal Medicine Service at the University Hospital of Móstoles, Río Júcar s/n, 28935 Móstoles, Madrid, Spain.
| |
Collapse
|
30
|
|
31
|
Xue Q, Zheng X, Mittal R, Bielamowicz S. Computational study of effects of tension imbalance on phonation in a three-dimensional tubular larynx model. J Voice 2014; 28:411-9. [PMID: 24725589 DOI: 10.1016/j.jvoice.2013.12.016] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2013] [Accepted: 12/23/2013] [Indexed: 10/25/2022]
Abstract
OBJECTIVES The present study explores the use of a continuum-based computational model to investigate the effect of left-right tension imbalance on vocal fold (VF) vibrations and glottal aerodynamics, as well as its implication on phonation. The study allows us to gain new insights into the underlying physical mechanism of irregularities induced by VF tension imbalance associated with unilateral cricothyroid muscle paralysis. METHODS A three-dimensional simulation of glottal flow and VF dynamics in a tubular laryngeal model with tension imbalance was conducted by using a coupled flow-structure interaction computational model. Tension imbalance was modeled by reducing by 20% the Young's modulus of one of the VFs, while holding VF length constant. Effects of tension imbalance on vibratory characteristic of the VFs and on the time-varying properties of glottal airflow as well as the aerodynamic energy transfer are comprehensively analyzed. RESULTS AND CONCLUSIONS The analysis demonstrates that the continuum-based biomechanical model can provide a good description of phonatory dynamics in tension imbalance conditions. It is found that although 20% tension imbalance does not have noticeable effects on the fundamental frequency, it does lead to a larger glottal flow leakage and asymmetric vibrations of the two VFs. A detailed analysis of the energy transfer suggests that the majority of the energy is consumed by the lateral motion of the VFs and the net energy transferred to the softer fold is less than the one transferred to the normal fold.
Collapse
Affiliation(s)
- Qian Xue
- Department of Mechanical Engineering, University of Maine, Orono, Maine
| | - Xudong Zheng
- Department of Mechanical Engineering, University of Maine, Orono, Maine.
| | - Rajat Mittal
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, Maryland
| | - Steven Bielamowicz
- Division of Otolaryngology, The George Washington University, Washington, District of Columbia
| |
Collapse
|
32
|
Kaleem M, Ghoraani B, Guergachi A, Krishnan S. Pathological speech signal analysis and classification using empirical mode decomposition. Med Biol Eng Comput 2013; 51:811-21. [PMID: 23460198 DOI: 10.1007/s11517-013-1051-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2012] [Accepted: 02/15/2013] [Indexed: 11/28/2022]
Affiliation(s)
- Muhammad Kaleem
- Department of Electrical and Computer Engineering, Ryerson University, Toronto, Canada.
| | | | | | | |
Collapse
|
33
|
|
34
|
Henríquez Rodríguez P, Alonso Hernández JB, Ferrer Ballester MA, Travieso González CM, Orozco-Arroyave JR. Global Selection of Features for Nonlinear Dynamics Characterization of Emotional Speech. Cognit Comput 2012. [DOI: 10.1007/s12559-012-9157-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
35
|
Arias-Londoño JD, Godino-Llorente JI, Sáenz-Lechón N, Osma-Ruiz V, Castellanos-Domínguez G. Automatic detection of pathological voices using complexity measures, noise parameters, and mel-cepstral coefficients. IEEE Trans Biomed Eng 2011; 58:370-9. [PMID: 21257362 DOI: 10.1109/tbme.2010.2089052] [Citation(s) in RCA: 96] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper proposes a new approach to improve the amount of information extracted from the speech aiming to increase the accuracy of a system developed for the automatic detection of pathological voices. The paper addresses the discrimination capabilities of 11 features extracted using nonlinear analysis of time series. Two of these features are based on conventional nonlinear statistics (largest Lyapunov exponent and correlation dimension), two are based on recurrence and fractal-scaling analysis, and the remaining are based on different estimations of the entropy. Moreover, this paper uses a strategy based on combining classifiers for fusing the nonlinear analysis with the information provided by classic parameterization approaches found in the literature (noise parameters and mel-frequency cepstral coefficients). The classification was carried out in two steps using, first, a generative and, later, a discriminative approach. Combining both classifiers, the best accuracy obtained is 98.23% ± 0.001.
Collapse
|
36
|
|
37
|
Rusz J, Cmejla R, Ruzickova H, Ruzicka E. Quantitative acoustic measurements for characterization of speech and voice disorders in early untreated Parkinson's disease. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2011; 129:350-367. [PMID: 21303016 DOI: 10.1121/1.3514381] [Citation(s) in RCA: 214] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
An assessment of vocal impairment is presented for separating healthy people from persons with early untreated Parkinson's disease (PD). This study's main purpose was to (a) determine whether voice and speech disorder are present from early stages of PD before starting dopaminergic pharmacotherapy, (b) ascertain the specific characteristics of the PD-related vocal impairment, (c) identify PD-related acoustic signatures for the major part of traditional clinically used measurement methods with respect to their automatic assessment, and (d) design new automatic measurement methods of articulation. The varied speech data were collected from 46 Czech native speakers, 23 with PD. Subsequently, 19 representative measurements were pre-selected, and Wald sequential analysis was then applied to assess the efficiency of each measure and the extent of vocal impairment of each subject. It was found that measurement of the fundamental frequency variations applied to two selected tasks was the best method for separating healthy from PD subjects. On the basis of objective acoustic measures, statistical decision-making theory, and validation from practicing speech therapists, it has been demonstrated that 78% of early untreated PD subjects indicate some form of vocal impairment. The speech defects thus uncovered differ individually in various characteristics including phonation, articulation, and prosody.
Collapse
Affiliation(s)
- J Rusz
- Department of Circuit Theory, Faculty of Electrical Engineering, Czech Technical University in Prague, Technicka 2, 116 27, Prague 6, Czech Republic.
| | | | | | | |
Collapse
|
38
|
Dibazar AA, Park HO, Berger TW. Nonlinear dynamic modeling of impaired voice. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2010:2770-2773. [PMID: 21095964 DOI: 10.1109/iembs.2010.5626361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
This paper presents a nonlinear dynamic model for the purpose of modeling vowels uttered by patients who have problem in the control of voice box muscles. The proposed model will be utilized in the detection of speech pathologies and also automatic speech recognition systems to enhance patients' communication capabilities. The model of this study utilizes feedback, and also a sigmoid nonlinear function which is not included in the linear speech production models. The nonlinear function allows for the higher order dynamics of the signal to be captured and feedback increases dynamicity of the model. The model of the current research was applied to discriminate between few voice pathologies and normal cases. The statistical analysis of the parameters of the trained model showed that these parameters can provide independent and distinct features with which pathological classes can be discriminated.
Collapse
Affiliation(s)
- Alireza A Dibazar
- Department of Biomedical Engineering, University of Southern California, 1042 Downey Way, DRB-140, Los Angeles, CA 90089, USA.
| | | | | |
Collapse
|