1
|
Liu R, He Y, Zhu X, Duan J, Liu C, Xie Z, McCulloch I, Yue W. Hardware-Feasible and Efficient N-Type Organic Neuromorphic Signal Recognition via Reservoir Computing. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2025; 37:e2409258. [PMID: 39578330 DOI: 10.1002/adma.202409258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 11/08/2024] [Indexed: 11/24/2024]
Abstract
Organic electrochemical synaptic transistors (OESTs), inspired by the biological nervous system, have garnered increasing attention due to their multifunctional applications in neuromorphic computing. However, the practical implementation of OESTs for signal recognition-particularly those utilizing n-type organic mixed ionic-electronic conductors (OMIECs)-still faces significant challenges at the hardware level. Here, a state-of-the-art small-molecule n-type OEST integrated within a physically simple and hardware feasible reservoir-computing (RC) framework for practical temporal signal recognition is presented. This integration is achieved by leveraging the adjustable synaptic properties of the n-OEST, which exhibits tunable nonlinear short-term memory, transitioning from volatility to nonvolatility, and demonstrating adaptive temporal specificity. Additionally, the nonvolatile OEST offers 256 conductance levels and a wide dynamic range (≈147) in long-term potentiation/depression (LTP/LTD), surpassing previously reported n-OESTs. By combining volatile n-OESTs as reservoirs with a single-layer perceptron readout composed of nonvolatile n-OEST networks, this physical RC system achieves substantial recognition accuracy for both handwritten-digit images (94.9%) and spoken digit (90.7%), along with ultrahigh weight efficiency. Furthermore, this system demonstrates outstanding accuracy (98.0%) by grouped RC in practical sleep monitoring, specifically in snoring recognition. Here, a reliable pathway for OMIEC-driven computing is presented to advance bioinspired hardware-based neuromorphic computing in the physical world.
Collapse
Affiliation(s)
- Riping Liu
- Guangzhou Key Laboratory of Flexible Electronic Materials and Wearable Devices, Key Laboratory for Polymeric Composite and Functional Materials of Ministry of Education, School of Materials Science and Engineering, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| | - Yifei He
- Guangzhou Key Laboratory of Flexible Electronic Materials and Wearable Devices, Key Laboratory for Polymeric Composite and Functional Materials of Ministry of Education, School of Materials Science and Engineering, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| | - Xiuyuan Zhu
- Guangzhou Key Laboratory of Flexible Electronic Materials and Wearable Devices, Key Laboratory for Polymeric Composite and Functional Materials of Ministry of Education, School of Materials Science and Engineering, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| | - Jiayao Duan
- Guangzhou Key Laboratory of Flexible Electronic Materials and Wearable Devices, Key Laboratory for Polymeric Composite and Functional Materials of Ministry of Education, School of Materials Science and Engineering, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| | - Chuan Liu
- State Key Laboratory of Optoelectronic Materials and Technologies, Guangdong Province Key Laboratory of Display Material and Technology, School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| | - Zhuang Xie
- Guangzhou Key Laboratory of Flexible Electronic Materials and Wearable Devices, Key Laboratory for Polymeric Composite and Functional Materials of Ministry of Education, School of Materials Science and Engineering, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| | - Iain McCulloch
- Andlinger Center for Energy and the Environment, Department of Electrical and Computer Engineering, Princeton University, Princeton, NJ, 08544, USA
| | - Wan Yue
- Guangzhou Key Laboratory of Flexible Electronic Materials and Wearable Devices, Key Laboratory for Polymeric Composite and Functional Materials of Ministry of Education, School of Materials Science and Engineering, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, 510275, P. R. China
| |
Collapse
|
2
|
Dinh NN, Bach NC, Bach TV, Nguyet Chi DT, Cuong DD, Dat NT, Kien DT, Phuong NT, Thao LQ, Thien ND, Thuy DTT, Minh Thuy LT. Implementing deep learning on edge devices for snoring detection and reduction. Comput Biol Med 2025; 184:109458. [PMID: 39579667 DOI: 10.1016/j.compbiomed.2024.109458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2024] [Revised: 11/01/2024] [Accepted: 11/19/2024] [Indexed: 11/25/2024]
Abstract
This study introduces MinSnore, a novel deep learning model tailored for real-time snoring detection and reduction, specifically designed for deployment on low-configuration edge devices. By integrating MobileViTV3 blocks into the Dynamic MobileNetV3 backbone model architecture, MinSnore leverages both Convolutional Neural Networks (CNNs) and transformers to deliver enhanced feature representations with minimal computational overhead. The model was pre-trained on a diverse dataset of 46,349 audio files using the Self-Supervised Learning with Barlow Twins (SSL-BT) method, followed by fine-tuning on 17,355 segmented clips extracted from this dataset. MinSnore represents a significant breakthrough in snoring detection, achieving an accuracy of 96.37 %, precision of 96.31 %, recall of 94.12 %, and an F1-score of 95.02 %. When deployed on a single-board computer like a Raspberry Pi, the system demonstrated a reduction in snoring duration during real-world experiments. These results underscore the importance of this work in addressing sleep-related health issues through an efficient, low-cost, and highly accurate snoring mitigation solution.
Collapse
Affiliation(s)
- Nguyen Ngoc Dinh
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| | - Ngo Chi Bach
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| | - Tran Viet Bach
- Phan Boi Chau High School for the Gifted, Nghean City, 460000, Viet Nam
| | | | - Duong Duc Cuong
- Vietnam National University, Hanoi, 100000, Viet Nam; Thai Nguyen University of Technology, Thainguyen City, 250000, Viet Nam
| | - Nguyen Tien Dat
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| | - Do Trung Kien
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| | | | - Le Quang Thao
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam.
| | - Nguyen Duy Thien
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| | - Dang Thi Thanh Thuy
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| | - Luong Thi Minh Thuy
- Faculty of Physics, VNU University of Science, Hanoi, 100000, Viet Nam; Vietnam National University, Hanoi, 100000, Viet Nam
| |
Collapse
|
3
|
Dong H, Wu H, Yang G, Zhang J, Wan K. A multi-branch convolutional neural network for snoring detection based on audio. Comput Methods Biomech Biomed Engin 2024:1-12. [PMID: 38372231 DOI: 10.1080/10255842.2024.2317438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 02/03/2024] [Indexed: 02/20/2024]
Abstract
Obstructive sleep apnea (OSA) is associated with various health complications, and snoring is a prominent characteristic of this disorder. Therefore, the exploration of a concise and effective method for detecting snoring has consistently been a crucial aspect of sleep medicine. As the easily accessible data, the identification of snoring through sound analysis offers a more convenient and straightforward method. The objective of this study was to develop a convolutional neural network (CNN) for classifying snoring and non-snoring events based on audio. This study utilized Mel-frequency cepstral coefficients (MFCCs) as a method for extracting features during the preprocessing of raw data. In order to extract multi-scale features from the frequency domain of sound sources, this study proposes the utilization of a multi-branch convolutional neural network (MBCNN) for the purpose of classification. The network utilized asymmetric convolutional kernels to acquire additional information, while the adoption of one-hot encoding labels aimed to mitigate the impact of labels. The experiment tested the network's performance by utilizing a publicly available dataset consisting of 1,000 sound samples. The test results indicate that the MBCNN achieved a snoring detection accuracy of 99.5%. The integration of multi-scale features and the implementation of MBCNN, based on audio data, have demonstrated a substantial improvement in the performance of snoring classification.
Collapse
Affiliation(s)
- Hao Dong
- School of Computer Science, Zhongyuan University of Technology, Henan, China
- School of Computing and Artificial Intelligence, Huanghuai University, Henan, China
| | - Haitao Wu
- School of Computing and Artificial Intelligence, Huanghuai University, Henan, China
- Henan Key Laboratory of Smart Lighting, Henan, China
| | - Guan Yang
- School of Computer Science, Zhongyuan University of Technology, Henan, China
| | - Junming Zhang
- School of Computing and Artificial Intelligence, Huanghuai University, Henan, China
- Henan Key Laboratory of Smart Lighting, Henan, China
- Henan Joint International Research Laboratory of Behavior Optimization Control for Smart Robots, Henan, China
- Zhumadian Artificial Intelligence and Medical Engineering Technical Research Centre, Henan, China
| | - Keqin Wan
- School of Computing and Artificial Intelligence, Huanghuai University, Henan, China
| |
Collapse
|
4
|
Song Y, Sun X, Ding L, Peng J, Song L, Zhang X. AHI estimation of OSAHS patients based on snoring classification and fusion model. Am J Otolaryngol 2023; 44:103964. [PMID: 37392727 DOI: 10.1016/j.amjoto.2023.103964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 06/13/2023] [Accepted: 06/17/2023] [Indexed: 07/03/2023]
Abstract
Obstructive sleep apnea-hypopnea syndrome (OSAHS) is a chronic and common sleep-breathing disease that could negatively influence lives of patients and cause serious concomitant diseases. Polysomnography(PSG) is the gold standard for diagnosing OSAHS, but it is expensive and requires overnight hospitalization. Snoring is a typical symptom of OSAHS. This study proposes an effective OSAHS screening method based on snoring sound analysis. Snores were labeled as OSAHS related snoring sounds and simple snoring sounds according to real-time PSG records. Three models were used, including acoustic features combined with XGBoost, Mel-spectrum combined with convolution neural network (CNN), and Mel-spectrum combined with residual neural network (ResNet). Further, the three models were fused by soft voting to detect these two types of snoring sounds. The subject's apnea-hypopnea index (AHI) was estimated according to these recognized snoring sounds. The accuracy and recall of the proposed fusion model achieved 83.44% and 85.27% respectively, and the predicted AHI has a Pearson correlation coefficient of 0.913 (R2 = 0.834, p < 0.001) with PSG. The results demonstrate the validity of predicting AHI based on analysis of snoring sound and show great potential for monitoring OSAHS at home.
Collapse
Affiliation(s)
- Yujun Song
- School of Physics and Optoelectronics, South China University of Technology, Guangzhou 510640, China
| | - Xiaoran Sun
- School of Physics and Optoelectronics, South China University of Technology, Guangzhou 510640, China.
| | - Li Ding
- School of Physics and Optoelectronics, South China University of Technology, Guangzhou 510640, China
| | - Jianxin Peng
- School of Physics and Optoelectronics, South China University of Technology, Guangzhou 510640, China.
| | - Lijuan Song
- State Key Laboratory of Respiratory Disease, Department of Otolaryngology-Head and Neck Surgery, Laboratory of ENT-HNS Disease, First Affiliated Hospital, Guangzhou Medical University, Guangzhou 510120, China
| | - Xiaowen Zhang
- State Key Laboratory of Respiratory Disease, Department of Otolaryngology-Head and Neck Surgery, Laboratory of ENT-HNS Disease, First Affiliated Hospital, Guangzhou Medical University, Guangzhou 510120, China
| |
Collapse
|
5
|
Li R, Li W, Yue K, Zhang R, Li Y. Automatic snoring detection using a hybrid 1D-2D convolutional neural network. Sci Rep 2023; 13:14009. [PMID: 37640790 PMCID: PMC10462688 DOI: 10.1038/s41598-023-41170-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 08/23/2023] [Indexed: 08/31/2023] Open
Abstract
Snoring, as a prevalent symptom, seriously interferes with life quality of patients with sleep disordered breathing only (simple snorers), patients with obstructive sleep apnea (OSA) and their bed partners. Researches have shown that snoring could be used for screening and diagnosis of OSA. Therefore, accurate detection of snoring sounds from sleep respiratory audio at night has been one of the most important parts. Considered that the snoring is somewhat dangerously overlooked around the world, an automatic and high-precision snoring detection algorithm is required. In this work, we designed a non-contact data acquire equipment to record nocturnal sleep respiratory audio of subjects in their private bedrooms, and proposed a hybrid convolutional neural network (CNN) model for the automatic snore detection. This model consists of a one-dimensional (1D) CNN processing the original signal and a two-dimensional (2D) CNN representing images mapped by the visibility graph method. In our experiment, our algorithm achieves an average classification accuracy of 89.3%, an average sensitivity of 89.7%, an average specificity of 88.5%, and an average AUC of 0.947, which surpasses some state-of-the-art models trained on our data. In conclusion, our results indicate that the proposed method in this study could be effective and significance for massive screening of OSA patients in daily life. And our work provides an alternative framework for time series analysis.
Collapse
Affiliation(s)
- Ruixue Li
- Key Laboratory of RF Circuits and Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
| | - Wenjun Li
- Key Laboratory of RF Circuits and Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China.
| | - Keqiang Yue
- Key Laboratory of RF Circuits and Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
| | - Rulin Zhang
- Key Laboratory of RF Circuits and Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
| | - Yilin Li
- Key Laboratory of RF Circuits and Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
| |
Collapse
|
6
|
Dogan S, Akbal E, Tuncer T, Acharya UR. Application of substitution box of present cipher for automated detection of snoring sounds. Artif Intell Med 2021; 117:102085. [PMID: 34127246 DOI: 10.1016/j.artmed.2021.102085] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 04/30/2021] [Accepted: 05/03/2021] [Indexed: 01/06/2023]
Abstract
BACKGROUND AND PURPOSE Snoring is one of the sleep disorders, and snoring sounds have been used to diagnose many sleep-related diseases. However, the snoring sound classification is done manually which is time-consuming and prone to human errors. An automated snoring sound classification model is proposed to overcome these problems. MATERIAL AND METHOD This work proposes an automated snoring sound classification method using three new methods. These methods are maximum absolute pooling (MAP), the nonlinear present pattern, and two-layered neighborhood component analysis, and iterative neighborhood component analysis (NCAINCA) selector. Using these methods, a new snoring sound classification (SSC) model is presented. The MAP decomposition model is applied to snoring sounds to extract both low and high-level features. The presented model aims to attain high performance for SSC problem. The developed present pattern (Present-Pat) uses substitution box (SBox) and statistical feature generator. By deploying these feature generators, both textural and statistical features are generated. NCAINCA chooses the most informative/valuable features, and these selected features are fed to k-nearest neighbor (kNN) classifier with leave-one-out cross-validation (LOOCV). The Present-Pat based SSC system is developed using Munich-Passau Snore Sound Corpus (MPSSC) dataset comprising of four categories. RESULTS Our model reached an accuracy and unweighted average recall (UAR) of 97.10 % and 97.60 %, respectively, using LOOCV. Moreover, a nocturnal sound dataset is used to show the universal success of the presented model. Our model attained an accuracy of 98.14 % using the used nocturnal sound dataset. CONCLUSIONS Our developed classification model is ready to be tested with more data and can be used by sleep specialists to diagnose the sleep disorders based on snoring sounds.
Collapse
Affiliation(s)
- Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey.
| | - Erhan Akbal
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - U Rajendra Acharya
- Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, 599489, Singapore; Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore; Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
7
|
Jiang Y, Peng J, Zhang X. Automatic snoring sounds detection from sleep sounds based on deep learning. Phys Eng Sci Med 2020; 43:679-689. [DOI: 10.1007/s13246-020-00876-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Accepted: 04/24/2020] [Indexed: 10/24/2022]
|
8
|
Analysis of Energy Consumption and Optimization Techniques for Writing Energy-Efficient Code. ELECTRONICS 2019. [DOI: 10.3390/electronics8101192] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The unprecedented growth of connected devices, together with the remarkable convergence of a wide variety of technologies, have led to an exponential increase in the services that the internet of things (IoT) can offer, all aimed at improving quality of life. Consequently, in order to meet the numerous challenges this produces, the IoT has become a major subject of research. One of these challenges is the reduction of energy consumption given the significant limitations of some devices. In addition, although the search for energy efficiency was initially focused on hardware, it has become a concern for software developers too. In fact, it has become an intense area of research with the principal objective of analyzing and optimizing the energy consumption of software systems. This research analyzes the energy saving that can be achieved when using a broad set of techniques for writing energy-efficient code for Raspberry Pi devices. It also demonstrates that programmers can save more energy if they apply the proposed techniques manually than when relying on other automatic optimization options offered by the GNU compiler collection (GCC). Thus, it is important that programmers are aware of the significant impact these techniques can have on an application’s energy consumption.
Collapse
|