1
|
Wang K, Liao Y, Li W, Li J, Su H, Chen R, Park JH, Zhang Y, Zhou X, Wu C, Liu Z, Guo T, Kim TW. Memory-electroluminescence for multiple action-potentials combination in bio-inspired afferent nerves. Nat Commun 2024; 15:3505. [PMID: 38664383 PMCID: PMC11045776 DOI: 10.1038/s41467-024-47641-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 04/05/2024] [Indexed: 04/28/2024] Open
Abstract
The development of optoelectronics mimicking the functions of the biological nervous system is important to artificial intelligence. This work demonstrates an optoelectronic, artificial, afferent-nerve strategy based on memory-electroluminescence spikes, which can realize multiple action-potentials combination through a single optical channel. The memory-electroluminescence spikes have diverse morphologies due to their history-dependent characteristics and can be used to encode distributed sensor signals. As the key to successful functioning of the optoelectronic, artificial afferent nerve, a driving mode for light-emitting diodes, namely, the non-carrier injection mode, is proposed, allowing it to drive nanoscale light-emitting diodes to generate a memory-electroluminescence spikes that has multiple sub-peaks. Moreover, multiplexing of the spikes can be obtained by using optical signals with different wavelengths, allowing for a large signal bandwidth, and the multiple action-potentials transmission process in afferent nerves can be demonstrated. Finally, sensor-position recognition with the bio-inspired afferent nerve is developed and shown to have a high recognition accuracy of 98.88%. This work demonstrates a strategy for mimicking biological afferent nerves and offers insights into the construction of artificial perception systems.
Collapse
Affiliation(s)
- Kun Wang
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Yitao Liao
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Wenhao Li
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Junlong Li
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Hao Su
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Rong Chen
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China
| | - Jae Hyeon Park
- Department of Electronic and Computer Engineering, Hanyang University, Seoul, 133-791, Korea
| | - Yongai Zhang
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China
| | - Xiongtu Zhou
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China
| | - Chaoxing Wu
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China.
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China.
| | - Zhiqiang Liu
- Research and Development Center for Semiconductor Lighting Technology, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China.
| | - Tailiang Guo
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China.
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China.
| | - Tae Whan Kim
- Department of Electronic and Computer Engineering, Hanyang University, Seoul, 133-791, Korea.
| |
Collapse
|
2
|
Jha CK. Automated cardiac arrhythmia detection techniques: a comprehensive review for prospective approach. Comput Methods Biomech Biomed Engin 2024:1-16. [PMID: 38566498 DOI: 10.1080/10255842.2024.2332942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Accepted: 03/13/2024] [Indexed: 04/04/2024]
Abstract
Abnormal cardiac functionality produces irregular heart rhythms which are commonly known as arrhythmias. In some conditions, arrhythmias are treated as very dangerous which may lead to sudden cardiac arrest. The incidence and prevalence of cardiac anomalies seeks early detection of arrhythmias using automated classification techniques. In the past, numerous automated arrhythmia detection techniques have been developed that are based on electrocardiogram (ECG) signal analysis. Focusing on the prospective research in this field, this article reports a comprehensive review of existing techniques that are obtained using search engines such as IEEE explore, Google scholar and science direct. Based on the review, the existing techniques are broadly categorized into two types: machine-learning and deep-learning-based techniques. In this study, it is noticed that the performance of the machine-learning-based arrhythmia detection techniques depend on pre-processing of ECG signal, R-peaks detection, features extraction and classification tools while the deep-learning-based techniques do not require the features extraction step. Generally, the existing techniques utilize Massachusetts Institute of Technology-Beth Israel Hospital arrhythmia database to evaluate the classification performance. The classification performance of automated techniques also depends on ECG data used for training and testing of the classifier. It is expected that the performance should be evaluated using a variety of ECG signals including the cases of inter-patient and intra-patient paradigm. The existing techniques also require to deal with the class-imbalance problem. In addition to this, a specific partition-ratio between training and testing datasets should be maintained for fair comparison of performance of different techniques.
Collapse
Affiliation(s)
- Chandan Kumar Jha
- Department of Electronics & Communication Engineering, Indian Institute of Information Technology Bhagalpur, India
| |
Collapse
|
3
|
Yang L, Zheng Y, Liu Z, Tang R, Ma L, Chen Y, Zhang T, Li W. SAR model for accurate detection of multi-label arrhythmias from electrocardiograms. Heliyon 2023; 9:e21627. [PMID: 38027936 PMCID: PMC10663866 DOI: 10.1016/j.heliyon.2023.e21627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 10/06/2023] [Accepted: 10/25/2023] [Indexed: 12/01/2023] Open
Abstract
Objective Arrhythmias are prevalent symptoms of cardiovascular disease, necessitating accurate and timely detection to mitigate associated risks. Detecting arrhythmias from ECGs quickly and accurately holds great significance in preventing heart disease and reducing mortality. This research endeavors to outperform previous studies by developing a scientific neural network model capable of training and predicting ECG signals for 11 categories of arrhythmias, accounting for up to 5 co-existing labels. Methods In this study, we initially address the issue of imbalanced datasets by employing Borderline SMOTE and Cluster Centroids techniques during preprocessing. Subsequently, we propose a novel SAR model that combines attention and resnet mechanisms. The dataset is subjected to a 10-fold validation process to train and evaluate the model. Finally, several metrics such as HammingLoss, RankingLoss, F1-score, AUC and Coverage are used to evaluate the model. Results By evaluating the results of the tests, the average Hamming Loss is 1.12 %, the average Ranking Loss is 1.17 %, the average Micro F1-score is 98.46 %, the average Micro AUC is 98.76 %, and the average Coverage is 3.2762. The results show that the SAR model outperforms previous related studies on the task of classifying arrhythmia signals with multiple categories and labels. Conclusion The SAR model demonstrated excellent performance in accurately classifying multi-category and multi-label arrhythmia signals, affirming its scientific validity. Compared with previous studies, the model achieves a certain improvement in performance, which can help cardiologists to achieve scientific and accurate diagnosis of arrhythmia diseases.
Collapse
Affiliation(s)
- Liuyang Yang
- The Affiliated Hospital of Kunming University of Science and Technology. The First People's Hospital of Yunnan Province, Kunming, Yunnan, China
- Department of Management Science and Information System, Faculty of Management and Economics, Kunming University of Science and Technology, Kunming, Yunnan, China
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
| | - Yaqing Zheng
- The Affiliated Hospital of Kunming University of Science and Technology. The First People's Hospital of Yunnan Province, Kunming, Yunnan, China
| | - Zhimin Liu
- The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Kunming, Yunnan,China
| | - Rui Tang
- Department of Management Science and Information System, Faculty of Management and Economics, Kunming University of Science and Technology, Kunming, Yunnan, China
| | - Libing Ma
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
- Department of Respiratory and Critical Care Medicine, the Affiliated Hospital of Guilin Medical University, Guilin, Guangxi, China
| | - Yu Chen
- Department of Management Science and Information System, Faculty of Management and Economics, Kunming University of Science and Technology, Kunming, Yunnan, China
| | - Ting Zhang
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
| | - Wei Li
- The Affiliated Hospital of Kunming University of Science and Technology. The First People's Hospital of Yunnan Province, Kunming, Yunnan, China
| |
Collapse
|
4
|
Rahman MM, Rivolta MW, Badilini F, Sassi R. A Systematic Survey of Data Augmentation of ECG Signals for AI Applications. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115237. [PMID: 37299964 DOI: 10.3390/s23115237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 05/23/2023] [Accepted: 05/27/2023] [Indexed: 06/12/2023]
Abstract
AI techniques have recently been put under the spotlight for analyzing electrocardiograms (ECGs). However, the performance of AI-based models relies on the accumulation of large-scale labeled datasets, which is challenging. To increase the performance of AI-based models, data augmentation (DA) strategies have been developed recently. The study presented a comprehensive systematic literature review of DA for ECG signals. We conducted a systematic search and categorized the selected documents by AI application, number of leads involved, DA method, classifier, performance improvements after DA, and datasets employed. With such information, this study provided a better understanding of the potential of ECG augmentation in enhancing the performance of AI-based ECG applications. This study adhered to the rigorous PRISMA guidelines for systematic reviews. To ensure comprehensive coverage, publications between 2013 and 2023 were searched across multiple databases, including IEEE Explore, PubMed, and Web of Science. The records were meticulously reviewed to determine their relevance to the study's objective, and those that met the inclusion criteria were selected for further analysis. Consequently, 119 papers were deemed relevant for further review. Overall, this study shed light on the potential of DA to advance the field of ECG diagnosis and monitoring.
Collapse
Affiliation(s)
- Md Moklesur Rahman
- Dipartimento di Informatica, Università degli Studi di Milano, 20133 Milan, Italy
| | | | - Fabio Badilini
- School of Nursing, University of California, San Francisco, CA 94143, USA
- AMPS-LLC, New York, NY 10025, USA
| | - Roberto Sassi
- Dipartimento di Informatica, Università degli Studi di Milano, 20133 Milan, Italy
| |
Collapse
|
5
|
Chen Y, Zhang H, Liu J, Zhang Z, Zhang X. Tapped area detection and new tapping line location for natural rubber trees based on improved mask region convolutional neural network. FRONTIERS IN PLANT SCIENCE 2023; 13:1038000. [PMID: 36704160 PMCID: PMC9871551 DOI: 10.3389/fpls.2022.1038000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Accepted: 12/12/2022] [Indexed: 06/18/2023]
Abstract
Aiming at the problem that the rubber tapping robot finds it difficult to accurately detect the tapped area and locate the new tapping line for natural rubber trees due to the influence of the rubber plantation environment during the rubber tapping operation, this study proposes a method for detecting the tapped area and locating the new tapping line for natural rubber trees based on the improved mask region convolutional neural network (Mask RCNN). First, Mask RCNN was improved by fusing the attention mechanism into the ResNeXt, modifying the anchor box parameters, and adding a tiny fully connected layer branch into the mask branch to realize the detection and rough segmentation of the tapped area. Then, the fine segmentation of the existing tapping line was realized by combining edge detection and logic operation. Finally, the existing tapping line was moved down a certain distance along the center line direction of the left and right edge lines of the tapped area to obtain the new tapping line. The tapped area detection results of 560 test images showed that the detection accuracy, segmentation accuracy, detection average precision, segmentation average precision, and intersection over union values of the improved Mask RCNN were 98.23%, 99.52%, 99.6%, 99.78%, and 93.71%, respectively. Compared with other state-of-the-art approaches, the improved Mask RCNN had better detection and segmentation performance, which could better detect and segment the tapped area of natural rubber trees under different shooting conditions. The location results of 560 new tapping lines under different shooting conditions showed that the average location success rate of new tapping lines was 90% and the average location time was 0.189 s. The average values of the location errors in the x and y directions were 3 and 2.8 pixels, respectively, and the average value of the total location error was 4.5 pixels. This research not only provides a location method for the new tapping line for the rubber tapping robot but also provides theoretical support for the realization of rubber tapping mechanization and automation.
Collapse
Affiliation(s)
- Yaya Chen
- School of Information and Communication Engineering, Hainan University, Haikou, China
| | - Heng Zhang
- School of Information and Communication Engineering, Hainan University, Haikou, China
| | - Junxiao Liu
- Mechanical and Electrical Engineering College, Hainan University, Haikou, China
| | - Zhifu Zhang
- Mechanical and Electrical Engineering College, Hainan University, Haikou, China
| | - Xirui Zhang
- School of Information and Communication Engineering, Hainan University, Haikou, China
- Mechanical and Electrical Engineering College, Hainan University, Haikou, China
| |
Collapse
|