1
|
Hassan M, Lin J, Fateh AA, Pang W, Zhang L, Wang D, Yun G, Zeng H. Attention over vulnerable brain regions associating cerebral palsy disorder and biological markers. J Adv Res 2024:S2090-1232(24)00534-4. [PMID: 39551127 DOI: 10.1016/j.jare.2024.11.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 09/11/2024] [Accepted: 11/10/2024] [Indexed: 11/19/2024] Open
Abstract
INTRODUCTION Cerebral palsy (CP) is a neurological disorder caused by cerebral ischemia and hypoxia during fetal brain development.Early intervention in CP favors medications and therapies; however, monitoring early brain development in children with CP is critical. It is essential to thoroughly examine brain-vulnerable regions associated with biological traits (BTs).Variations in BTs were evident in children with CP; however, it is critical to explore the BTs' impact on the brains of healthy controls (HC) and CP-disordered children. OBJECTIVE This study associates BTs with HC and CP children.This study investigates the neurodevelopment of HC and CP underlying BTs. This study establishes a benchmark for the association of BT with HC and CP children. METHOD The proposed AWG-Net is composed of customized spatial-channel (CSC) and multi-head self (MHA) attentions, where CSC blocks are incorporated at the first few stages, MHA at later stages, and cumulative-dense structures to propagate susceptible regions to deeper layers. The training samples include T1-w, T2-w, Flair, and Sag, annotated with age, gender, and weight. RESULTS The significant results for HC and CP are age (HC: MAE = 1.05, MCS10=85.63, R2=0.844; CP: MAE = 1.16, MCS10=84.79, R2=0.717), gender (HC: Acc = 82.98%, CP: Acc = 82.00%), and weight (HC: MAE = 4.65, MCS10=56.30, R2=0.78; CP: MAE = 2.85, MCS10=70.24, R2=0.82). Vulnerable regions for age are the cerebellar hemisphere, frontal, occipital, and parietal bones in HC and inconsistent in CP. HC and CP commonalities are in the frontal bone and cerebellar hemisphere with HC and discrepant in the occipital and temporal bones for CP. Similarly, gender differences are found for HC and CP. CONCLUSION Age and gender are marginally less affected by the brain regions vulnerable to CP than weight estimation. T1-w is appropriate for age, weight, and gender. The learned trends are different for HC and CP in brain development and gender while slightly different in the case of weight.
Collapse
Affiliation(s)
- Muhammad Hassan
- Department of Radiology, Shenzhen Children's Hospital, Shenzhen, Guangdong, China
| | - Jieqiong Lin
- Department of Radiology, Shenzhen Children's Hospital, Shenzhen, Guangdong, China
| | - Ahmed Ameen Fateh
- Department of Radiology, Shenzhen Children's Hospital, Shenzhen, Guangdong, China
| | - Wei Pang
- School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, UK
| | - Luning Zhang
- Department of Radiology, Shenzhen Children's Hospital, Shenzhen, Guangdong, China
| | - Di Wang
- Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), Nanyang Technological University, Singapore
| | - Guojun Yun
- Department of Radiology, Shenzhen Children's Hospital, Shenzhen, Guangdong, China
| | - Hongwu Zeng
- Department of Radiology, Shenzhen Children's Hospital, Shenzhen, Guangdong, China.
| |
Collapse
|
2
|
Li R, Agu E, Sarwar A, Grimone K, Herman D, Abrantes AM, Stein MD. Fine-Grained Intoxicated Gait Classification Using a Bilinear CNN. IEEE SENSORS JOURNAL 2023; 23:29733-29748. [PMID: 38186565 PMCID: PMC10769125 DOI: 10.1109/jsen.2023.3248868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2024]
Abstract
Consuming excessive amounts of alcohol causes impaired mobility and judgment and driving accidents, resulting in more than 800 injuries and fatalities each day. Passive methods to detect intoxicated drivers beyond the safe driving limit can facilitate Just-In-Time alerts and reduce Driving Under the Influence (DUI) incidents. Popularly-owned smartphones are not only equipped with motion sensors (accelerometer and gyroscope) that can be employed for passively collecting gait (walk) data but also have the processing power to run computationally expensive machine learning models. In this paper, we advance the state-of-the-art by proposing a novel method that utilizes a Bi-linear Convolution Neural Network (BiCNN) for analyzing smartphone accelerometer and gyroscope data to determine whether a smartphone user is over the legal driving limit (0.08) from their gait. After segmenting the gait data into steps, we converted the smartphone motion sensor data to a Gramian Angular Field (GAF) image and then leveraged the BiCNN architecture for intoxication classification. Distinguishing GAF-encoded images of the gait of intoxicated vs. sober users is challenging as the differences between the classes (intoxicated vs. sober) are subtle, also known as a fine-grained image classification problem. The BiCNN neural network has previously produced state-of-the-art results on fine-grained image classification of natural images. To the best of our knowledge, our work is the first to innovatively utilize the BiCNN to classify GAF encoded images of smartphone gait data in order to detect intoxication. Prior work had explored using the BiCNN to classify natural images or explored other gait-related tasks but not intoxication Our complete intoxication classification pipeline consists of several important pre-processing steps carefully adapted to the BAC classification task, including step detection and segmentation, data normalization to account for inter-subject variability, data fusion, GAF image generation from time-series data, and a BiCNN classification model. In rigorous evaluation, our BiCNN model achieves an accuracy of 83.5%, outperforming the previous state-of-the-art and demonstrating the feasibility of our approach.
Collapse
Affiliation(s)
- Ruojun Li
- Department of Optical Information, Huazhong University of Science and Technology, Wuhan, China
- Department of Electrical and Computer Engineering, Worcester Polytechnic Institute(WPI), Worcester, MA, USA
| | - Emmanuel Agu
- Computer Science Department, Worcester Polytechnic Institute, Worcester, MA, USA
| | | | | | - Debra Herman
- Department of Psychiatry and Human Behavior and a Research Psychologist in the Behavioral Medicine and Addictions Research group at Butler Hospital
| | - Ana M Abrantes
- Behavioral Medicine and Addictions Research at Butler Hospital and a Professor in the Department of Psychiatry and Human Behavior at the Alpert Medical School of Brown University
| | - Michael D Stein
- Chair of Health Law, Policy & Management at Boston University
| |
Collapse
|
3
|
Cheng F, Li W, Ji Z, Li J, Hu W, Zhao M, Yu D, Simayijiang H, Yan J. Estimation of bloodstain deposition time within a 24-h day-night cycle with rhythmic mRNA based on a machine learning algorithm. Forensic Sci Int Genet 2023; 66:102910. [PMID: 37406538 DOI: 10.1016/j.fsigen.2023.102910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 04/15/2023] [Accepted: 06/22/2023] [Indexed: 07/07/2023]
Abstract
Estimating the time that bloodstains are left at a crime scene can provide invaluable evidence for law enforcement investigations, including determining the time of the crime, linking the perpetrator to the crime scene, narrowing the pool of possible suspects, and verifying witness statements. There have been some attempts to estimate the time since deposition of bloodstains, i.e., how much time has passed since the bloodstain was left at a crime scene. However, most studies focus on the time interval of days. As far as we know, previous study have been conducted to estimate the deposition time of blood within a 24-h day-night cycle. To date, there is a lack of studies on whether rhythmic mRNA of blood is suitable for bloodstain samples. In this study, we estimated the bloodstain deposition time within a 24-h day-night cycle based on the expression of messenger RNAs (mRNAs) by real-time quantitative polymerase chain reaction. Bloodstain samples were prepared from eight individuals at eight time points under real and uncontrolled conditions. Four mRNAs expressed rhythmically and were used to construct a regression model using the k-nearest neighbor (KNN) algorithm, resulting in a mean absolute error of 3.92 h. Overall, using the rhythmic mRNAs, a machine learning model was developed which has allowed us to predict the deposition time of bloodstains within the 24-h day-night cycle in East Asian populations. This study demonstrates that mRNA biomarkers can be used to estimate the bloodstain deposition time within a 24-h period. Furthermore, rhythmic mRNA biomarkers provide a potential method and perspective for estimating the deposition time of forensic traces in forensic investigation. Case samples in forensic analysis are usually limited or degraded, so the stability and sensitivity of rhythmic biomarkers need to be further investigated.
Collapse
Affiliation(s)
- Feng Cheng
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Wanting Li
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Zhimin Ji
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Junli Li
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Wenjing Hu
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Mengyang Zhao
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Daijing Yu
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China
| | - Halimureti Simayijiang
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China.
| | - Jiangwei Yan
- School of Forensic Medicine, Shanxi Medical University, Taiyuan 030009, Shanxi, PR China.
| |
Collapse
|
4
|
Galante N, Cotroneo R, Furci D, Lodetti G, Casali MB. Applications of artificial intelligence in forensic sciences: Current potential benefits, limitations and perspectives. Int J Legal Med 2023; 137:445-458. [PMID: 36507961 DOI: 10.1007/s00414-022-02928-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 12/04/2022] [Indexed: 12/14/2022]
Abstract
In recent years, new studies based on artificial intelligence (AI) have been conducted in the forensic field, posing new challenges and demonstrating the advantages and disadvantages of using AI methodologies to solve forensic well-known problems. Specifically, AI technology has tried to overcome the human subjective bias limitations of the traditional approach of the forensic sciences, which include sex prediction and age estimation from morphometric measurements in forensic anthropology or evaluating the third molar stage of development in forensic odontology. Likewise, AI has been studied as an assisting tool in forensic pathology for a quick and easy identification of the taxonomy of diatoms. The present systematic review follows the PRISMA 2020 statements and aims to explore an emerging topic that has been poorly analyzed in the forensic literature. Benefits, limitations, and forensic implications concerning AI are therefore highlighted, by providing an extensive critical review of its current applications on forensic sciences as well as its future directions. Results are divided into 5 subsections which included forensic anthropology, forensic odontology, forensic pathology, forensic genetics, and other forensic branches. The discussion offers a useful instrument to investigate the potential benefits of AI in the forensic fields as well as to point out the existing open questions and issues concerning its application on real-life scenarios. Procedural notes and technical aspects are also provided to the readers.
Collapse
Affiliation(s)
- Nicola Galante
- Healthcare Accountability Lab, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy.
- Department of Biomedical Sciences for Health, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy.
| | - Rosy Cotroneo
- Healthcare Accountability Lab, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
- Department of Biomedical Sciences for Health, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
| | - Domenico Furci
- Healthcare Accountability Lab, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
- Department of Biomedical Sciences for Health, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
| | - Giorgia Lodetti
- Healthcare Accountability Lab, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
- Department of Biomedical Sciences for Health, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
| | - Michelangelo Bruno Casali
- Healthcare Accountability Lab, Institute of Legal Medicine of Milan, University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
- Department of Oncology and Hemato-Oncology (DIPO), University of Milan, Via Luigi Mangiagalli 37, 20133, Milan, Italy
| |
Collapse
|
5
|
A Deep Learning Approach to Predict Chronological Age. Healthcare (Basel) 2023; 11:healthcare11030448. [PMID: 36767023 PMCID: PMC9914671 DOI: 10.3390/healthcare11030448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Revised: 01/31/2023] [Accepted: 02/02/2023] [Indexed: 02/08/2023] Open
Abstract
Recently, researchers have turned their focus to predicting the age of people since numerous applications depend on facial recognition approaches. In the medical field, Alzheimer's disease mainly depends on patients' ages. Multiple methods have been implemented and developed to predict age. However, these approaches lack accuracy because every image has unique features, such as shape, pose, and scale. In Saudi Arabia, Vision 2030, concerning the quality of life, is one of the twelve initiatives that were launched recently. The health sector has gained increasing attention as the government has introduced age-based policies to improve the health of its elderly residents. These residents are urgently advised to vaccinate against COVID-19 based on their age. In this paper, proposing a practical, consistent, and trustworthy method to predict age is presented. This method uses the color intensity of eyes and a Convolutional Neural Network (CNN) to predict age in real time based on the ensemble of CNN. A segmentation algorithm is engaged since the approach takes its input from a video stream or an image. This algorithm extracts data from one of the essential parts of the face: the eyes. This part is also informative. Several experiments have been conducted on MATLAB to verify and validate results and relative errors. A Kaggle website dataset is utilized for ages 4 to 59. This dataset includes over 270,000 images, and its size is roughly 2 GB. Consequently, the proposed approach produces ±8.69 years of Mean Square Error (MSE) for the predicted ages. Lastly, a comparative evaluation of relevant studies and the presented algorithm in terms of accuracy, MSE, and Mean Absolute Error (MAE) is also provided. This evaluation shows that the approach developed in the current study outperforms all considered performance metrics since its accuracy is 97.29%. This study found that the color intensity of eyes is highly effective in predicting age, given the high accuracy and acceptable MSE and MAE results. This indicates that it is helpful to utilize this methodology in real-life applications.
Collapse
|
6
|
Zhang Z, Liu N, Guo Z, Jiao L, Fenster A, Jin W, Zhang Y, Chen J, Yan C, Gou S. Ageing and degeneration analysis using ageing-related dynamic attention on lateral cephalometric radiographs. NPJ Digit Med 2022; 5:151. [PMID: 36168038 PMCID: PMC9515216 DOI: 10.1038/s41746-022-00681-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 08/22/2022] [Indexed: 11/25/2022] Open
Abstract
With the increase of the ageing in the world's population, the ageing and degeneration studies of physiological characteristics in human skin, bones, and muscles become important topics. Research on the ageing of bones, especially the skull, are paid much attention in recent years. In this study, a novel deep learning method representing the ageing-related dynamic attention (ARDA) is proposed. The proposed method can quantitatively display the ageing salience of the bones and their change patterns with age on lateral cephalometric radiographs images (LCR) images containing the craniofacial and cervical spine. An age estimation-based deep learning model based on 14142 LCR images from 4 to 40 years old individuals is trained to extract ageing-related features, and based on these features the ageing salience maps are generated by the Grad-CAM method. All ageing salience maps with the same age are merged as an ARDA map corresponding to that age. Ageing salience maps show that ARDA is mainly concentrated in three regions in LCR images: the teeth, craniofacial, and cervical spine regions. Furthermore, the dynamic distribution of ARDA at different ages and instances in LCR images is quantitatively analyzed. The experimental results on 3014 cases show that ARDA can accurately reflect the development and degeneration patterns in LCR images.
Collapse
Affiliation(s)
- Zhiyong Zhang
- Key Laboratory of Shaanxi Province for Craniofacial Precision Medicine Research, College of Stomatology, Xi'an Jiaotong University, Xi'an, 710004, Shaanxi, China
- College of Forensic Medicine, Xi'an Jiaotong University Health Science Center, Xi'an, 710061, Shaanxi, China
- Department of Orthodontics, the Affiliated Stomatological Hospital of Xi'an Jiaotong University, Xi'an, 710004, Shaanxi, China
| | - Ningtao Liu
- Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi'an, 710071, Shaanxi, China
- Robarts Research Institute, Western University, London, N6A 3K7, ON, Canada
| | - Zhang Guo
- Academy of Advanced Interdisciplinary Research, Xidian University, Xi'an, 710071, Shaanxi, China
| | - Licheng Jiao
- Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi'an, 710071, Shaanxi, China
| | - Aaron Fenster
- Robarts Research Institute, Western University, London, N6A 3K7, ON, Canada
| | - Wenfan Jin
- Department of Radiology, the Affiliated Stomatological Hospital of Xi'an Jiaotong University, Xi'an, 710004, Shaanxi, China
| | - Yuxiang Zhang
- College of Forensic Medicine, Xi'an Jiaotong University Health Science Center, Xi'an, 710061, Shaanxi, China
| | - Jie Chen
- College of Forensic Medicine, Xi'an Jiaotong University Health Science Center, Xi'an, 710061, Shaanxi, China
| | - Chunxia Yan
- College of Forensic Medicine, Xi'an Jiaotong University Health Science Center, Xi'an, 710061, Shaanxi, China.
| | - Shuiping Gou
- Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi'an, 710071, Shaanxi, China.
| |
Collapse
|
7
|
Hassan M, Wang Y, Wang D, Pang W, Wang K, Li D, Zhou Y, Xu D. Restorable-inpainting: A novel deep learning approach for shoeprint restoration. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.03.080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
8
|
Hassan M, Wang Y, Pang W, Wang D, Li D, Zhou Y, Xu D. GUV-Net for high fidelity shoeprint generation. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-021-00558-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
AbstractShoeprints contain valuable information for tracing evidence in forensic scenes, and they need to be generated into cleaned, sharp, and high-fidelity images. Most of the acquired shoeprints are found with low quality and/or in distorted forms. The high-fidelity shoeprint generation is of great significance in forensic science. A wide range of deep learning models has been suggested for super-resolution, being either generalized approaches or application specific. Considering the crucial challenges in shoeprint based processing and lacking specific algorithms, we proposed a deep learning based GUV-Net model for high-fidelity shoeprint generation. GUV-Net imitates learning features from VAE, U-Net, and GAN network models with special treatment of absent ground truth shoeprints. GUV-Net encodes efficient probabilistic distributions in the latent space and decodes variants of samples together with passed key features. GUV-Net forwards the learned samples to a refinement-unit proceeded to the generation of high-fidelity output. The refinement-unit receives low-level features from the decoding module at distinct levels. Furthermore, the refinement process is made more efficient by inverse-encoded in high dimensional space through a parallel inverse encoding network. The objective functions at different levels enable the model to efficiently optimize the parameters by mapping a low quality image to a high-fidelity one by maintaining salient features which are important to forensics. Finally, the performance of the proposed model is evaluated against state-of-the-art super-resolution network models.
Collapse
|