Automatic Assessment of Ultrasound Curvature Angle for Scoliosis Detection Using 3-D Ultrasound Volume Projection Imaging

OBJECTIVE

Scoliosis is a spinal deformation in which the spine takes a lateral curvature, generating an angle in the coronal plane. The conventional method for detecting scoliosis is measurement of the Cobb angle in spine images obtained by anterior X-ray scanning. Ultrasound imaging of the spine is found to be less ionising than traditional radiographic modalities. For posterior ultrasound scanning, alternate indices of the spinous process angle (SPA) and ultrasound curve angle (UCA) were developed and have proven comparable to those of the traditional Cobb angle. In SPA, the measurements are made using the spinous processes as an anatomical reference, leading to an underestimation of the traditionally used Cobb angles. Alternatively, in UCA, more lateral features of the spine are employed for measurement of the main thoracic and thoracolumbar angles; however, clear identification of bony features is required. The current practice of UCA angle measurement is manual. This research attempts to automate the process so that the errors related to human intervention can be avoided and the scalability of ultrasound scoliosis diagnosis can be improved. The key objective is to develop an automatic scoliosis diagnosis system using 3-D ultrasound imaging.

METHODS

The novel diagnosis system is a three-step process: (i) finding the ultrasound spine image with the most visible lateral features using the convolutional RankNet algorithm; (ii) segmenting the bony features from the noisy ultrasound images using joint spine segmentation and noise removal; and (iii) calculating the UCA automatically using a newly developed centroid pairing and inscribed rectangle slope method.

RESULTS

The proposed method was evaluated on 109 patients with scoliosis of different severity. The results obtained had a good correlation with manually measured UCAs (R2=0.9784 for the main thoracic angle andR2=0.9671 for the thoracolumbar angle) and a clinically acceptable mean absolute difference of the main thoracic angle (2.82 ± 2.67°) and thoracolumbar angle (3.34 ± 2.83°).

CONCLUSION

The proposed method establishes a very promising approach for enabling the applications of economic 3-D ultrasound volume projection imaging for mass screening of scoliosis.

Landmark Localization from Medical Images with Generative Distribution Prior

In medical image analysis, anatomical landmarks usually contain strong prior knowledge of their structural information. In this paper, we propose to promote medical landmark localization by modeling the underlying landmark distribution via normalizing flows. Specifically, we introduce the flow-based landmark distribution prior as a learnable objective function into a regression-based landmark localization framework. Moreover, we employ an integral operation to make the mapping from heatmaps to coordinates differentiable to further enhance heatmap-based localization with the learned distribution prior. Our proposed Normalizing Flow-based Distribution Prior (NFDP) employs a straightforward backbone and non-problem-tailored architecture (i.e., ResNet18), which delivers high-fidelity outputs across three X-ray-based landmark localization datasets. Remarkably, the proposed NFDP can do the job with minimal additional computational burden as the normalizing flows module is detached from the framework on inferencing. As compared to existing techniques, our proposed NFDP provides a superior balance between prediction accuracy and inference speed, making it a highly efficient and effective approach. The source code of this paper is available at https://github.com/jacksonhzx95/NFDP.

Sleep Apnea Detection Using Multi-Error-Reduction Classification System with Multiple Bio-Signals

INTRODUCTION

Obstructive sleep apnea (OSA) can cause serious health problems such as hypertension or cardiovascular disease. The manual detection of apnea is a time-consuming task, and automatic diagnosis is much more desirable. The contribution of this work is to detect OSA using a multi-error-reduction (MER) classification system with multi-domain features from bio-signals.

METHODS

Time-domain, frequency-domain, and non-linear analysis features are extracted from oxygen saturation (SaO2), ECG, airflow, thoracic, and abdominal signals. To analyse the significance of each feature, we design a two-stage feature selection. Stage 1 is the statistical analysis stage, and Stage 2 is the final feature subset selection stage using machine learning methods. In Stage 1, two statistical analyses (the one-way analysis of variance (ANOVA) and the rank-sum test) provide a list of the significance level of each kind of feature. Then, in Stage 2, the support vector machine (SVM) algorithm is used to select a final feature subset based on the significance list. Next, an MER classification system is constructed, which applies a stacking with a structure that consists of base learners and an artificial neural network (ANN) meta-learner.

RESULTS

The Sleep Heart Health Study (SHHS) database is used to provide bio-signals. A total of 66 features are extracted. In the experiment that involves a duration parameter, 19 features are selected as the final feature subset because they provide a better and more stable performance. The SVM model shows good performance (accuracy = 81.68%, sensitivity = 97.05%, and specificity = 66.54%). It is also found that classifiers have poor performance when they predict normal events in less than 60 s. In the next experiment stage, the time-window segmentation method with a length of 60s is used. After the above two-stage feature selection procedure, 48 features are selected as the final feature subset that give good performance (accuracy = 90.80%, sensitivity = 93.95%, and specificity = 83.82%). To conduct the classification, Gradient Boosting, CatBoost, Light GBM, and XGBoost are used as base learners, and the ANN is used as the meta-learner. The performance of this MER classification system has the accuracy of 94.66%, the sensitivity of 96.37%, and the specificity of 90.83%.

Joint Spine Segmentation and Noise Removal From Ultrasound Volume Projection Images With Selective Feature Sharing

Volume Projection Imaging from ultrasound data is a promising technique to visualize spine features and diagnose Adolescent Idiopathic Scoliosis. In this paper, we present a novel multi-task framework to reduce the scan noise in volume projection images and to segment different spine features simultaneously, which provides an appealing alternative for intelligent scoliosis assessment in clinical applications. Our proposed framework consists of two streams: i) A noise removal stream based on generative adversarial networks, which aims to achieve effective scan noise removal in a weakly-supervised manner, i.e., without paired noisy-clean samples for learning; ii) A spine segmentation stream, which aims to predict accurate bone masks. To establish the interaction between these two tasks, we propose a selective feature-sharing strategy to transfer only the beneficial features, while filtering out the useless or harmful information. We evaluate our proposed framework on both scan noise removal and spine segmentation tasks. The experimental results demonstrate that our proposed method achieves promising performance on both tasks, which provides an appealing approach to facilitating clinical diagnosis.

Dual-task ultrasound spine transverse vertebrae segmentation network with contour regularization

3D ultrasound imaging has become one of the common diagnosis ways to assess scoliosis since it is radiation-free, real-time, and low-cost. Spine curvature angle measurement is an important step to assess scoliosis precisely. One way to calculate the angle is using the vertebrae features of the 2-D coronal images to identify the most tilted vertebrae. To do the measurement, the segmentation of the transverse vertebrae is an important step. In this paper, we propose a dual-task ultrasound transverse vertebrae segmentation network (D-TVNet) based on U-Net. First, we arrange an auxiliary shape regularization network to learn the contour segmentation of the bones. It improves the boundary segmentation and anti-interference ability of the U-Net by fusing some of the features of the auxiliary task and the main task. Then, we introduce the atrous spatial pyramid pooling (ASPP) module to the end of the down-sampling stage of the main task stream to improve the relative feature extraction ability. To further improve the boundary segmentation, we extendedly fuse the down-sampling output features of the auxiliary network in the ASPP. The experiment results show that the proposed D-TVNet achieves the best dice score of 86.68% and the mean dice score of 86.17% based on cross-validation, which is an improvement of 5.17% over the baseline U-Net. An automatic ultrasound spine bone segmentation network with promising results has been achieved.

Predicting protein-ligand binding site using support vector machine with protein properties

Identification of protein-ligand binding site is an important task in structure-based drug design and docking algorithms. In the past two decades, different approaches have been developed to predict the binding site, such as the geometric, energetic, and sequence-based methods. When scores are calculated from these methods, the algorithm for doing classification becomes very important and can affect the prediction results greatly. In this paper, the support vector machine (SVM) is used to cluster the pockets that are most likely to bind ligands with the attributes of geometric characteristics, interaction potential, offset from protein, conservation score, and properties surrounding the pockets. Our approach is compared to LIGSITE, LIGSITE(CSC), SURFNET, Fpocket, PocketFinder, Q-SiteFinder, ConCavity, and MetaPocket on the data set LigASite and 198 drug-target protein complexes. The results show that our approach improves the success rate from 60 to 80 percent at AUC measure and from 61 to 66 percent at top 1 prediction. Our method also provides more comprehensive results than the others.

LMI-based stability and performance conditions for continuous-time nonlinear systems in Takagi-Sugeno's form

This correspondence presents the stability analysis and performance design of the continuous-time fuzzy-model-based control systems. The idea of the nonparallel-distributed-compensation (non-PDC) control laws is extended to the continuous-time fuzzy-model-based control systems. A nonlinear controller with non-PDC control laws is proposed to stabilize the continuous-time nonlinear systems in Takagi-Sugeno's form. To produce the stability-analysis result, a parameter-dependent Lyapunov function (PDLF) is employed. However, two difficulties are usually encountered: 1) the time-derivative terms produced by the PDLF will complicate the stability analysis and 2) the stability conditions are not in the form of linear-matrix inequalities (LMIs) that aid the design of feedback gains. To tackle the first difficulty, the time-derivative terms are represented by some weighted-sum terms in some existing approaches, which will increase the number of stability conditions significantly. In view of the second difficulty, some positive-definitive terms are added in order to cast the stability conditions into LMIs. In this correspondence, the favorable properties of the membership functions and nonlinear control laws, which allow the introduction of some free matrices, are employed to alleviate the two difficulties while retaining the favorable properties of PDLF-based approach. LMI-based stability conditions are derived to ensure the system stability. Furthermore, based on a common scalar performance index, LMI-based performance conditions are derived to guarantee the system performance. Simulation examples are given to illustrate the effectiveness of the proposed approach.

Sampled-Data Fuzzy Controller for Time-Delay Nonlinear Systems: Fuzzy-Model-Based LMI Approach

This paper presents the stability analysis and performance design for a sampled-data fuzzy control system with time delay, which is formed by a nonlinear plant with time delay and a sampled-data fuzzy controller connected in a closed loop. As the sampled-data fuzzy controller can be implemented by a microcontroller or a digital computer, the implementation time and cost can be reduced. However, the sampling activity and time delay, which are potential causes of system instability, will complicate the system dynamics and make the stability analysis much more difficult than that for a pure continuous-time fuzzy control system. In this paper, a sampled-data fuzzy controller with enhanced nonlinearity compensation ability is proposed. Based on the fuzzy-model-based control approach, linear matrix inequality (LMI)-based stability conditions are derived to guarantee the system stability. By using a descriptor representation, the complexity of the sampled-data fuzzy control system with time delay can be reduced to ease the stability analysis, which effectively leads to a smaller number of LMI-stability conditions. Information of the membership functions of both the fuzzy plant model and fuzzy controller are considered, which allows arbitrary matrices to be introduced, to ease the satisfaction of the stability conditions. An application example will be given to show the merits and design procedure of the proposed approach. Furthermore, LMI-based performance conditions are derived to aid the design of a well-performed sampled-data fuzzy controller.

Design and Stabilization of Sampled-Data Neural-Network-Based Control Systems

This paper presents the design and stability analysis of a sampled-data neural-network-based control system. A continuous-time nonlinear plant and a sampled-data three-layer fully connected feedforward neural-network-based controller are connected in a closed loop to perform the control task. Stability conditions will be derived to guarantee the closed-loop system stability. Linear-matrix-inequality- and genetic-algorithm-based approaches will be employed to obtain the largest sampling period and the connection weights of the neural network subject to the considerations of the system stability and performance. An application example will be given to illustrate the design procedure and effectiveness of the proposed approach.

An improved genetic algorithm based fuzzy-tuned neural network

This paper presents a fuzzy-tuned neural network, which is trained by an improved genetic algorithm (GA). The fuzzy-tuned neural network consists of a neural-fuzzy network and a modified neural network. In the modified neural network, a neuron model with two activation functions is used so that the degree of freedom of the network function can be increased. The neural-fuzzy network governs some of the parameters of the neuron model. It will be shown that the performance of the proposed fuzzy-tuned neural network is better than that of the traditional neural network with a similar number of parameters. An improved GA is proposed to train the parameters of the proposed network. Sets of improved genetic operations are presented. The performance of the improved GA will be shown to be better than that of the traditional GA. Some application examples are given to illustrate the merits of the proposed neural network and the improved GA.

Stability Analysis of Fuzzy Control Systems Subject to Uncertain Grades of Membership

This paper presents relaxed stability conditions for fuzzy control systems subject to parameter uncertainties. As the parameter uncertainties introduce uncertain grades of membership to the fuzzy control systems, the favorable property offered by sharing the same premises in the fuzzy plant models and fuzzy controllers cannot be employed to enhance the stabilization ability of the fuzzy control systems. To widen the applicability of the fuzzy control approach, fuzzy control systems subject to uncertain grades of membership will be investigated. New relaxed stability conditions will be derived to guarantee the stability of this class of fuzzy control systems. A numerical example will be given to show the effectiveness of the proposed approach.

Fuzzy combination of fuzzy and switching state-feedback controllers for nonlinear systems subject to parameter uncertainties

This paper presents a fuzzy controller, which involves a fuzzy combination of local fuzzy and global switching state-feedback controllers, for nonlinear systems subject to parameter uncertainties with known bounds. The nonlinear system is represented by a fuzzy combined Takagi-Sugeno-Kang model, which is a fuzzy combination of the global and local fuzzy plant models. By combining the local fuzzy and global switching state-feedback controllers using fuzzy logic techniques, the advantages of both controllers can be retained and the undesirable chattering effect introduced by the global switching state-feedback controller can be eliminated. The steady-state error introduced by the global switching state-feedback controller when a saturation function is used can also be removed. Stability conditions, which are related to the system matrices of the local and global closed-loop systems, are derived to guarantee the closed-loop system stability. An application example will be given to demonstrate the merits of the proposed approach.

Digit and Command Interpretation for Electronic Book Using Neural Network and Genetic Algorithm

This paper presents the interpretation of digits and commands using a modified neural network and the genetic algorithm. The modified neural network exhibits a node-to-node relationship which enhances its learning and generalization abilities. A digit-and-command interpreter constructed by the modified neural networks is proposed to recognize handwritten digits and commands. A genetic algorithm is employed to train the parameters of the modified neural networks of the digit-and-command interpreter. The proposed digit-and-command interpreter is successfully realized in an electronic book. Simulation and experimental results will be presented to show the applicability and merits of the proposed approach.

Design of a switching controller for nonlinear systems with unknown parameters based on a fuzzy logic approach

This paper deals with nonlinear plants subject to unknown parameters. A fuzzy model is first used to represent the plant. An equivalent switching plant model is then derived, which supports the design of a switching controller. It will be shown that the closed-loop system formed by the plant and the switching controller is a linear system. Hence, the system performance of the closed-loop system can be designed. An application example on controlling a two-inverted pendulum system on a cart will be given to illustrate the design procedure of the proposed switching controller.