An Automated Machine Learning Approach for Real-Time Fault Detection and Diagnosis

Automated machine learning for predicting liver metastasis in patients with gastrointestinal stromal tumor: a SEER-based analysis

Gastrointestinal stromal tumors (GISTs) are a rare type of tumor that can develop liver metastasis (LIM), significantly impacting the patient's prognosis. This study aimed to predict LIM in GIST patients by constructing machine learning (ML) algorithms to assist clinicians in the decision-making process for treatment. Retrospective analysis was performed using the Surveillance, Epidemiology, and End Results (SEER) database, and cases from 2010 to 2015 were assigned to the developing sets, while cases from 2016 to 2017 were assigned to the testing set. Missing values were addressed using the multiple imputation technique. Four algorithms were utilized to construct the models, comprising traditional logistic regression (LR) and automated machine learning (AutoML) analysis such as gradient boost machine (GBM), deep neural net (DL), and generalized linear model (GLM). We evaluated the models' performance using LR-based metrics, including the area under the receiver operating characteristic curve (AUC), calibration curve, and decision curve analysis (DCA), as well as AutoML-based metrics, such as feature importance, SHapley Additive exPlanation (SHAP) Plots, and Local Interpretable Model Agnostic Explanation (LIME). A total of 6207 patients were included in this study, with 2683, 1780, and 1744 patients allocated to the training, validation, and test sets, respectively. Among the different models evaluated, the GBM model demonstrated the highest performance in the training, validation, and test cohorts, with respective AUC values of 0.805, 0.780, and 0.795. Furthermore, the GBM model outperformed other AutoML models in terms of accuracy, achieving 0.747, 0.700, and 0.706 in the training, validation, and test cohorts, respectively. Additionally, the study revealed that tumor size and tumor location were the most significant predictors influencing the AutoML model's ability to accurately predict LIM. The AutoML model utilizing the GBM algorithm for GIST patients can effectively predict the risk of LIM and provide clinicians with a reference for developing individualized treatment plans.

A Novel Data-Driven Fault Detection Method Based on Stable Kernel Representation for Dynamic Systems

With the steady improvement of advanced manufacturing processes and big data technologies, modern industrial systems have become large-scale. To enhance the sensitivity of fault detection (FD) and overcome the drawbacks of the centralized FD framework in dynamic systems, a new data-driven FD method based on Hellinger distance and subspace techniques is proposed for dynamic systems. Specifically, the proposed approach uses only system input/output data collected via sensor networks, and the distributed residual signals can be generated directly through the stable kernel representation of the process. Based on this, each sensor node can obtain the identical residual signal and test statistic through the average consensus algorithms. In addition, this paper integrates the Hellinger distance into the residual signal analysis for improving the FD performance. Finally, the effectiveness and accuracy of the proposed method have been verified in a real multiphase flow facility.

Automated machine learning to predict the difficulty for endoscopic resection of gastric gastrointestinal stromal tumor

Background

Accurate preoperative assessment of surgical difficulty is crucial to the success of the surgery and patient safety. This study aimed to evaluate the difficulty for endoscopic resection (ER) of gastric gastrointestinal stromal tumors (gGISTs) using multiple machine learning (ML) algorithms.

Methods

From December 2010 to December 2022, 555 patients with gGISTs in multi-centers were retrospectively studied and assigned to a training, validation, and test cohort. A difficult case was defined as meeting one of the following criteria: an operative time ≥ 90 min, severe intraoperative bleeding, or conversion to laparoscopic resection. Five types of algorithms were employed in building models, including traditional logistic regression (LR) and automated machine learning (AutoML) analysis (gradient boost machine (GBM), deep neural net (DL), generalized linear model (GLM), and default random forest (DRF)). We assessed the performance of the models using the areas under the receiver operating characteristic curves (AUC), the calibration curve, and the decision curve analysis (DCA) based on LR, as well as feature importance, SHapley Additive exPlanation (SHAP) Plots and Local Interpretable Model Agnostic Explanation (LIME) based on AutoML.

Results

The GBM model outperformed other models with an AUC of 0.894 in the validation and 0.791 in the test cohorts. Furthermore, the GBM model achieved the highest accuracy among these AutoML models, with 0.935 and 0.911 in the validation and test cohorts, respectively. In addition, it was found that tumor size and endoscopists' experience were the most prominent features that significantly impacted the AutoML model's performance in predicting the difficulty for ER of gGISTs.

Conclusion

The AutoML model based on the GBM algorithm can accurately predict the difficulty for ER of gGISTs before surgery.

Automatic Evaluation of Neural Network Training Results

This article is dedicated to solving the problem of an insufficient degree of automation of artificial neural network training. Despite the availability of a large number of libraries for training neural networks, machine learning engineers often have to manually control the training process to detect overfitting or underfitting. This article considers the task of automatically estimating neural network training results through an analysis of learning curves. Such analysis allows one to determine one of three possible states of the training process: overfitting, underfitting, and optimal training. We propose several algorithms for extracting feature descriptions from learning curves using mathematical statistics. Further state classification is performed using classical machine learning models. The proposed automatic estimation model serves to improve the degree of automation of neural network training and interpretation of its results, while also taking a step toward constructing self-training models. In most cases when the training process of neural networks leads to overfitting, the developed model determines its onset ahead of the early stopping method by 3–5 epochs.

Stress-Adaptive Training: An Adaptive Psychomotor Training According to Stress Measured by Grip Force

Current training methods show advances in simulation technologies; however, most of them fail to account for changes in the physical or mental state of the trainee. An innovative training method, adaptive to the trainee's stress levels as measured by grip force, is described and inspected. It is compared with two standard training methods that ignore the trainee's state, either leaving the task's level of difficulty constant or increasing it over time. Fifty-two participants, divided into three test groups, performed a psychomotor training task. The performance level of the stress-adaptive group was higher than for both control groups, with a main effect of t = -2.12 (p = 0.039), while the training time was shorter than both control groups, with a main effect of t = 3.27 (p = 0.002). These results indicate that stress-adaptive training has the potential to improve training outcomes. Moreover, these results imply that grip force measurement has practical applications. Future studies may aid in the development of this training method and its outcomes.