Bayesian optimization of gradient trajectory for parallel-transmit pulse design

PURPOSE

Spoke pulses improve excitation homogeneity in parallel-transmit MRI. We propose an efficient global optimization algorithm, Bayesian optimization of gradient trajectory (BOGAT), for single-slice and simultaneous multislice imaging.

THEORY AND METHODS

BOGAT adds an outer loop to optimize kT-space positions. For each position, the RF coefficients are optimized (e.g., with magnitude least squares) and the cost function evaluated. Bayesian optimization progressively estimates the cost function. It automatically chooses the kT-space positions to sample, to achieve fast convergence, often coming close to the globally optimal spoke positions. We investigated the typical features of spokes cost functions by a grid search with field maps comprising 85 slabs from 14 volunteers. We tested BOGAT in this database, and prospectively in a phantom and in vivo. We compared the vendor-provided Fourier transform approach with the same magnitude least squares RF optimizer.

RESULTS

The cost function is nonconvex and seen empirically to be piecewise smooth with discontinuities where the underlying RF optimum changes sharply. BOGAT converged to within 10% of the global minimum cost within 30 iterations in 93% of slices in our database. BOGAT achieved up to 56% lower flip angle RMS error (RMSE) or 55% lower pulse energy in phantoms versus the Fourier transform approach, and up to 30% lower RMSE and 29% lower energy in vivo with 7.8 s extra computation.

CONCLUSION

BOGAT efficiently estimated near-global optimum spoke positions for the two-spoke tests, reducing flip-angle RMSE and/or pulse energy in a computation time (˜10 s), which is suitable for online optimization.

Material characterization of human middle ear using machine-learning-based surrogate models

This study aims to introduce a novel non-invasive method for rapid material characterization of middle-ear structures, taking into consideration the invaluable insights provided by the mechanical properties of ear tissues. Valuable insights into various ear pathologies can be gleaned from the mechanical properties of ear tissues, yet conventional techniques for assessing these properties often entail invasive procedures that preclude their use on living patients. In this study, in the first step, we developed machine-learning models of the middle ear to predict its responses with a significantly lower computational cost in comparison to finite-element models. Leveraging findings from prior research, we focused on the most influential model parameters: the Young's modulus and thickness of the tympanic membrane and the Young's modulus of the stapedial annular ligament. The eXtreme Gradient Boosting (XGBoost) method was implemented for creating the machine-learning models. Subsequently, we combined the created machine-learning models with Bayesian optimization (BoTorch) for fast and efficient estimation of the Young's moduli of the tympanic membrane and the stapedial annular ligament. We demonstrate that the resultant surrogate models can fairly represent the vibrational responses of the umbo, stapes footplate, and vibration patterns of the tympanic membrane at most frequencies. Also, our proposed material characterization approach successfully estimated the Young's moduli of the tympanic membrane and stapedial annular ligament (separately and simultaneously) with values of mean absolute percentage error of less than 7%. The remarkable accuracy achieved through the proposed material characterization method underscores its potential for eventual clinical applications of estimating mechanical properties of the middle-ear structures for diagnostic purposes.

High cell density cultivation of Corynebacterium glutamicum by deep learning-assisted medium design and the subsequent feeding strategy

To improve the cell productivity of Corynebacterium glutamicum, its initial specific growth rate was improved by medium improvement using deep neural network (DNN)-assisted design with Bayesian optimization (BO) and a genetic algorithm (GA). To obtain training data for the DNN, experimental design with an orthogonal array was set up using a chemically defined basal medium (GC XII). Based on the cultivation results for the training data, specific growth rates were observed between 0.04 and 0.3/h. The resulting DNN model estimated the test data with high accuracy (R2test ≥ 0.98). According to the validation cultivation, specific growth rates in the optimal media components estimated by DNN-BO and DNN-GA increased from 0.242 to 0.355/h. Using the optimal media (UCB_3), the specific growth rate, along with other parameters, was evaluated in batch culture. The specific growth rate reached 0.371/h from 3 to 12 h, and the dry cell weight was 28.0 g/L at 22.5 h. From the cultivation, the cell yields against glucose, ammonium ion, phosphate ion, sulfate ion, potassium ion, and magnesium ion were calculated. The cell yield calculation was used to estimate the required amounts of each component, and magnesium was found to limit the cell growth. However, in the follow-up fed-batch cultivation, glucose and magnesium addition was required to achieve the high initial specific growth rate, while appropriate feeding of glucose and magnesium during cultivation resulted in maintaining the high specific growth rate, and obtaining a cell yield of 80 g/Lini.

Bayesian cell therapy process optimization

Optimizing complex bioprocesses poses a significant challenge in several fields, particularly in cell therapy manufacturing. The development of customized, closed, and automated processes is crucial for their industrial translation and for addressing large patient populations at a sustainable price. Limited understanding of the underlying biological mechanisms, coupled with highly resource-intensive experimentation, are two contributing factors that make the development of these next-generation processes challenging. Bayesian optimization (BO) is an iterative experimental design methodology that addresses these challenges, but has not been extensively tested in situations that require parallel experimentation with significant experimental variability. In this study, we present an evaluation of noisy, parallel BO for increasing noise levels and parallel batch sizes on two in silico bioprocesses, and compare it to the industry state-of-the-art. As an in vitro showcase, we apply the method to the optimization of a monocyte purification unit operation. The in silico results show that BO significantly outperforms the state-of-the-art, requiring approximately 50% fewer experiments on average. This study highlights the potential of noisy, parallel BO as valuable tool for cell therapy process development and optimization.

A UV-Vis spectroscopic detection method for cobalt ions in zinc sulfate solution based on discrete wavelet transform and extreme gradient boosting

Zinc is a crucial strategic metal resource. The concentration of cobalt ions in zinc refining solution significantly impacts the efficiency of zinc electrolysis production. The traditional method of detecting cobalt ions in zinc solution is time-consuming, labor-intensive and ineffective. However, optical detection offers the advantage of high efficiency and low cost, making it a potential replacement for the traditional method. In this study, the spectral curve of cobalt ions in zinc solution is detected by ultraviolet-visible (UV-Vis) spectrophotometry. Additionally, we propose a model for the concentration-absorbance relationship of cobalt ions in zinc solution based on discrete wavelet transform and extreme gradient boosting (DWT-XGBoost) algorithms. First, the spectral curve's information region is denoised by using Savitzky-Golay (S-G) smoothing. Then, the denoised spectra is utilized to extract features through discrete wavelet transform and principal component analysis. These features are used as inputs to the XGBoost model to establish prediction models for low and high cobalt ions in zinc solution. Bayesian optimization is implemented to adjust the model's hyperparameters, including learning rate, feature sampling ratio, to enhance the prediction performance. Finally, applying the model to zinc solution samples from a zinc smelter and compared with other state-of-the-art algorithms, the DWT-XGBoost algorithm exhibits the lowest RMSE, MAE and MAPE, with values of 0.034 mg/L, 0.025 mg/L, 6.983 % for low cobalt and with values of 0.231 mg/L, 0.067 mg/L and 0.472 % for high cobalt. The experimental results demonstrate that the DWT-XGBoost model exhibits significantly superior prediction performance.

Rapid and accurate quality evaluation of Angelicae Sinensis Radix based on near-infrared spectroscopy and Bayesian optimized LSTM network

The authentic traditional Chinese medicines (TCMs) including Angelicae Sinensis Radix (ASR) are the representative of high-quality herbals in China. However, ASR from authentic region being adulterated or counterfeited is frequently occurring, and there is still a lack of rapid quality evaluation methods for identifying the authentic ASR. In this study, the color features of ASR were firstly characterized. The results showed that the authentic ASR cannot be fully identified by color characteristics. Then near-infrared (NIR) spectroscopy combined with Bayesian optimized long short-term memory (BO-LSTM) was used to evaluate the quality of ASR, and the performance of BO-LSTM with common classification and regression algorithms was compared. The results revealed that following the pretreatment of NIR spectra, the optimal NIR spectra combined with BO-LSTM not only successfully distinguished authentic, non-authentic, and adulterated ASR with 100 % accuracy, but also accurately predicted the adulteration concentration of authentic ASR (R2 > 0.99). Moreover, BO-LSTM demonstrated excellent performance in classification and regression compared with common algorithms (ANN, SVM, PLSR, etc.). Overall, the proposed strategy could quickly and accurately evaluate the quality of ASR, which provided a reference for other TCMs.

Game-theoretic optimization of landslide susceptibility mapping: a comparative study between Bayesian-optimized basic neural network and new generation neural network models

Landslide susceptibility mapping is essential for reducing the risk of landslides and ensuring the safety of people and infrastructure in landslide-prone areas. However, little research has been done on the development of well-optimized Elman neural networks (ENN), deep neural networks (DNN), and artificial neural networks (ANN) for robust landslide susceptibility mapping (LSM). Additionally, there is a research gap regarding the use of Bayesian optimization and the derivation of SHapley Additive exPlanations (SHAP) values from optimized models. Therefore, this study aims to optimize DNN, ENN, and ANN models using Bayesian optimization for landslide susceptibility mapping and derive SHAP values from these optimized models. The LSM models have been validated using the receiver operating characteristics curve, confusion matrix, and other twelve error matrices. The study used six machine learning-based feature selection techniques to identify the most important variables for predicting landslide susceptibility. The decision tree, random forest, and bagging feature selection models showed that slope, elevation, DFR, annual rainfall, LD, DD, RD, and LULC are influential variables, while geology and soil texture have less influence. The DNN model outperformed the other two models, covering 7839.54 km2 under the very low landslide susceptibility zone and 3613.44 km2 under the very high landslide susceptibility zone. The DNN model is better suited for generating landslide susceptibility maps, as it can classify areas with higher accuracy. The model identified several key factors that contribute to the initiation of landslides, including high elevation, built-up and agricultural land use, less vegetation, aspect (north and northwest), soil depth less than 140 cm, high rainfall, high lineament density, and a low distance from roads. The study's findings can help stakeholders make informed decisions to reduce the risk of landslides and ensure the safety of people and infrastructure in landslide-prone areas.

Online Bayesian optimization of vagus nerve stimulation

Objective.In bioelectronic medicine, neuromodulation therapies induce neural signals to the brain or organs, modifying their function. Stimulation devices capable of triggering exogenous neural signals using electrical waveforms require a complex and multi-dimensional parameter space to control such waveforms. Determining the best combination of parameters (waveform optimization or dosing) for treating a particular patient's illness is therefore challenging. Comprehensive parameter searching for an optimal stimulation effect is often infeasible in a clinical setting due to the size of the parameter space. Restricting this space, however, may lead to suboptimal therapeutic results, reduced responder rates, and adverse effects.Approach. As an alternative to a full parameter search, we present a flexible machine learning, data acquisition, and processing framework for optimizing neural stimulation parameters, requiring as few steps as possible using Bayesian optimization. This optimization builds a model of the neural and physiological responses to stimulations, enabling it to optimize stimulation parameters and provide estimates of the accuracy of the response model. The vagus nerve (VN) innervates, among other thoracic and visceral organs, the heart, thus controlling heart rate (HR), making it an ideal candidate for demonstrating the effectiveness of our approach.Main results.The efficacy of our optimization approach was first evaluated on simulated neural responses, then applied to VN stimulation intraoperatively in porcine subjects. Optimization converged quickly on parameters achieving target HRs and optimizing neural B-fiber activations despite high intersubject variability.Significance.An optimized stimulation waveform was achieved in real time with far fewer stimulations than required by alternative optimization strategies, thus minimizing exposure to side effects. Uncertainty estimates helped avoiding stimulations outside a safe range. Our approach shows that a complex set of neural stimulation parameters can be optimized in real-time for a patient to achieve a personalized precision dosing.

Optimization of medium components for protein production by Escherichia coli with a high-throughput pipeline that uses a deep neural network

To optimize rapidly the medium for green fluorescent protein expression by Escherichia coli with an introduced plasmid, pRSET/emGFP, a single-cycle optimization pipeline was applied. The pipeline included a deep neural network (DNN) and mathematical optimization algorithms with simultaneous optimization of 18 medium components. To evaluate the DNN data sampling method, two methods, orthogonal array (OA) and Latin hypercube sampling (LHS), were used to design 64 initial media for each sampling method. The OA- and LHS-based data sampling resulted in green fluorescent protein fluorescence intensities of 0.088 × 103-1.85 × 104 and 3.30 × 103-1.50 × 104, respectively. Fifty DNN models were built using the OA and LHS datasets. Hold-out validation was performed using 15 % test of OA and LHS data. Mean square errors of the DNN models were 0.015-0.64, indicating the estimation accuracies were sufficient. However, the sensitivities of components in the DNN models varied and were grouped into six major classes by the index of k-means clustering. A representative model was selected for each class. Mathematical optimization algorithms using Bayesian optimization and genetic algorithm were applied to the representative models, and representative optimized medium (OM) compositions were selected by k-means clustering from the proposed OMs. A total of 54 OMs were obtained from the OA and LHS datasets. In the validating cultivation, the best OMs of OA and LHS were 2.12-fold and 2.13-fold higher, respectively, than those of the learning data.

Learning to Control a Three-Dimensional Ferrofluidic Robot

In recent years, ferrofluids have found increased popularity as a material for medical applications, such as ocular surgery, gastrointestinal surgery, and cancer treatment, among others. Ferrofluidic robots are multifunctional and scalable, exhibit fluid properties, and can be controlled remotely; thus, they are particularly advantageous for such medical tasks. Previously, ferrofluidic robot control has been achieved via the manipulation of handheld permanent magnets or in current-controlled electromagnetic fields resulting in two-dimensional position and shape control and three-dimensional (3D) coupled position-shape or position-only control. Control of ferrofluidic liquid droplet robots poses a unique challenge where model-based control has been shown to be computationally limiting. Thus, in this study, a model-free control method is chosen, and it is shown that the task of learning optimal control parameters for ferrofluidic robot control can be performed using machine learning. Particularly, we explore the use of Bayesian optimization to find optimal controller parameters for 3D pose control of a ferrofluid droplet: its centroid position, stretch direction, and stretch radius. We demonstrate that the position, stretch direction, and stretch radius of a ferrofluid droplet can be independently controlled in 3D with high accuracy and precision, using a simple control approach. Finally, we use ferrofluidic robots to perform pick-and-place, a lab-on-a-chip pH test, and electrical switching, in 3D settings. The purpose of this research is to expand the potential of ferrofluidic robots by introducing full pose control in 3D and to showcase the potential of this technology in the areas of microassembly, lab-on-a-chip, and electronics. The approach presented in this research can be used as a stepping-off point to incorporate ferrofluidic robots toward future research in these areas.

Bypassing the Single Junction Limit with Advanced Photovoltaic Architectures

Multijunction devices and photon up- and down-conversion are prominent concepts aimed at increasing photovoltaic efficiencies beyond the single junction limit. Integrating these concepts into advanced architectures may address long-standing issues such as processing complexity, microstructure control, and resilience against spectral changes of the incoming radiation. However, so far, no models have been established to predict the performance of such integrated architectures. Here, a simulation environment based on Bayesian optimization is presented, that can predict and virtually optimize the electrical performance of multi-junction architectures, both vertical and lateral, in combination with up- and down-conversion materials. Microstructure effects on performance are explicitly considered using machine-learned predictive models from high throughput experimentation on simpler architectures. Two architectures that would surpass the single junction limit of photovoltaic energy conversion at reasonable complexity are identified: a vertical "staggered half octave system," where selective absorption allows the use of 6 different bandgaps, and the lateral "overlapping rainbow system" where selective irradiation allows the use of a narrowband energy acceptor with reduced voltage losses, according to the energy gap law. Both architectures would be highly resilient against spectral changes, in contrast with two terminal multi-junction architectures which are limited by Kirchhoff's law.

Connectome spectrum electromagnetic tomography: A method to reconstruct electrical brain source networks at high-spatial resolution

Connectome spectrum electromagnetic tomography (CSET) combines diffusion MRI-derived structural connectivity data with well-established graph signal processing tools to solve the M/EEG inverse problem. Using simulated EEG signals from fMRI responses, and two EEG datasets on visual-evoked potentials, we provide evidence supporting that (i) CSET captures realistic neurophysiological patterns with better accuracy than state-of-the-art methods, (ii) CSET can reconstruct brain responses more accurately and with more robustness to intrinsic noise in the EEG signal. These results demonstrate that CSET offers high spatio-temporal accuracy, enabling neuroscientists to extend their research beyond the current limitations of low sampling frequency in functional MRI and the poor spatial resolution of M/EEG.

De Novo Atomistic Discovery of Disordered Mechanical Metamaterials by Machine Learning

Architected materials design across orders of magnitude length scale intrigues exceptional mechanical responses nonexistent in their natural bulk state. However, the so-termed mechanical metamaterials, when scaling bottom down to the atomistic or microparticle level, remain largely unexplored and conventionally fall out of their coarse-resolution, ordered-pattern design space. Here, combining high-throughput molecular dynamics (MD) simulations and machine learning (ML) strategies, some intriguing atomistic families of disordered mechanical metamaterials are discovered, as fabricated by melt quenching and exemplified herein by lightweight-yet-stiff cellular materials featuring a theoretical limit of linear stiffness-density scaling, whose structural disorder-rather than order-is key to reduce the scaling exponent and is simply controlled by the bonding interactions and their directionality that enable flexible tunability experimentally. Importantly, a systematic navigation in the forcefield landscape reveals that, in-between directional and non-directional bonding such as covalent and ionic bonds, modest bond directionality is most likely to promotes disordered packing of polyhedral, stretching-dominated structures responsible for the formation of metamaterials. This work pioneers a bottom-down atomistic scheme to design mechanical metamaterials formatted disorderly, unlocking a largely untapped field in leveraging structural disorder in devising metamaterials atomistically and, potentially, generic to conventional upscaled designs.

Insight into Automatic Image Diagnosis of Ear Conditions Based on Optimized Deep Learning Approach

Examining otoscopic images for ear diseases is necessary when the clinical diagnosis of ear diseases extracted from the knowledge of otolaryngologists is limited. Improved diagnosis approaches based on otoscopic image processing are urgently needed. Recently, convolutional neural networks (CNNs) have been carried out for medical diagnosis to obtain higher accuracy than standard machine learning algorithms and specialists' expertise. Therefore, the proposed approach involves using the Bayesian hyperparameter optimization with the CNN architecture for automatic diagnosis of ear imagery database including four classes: normal, myringosclerosis, earwax plug, and chronic otitis media (COM). The suggested approach was trained using 616 otoscopic images, and the performance of this approach was assessed using 264 testing images. In this paper, the performance of ear disease classification was compared in terms of accuracy, sensitivity, specificity, and positive predictive value (PPV). The results produced a classification accuracy of 98.10%, a sensitivity of 98.11%, a specificity of 99.36%, and a PPV of 98.10%. Finally, the suggested approach demonstrates how to locate optimal CNN hyperparameters for accurate diagnosis of ear diseases while taking time into account. As a result, the usefulness and dependability of the suggested approach will lead to the establishment of an automated tool for better categorization and prediction of different ear diseases.

Enhanced prediction of stock markets using a novel deep learning model PLSTM-TAL in urbanized smart cities

Accurate predictions of stock markets are important for investors and other stakeholders of the equity markets to formulate profitable investment strategies. The improved accuracy of a prediction model even with a slight margin can translate into considerable monetary returns. However, the stock markets' prediction is regarded as an intricate research problem for the noise, complexity and volatility of the stocks' data. In recent years, the deep learning models have been successful in providing robust forecasts for sequential data. We propose a novel deep learning-based hybrid classification model by combining peephole LSTM with temporal attention layer (TAL) to accurately predict the direction of stock markets. The daily data of four world indices including those of U.S., U.K., China and India, from 2005 to 2022, are examined. We present a comprehensive evaluation with preliminary data analysis, feature extraction and hyperparameters' optimization for the problem of stock market prediction. TAL is introduced post peephole LSTM to select the relevant information with respect to time and enhance the performance of the proposed model. The prediction performance of the proposed model is compared with that of the benchmark models CNN, LSTM, SVM and RF using evaluation metrics of accuracy, precision, recall, F1-score, AUC-ROC, PR-AUC and MCC. The experimental results show the superior performance of our proposed model achieving better scores than the benchmark models for most evaluation metrics and for all datasets. The accuracy of the proposed model is 96% and 88% for U.K. and Chinese stock markets respectively and it is 85% for both U.S. and Indian markets. Hence, the stock markets of U.K. and China are found to be more predictable than those of U.S. and India. Significant findings of our work include that the attention layer enables peephole LSTM to better identify the long-term dependencies and temporal patterns in the stock markets' data. Profitable and timely trading strategies can be formulated based on our proposed prediction model.

Fin-Bayes: A Multi-Objective Bayesian Optimization Framework for Soft Robotic Fingers

Computational design is a critical tool to realize the full potential of Soft Robotics, maximizing their inherent benefits of high performance, flexibility, robustness, and safe interaction. Practically, computational design entails a rapid iterative search process over a parameterized design space, with assessment using (frequently) computational modeling and (more rarely) physical experimentation. Bayesian approaches work well for these expensive-to-analyze systems and can lead to efficient exploration of design space than comparative algorithms. However, such computational design typically entails weaknesses related to a lack of fidelity in assessment, a lack of sufficient iterations, and/or optimizing to a singular objective function. Our work directly addresses these shortcomings. First, we harness a sophisticated nonlinear Finite Element Modeling suite that explicitly considers geometry, material, and contact nonlinearity to perform rapid accurate characterization. We validate this through extensive physical testing using an automated test rig and printed robotic fingers, providing far more experimental data than that reported in the literature. Second, we explore a significantly larger design space than comparative approaches, with more free variables and more opportunity to discover novel, high performance designs. Finally, we use a multiobjective Bayesian optimizer that allows for the identification of promising trade-offs between two critical objectives, compliance and contact force. We test our framework on optimizing Fin Ray grippers, which are ubiquitous throughout research and industry due to their passive compliance and durability. Results demonstrate the benefits of our approach, allowing for the optimization and identification of promising gripper designs within an extensive design space, which are then 3D printed and usable in reality.

Alignment of density maps in Wasserstein distance

In this article, we propose an algorithm for aligning three-dimensional objects when represented as density maps, motivated by applications in cryogenic electron microscopy. The algorithm is based on minimizing the 1-Wasserstein distance between the density maps after a rigid transformation. The induced loss function enjoys a more benign landscape than its Euclidean counterpart and Bayesian optimization is employed for computation. Numerical experiments show improved accuracy and efficiency over existing algorithms on the alignment of real protein molecules. In the context of aligning heterogeneous pairs, we illustrate a potential need for new distance functions.

AI-enhanced chemical paradigm: From molecular graphs to accurate prediction and mechanism

The development of accurate and interpretable models for predicting reaction constants of organic compounds with hydroxyl radicals is vital for advancing quantitative structure-activity relationships (QSAR) in pollutant degradation. Methods like molecular descriptors, molecular fingerprinting, and group contribution methods have limitations, as traditional machine learning struggles to capture all intramolecular information simultaneously. To address this, we established an integrated graph neural network (GNN) with approximately 12 million learnable parameters. GNN represents atoms as nodes and chemical bonds as edges, thus transforming molecules into a graph structures, effectively capturing microscopic properties while depicting atom connectivity in non-Euclidean space. Our datasets comprise 1401 pollutants to develop an integrated GNN model with Bayesian optimization, the model achieves root mean square errors of 0.165, 0.172, and 0.189 on the training, validation, and test datasets, respectively. Furthermore, we assess molecular structure similarity using molecular fingerprint to enhance the model's applicability. Afterwards, we propose a gradient weight mapping method for model explainability, uncovering the key functional groups in chemical reactions in artificial intelligence perspective, which would boost chemistry through artificial intelligence extreme arithmetic power.

A physics-informed Bayesian optimization method for rapid development of electrical machines

Advanced slot and winding designs are imperative to create future high performance electrical machines (EM). As a result, the development of methods to design and improve slot filling factor (SFF) has attracted considerable research. Recent developments in manufacturing processes, such as additive manufacturing and alternative materials, has also highlighted a need for novel high-fidelity design techniques to develop high performance complex geometries and topologies. This study therefore introduces a novel physics-informed machine learning (PIML) design optimization process for improving SFF in traction electrical machines used in electric vehicles. A maximum entropy sampling algorithm (MESA) is used to seed a physics-informed Bayesian optimization (PIBO) algorithm, where the target function and its approximations are produced by Gaussian processes (GP)s. The proposed PIBO-MESA is coupled with a 2D finite element model (FEM) to perform a GP-based surrogate and provide the first demonstration of the optimal combination of complex design variables for an electrical machine. Significant computational gains were achieved using the new PIBO-MESA approach, which is 45% faster than existing stochastic methods, such as the non-dominated sorting genetic algorithm II (NSGA-II). The FEM results confirm that the new design optimization process and keystone shaped wires lead to a higher SFF (i.e. by 20%) and electromagnetic improvements (e.g. maximum torque by 12%) with similar resistivity. The newly developed PIBO-MESA design optimization process therefore presents significant benefits in the design of high-performance electric machines, with reduced development time and costs.

On-Demand Optimization of Colorimetric Gas Sensors Using a Knowledge-Aware Algorithm-Driven Robotic Experimental Platform

Synthesizing the best material globally is challenging; it needs to know what and how much the best ingredient composition should be for satisfying multiple figures of merit simultaneously. Traditional one-variable-at-a-time methods are inefficient; the design-build-test-learn (DBTL) method could achieve the optimal composition from only a handful of ingredients. A vast design space needs to be explored to discover the possible global optimal composition for on-demand materials synthesis. This research developed a hypothesis-guided DBTL (H-DBTL) method combined with robots to expand the dimensions of the search space, thereby achieving a better global optimal performance. First, this study engineered the search space with knowledge-aware chemical descriptors and customized multiobjective functions to fulfill on-demand research objectives. To verify this concept, this novel method was used to optimize colorimetric ammonia sensors across a vast design space of as high as 19 variables, achieving two remarkable optimization goals within 1 week: first, a sensing array was developed for ammonia quantification of a wide dynamic range, from 0.5 to 500 ppm; second, a new state-of-the-art detection limit of 50 ppb was reached. This work demonstrates that the H-DBTL approach, combined with a robot, develops a novel paradigm for the on-demand optimization of functional materials.

An adaptive adjacency matrix-based graph convolutional recurrent network for air quality prediction

In recent years, air pollution has become increasingly serious and poses a great threat to human health. Timely and accurate air quality prediction is crucial for air pollution early warning and control. Although data-driven air quality prediction methods are promising, there are still challenges in studying spatial-temporal correlations of air pollutants to design effective predictors. To address this issue, a novel model called adaptive adjacency matrix-based graph convolutional recurrent network (AAMGCRN) is proposed in this study. The model inputs Point of Interest (POI) data and meteorological data into a fully connected neural network to learn the weights of the adjacency matrix thereby constructing the self-ringing adjacency matrix and passes the pollutant data with this matrix as input to the Graph Convolutional Network (GCN) unit. Then, the GCN unit is embedded into LSTM units to learn spatio-temporal dependencies. Furthermore, temporal features are extracted using Long Short-Term Memory network (LSTM). Finally, the outputs of these two components are merged and air quality predictions are generated through a hidden layer. To evaluate the performance of the model, we conducted multi-step predictions for the hourly concentration of PM2.5, PM10 and O3 at Fangshan, Tiantan and Dongsi monitoring stations in Beijing. The experimental results show that our method achieves better predicted effects compared with other baseline models based on deep learning. In general, we designed a novel air quality prediction method and effectively addressed the shortcomings of existing studies in learning the spatio-temporal correlations of air pollutants. This method can provide more accurate air quality predictions and is expected to provide support for public health protection and government environmental decision-making.

Enhanced osteoporotic fracture prediction in postmenopausal women using Bayesian optimization of machine learning models with genetic risk score

This study aimed to enhance the fracture risk prediction accuracy in major osteoporotic fractures (MOF) and hip fractures (HF) by integrating genetic profiles, machine learning (ML) techniques, and Bayesian optimization. The Genetic Risk Score (GRS), derived from 1103 risk single nucleotide polymorphisms (SNPs) from GWAS, was formulated for 25 772 postmenopausal women from the Women's Health Initiative dataset. We developed four ML models: Support Vector Machine (SVM), Random Forest, XGBoost, and Artificial Neural Network (ANN) for binary fracture outcome and ten-year fracture risk prediction. GRS and FRAX Clinical Risk Factors (CRFs) were used as predictors. Death as a competing risk was accounted for in ML models for time-to-fracture data. ML models were subsequently fine-tuned through Bayesian optimization, which displayed marked superiority over traditional grid search. Evaluation of the models' performance considered an array of metrics such as accuracy, weighted F1 Score, PRAUC, and AUC for binary fracture predictions, and the C-index, Brier score, and dynamic mean AUC over a ten-year follow-up period. We found that GRS-integrated XGBoost with Bayesian optimization is the most effective model, with an accuracy of 91.2% (95% CI: 90.4-92.0%) and an AUC of 0.739 (95% CI: 0.731-0.746) in MOF binary predictions. For 10-year fracture risk modeling, the XGBoost model attained a C-index of 0.795 (95% CI: 0.783-0.806) and mean dynamic AUC of 0.799 (95% CI: 0.788-0.809). Compared to FRAX, the XGBoost model exhibited a categorical Net Reclassification Improvement (NRI) of 22.6% (p = .004). A sensitivity analysis, which included BMD but lacked GRS, reaffirmed these findings. Furthermore, portability tests in diverse non-European groups, including Asians and African Americans, underscored the model's robustness and adaptability. This study accentuates the potential of combining genetic insights and optimized ML in strengthening fracture predictions, heralding new preventive strategies for postmenopausal women.

Artificial intelligence-based prediction model for the elemental occurrence form of tailings and mine wastes

With the advent of the second industrial revolution, mining and metallurgical processes generate large volumes of tailings and mine wastes (TMW), which worsens global environmental pollution. Studying the occurrence of metal and metalloid elements in TMW is an effective approach to evaluating pollution linked to TMW. However, traditional laboratory-based measurements are complicated and time-consuming; thus, an empirical method is urgently needed that can rapidly and accurately determine elemental occurrence forms. In this study, a model combining Bayesian optimization and random forest (RF) approaches was proposed to predict TMW occurrence forms. To build the RF model, a dataset of 2376 samples was obtained, with mineral composition, elemental properties, and total concentration composition used as inputs and the percentage of occurrence forms as the model output. The correlation coefficient (R), coefficient of determination, mean absolute error, root mean squared error, and root mean squared logarithmic error metrics were used for model evaluation. After Bayesian optimization, the optimal RF model achieved accurate predictive performance, with R values of 0.99 and 0.965 on the training and test sets, respectively. The feature significance was analyzed using feature importance and Shapley additive explanatory values, which revealed that the electronegativity and total concentration of the elements were the two features with the greatest influence on the model output. As the electronegativity of an element increases, its corresponding residual fraction content gradually decreases. This is because the solubility typically increases with the solvent's polarity and electronegativity. Overall, this study proposes an RF model based on the nature of TMW that can rapidly and accurately predict the percentage values of metal and metalloid element occurrence forms in TMW. This method can minimize testing time requirements and help to assess TMW pollution risks, as well as further promote safe TMW management and recycling.

Explainable Learning-Based Timeout Optimization for Accurate and Efficient Elephant Flow Prediction in SDNs

Accurately and efficiently predicting elephant flows (elephants) is crucial for optimizing network performance and resource utilization. Current prediction approaches for software-defined networks (SDNs) typically rely on complete traffic and statistics moving from switches to controllers. This leads to an extra control channel bandwidth occupation and network delay. To address this issue, this paper proposes a prediction strategy based on incomplete traffic that is sampled by the timeouts for the installation or reactivation of flow entries. The strategy involves assigning a very short hard timeout (Tinitial) to flow entries and then increasing it at a rate of r until flows are identified as elephants or out of their lifespans. Predicted elephants are switched to an idle timeout of 5 s. Logistic regression is used to model elephants based on a complete dataset. Bayesian optimization is then used to tune the trained model Tinitial and r over the incomplete dataset. The process of feature selection, model learning, and optimization is explained. An extensive evaluation shows that the proposed approach can achieve over 90% generalization accuracy over 7 different datasets, including campus, backbone, and the Internet of Things (IoT). Elephants can be correctly predicted for about half of their lifetime. The proposed approach can significantly reduce the controller-switch interaction in campus and IoT networks, although packet completion approaches may need to be applied in networks with a short mean packet inter-arrival time.

Traditional or adaptive design of experiments? A pilot-scale comparison on wood delignification

Traditional design of experiments and response surface methodology are widely used in engineering and process development. Bayesian optimization is an alternative machine learning approach that adaptively selects successive experimental conditions based on a predefined performance measure. Here we compared the two approaches using simulations and empirical experiments on alkaline wood delignification to identify important benefits and drawbacks of Bayesian optimization in the context of design of experiments. The simulations showed that the selection of initial experiments and measurement noise influenced the convergence of the Bayesian optimization algorithm to known optimal conditions. Both methods, however, showed comparable pilot-scale results on optimal digestion conditions, where high cellulose yields were combined with acceptable kappa numbers and pulp viscosities. Bayesian optimization did not enable a decrease in the number of experiments required for reaching these conditions but provided a more accurate model in the vicinity of the optimum based on additional modelling and cross-validation. These results shed light on the practical differences between the two methodologies for process development and are an important contribution to the chemometrics and machine learning communities.

Hour-Ahead Photovoltaic Power Prediction Combining BiLSTM and Bayesian Optimization Algorithm, with Bootstrap Resampling for Interval Predictions

Photovoltaic (PV) power prediction plays a critical role amid the accelerating adoption of renewable energy sources. This paper introduces a bidirectional long short-term memory (BiLSTM) deep learning (DL) model designed for forecasting photovoltaic power one hour ahead. The dataset under examination originates from a small PV installation located at the Polytechnic School of the University of Alcala. To improve the quality of historical data and optimize model performance, a robust data preprocessing algorithm is implemented. The BiLSTM model is synergistically combined with a Bayesian optimization algorithm (BOA) to fine-tune its primary hyperparameters, thereby enhancing its predictive efficacy. The performance of the proposed model is evaluated across diverse meteorological and seasonal conditions. In deterministic forecasting, the findings indicate its superiority over alternative models employed in this research domain, specifically a multilayer perceptron (MLP) neural network model and a random forest (RF) ensemble model. Compared with the MLP and RF reference models, the proposed model achieves reductions in the normalized mean absolute error (nMAE) of 75.03% and 77.01%, respectively, demonstrating its effectiveness in this type of prediction. Moreover, interval prediction utilizing the bootstrap resampling method is conducted, with the acquired prediction intervals carefully adjusted to meet the desired confidence levels, thereby enhancing the robustness and flexibility of the predictions.

Enhancing Seismic Damage Detection and Assessment in Highway Bridge Systems: A Pattern Recognition Approach with Bayesian Optimization

Highway bridges stand as paramount elements within transportation infrastructure systems. The ability to ensure swift recovery after extreme events, such as earthquakes, is a fundamental trait of resilient communities. Consequently, expediting the recovery process necessitates near real-time diagnosis of structural damage to provide dependable information. In this study, a data-driven approach for damage detection and assessment is investigated, focusing on bridge columns-the pivotal supporting elements of bridge systems-based on simulations derived from nonlinear time history analysis. This research introduces a set of cumulative intensity-based damage features, whose efficacy is demonstrated through unsupervised learning techniques. Leveraging the support vector machine, a prominent pattern recognition algorithm in supervised learning, alongside Bayesian optimization with a Gaussian process, seismic damage detection and assessment are explored. Encouragingly, the methodology yields high estimation accuracies for both binary outcomes (indicating the presence of damage or the occurrence of collapse) and multi-class classifications (indicating the severity of damage). This breakthrough opens avenues for the practical implementation of on-board sensor computing, enabling near real-time damage detection and assessment in bridge structures.

Personalized inference for neurostimulation with meta-learning: a case study of vagus nerve stimulation

Objective. Neurostimulation is emerging as treatment for several diseases of the brain and peripheral organs. Due to variability arising from placement of stimulation devices, underlying neuroanatomy and physiological responses to stimulation, it is essential that neurostimulation protocols are personalized to maximize efficacy and safety. Building such personalized protocols would benefit from accumulated information in increasingly large datasets of other individuals' responses.Approach. To address that need, we propose a meta-learning family of algorithms to conduct few-shot optimization of key fitting parameters of physiological and neural responses in new individuals. While our method is agnostic to neurostimulation setting, here we demonstrate its effectiveness on the problem of physiological modeling of fiber recruitment during vagus nerve stimulation (VNS). Using data from acute VNS experiments, the mapping between amplitudes of stimulus-evoked compound action potentials (eCAPs) and physiological responses, such as heart rate and breathing interval modulation, is inferred.Main results. Using additional synthetic data sets to complement experimental results, we demonstrate that our meta-learning framework is capable of directly modeling the physiology-eCAP relationship for individual subjects with much fewer individually queried data points than standard methods.Significance. Our meta-learning framework is general and can be adapted to many input-response neurostimulation mapping problems. Moreover, this method leverages information from growing data sets of past patients, as a treatment is deployed. It can also be combined with several model types, including regression, Gaussian processes with Bayesian optimization, and beyond.

Artificial intelligence in healthcare: combining deep learning and Bayesian optimization to forecast COVID-19 confirmed cases

Healthcare is a topic of significant concern within the academic and business sectors. The COVID-19 pandemic has had a considerable effect on the health of people worldwide. The rapid increase in cases adversely affects a nation's economy, public health, and residents' social and personal well-being. Improving the precision of COVID-19 infection forecasts can aid in making informed decisions regarding interventions, given the pandemic's harmful impact on numerous aspects of human life, such as health and the economy. This study aims to predict the number of confirmed COVID-19 cases in Saudi Arabia using Bayesian optimization (BOA) and deep learning (DL) methods. Two methods were assessed for their efficacy in predicting the occurrence of positive cases of COVID-19. The research employed data from confirmed COVID-19 cases in Saudi Arabia (SA), the United Kingdom (UK), and Tunisia (TU) from 2020 to 2021. The findings from the BOA model indicate that accurately predicting the number of COVID-19 positive cases is difficult due to the BOA projections needing to align with the assumptions. Thus, a DL approach was utilized to enhance the precision of COVID-19 positive case prediction in South Africa. The DQN model performed better than the BOA model when assessing RMSE and MAPE values. The model operates on a local server infrastructure, where the trained policy is transmitted solely to DQN. DQN formulated a reward function to amplify the efficiency of the DQN algorithm. By examining the rate of change and duration of sleep in the test data, this function can enhance the DQN model's training. Based on simulation findings, it can decrease the DQN work cycle by roughly 28% and diminish data overhead by more than 50% on average.

Pesticide effect on earthworm lethality via interpretable machine learning

Earthworms are among the most important animals (invertebrates) for soil health. Many chemical substances released into nature for agricultural development, such as pesticides, may have unwanted effects on those organisms. However, it is essential to understand the extent of the impact of chemicals on soil health first and then make the proper decisions for regulatory or commercial purposes. We hypothesize that there is an expressible quantitative structure-activity relationship (QSAR) between the structure of pesticide compounds and the acute toxicity effect of earthworm species Eisenia fetida. The description of this relationship allows for a better assessment of the impact of chemicals on the said earthworm. To describe this relationship, a dataset of chemicals was collected from open-access sources to develop a mathematical model. A novel approach, combining genetic algorithm and Bayesian optimization, was used to select structural features into the model and to optimize model parameters. The final QSAR classification model was created with the Random Forest algorithm and exhibited good prediction Accuracy of 0.78 on training set and 0.80 on test set. The model representation follows FAIR principles and is available on QsarDB.org.

ENAS-B: Combining ENAS With Bayesian Optimization for Automatic Design of Optimal CNN Architectures for Breast Lesion Classification From Ultrasound Images

Efficient Neural Architecture Search (ENAS) is a recent development in searching for optimal cell structures for Convolutional Neural Network (CNN) design. It has been successfully used in various applications including ultrasound image classification for breast lesions. However, the existing ENAS approach only optimizes cell structures rather than the whole CNN architecture nor its trainable hyperparameters. This paper presents a novel framework for automatic design of CNN architectures by combining strengths of ENAS and Bayesian Optimization in two-folds. Firstly, we use ENAS to search for optimal normal and reduction cells. Secondly, with the optimal cells and a suitable hyperparameter search space, we adopt Bayesian Optimization to find the optimal depth of the network and optimal configuration of the trainable hyperparameters. To test the validity of the proposed framework, a dataset of 1522 breast lesion ultrasound images is used for the searching and modeling. We then evaluate the robustness of the proposed approach by testing the optimized CNN model on three external datasets consisting of 727 benign and 506 malignant lesion images. We further compare the CNN model with the default ENAS-based CNN model, and then with CNN models based on the state-of-the-art architectures. The results (error rate of no more than 20.6% on internal tests and 17.3% on average of external tests) show that the proposed framework generates robust and light CNN models.

Bayesian Optimization in Drug Discovery

Drug discovery deals with the search for initial hits and their optimization toward a targeted clinical profile. Throughout the discovery pipeline, the candidate profile will evolve, but the optimization will mainly stay a trial-and-error approach. Tons of in silico methods have been developed to improve and fasten this pipeline. Bayesian optimization (BO) is a well-known method for the determination of the global optimum of a function. In the last decade, BO has gained popularity in the early drug design phase. This chapter starts with the concept of black box optimization applied to drug design and presents some approaches to tackle it. Then it focuses on BO and explains its principle and all the algorithmic building blocks needed to implement it. This explanation aims to be accessible to people involved in drug discovery projects. A strong emphasis is made on the solutions to deal with the specific constraints of drug discovery. Finally, a large set of practical applications of BO is highlighted.

Machine Learning for Biological Design

We briefly present machine learning approaches for designing better biological experiments. These approaches build on machine learning predictors and provide additional tools to guide scientific discovery. There are two different kinds of objectives when designing better experiments: to improve the predictive model or to improve the experimental outcome. We survey five different approaches for adaptive experimental design that iteratively search the space of possible experiments while adapting to measured data. The approaches are Bayesian optimization, bandits, reinforcement learning, optimal experimental design, and active learning. These machine learning approaches have shown promise in various areas of biology, and we provide broad guidelines to the practitioner and links to further resources.

Classification of breast lesions in ultrasound images using deep convolutional neural networks: transfer learning versus automatic architecture design

Deep convolutional neural networks (DCNNs) have demonstrated promising performance in classifying breast lesions in 2D ultrasound (US) images. Exiting approaches typically use pre-trained models based on architectures designed for natural images with transfer learning. Fewer attempts have been made to design customized architectures specifically for this purpose. This paper presents a comprehensive evaluation on transfer learning based solutions and automatically designed networks, analyzing the accuracy and robustness of different recognition models in three folds. First, we develop six different DCNN models (BNet, GNet, SqNet, DsNet, RsNet, IncReNet) based on transfer learning. Second, we adapt the Bayesian optimization method to optimize a CNN network (BONet) for classifying breast lesions. A retrospective dataset of 3034 US images collected from various hospitals is then used for evaluation. Extensive tests show that the BONet outperforms other models, exhibiting higher accuracy (83.33%), lower generalization gap (1.85%), shorter training time (66 min), and less model complexity (approximately 0.5 million weight parameters). We also compare the diagnostic performance of all models against that by three experienced radiologists. Finally, we explore the use of saliency maps to explain the classification decisions made by different models. Our investigation shows that saliency maps can assist in comprehending the classification decisions.

Machine Learning-Based Shear Optimal Adhesive Microstructures with Experimental Validation

Bioinspired fibrillar structures are promising for a wide range of disruptive adhesive applications. Especially micro/nanofibrillar structures on gecko toes can have strong and controllable adhesion and shear on a wide range of surfaces with residual-free, repeatable, self-cleaning, and other unique features. Synthetic dry fibrillar adhesives inspired by such biological fibrils are optimized in different aspects to increase their performance. Previous fibril designs for shear optimization are limited by predefined standard shapes in a narrow range primarily based on human intuition, which restricts their maximum performance. This study combines the machine learning-based optimization and finite-element-method-based shear mechanics simulations to find shear-optimized fibril designs automatically. In addition, fabrication limitations are integrated into the simulations to have more experimentally relevant results. The computationally discovered shear-optimized structures are fabricated, experimentally validated, and compared with the simulations. The results show that the computed shear-optimized fibrils perform better than the predefined standard fibril designs. This design optimization method can be used in future real-world shear-based gripping or nonslip surface applications, such as robotic pick-and-place grippers, climbing robots, gloves, electronic devices, and medical and wearable devices.

Bayesian Optimization of Wet-Impregnated Co-Mo/Al2O3 Catalyst for Maximizing the Yield of Carbon Nanotube Synthesis

Multimetallic catalysts have demonstrated their high potential for the controlled synthesis of carbon nanotubes (CNTs), but their development requires a more complicated optimization than that of monometallic catalysts. Here, we employed Bayesian optimization (BO) to optimize the preparation of Co-Mo/Al2O3 catalyst using wet impregnation, with the goal of maximizing carbon yield in the chemical vapor deposition (CVD) synthesis of CNTs. In the catalyst preparation process, we selected four parameters to optimize: the weight percentage of metal, the ratio of Co to Mo in the catalyst, the drying temperature, and the calcination temperature. We ran two parallel BO processes to compare the performance of two types of acquisitions: expected improvement (EI), which does not consider noise, and one-shot knowledge gradient (OKG), which takes noise into account. As a result, both acquisition functions successfully optimized the carbon yield with similar performance. The result suggests that the use of EI, which has a lower computational load, is acceptable if the system has sufficient robustness. The investigation of the contour plots showed that the addition of Mo has a negative effect on carbon yield.

Active Learning Guided Computational Discovery of Plant-Based Redoxmers for Organic Nonaqueous Redox Flow Batteries

Organic nonaqueous redox flow batteries (O-NRFBs) are promising energy storage devices due to their scalability and reliance on sourceable materials. However, finding suitable redox-active organic molecules (redoxmers) for these batteries remains a challenge. Using plant-based compounds as precursors for these redoxmers can decrease their costs and environmental toxicity. In this computational study, flavonoid molecules have been examined as potential redoxmers for O-NRFBs. Flavone and isoflavone derivatives were selected as catholyte (positive charge carrier) and anolyte (negative charge carrier) molecules, respectively. To drive their redox potentials to the opposite extremes, in silico derivatization was performed using a novel algorithm to generate a library of > 40000 candidate molecules that penalizes overly complex structures. A multiobjective Bayesian optimization based active learning algorithm was then used to identify best redoxmer candidates in these search spaces. Our study provides methodologies for molecular design and optimization of natural scaffolds and highlights the need of incorporating expert chemistry awareness of the natural products and the basic rules of synthetic chemistry in machine learning.

Explainable Artificial Intelligence Paves the Way in Precision Diagnostics and Biomarker Discovery for the Subclass of Diabetic Retinopathy in Type 2 Diabetics

Diabetic retinopathy (DR), a common ocular microvascular complication of diabetes, contributes significantly to diabetes-related vision loss. This study addresses the imperative need for early diagnosis of DR and precise treatment strategies based on the explainable artificial intelligence (XAI) framework. The study integrated clinical, biochemical, and metabolomic biomarkers associated with the following classes: non-DR (NDR), non-proliferative diabetic retinopathy (NPDR), and proliferative diabetic retinopathy (PDR) in type 2 diabetes (T2D) patients. To create machine learning (ML) models, 10% of the data was divided into validation sets and 90% into discovery sets. The validation dataset was used for hyperparameter optimization and feature selection stages, while the discovery dataset was used to measure the performance of the models. A 10-fold cross-validation technique was used to evaluate the performance of ML models. Biomarker discovery was performed using minimum redundancy maximum relevance (mRMR), Boruta, and explainable boosting machine (EBM). The predictive proposed framework compares the results of eXtreme Gradient Boosting (XGBoost), natural gradient boosting for probabilistic prediction (NGBoost), and EBM models in determining the DR subclass. The hyperparameters of the models were optimized using Bayesian optimization. Combining EBM feature selection with XGBoost, the optimal model achieved (91.25 ± 1.88) % accuracy, (89.33 ± 1.80) % precision, (91.24 ± 1.67) % recall, (89.37 ± 1.52) % F1-Score, and (97.00 ± 0.25) % the area under the ROC curve (AUROC). According to the EBM explanation, the six most important biomarkers in determining the course of DR were tryptophan (Trp), phosphatidylcholine diacyl C42:2 (PC.aa.C42.2), butyrylcarnitine (C4), tyrosine (Tyr), hexadecanoyl carnitine (C16) and total dimethylarginine (DMA). The identified biomarkers may provide a better understanding of the progression of DR, paving the way for more precise and cost-effective diagnostic and treatment strategies.

Accelerating the Design of Multishell Upconverting Nanoparticles through Bayesian Optimization

The photon upconverting properties of lanthanide-doped nanoparticles drive their applications in imaging, optoelectronics, and additive manufacturing. To maximize their brightness, these upconverting nanoparticles (UCNPs) are often synthesized as core/shell heterostructures. However, the large numbers of compositional and structural parameters in multishell heterostructures make optimizing optical properties challenging. Here, we demonstrate the use of Bayesian optimization (BO) to learn the structure and design rules for multishell UCNPs with bright ultraviolet and violet emission. We leverage an automated workflow that iteratively recommends candidate UCNP structures and then simulates their emission spectra using kinetic Monte Carlo. Yb3+/Er3+- and Yb3+/Er3+/Tm3+-codoped UCNP nanostructures optimized with this BO workflow achieve 10- and 110-fold brighter emission within 22 and 40 iterations, respectively. This workflow can be expanded to structures with higher compositional and structural complexity, accelerating the discovery of novel UCNPs while domain-specific knowledge is being developed.

Metabolic syndrome prediction model using Bayesian optimization and XGBoost based on traditional Chinese medicine features

Metabolic syndrome (MetS) has a high prevalence and is prone to many complications. However, current MetS diagnostic methods require blood tests that are not conducive to self-testing, so a user-friendly and accurate method for predicting MetS is needed to facilitate early detection and treatment. In this study, a MetS prediction model based on a simple, small number of Traditional Chinese Medicine (TCM) clinical indicators and biological indicators combined with machine learning algorithms is investigated. Electronic medical record data from 2040 patients who visited outpatient clinics at Guangdong Chinese medicine hospitals from 2020 to 2021 were used to investigate the fusion of Bayesian optimization (BO) and eXtreme gradient boosting (XGBoost) in order to create a BO-XGBoost model for screening nineteen key features in three categories: individual bio-information, TCM indicators, and TCM habits that influence MetS prediction. Subsequently, the predictive diagnostic model for MetS was developed. The experimental results revealed that the model proposed in this paper achieved values of 93.35 %, 90.67 %, 80.40 %, and 0.920 for the F1, sensitivity, FRS, and AUC metrics, respectively. These values outperformed those of the seven other tested machine learning models. Finally, this study developed an intelligent prediction application for MetS based on the proposed model, which can be utilized by ordinary users to perform self-diagnosis through a web-based questionnaire, thereby accomplishing the objective of early detection and intervention for MetS.

Machine Learning Driven Channel Thickness Optimization in Dual-Layer Oxide Thin-Film Transistors for Advanced Electrical Performance

Machine learning (ML) provides temporal advantage and performance improvement in practical electronic device design by adaptive learning. Herein, Bayesian optimization (BO) is successfully applied to the design of optimal dual-layer oxide semiconductor thin film transistors (OS TFTs). This approach effectively manages the complex correlation and interdependency between two oxide semiconductor layers, resulting in the efficient design of experiment (DoE) and reducing the trial-and-error. Considering field effect mobility (𝜇) and threshold voltage (Vth ) simultaneously, the dual-layer structure designed by the BO model allows to produce OS TFTs with remarkable electrical performance while significantly saving an amount of experimental trial (only 15 data sets are required). The optimized dual-layer OS TFTs achieve the enhanced field effect mobility of 36.1 cm2  V-1  s-1 and show good stability under bias stress with negligible difference in its threshold voltage compared to conventional IGZO TFTs. Moreover, the BO algorithm is successfully customized to the individual preferences by applying the weight factors assigned to both field effect mobility (𝜇) and threshold voltage (Vth ).

On Model-Based Transfer Learning Method for the Detection of Inter-Turn Short Circuit Faults in PMSM

The early detection of an inter-turn short circuit (ITSC) fault is extremely critical for permanent magnet synchronous motors (PMSMs) because it can lead to catastrophic consequences. In this study, a model-based transfer learning method is developed for ITSC fault detection. The contribution can be summarized as two points. First of all, a Bayesian-optimized residual dilated CNN model was proposed for the pre-training of the method. The dilated convolution is utilized to extend the receptive domain of the model, the residual architecture is employed to surmount the degradation problems, and the Bayesian optimization method is launched to address the hyperparameters tuning issues. Secondly, a transfer learning framework and strategy are presented to settle the new target domain datasets after the pre-training of the proposed model. Furthermore, motor fault experiments are carried out to validate the effectiveness of the proposed method. Comparison with seven other methods indicates the performance and advantage of the proposed method.

Controlling biofilm transport with porous metamaterials designed with Bayesian learning

Biofilm growth and transport in confined systems frequently occur in natural and engineered systems. Designing customizable engineered porous materials for controllable biofilm transportation properties could significantly improve the rapid utilization of biofilms as engineered living materials for applications in pollution alleviation, material self-healing, energy production, and many more. We combine Bayesian optimization (BO) and individual-based modeling to conduct design optimizations for maximizing different porous materials' (PM) biofilm transportation capability. We first characterize the acquisition function in BO for designing 2-dimensional porous membranes. We use the expected improvement acquisition function for designing lattice metamaterials (LM) and 3-dimensional porous media (3DPM). We find that BO is 92.89% more efficient than the uniform grid search method for LM and 223.04% more efficient for 3DPM. For all three types of structures, the selected characterization simulation tests are in good agreement with the design spaces approximated with Gaussian process regression. All the extracted optimal designs exhibit better biofilm growth and transportability than unconfined space without substrates. Our comparison study shows that PM stimulates biofilm growth by taking up volumetric space and pushing biofilms' upward growth, as evidenced by a 20% increase in bacteria cell numbers in unconfined space compared to porous materials, and 128% more bacteria cells in the target growth region for PM-induced biofilm growth compared with unconfined growth. Our work provides deeper insights into the design of substrates to tune biofilm growth, analyzing the optimization process and characterizing the design space, and understanding biophysical mechanisms governing the growth of biofilms.

Enhanced joint hybrid deep neural network explainable artificial intelligence model for 1-hr ahead solar ultraviolet index prediction

BACKGROUND AND OBJECTIVE

Exposure to solar ultraviolet (UV) radiation can cause malignant keratinocyte cancer and eye disease. Developing a user-friendly, portable, real-time solar UV alert system especially or wearable electronic mobile devices can help reduce the exposure to UV as a key measure for personal and occupational management of the UV risks. This research aims to design artificial intelligence-inspired early warning tool tailored for short-term forecasting of UV index (UVI) integrating satellite-derived and ground-based predictors for Australian hotspots receiving high UV exposures. The study further improves the trustworthiness of the newly designed tool using an explainable artificial intelligence approach.

METHODS

An enhanced joint hybrid explainable deep neural network model (called EJH-X-DNN) is constructed involving two phases of feature selection and hyperparameter tuning using Bayesian optimization. A comprehensive assessment of EJH-X- DNN is conducted with six other competing benchmarked models. The proposed model is explained locally and globally using robust model-agnostic explainable artificial intelligence frameworks such as Local Interpretable Model-Agnostic Explanations (LIME), Shapley additive explanations (SHAP), and permutation feature importance (PFI).

RESULTS

The newly proposed model outperformed all benchmarked models for forecasting hourly horizons UVI, with correlation coefficients of 0.900, 0.960, 0.897, and 0.913, respectively, for Darwin, Alice Springs, Townsville, and Emerald hotspots. According to the combined local and global explainable model outcomes, the site-based results indicate that antecedent lagged memory of UVI and solar zenith angle are influential features. Predictions made by EJH-X-DNN model are strongly influenced by factors such as ozone effect, cloud conditions, and precipitation.

CONCLUSION

With its superiority and skillful interpretation, the UVI prediction system reaffirms its benefits for providing real-time UV alerts to mitigate risks of skin and eye health complications, reducing healthcare costs and contributing to outdoor exposure policy.

Hybrid Data-Driven Discovery of High-Performance Silver Selenide-Based Thermoelectric Composites

Optimizing material compositions often enhances thermoelectric performances. However, the large selection of possible base elements and dopants results in a vast composition design space that is too large to systematically search using solely domain knowledge. To address this challenge, a hybrid data-driven strategy that integrates Bayesian optimization (BO) and Gaussian process regression (GPR) is proposed to optimize the composition of five elements (Ag, Se, S, Cu, and Te) in AgSe-based thermoelectric materials. Data is collected from the literature to provide prior knowledge for the initial GPR model, which is updated by actively collected experimental data during the iteration between BO and experiments. Within seven iterations, the optimized AgSe-based materials prepared using a simple high-throughput ink mixing and blade coating method deliver a high power factor of 2100 µW m-1 K-2 , which is a 75% improvement from the baseline composite (nominal composition of Ag2 Se1 ). The success of this study provides opportunities to generalize the demonstrated active machine learning technique to accelerate the development and optimization of a wide range of material systems with reduced experimental trials.

Evaluation of Austenite-Ferrite Phase Transformation in Carbon Steel Using Bayesian Optimized Cellular Automaton Simulation

Austenite-ferrite phase transformation is a crucial metallurgical tool to tailor the properties of steels required for particular applications. Extensive simulation and modeling studies have been conducted to evaluate the phase transformation behaviors; however, some fundamental physical parameters still need to be optimized for better understanding. In this study, the austenite-ferrite phase transformation was evaluated in carbon steels with three carbon concentrations during isothermal annealing at various temperatures using a developed cellular automaton simulation model combined with Bayesian optimization. The simulation results show that the incubation period for nucleation is an essential factor that needs to be considered during austenite-ferrite phase transformation simulation. The incubation period constant is mainly affected by carbon concentration and the optimized values have been obtained as 10-24, 10-19, and 10-21 corresponding to carbon concentrations of 0.2 wt%, 0.35 wt%, and 0.5 wt%, respectively. The average ferrite grain size after phase transformation completion could decrease with the decreasing initial austenite grain size. Some other parameters were also analyzed in detail. The developed cellular automaton simulation model combined with Bayesian optimization in this study could conduct an in-depth exploration of critical and optimal parameters and provide deeper insights into understanding the fundamental physical characteristics during austenite-ferrite phase transformation.

CHP Engine Anomaly Detection Based on Parallel CNN-LSTM with Residual Blocks and Attention

The extreme operating environment of the combined heat and power (CHP) engine is likely to cause anomalies and defects, which can lead to engine failure; thus, detecting engine anomalies is essential. In this study, we propose a parallel convolutional neural network-long short-term memory (CNN-LSTM) residual blocks attention (PCLRA) anomaly detection model with engine sensor data. To our knowledge, this is the first time that parallel CNN-LSTM-based networks have been used in the field of CHP engine anomaly detection. In PCLRA, spatiotemporal features are extracted via CNN-LSTM in parallel and the information loss is compensated using the residual blocks and attention mechanism. The performance of PCLRA is compared with various hybrid models for 15 cases. First, the performances of serial and parallel models are compared. In addition, we evaluated the contributions of the residual blocks and attention mechanism to the performance of the CNN-LSTM hybrid model. The results indicate that PCLRA achieves the best performance, with a macro f1 score (mean ± standard deviation) of 0.951 ± 0.033, an anomaly f1 score of 0.903 ± 0.064, and an accuracy of 0.999 ± 0.002. We expect that the energy efficiency and safety of CHP engines can be improved by applying the PCLRA anomaly detection model.

Advanced techniques in automated high-resolution scanning transmission electron microscopy

Scanning transmission electron microscopy is a common tool used to study the atomic structure of materials. It is an inherently multimodal tool allowing for the simultaneous acquisition of multiple information channels. Despite its versatility, however, experimental workflows currently rely heavily on experienced human operators and can only acquire data from small regions of a sample at a time. Here, we demonstrate a flexible pipeline-based system for high-throughput acquisition of atomic-resolution structural data using an all-piezo sample stage applied to large-scale imaging of nanoparticles and multimodal data acquisition. The system is available as part of the user program of the Molecular Foundry at Lawrence Berkeley National Laboratory.

Ensemble Machine Learning of Gradient Boosting (XGBoost, LightGBM, CatBoost) and Attention-Based CNN-LSTM for Harmful Algal Blooms Forecasting

Harmful algal blooms (HABs) are a serious threat to ecosystems and human health. The accurate prediction of HABs is crucial for their proactive preparation and management. While mechanism-based numerical modeling, such as the Environmental Fluid Dynamics Code (EFDC), has been widely used in the past, the recent development of machine learning technology with data-based processing capabilities has opened up new possibilities for HABs prediction. In this study, we developed and evaluated two types of machine learning-based models for HABs prediction: Gradient Boosting models (XGBoost, LightGBM, CatBoost) and attention-based CNN-LSTM models. We used Bayesian optimization techniques for hyperparameter tuning, and applied bagging and stacking ensemble techniques to obtain the final prediction results. The final prediction result was derived by applying the optimal hyperparameter and bagging and stacking ensemble techniques, and the applicability of prediction to HABs was evaluated. When predicting HABs with an ensemble technique, it is judged that the overall prediction performance can be improved by complementing the advantages of each model and averaging errors such as overfitting of individual models. Our study highlights the potential of machine learning-based models for HABs prediction and emphasizes the need to incorporate the latest technology into this important field.

DeepSWI: Using Deep Learning to Enhance Susceptibility Contrast on T2*-Weighted MRI

BACKGROUND

Although susceptibility-weighted imaging (SWI) is the gold standard for visualizing cerebral microbleeds (CMBs) in the brain, the required phase data are not always available clinically. Having a postprocessing tool for generating SWI contrast from T2*-weighted magnitude images is therefore advantageous.

PURPOSE

To create synthetic SWI images from clinical T2*-weighted magnitude images using deep learning and evaluate the resulting images in terms of similarity to conventional SWI images and ability to detect radiation-associated CMBs.

STUDY TYPE

Retrospective.

POPULATION

A total of 145 adults (87 males/58 females; 43.9 years old) with radiation-associated CMBs were used to train (16,093 patches/121 patients), validate (484 patches/4 patients), and test (2420 patches/20 patients) our networks.

FIELD STRENGTH/SEQUENCE

3D T2*-weighted, gradient-echo acquired at 3 T.

ASSESSMENT

Structural similarity index (SSIM), peak signal-to-noise-ratio (PSNR), normalized mean-squared-error (nMSE), CMB counts, and line profiles were compared among magnitude, original SWI, and synthetic SWI images. Three blinded raters (J.E.V.M., M.A.M., B.B. with 8-, 6-, and 4-years of experience, respectively) independently rated and classified test-set images.

STATISTICAL TESTS

Kruskall-Wallis and Wilcoxon signed-rank tests were used to compare SSIM, PSNR, nMSE, and CMB counts among magnitude, original SWI, and predicted synthetic SWI images. Intraclass correlation assessed interrater variability. P values <0.005 were considered statistically significant.

RESULTS

SSIM values of the predicted vs. original SWI (0.972, 0.995, 0.9864) were statistically significantly higher than that of the magnitude vs. original SWI (0.970, 0.994, 0.9861) for whole brain, vascular structures, and brain tissue regions, respectively; 67% (19/28) CMBs detected on original SWI images were also detected on the predicted SWI, whereas only 10 (36%) were detected on magnitude images. Overall image quality was similar between the synthetic and original SWI images, with less artifacts on the former.

CONCLUSIONS

This study demonstrated that deep learning can increase the susceptibility contrast present in neurovasculature and CMBs on T2*-weighted magnitude images, without residual susceptibility-induced artifacts. This may be useful for more accurately estimating CMB burden from magnitude images alone.

EVIDENCE LEVEL

3.

TECHNICAL EFFICACY

Stage 2.