A drug identification model developed using deep learning technologies: experience of a medical center in Taiwan

Automated medication verification system (AMVS): System based on edge detection and CNN classification drug on embedded systems

A novel automated medication verification system (AMVS) aims to address the limitation of manual medication verification among healthcare professionals with a high workload, thereby reducing medication errors in hospitals. Specifically, the manual medication verification process is time-consuming and prone to errors, especially in healthcare settings with high workloads. The proposed system strategy is to streamline and automate this process, enhancing efficiency and reducing medication errors. The system employs deep learning models to swiftly and accurately classify multiple medications within a single image without requiring manual labeling during model construction. It comprises edge detection and classification to verify medication types. Unlike previous studies conducted in open spaces, our study takes place in a closed space to minimize the impact of optical changes on image capture. During the experimental process, the system individually identifies each drug within the image by edge detection method and utilizes a classification model to determine each drug type. Our research has successfully developed a fully automated drug recognition system, achieving an accuracy of over 95 % in identifying drug types and conducting segmentation analyses. Specifically, the system demonstrates an accuracy rate of approximately 96 % for drug sets containing fewer than ten types and 93 % for those with ten types. This verification system builds an image classification model quickly. It holds promising potential in assisting nursing staff during AMVS, thereby reducing the likelihood of medication errors and alleviating the burden on nursing staff.

Risk Management and Patient Safety in the Artificial Intelligence Era: A Systematic Review

BACKGROUND

Healthcare systems represent complex organizations within which multiple factors (physical environment, human factor, technological devices, quality of care) interconnect to form a dense network whose imbalance is potentially able to compromise patient safety. In this scenario, the need for hospitals to expand reactive and proactive clinical risk management programs is easily understood, and artificial intelligence fits well in this context. This systematic review aims to investigate the state of the art regarding the impact of AI on clinical risk management processes. To simplify the analysis of the review outcomes and to motivate future standardized comparisons with any subsequent studies, the findings of the present review will be grouped according to the possibility of applying AI in the prevention of the different incident type groups as defined by the ICPS.

MATERIALS AND METHODS

On 3 November 2023, a systematic review of the literature according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines was carried out using the SCOPUS and Medline (via PubMed) databases. A total of 297 articles were identified. After the selection process, 36 articles were included in the present systematic review.

RESULTS AND DISCUSSION

The studies included in this review allowed for the identification of three main "incident type" domains: clinical process, healthcare-associated infection, and medication. Another relevant application of AI in clinical risk management concerns the topic of incident reporting.

CONCLUSIONS

This review highlighted that AI can be applied transversely in various clinical contexts to enhance patient safety and facilitate the identification of errors. It appears to be a promising tool to improve clinical risk management, although its use requires human supervision and cannot completely replace human skills. To facilitate the analysis of the present review outcome and to enable comparison with future systematic reviews, it was deemed useful to refer to a pre-existing taxonomy for the identification of adverse events. However, the results of the present study highlighted the usefulness of AI not only for risk prevention in clinical practice, but also in improving the use of an essential risk identification tool, which is incident reporting. For this reason, the taxonomy of the areas of application of AI to clinical risk processes should include an additional class relating to risk identification and analysis tools. For this purpose, it was considered convenient to use ICPS classification.

A Novel Two-Stage Induced Deep Learning System for Classifying Similar Drugs with Diverse Packaging

Dispensing errors play a crucial role in various medical errors, unfortunately emerging as the third leading cause of death in the United States. This alarming statistic has spurred the World Health Organization (WHO) into action, leading to the initiation of the Medication Without Harm Campaign. The primary objective of this campaign is to prevent dispensing errors from occurring and ensure patient safety. Due to the rapid development of deep learning technology, there has been a significant increase in the development of automatic dispensing systems based on deep learning classification to avoid dispensing errors. However, most previous studies have focused on developing deep learning classification systems for unpackaged pills or drugs with the same type of packaging. However, in the actual dispensing process, thousands of similar drugs with diverse packaging within a healthcare facility greatly increase the risk of dispensing errors. In this study, we proposed a novel two-stage induced deep learning (TSIDL)-based system to classify similar drugs with diverse packaging efficiently. The results demonstrate that the proposed TSIDL method outperforms state-of-the-art CNN models in all classification metrics. It achieved a state-of-the-art classification accuracy of 99.39%. Moreover, this study also demonstrated that the TSIDL method achieved an inference time of only 3.12 ms per image. These results highlight the potential of real-time classification for similar drugs with diverse packaging and their applications in future dispensing systems, which can prevent dispensing errors from occurring and ensure patient safety efficiently.

Development of artificial intelligence powered apps and tools for clinical pharmacy services: A systematic review

OBJECTIVE

Artificial Intelligence (AI) offers potential opportunities to optimize clinical pharmacy services in community or hospital settings. The objective of this systematic literature review was to identify and analyse quantitative studies using or integrating AI for clinical pharmacy services.

MATERIALS AND METHODS

A systematic review was conducted using PubMed/Medline and Web of Science databases, including all articles published from 2000 to December 2021. Included studies had to involve pharmacists in the development or use of AI-powered apps and tools..

RESULTS

19 studies using AI for clinical pharmacy services were included in this review. 12 out of 19 articles (63.1%) were published in 2020 or 2021. Various methodologies of AI were used, mainly machine learning techniques and subsets (natural language processing and deep learning). The datasets used to train the models were mainly extracted from electronic medical records (6 studies, 32%). Among clinical pharmacy services, medication order review was the service most targeted by AI-powered apps and tools (9 studies), followed by health product dispensing (4 studies), pharmaceutical interviews and therapeutic education (2 studies). The development of these tools mainly involved hospital pharmacists (12/19 studies).

DISCUSSION AND CONCLUSION

The development of AI-powered apps and tools for clinical pharmacy services is just beginning. Pharmacists need to keep abreast of these developments in order to position themselves optimally while maintaining their human relationships with healthcare teams and patients. Significant efforts have to be made, in collaboration with data scientists, to better assess whether AI-powered apps and tools bring value to clinical pharmacy services in real practice.

Multispectral Portable Fibre-Optic Reflectometer for the Classification of the Origin of Chicken Eggshells in the Case of Mycoplasma synoviae Infections

The proper classification of the origins of food products is a crucial issue all over the world nowadays. In this paper, the authors present a device-a multispectral portable fibre-optic reflectometer and signal processing patch-together with a machine-learning algorithm for the classification of the origins of chicken eggshells in the case of Mycoplasma synoviae infection. The sensor device was developed based on previous studies with a continuous spectrum in transmittance and selected spectral lines in reflectance. In the described case, the sensor is based on the integration of reflected spectral data from short spectral bands from the VIS and NIR region, which are produced by single-colour LEDs and introduced to the sample via a fibre bundle. The measurement is carried out in a sequence, and the reflected signal is pre-processed to be put in the machine learning algorithm. The support vector machine algorithm is used together with three different types of data normalization. The obtained results of the F-score factor for classification of the origins of samples show that the percentages of eggs coming from Mycoplasma synoviae infected hens are up to 87% for white and 96% for brown eggshells.

A Clinical Decision Support System for Diabetes Patients with Deep Learning: Experience of a Taiwan Medical Center

Background: Diabetes mellitus (DM) is a major public health problem worldwide. It involves dysfunction of blood sugar regulation resulting from insulin resistance, inadequate insulin secretion, or excessive glucagon secretion. Methods: This study collated 971,401 drug usage records of 51,009 DM patients. These data include patient identification code, age, gender, outpatient visiting dates, visiting code, medication features (included items, doses, and frequencies of drugs), HbA1c results, and testing time. We apply a random forest (RF) model for feature selection and implement a regression model with the bidirectional long short-term memory (Bi-LSTM) deep learning architecture. Finally, we use the root mean square error (RMSE) as the evaluation index for the prediction model. Results: After data cleaning, the data included 8,729 male and 9,115 female cases. Metformin was the most important feature suggested by the RF model, followed by glimepiride, acarbose, pioglitazone, glibenclamide, gliclazide, repaglinide, nateglinide, sitagliptin, and vildagliptin. The model performed better with the past two seasons in the training data than with additional seasons. Further, the Bi-LSTM architecture model performed better than support vector machines (SVMs). Discussion & Conclusion: This study found that Bi-LSTM models is a well kernel in a CDSS which help physicians' decision-making, and the increasing the number of seasons will negative impact the performance. In addition, this study found that the most important drug is metformin, which is recommended as first-line treatment OHA in various situations for DM patients.

Hybrid Method Incorporating a Rule-Based Approach and Deep Learning for Prescription Error Prediction

INTRODUCTION

Recently, automated detection has been a new approach to address the risks posed by prescribing errors. This study focused on prescription errors and utilized real medical data to supplement the Drug Utilization Review (DUR)-based rules, the current prescription error detection method. We developed a new hybrid method through artificial intelligence for prescription error prediction by utilizing actual detection accuracy improvement to reduce 'warning fatigue' for doctors and improve medical care quality.

OBJECT

This study was conducted in the Department of Pediatrics, targeting children sensitive to drugs to develop a prescription error detection system. Based on the DUR prescription history, 15,281 patient-level observations of children from Konyang University Hospital (KYUH)'s common data model (CDM) and DUR were collected and analyzed retrospectively.

METHOD

Among the CDM data, inspection information was interlocked with DUR and reflected as standard information for model development; this included outpatient prescriptions from January 1 to December 31, 2018. Through consultation with pediatric clinicians, rule definitions and model development were conducted for 35 drugs, with 137,802 normal and 1609 prescription errors.

RESULTS

We developed a novel hybrid method of error detection in the form of an advanced rule-based deep neural network (ARDNN), which showed the expected performance (precision: 72.86, recall: 81.01, F1 score: 76.72) and reduced alarm pop-up alert fatigue to below 10%. We also created an ARDNN-based comprehensive dashboard that allows doctors to monitor prescription errors with alarm pop-ups when prescribing medications.

CONCLUSION

These results can advance the existing rule-based model by developing a prescription error detection model using deep learning. This method can improve overall medical efficiency and service quality by reducing doctors' fatigue.

Developing an Image-Based Deep Learning Framework for Automatic Scoring of The Pentagon Drawing Test

BACKGROUND

The Pentagon Drawing Test (PDT) is a common assessment for visuospatial function. Evaluating the PDT by artificial intelligence can improve efficiency and reliability in the big data era. This study aimed to develop a deep learning (DL) framework for automatic scoring of the PDT based on image data.

METHODS

A total of 823 PDT photos were retrospectively collected and preprocessed into black-and-white, square-shape images. Stratified fivefold cross-validation was applied for training and testing. Two strategies based on convolutional neural networks were compared. The first strategy was to perform an image classification task using supervised transfer learning. The second strategy was designed with an object detection model for recognizing the geometric shapes in the figure, followed by a predetermined algorithm to score based on their classes and positions.

RESULTS

On average, the first framework demonstrated 62%accuracy, 62%recall, 65%precision, 63%specificity, and 0.72 area under the receiver operating characteristic curve. This performance was substantially outperformed by the second framework, with averages of 94%, 95%, 93%, 93%, and 0.95, respectively.

CONCLUSION

An image-based DL framework based on the object detection approach may be clinically applicable for automatic scoring of the PDT with high efficiency and reliability. With a limited sample size, transfer learning should be used with caution if the new images are distinct from the previous training data. Partitioning the problem-solving workflow into multiple simple tasks should facilitate model selection, improve performance, and allow comprehensible logic of the DL framework.

Deep Learning for Classifying Physical Activities from Accelerometer Data

Physical inactivity increases the risk of many adverse health conditions, including the world’s major non-communicable diseases, such as coronary heart disease, type 2 diabetes, and breast and colon cancers, shortening life expectancy. There are minimal medical care and personal trainers’ methods to monitor a patient’s actual physical activity types. To improve activity monitoring, we propose an artificial-intelligence-based approach to classify physical movement activity patterns. In more detail, we employ two deep learning (DL) methods, namely a deep feed-forward neural network (DNN) and a deep recurrent neural network (RNN) for this purpose. We evaluate the two models on two physical movement datasets collected from several volunteers who carried tri-axial accelerometer sensors. The first dataset is from the UCI machine learning repository, which contains 14 different activities-of-daily-life (ADL) and is collected from 16 volunteers who carried a single wrist-worn tri-axial accelerometer. The second dataset includes ten other ADLs and is gathered from eight volunteers who placed the sensors on their hips. Our experiment results show that the RNN model provides accurate performance compared to the state-of-the-art methods in classifying the fundamental movement patterns with an overall accuracy of 84.89% and an overall F1-score of 82.56%. The results indicate that our method provides the medical doctors and trainers a promising way to track and understand a patient’s physical activities precisely for better treatment.