Evaluation of an Object Detection Algorithm for Shrapnel and Development of a Triage Tool to Determine Injury Severity

Overview of Wearable Healthcare Devices for Clinical Decision Support in the Prehospital Setting

Prehospital medical care is a major challenge for both civilian and military situations as resources are limited, yet critical triage and treatment decisions must be rapidly made. Prehospital medicine is further complicated during mass casualty situations or remote applications that require more extensive medical treatments to be monitored. It is anticipated on the future battlefield where air superiority will be contested that prolonged field care will extend to as much 72 h in a prehospital environment. Traditional medical monitoring is not practical in these situations and, as such, wearable sensor technology may help support prehospital medicine. However, sensors alone are not sufficient in the prehospital setting where limited personnel without specialized medical training must make critical decisions based on physiological signals. Machine learning-based clinical decision support systems can instead be utilized to interpret these signals for diagnosing injuries, making triage decisions, or driving treatments. Here, we summarize the challenges of the prehospital medical setting and review wearable sensor technology suitability for this environment, including their use with medical decision support triage or treatment guidance options. Further, we discuss recommendations for wearable healthcare device development and medical decision support technology to better support the prehospital medical setting. With further design improvement and integration with decision support tools, wearable healthcare devices have the potential to simplify and improve medical care in the challenging prehospital environment.

Design and testing of ultrasound probe adapters for a robotic imaging platform

Medical imaging-based triage is a critical tool for emergency medicine in both civilian and military settings. Ultrasound imaging can be used to rapidly identify free fluid in abdominal and thoracic cavities which could necessitate immediate surgical intervention. However, proper ultrasound image capture requires a skilled ultrasonography technician who is likely unavailable at the point of injury where resources are limited. Instead, robotics and computer vision technology can simplify image acquisition. As a first step towards this larger goal, here, we focus on the development of prototypes for ultrasound probe securement using a robotics platform. The ability of four probe adapter technologies to precisely capture images at anatomical locations, repeatedly, and with different ultrasound transducer types were evaluated across more than five scoring criteria. Testing demonstrated two of the adapters outperformed the traditional robot gripper and manual image capture, with a compact, rotating design compatible with wireless imaging technology being most suitable for use at the point of injury. Next steps will integrate the robotic platform with computer vision and deep learning image interpretation models to automate image capture and diagnosis. This will lower the skill threshold needed for medical imaging-based triage, enabling this procedure to be available at or near the point of injury.

Using AI Segmentation Models to Improve Foreign Body Detection and Triage from Ultrasound Images

Medical imaging can be a critical tool for triaging casualties in trauma situations. In remote or military medicine scenarios, triage is essential for identifying how to use limited resources or prioritize evacuation for the most serious cases. Ultrasound imaging, while portable and often available near the point of injury, can only be used for triage if images are properly acquired, interpreted, and objectively triage scored. Here, we detail how AI segmentation models can be used for improving image interpretation and objective triage evaluation for a medical application focused on foreign bodies embedded in tissues at variable distances from critical neurovascular features. Ultrasound images previously collected in a tissue phantom with or without neurovascular features were labeled with ground truth masks. These image sets were used to train two different segmentation AI frameworks: YOLOv7 and U-Net segmentation models. Overall, both approaches were successful in identifying shrapnel in the image set, with U-Net outperforming YOLOv7 for single-class segmentation. Both segmentation models were also evaluated with a more complex image set containing shrapnel, artery, vein, and nerve features. YOLOv7 obtained higher precision scores across multiple classes whereas U-Net achieved higher recall scores. Using each AI model, a triage distance metric was adapted to measure the proximity of shrapnel to the nearest neurovascular feature, with U-Net more closely mirroring the triage distances measured from ground truth labels. Overall, the segmentation AI models were successful in detecting shrapnel in ultrasound images and could allow for improved injury triage in emergency medicine scenarios.

Using Ultrasound Image Augmentation and Ensemble Predictions to Prevent Machine-Learning Model Overfitting

Deep learning predictive models have the potential to simplify and automate medical imaging diagnostics by lowering the skill threshold for image interpretation. However, this requires predictive models that are generalized to handle subject variability as seen clinically. Here, we highlight methods to improve test accuracy of an image classifier model for shrapnel identification using tissue phantom image sets. Using a previously developed image classifier neural network-termed ShrapML-blind test accuracy was less than 70% and was variable depending on the training/test data setup, as determined by a leave one subject out (LOSO) holdout methodology. Introduction of affine transformations for image augmentation or MixUp methodologies to generate additional training sets improved model performance and overall accuracy improved to 75%. Further improvements were made by aggregating predictions across five LOSO holdouts. This was done by bagging confidences or predictions from all LOSOs or the top-3 LOSO confidence models for each image prediction. Top-3 LOSO confidence bagging performed best, with test accuracy improved to greater than 85% accuracy for two different blind tissue phantoms. This was confirmed by gradient-weighted class activation mapping to highlight that the image classifier was tracking shrapnel in the image sets. Overall, data augmentation and ensemble prediction approaches were suitable for creating more generalized predictive models for ultrasound image analysis, a critical step for real-time diagnostic deployment.

Using an Ultrasound Tissue Phantom Model for Hybrid Training of Deep Learning Models for Shrapnel Detection

Tissue phantoms are important for medical research to reduce the use of animal or human tissue when testing or troubleshooting new devices or technology. Development of machine-learning detection tools that rely on large ultrasound imaging data sets can potentially be streamlined with high quality phantoms that closely mimic important features of biological tissue. Here, we demonstrate how an ultrasound-compliant tissue phantom comprised of multiple layers of gelatin to mimic bone, fat, and muscle tissue types can be used for machine-learning training. This tissue phantom has a heterogeneous composition to introduce tissue level complexity and subject variability in the tissue phantom. Various shrapnel types were inserted into the phantom for ultrasound imaging to supplement swine shrapnel image sets captured for applications such as deep learning algorithms. With a previously developed shrapnel detection algorithm, blind swine test image accuracy reached more than 95% accuracy when training was comprised of 75% tissue phantom images, with the rest being swine images. For comparison, a conventional MobileNetv2 deep learning model was trained with the same training image set and achieved over 90% accuracy in swine predictions. Overall, the tissue phantom demonstrated high performance for developing deep learning models for ultrasound image classification.