A Framework for Automatic Burn Image Segmentation and Burn Depth Diagnosis Using Deep Learning

Review of machine learning for optical imaging of burn wound severity assessment

Significance

Over the past decade, machine learning (ML) algorithms have rapidly become much more widespread for numerous biomedical applications, including the diagnosis and categorization of disease and injury.

Aim

Here, we seek to characterize the recent growth of ML techniques that use imaging data to classify burn wound severity and report on the accuracies of different approaches.

Approach

To this end, we present a comprehensive literature review of preclinical and clinical studies using ML techniques to classify the severity of burn wounds.

Results

The majority of these reports used digital color photographs as input data to the classification algorithms, but recently there has been an increasing prevalence of the use of ML approaches using input data from more advanced optical imaging modalities (e.g., multispectral and hyperspectral imaging, optical coherence tomography), in addition to multimodal techniques. The classification accuracy of the different methods is reported; it typically ranges from ∼ 70 % to 90% relative to the current gold standard of clinical judgment.

Conclusions

The field would benefit from systematic analysis of the effects of different input data modalities, training/testing sets, and ML classifiers on the reported accuracy. Despite this current limitation, ML-based algorithms show significant promise for assisting in objectively classifying burn wound severity.

A Deep Learning Image-to-Image Translation Approach for a More Accessible Estimator of the Healing Time of Burns

OBJECTIVE

An accurate and timely diagnosis of burn severity is critical to ensure a positive outcome. Laser Doppler imaging (LDI) has become a very useful tool for this task. It measures the perfusion of the burn and estimates its potential healing time. LDIs generate a 6-color palette image, with each color representing a healing time. This technique has very high costs associated. In resource-limited areas, such as low- and middle-income countries or remote locations like space, where access to specialized burn care is inadequate, more affordable and portable tools are required. This study proposes a novel image-to-image translation approach to estimate burn healing times, using a digital image to approximate the LDI.

METHODS

This approach consists of a U-net architecture with a VGG-based encoder and applies the concept of ordinal classification. Paired digital and LDI images of burns were collected. The performance was evaluated with 10-fold cross-validation, mean absolute error (MAE), and color distribution differences between the ground truth and the estimated LDI.

RESULTS

Results showed a satisfactory performance in terms of low MAE ( 0.2370 ±0.0086). However, the unbalanced distribution of colors in the data affects this performance.

SIGNIFICANCE

This novel and unique approach serves as a basis for developing more accessible support tools in the burn care environment in resource-limited areas.

Automated wound segmentation and classification of seven common injuries in forensic medicine

In forensic medical investigations, physical injuries are documented with photographs accompanied by written reports. Automatic segmentation and classification of wounds on these photographs could provide forensic pathologists with a tool to improve the assessment of injuries and accelerate the reporting process. In this pilot study, we trained and compared several preexisting deep learning architectures for image segmentation and wound classification on forensically relevant photographs in our database. The best scores were a mean pixel accuracy of 69.4% and a mean intersection over union (IoU) of 48.6% when evaluating the trained models on our test set. The models had difficulty distinguishing the background from wounded areas. As an example, image pixels showing subcutaneous hematomas or skin abrasions were assigned to the background class in 31% of cases. Stab wounds, on the other hand, were reliably classified with a pixel accuracy of 93%. These results can be partially attributed to undefined wound boundaries for some types of injuries, such as subcutaneous hematoma. However, despite the large class imbalance, we demonstrate that the best trained models could reliably distinguish among seven of the most common wounds encountered in forensic medical investigations.

Towards Home-Based Diabetic Foot Ulcer Monitoring: A Systematic Review

It is considered that 1 in 10 adults worldwide have diabetes. Diabetic foot ulcers are some of the most common complications of diabetes, and they are associated with a high risk of lower-limb amputation and, as a result, reduced life expectancy. Timely detection and periodic ulcer monitoring can considerably decrease amputation rates. Recent research has demonstrated that computer vision can be used to identify foot ulcers and perform non-contact telemetry by using ulcer and tissue area segmentation. However, the applications are limited to controlled lighting conditions, and expert knowledge is required for dataset annotation. This paper reviews the latest publications on the use of artificial intelligence for ulcer area detection and segmentation. The PRISMA methodology was used to search for and select articles, and the selected articles were reviewed to collect quantitative and qualitative data. Qualitative data were used to describe the methodologies used in individual studies, while quantitative data were used for generalization in terms of dataset preparation and feature extraction. Publicly available datasets were accounted for, and methods for preprocessing, augmentation, and feature extraction were evaluated. It was concluded that public datasets can be used to form a bigger, more diverse datasets, and the prospects of wider image preprocessing and the adoption of augmentation require further research.

GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn

Burns constitute one of the most common injuries in the world, and they can be very painful for the patient. Especially in the judgment of superficial partial thickness burns and deep partial thickness burns, many inexperienced clinicians are easily confused. Therefore, in order to make burn depth classification automated as well as accurate, we have introduced the deep learning method. This methodology uses a U-Net to segment burn wounds. On this basis, a new thickness burn classification model that fuses global and local features (GL-FusionNet) is proposed. For the thickness burn classification model, we use a ResNet50 to extract local features, use a ResNet101 to extract global features, and finally implement the add method to perform feature fusion and obtain the deep partial or superficial partial thickness burn classification results. Burns images are collected clinically, and they are segmented and labeled by professional physicians. Among the segmentation methods, the U-Net used achieved a Dice score of 85.352 and IoU score of 83.916, which are the best results among all of the comparative experiments. In the classification model, different existing classification networks are mainly used, as well as a fusion strategy and feature extraction method that are adjusted to conduct experiments; the proposed fusion network model also achieved the best results. Our method yielded the following: accuracy of 93.523, recall of 93.67, precision of 93.51, and F1-score of 93.513. In addition, the proposed method can quickly complete the auxiliary diagnosis of the wound in the clinic, which can greatly improve the efficiency of the initial diagnosis of burns and the nursing care of clinical medical staff.

A Spiking Neural Network Based on Retinal Ganglion Cells for Automatic Burn Image Segmentation

Burn is a common traumatic disease. After severe burn injury, the human body will increase catabolism, and burn wounds lead to a large amount of body fluid loss, with a high mortality rate. Therefore, in the early treatment for burn patients, it is essential to calculate the patient's water requirement based on the percentage of the burn wound area in the total body surface area (TBSA%). However, burn wounds are so complex that there is observer variability by the clinicians, making it challenging to locate the burn wounds accurately. Therefore, an objective, accurate location method of burn wounds is very necessary and meaningful. Convolutional neural networks (CNNs) provide feasible means for this requirement. However, although the CNNs continue to improve the accuracy in the semantic segmentation task, they are often limited by the computing resources of edge hardware. For this purpose, a lightweight burn wounds segmentation model is required. In our work, we constructed a burn image dataset and proposed a U-type spiking neural networks (SNNs) based on retinal ganglion cells (RGC) for segmenting burn and non-burn areas. Moreover, a module with cross-layer skip concatenation structure was introduced. Experimental results showed that the pixel accuracy of the proposed reached 92.89%, and our network parameter only needed 16.6 Mbytes. The results showed our model achieved remarkable accuracy while achieving edge hardware affinity.

Effect of vacuum sealing drainage plus skin grafting on deep burns and analysis of risk factors for postoperative infection

OBJECTIVE

To analyze the effect of vacuum sealing drainage (VSD) plus skin grafting on deep burns and the risk factors of postoperative infection.

METHODS

A retrospective analysis was conducted on 124 patients with deep burns who were admitted to the Taizhou People's Hospital from February 2019 to February 2021. The 55 patients who underwent traditional dressing change therapy plus second-stage skin grafting became the control group. The remaining 69 patients treated with first stage VSD plus second-stage skin grafting became the observation group. Wound healing time, hospital stay, postoperative infection, wound closure success rate, pain degree, and scar hyperplasia were recorded and compared between the two groups. Logistic regression was used to analyze the risk factors of postoperative infection in patients.

RESULTS

Compared with the control group, the observation group had a shorter time of wound healing and hospital stay, lower postoperative wound infection rate and lung infection rate, higher success rate of wound closure, lower pain degree scores on the 7th day after the operation, and less scar hyperplasia (all P<0.05). Logistic regression analysis revealed that burn degree, treatment plan, proportion of burn area, and wound healing time were the factors affecting postoperative infection in patients.

CONCLUSION

VSD plus skin grafting have significant effects on deep burns. This combined treatment reduced the occurrence of the wound infection, relieved pain, shortened the healing time and hospitalization time, and reduced the proliferation of scars in the later stage.