Ultrasound image analysis using deep neural networks for discriminating between benign and malignant ovarian tumors: comparison with expert subjective assessment

Artificial Intelligence in the Management of Women with Endometriosis and Adenomyosis: Can Machines Ever Be Worse Than Humans?

Artificial intelligence (AI) is experiencing advances and integration in all medical specializations, and this creates excitement but also concerns. This narrative review aims to critically assess the state of the art of AI in the field of endometriosis and adenomyosis. By enabling automation, AI may speed up some routine tasks, decreasing gynecologists' risk of burnout, as well as enabling them to spend more time interacting with their patients, increasing their efficiency and patients' perception of being taken care of. Surgery may also benefit from AI, especially through its integration with robotic surgery systems. This may improve the detection of anatomical structures and enhance surgical outcomes by combining intra-operative findings with pre-operative imaging. Not only that, but AI promises to improve the quality of care by facilitating clinical research. Through the introduction of decision-support tools, it can enhance diagnostic assessment; it can also predict treatment effectiveness and side effects, as well as reproductive prognosis and cancer risk. However, concerns exist regarding the fact that good quality data used in tool development and compliance with data sharing guidelines are crucial. Also, professionals are worried AI may render certain specialists obsolete. This said, AI is more likely to become a well-liked team member rather than a usurper.

Multi-modality deep learning model reaches high prediction accuracy in the diagnosis of ovarian cancer

We evaluated the diagnostic performance of a multimodal deep-learning (DL) model for ovarian mass differential diagnosis. This single-center retrospective study included 1,054 ultrasound (US)-detected ovarian tumors (699 benign and 355 malignant). Patients were randomly divided into training (n = 675), validation (n = 169), and testing (n = 210) sets. The model was developed using ResNet-50. Three DL-based models were proposed for benign-malignant classification of these lesions: single-modality model that only utilized US images; dual-modality model that used US images and menopausal status as inputs; and multi-modality model that integrated US images, menopausal status, and serum indicators. After 5-fold cross-validation, 210 lesions were tested. We evaluated the three models using the area under the curve (AUC), accuracy, sensitivity, and specificity. The multimodal model outperformed the single- and dual-modality models with 93.80% accuracy and 0.983 AUC. The Multimodal ResNet-50 DL model outperformed the single- and dual-modality models in identifying benign and malignant ovarian tumors.

MRI-Based Radiomics as a Promising Noninvasive Diagnostic Technique for Adenomyosis

Background: MRI diagnostics are important for adenomyosis, especially in cases with inconclusive ultrasound. This study assessed the potential of MRI-based radiomics as a novel tool for differentiating between uteri with and without adenomyosis. Methods: This retrospective proof-of-principle single-center study included nine patients with and six patients without adenomyosis. All patients had preoperative T2w MR images and histological findings served as the reference standard. The uterus of each patient was segmented in 3D using dedicated software, and 884 radiomics features were extracted. After dimension reduction and feature selection, the diagnostic yield of individual and combined features implemented in the machine learning models were assessed by means of receiver operating characteristics analyses. Results: Eleven relevant radiomics features were identified. The diagnostic performance of individual features in differentiating adenomyosis from the control group was high, with areas under the curve (AUCs) ranging from 0.78 to 0.98. The performance of ML models incorporating several features was excellent, with AUC scores of 1 and an area under the precision-recall curve of 0.4. Conclusions: The set of radiomics features derived from routine T2w MRI enabled accurate differentiation of uteri with adenomyosis. Radiomics could enhance diagnosis and furthermore serve as an imaging biomarker to aid in personalizing therapies and monitoring treatment responses.

Ultrasound-based deep learning radiomics model for differentiating benign, borderline, and malignant ovarian tumours: a multi-class classification exploratory study

BACKGROUND

Accurate preoperative identification of ovarian tumour subtypes is imperative for patients as it enables physicians to custom-tailor precise and individualized management strategies. So, we have developed an ultrasound (US)-based multiclass prediction algorithm for differentiating between benign, borderline, and malignant ovarian tumours.

METHODS

We randomised data from 849 patients with ovarian tumours into training and testing sets in a ratio of 8:2. The regions of interest on the US images were segmented and handcrafted radiomics features were extracted and screened. We applied the one-versus-rest method in multiclass classification. We inputted the best features into machine learning (ML) models and constructed a radiomic signature (Rad_Sig). US images of the maximum trimmed ovarian tumour sections were inputted into a pre-trained convolutional neural network (CNN) model. After internal enhancement and complex algorithms, each sample's predicted probability, known as the deep transfer learning signature (DTL_Sig), was generated. Clinical baseline data were analysed. Statistically significant clinical parameters and US semantic features in the training set were used to construct clinical signatures (Clinic_Sig). The prediction results of Rad_Sig, DTL_Sig, and Clinic_Sig for each sample were fused as new feature sets, to build the combined model, namely, the deep learning radiomic signature (DLR_Sig). We used the receiver operating characteristic (ROC) curve and the area under the ROC curve (AUC) to estimate the performance of the multiclass classification model.

RESULTS

The training set included 440 benign, 44 borderline, and 196 malignant ovarian tumours. The testing set included 109 benign, 11 borderline, and 49 malignant ovarian tumours. DLR_Sig three-class prediction model had the best overall and class-specific classification performance, with micro- and macro-average AUC of 0.90 and 0.84, respectively, on the testing set. Categories of identification AUC were 0.84, 0.85, and 0.83 for benign, borderline, and malignant ovarian tumours, respectively. In the confusion matrix, the classifier models of Clinic_Sig and Rad_Sig could not recognise borderline ovarian tumours. However, the proportions of borderline and malignant ovarian tumours identified by DLR_Sig were the highest at 54.55% and 63.27%, respectively.

CONCLUSIONS

The three-class prediction model of US-based DLR_Sig can discriminate between benign, borderline, and malignant ovarian tumours. Therefore, it may guide clinicians in determining the differential management of patients with ovarian tumours.

Development and validation of an ultrasound-based deep learning radiomics nomogram for predicting the malignant risk of ovarian tumours

BACKGROUND

The timely identification and management of ovarian cancer are critical determinants of patient prognosis. In this study, we developed and validated a deep learning radiomics nomogram (DLR_Nomogram) based on ultrasound (US) imaging to accurately predict the malignant risk of ovarian tumours and compared the diagnostic performance of the DLR_Nomogram to that of the ovarian-adnexal reporting and data system (O-RADS).

METHODS

This study encompasses two research tasks. Patients were randomly divided into training and testing sets in an 8:2 ratio for both tasks. In task 1, we assessed the malignancy risk of 849 patients with ovarian tumours. In task 2, we evaluated the malignancy risk of 391 patients with O-RADS 4 and O-RADS 5 ovarian neoplasms. Three models were developed and validated to predict the risk of malignancy in ovarian tumours. The predicted outcomes of the models for each sample were merged to form a new feature set that was utilised as an input for the logistic regression (LR) model for constructing a combined model, visualised as the DLR_Nomogram. Then, the diagnostic performance of these models was evaluated by the receiver operating characteristic curve (ROC).

RESULTS

The DLR_Nomogram demonstrated superior predictive performance in predicting the malignant risk of ovarian tumours, as evidenced by area under the ROC curve (AUC) values of 0.985 and 0.928 for the training and testing sets of task 1, respectively. The AUC value of its testing set was lower than that of the O-RADS; however, the difference was not statistically significant. The DLR_Nomogram exhibited the highest AUC values of 0.955 and 0.869 in the training and testing sets of task 2, respectively. The DLR_Nomogram showed satisfactory fitting performance for both tasks in Hosmer-Lemeshow testing. Decision curve analysis demonstrated that the DLR_Nomogram yielded greater net clinical benefits for predicting malignant ovarian tumours within a specific range of threshold values.

CONCLUSIONS

The US-based DLR_Nomogram has shown the capability to accurately predict the malignant risk of ovarian tumours, exhibiting a predictive efficacy comparable to that of O-RADS.

Ultrasound radiomics-based artificial intelligence model to assist in the differential diagnosis of ovarian endometrioma and ovarian dermoid cyst

Background

Accurately differentiating between ovarian endometrioma and ovarian dermoid cyst is of clinical significance. However, the ultrasound appearance of these two diseases is variable, occasionally causing confusion and overlap with each other. This study aimed to develop a diagnostic classification model based on ultrasound radiomics to intelligently distinguish and diagnose the two diseases.

Methods

We collected ovarian ultrasound images from participants diagnosed as patients with ovarian endometrioma or ovarian dermoid cyst. Feature extraction and selection were performed using the Mann-Whitney U-test, Spearman correlation analysis, and the least absolute shrinkage and selection operator (LASSO) regression. We then input the final features into the machine learning classifiers for model construction. A nomogram was established by combining the radiomic signature and clinical signature.

Results

A total of 407 participants with 407 lesions were included and categorized into the ovarian endometriomas group (n = 200) and the dermoid cyst group (n = 207). In the test cohort, Logistic Regression (LR) achieved the highest area under curve (AUC) value (0.981, 95% CI: 0.963-1.000), the highest accuracy (94.8%), and the highest sensitivity (95.5%), while LightGBM achieved the highest specificity (97.1%). A nomogram incorporating both clinical features and radiomic features achieved the highest level of performance (AUC: 0.987, 95% CI: 0.967-1.000, accuracy: 95.1%, sensitivity: 88.0%, specificity: 100.0%, PPV: 100.0%, NPV: 88.0%, precision: 93.6%). No statistical difference in diagnostic performance was observed between the radiomic model and the nomogram (P > 0.05). The diagnostic indexes of radiomic model were comparable to that of senior radiologists and superior to that of junior radiologist. The diagnostic performance of junior radiologists significantly improved with the assistance of the model.

Conclusion

This ultrasound radiomics-based model demonstrated superior diagnostic performance compared to those of junior radiologists and comparable diagnostic performance to those of senior radiologists, and it has the potential to enhance the diagnostic performance of junior radiologists.

Staging by imaging in gynecologic cancer and the role of ultrasound: an update of European joint consensus statements

In recent years the role of diagnostic imaging by pelvic ultrasound in the diagnosis and staging of gynecological cancers has been growing exponentially. Evidence from recent prospective multicenter studies has demonstrated high accuracy for pre-operative locoregional ultrasound staging in gynecological cancers. Therefore, in many leading gynecologic oncology units, ultrasound is implemented next to pelvic MRI as the first-line imaging modality for gynecological cancer. The work herein is a consensus statement on the role of pre-operative imaging by ultrasound and other imaging modalities in gynecological cancer, following European Society guidelines.

Advances in artificial intelligence for the diagnosis and treatment of ovarian cancer (Review)

Artificial intelligence (AI) has emerged as a crucial technique for extracting high‑throughput information from various sources, including medical images, pathological images, and genomics, transcriptomics, proteomics and metabolomics data. AI has been widely used in the field of diagnosis, for the differentiation of benign and malignant ovarian cancer (OC), and for prognostic assessment, with favorable results. Notably, AI‑based radiomics has proven to be a non‑invasive, convenient and economical approach, making it an essential asset in a gynecological setting. The present study reviews the application of AI in the diagnosis, differentiation and prognostic assessment of OC. It is suggested that AI‑based multi‑omics studies have the potential to improve the diagnostic and prognostic predictive ability in patients with OC, thereby facilitating the realization of precision medicine.

Machine learning and radiomics for segmentation and classification of adnexal masses on ultrasound

Ultrasound-based models exist to support the classification of adnexal masses but are subjective and rely upon ultrasound expertise. We aimed to develop an end-to-end machine learning (ML) model capable of automating the classification of adnexal masses. In this retrospective study, transvaginal ultrasound scan images with linked diagnoses (ultrasound subjective assessment or histology) were extracted and segmented from Imperial College Healthcare, UK (ICH development dataset; n = 577 masses; 1444 images) and Morgagni-Pierantoni Hospital, Italy (MPH external dataset; n = 184 masses; 476 images). A segmentation and classification model was developed using convolutional neural networks and traditional radiomics features. Dice surface coefficient (DICE) was used to measure segmentation performance and area under the ROC curve (AUC), F1-score and recall for classification performance. The ICH and MPH datasets had a median age of 45 (IQR 35-60) and 48 (IQR 38-57) years old and consisted of 23.1% and 31.5% malignant cases, respectively. The best segmentation model achieved a DICE score of 0.85 ± 0.01, 0.88 ± 0.01 and 0.85 ± 0.01 in the ICH training, ICH validation and MPH test sets. The best classification model achieved a recall of 1.00 and F1-score of 0.88 (AUC:0.93), 0.94 (AUC:0.89) and 0.83 (AUC:0.90) in the ICH training, ICH validation and MPH test sets, respectively. We have developed an end-to-end radiomics-based model capable of adnexal mass segmentation and classification, with a comparable predictive performance (AUC 0.90) to the published performance of expert subjective assessment (gold standard), and current risk models. Further prospective evaluation of the classification performance of this ML model against existing methods is required.

Revolutionizing Women's Health: A Comprehensive Review of Artificial Intelligence Advancements in Gynecology

Artificial intelligence has yielded remarkably promising results in several medical fields, namely those with a strong imaging component. Gynecology relies heavily on imaging since it offers useful visual data on the female reproductive system, leading to a deeper understanding of pathophysiological concepts. The applicability of artificial intelligence technologies has not been as noticeable in gynecologic imaging as in other medical fields so far. However, due to growing interest in this area, some studies have been performed with exciting results. From urogynecology to oncology, artificial intelligence algorithms, particularly machine learning and deep learning, have shown huge potential to revolutionize the overall healthcare experience for women's reproductive health. In this review, we aim to establish the current status of AI in gynecology, the upcoming developments in this area, and discuss the challenges facing its clinical implementation, namely the technological and ethical concerns for technology development, implementation, and accountability.

Artificial intelligence as a teaching tool for gynaecological ultrasound: A systematic search and scoping review

Purpose

The aim of this study was to investigate the current application of artificial intelligence (AI) tools in the teaching of ultrasound skills as they pertain to gynaecological ultrasound.

Methods

A scoping review was performed. Eight databases (MEDLINE, EMBASE, EMCARE, CINAHL, Scopus, Web of Science, IEEE Xplore and ACM digital library) were searched in December 2022 using predefined keywords. All types of publications were eligible for inclusion so long as they reported the use of an AI tool, included reference to or discussion of teaching or the improvement of ultrasound skills and pertained to gynaecological ultrasound. Conference abstracts and non-English language papers which could not be adequately translated into English were excluded.

Results

The initial database search returned 481 articles. After screening against our inclusion and exclusion criteria, two were deemed to meet the inclusion criteria. Neither of the articles included reported original research (one systematic review and one review article). Neither of the included articles explicitly provided details of specific tools developed for the teaching of ultrasound skills for gynaecological imaging but highlighted similar applications within the field of obstetrics which could potentially be expanded.

Conclusion

Artificial intelligence can potentially assist in the training of sonographers and other ultrasound operators, including in the field of gynaecological ultrasound. This scoping review revealed however that to date, no original research has been published reporting the use or development of such a tool specifically for gynaecological ultrasound.

Deep learning in ovarian cancer diagnosis: a comprehensive review of various imaging modalities

Ovarian cancer poses a major worldwide health issue, marked by high death rates and a deficiency in reliable diagnostic methods. The precise and prompt detection of ovarian cancer holds great importance in advancing patient outcomes and determining suitable treatment plans. Medical imaging techniques are vital in diagnosing ovarian cancer, but achieving accurate diagnoses remains challenging. Deep learning (DL), particularly convolutional neural networks (CNNs), has emerged as a promising solution to improve the accuracy of ovarian cancer detection. This systematic review explores the role of DL in improving the diagnostic accuracy for ovarian cancer. The methodology involved the establishment of research questions, inclusion and exclusion criteria, and a comprehensive search strategy across relevant databases. The selected studies focused on DL techniques applied to ovarian cancer diagnosis using medical imaging modalities, as well as tumour differentiation and radiomics. Data extraction, analysis, and synthesis were performed to summarize the characteristics and findings of the selected studies. The review emphasizes the potential of DL in enhancing the diagnosis of ovarian cancer by accelerating the diagnostic process and offering more precise and efficient solutions. DL models have demonstrated their effectiveness in categorizing ovarian tissues and achieving comparable diagnostic performance to that of experienced radiologists. The integration of DL into ovarian cancer diagnosis holds the promise of improving patient outcomes, refining treatment approaches, and supporting well-informed decision-making. Nevertheless, additional research and validation are necessary to ensure the dependability and applicability of DL models in everyday clinical settings.

Artificial Intelligence in Ultrasound Diagnoses of Ovarian Cancer: A Systematic Review and Meta-Analysis

Ovarian cancer is the sixth most common malignancy, with a 35% survival rate across all stages at 10 years. Ultrasound is widely used for ovarian tumour diagnosis, and accurate pre-operative diagnosis is essential for appropriate patient management. Artificial intelligence is an emerging field within gynaecology and has been shown to aid in the ultrasound diagnosis of ovarian cancers. For this study, Embase and MEDLINE databases were searched, and all original clinical studies that used artificial intelligence in ultrasound examinations for the diagnosis of ovarian malignancies were screened. Studies using histopathological findings as the standard were included. The diagnostic performance of each study was analysed, and all the diagnostic performances were pooled and assessed. The initial search identified 3726 papers, of which 63 were suitable for abstract screening. Fourteen studies that used artificial intelligence in ultrasound diagnoses of ovarian malignancies and had histopathological findings as a standard were included in the final analysis, each of which had different sample sizes and used different methods; these studies examined a combined total of 15,358 ultrasound images. The overall sensitivity was 81% (95% CI, 0.80-0.82), and specificity was 92% (95% CI, 0.92-0.93), indicating that artificial intelligence demonstrates good performance in ultrasound diagnoses of ovarian cancer. Further prospective work is required to further validate AI for its use in clinical practice.

In Situ Monitoring and Assessment of Ischemic Skin Flap by High-Frequency Ultrasound and Quantitative Parameters

Skin flap surgery is a critical procedure for treating severe skin injury in which post-surgery lesions must well monitored and cared for noninvasively. In the present study, attempts using high-frequency ultrasound imaging, quantitative parameters, and statistical analysis were made to extensively assess variations in the skin flap. Experiments were arranged by incising the dorsal skin of rats to create a skin flap using the chamber model. Measurements, including photographs, 30 MHz ultrasound B-mode images, skin thickness, echogenicity, Nakagami statistics, and histological analysis of post-surgery skin flap, were performed. Photograph results showed that color variations in different parts of the skin flap may readily correspond to ischemic states of local tissues. Compared to post-surgery skin flap on day 7, both integrated backscatter (IB) and Nakagami parameter (m) of the distal part of tissues were increased, and those of the skin thickness were decreased. Overall, relative skin thickness, IB, and m of the distal part of post-surgery skin flap varied from 100 to 67%, -66 to -61 dB, and 0.48 to 0.36, respectively. These results demonstrate that this modality and quantitative parameters can be feasibly applied for long-term and in situ assessment of skin flap tissues.

Artificial intelligence-based risk stratification, accurate diagnosis and treatment prediction in gynecologic oncology

As data-driven science, artificial intelligence (AI) has paved a promising path toward an evolving health system teeming with thrilling opportunities for precision oncology. Notwithstanding the tremendous success of oncological AI in such fields as lung carcinoma, breast tumor and brain malignancy, less attention has been devoted to investigating the influence of AI on gynecologic oncology. Hereby, this review sheds light on the ever-increasing contribution of state-of-the-art AI techniques to the refined risk stratification and whole-course management of patients with gynecologic tumors, in particular, cervical, ovarian and endometrial cancer, centering on information and features extracted from clinical data (electronic health records), cancer imaging including radiological imaging, colposcopic images, cytological and histopathological digital images, and molecular profiling (genomics, transcriptomics, metabolomics and so forth). However, there are still noteworthy challenges beyond performance validation. Thus, this work further describes the limitations and challenges faced in the real-word implementation of AI models, as well as potential solutions to address these issues.

Evolving the Era of 5D Ultrasound? A Systematic Literature Review on the Applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology

Artificial intelligence (AI) has gained prominence in medical imaging, particularly in obstetrics and gynecology (OB/GYN), where ultrasound (US) is the preferred method. It is considered cost effective and easily accessible but is time consuming and hindered by the need for specialized training. To overcome these limitations, AI models have been proposed for automated plane acquisition, anatomical measurements, and pathology detection. This study aims to overview recent literature on AI applications in OB/GYN US imaging, highlighting their benefits and limitations. For the methodology, a systematic literature search was performed in the PubMed and Cochrane Library databases. Matching abstracts were screened based on the PICOS (Participants, Intervention or Exposure, Comparison, Outcome, Study type) scheme. Articles with full text copies were distributed to the sections of OB/GYN and their research topics. As a result, this review includes 189 articles published from 1994 to 2023. Among these, 148 focus on obstetrics and 41 on gynecology. AI-assisted US applications span fetal biometry, echocardiography, or neurosonography, as well as the identification of adnexal and breast masses, and assessment of the endometrium and pelvic floor. To conclude, the applications for AI-assisted US in OB/GYN are abundant, especially in the subspecialty of obstetrics. However, while most studies focus on common application fields such as fetal biometry, this review outlines emerging and still experimental fields to promote further research.

Gynecological Healthcare: Unveiling Pelvic Masses Classification through Evolutionary Gravitational Neocognitron Neural Network Optimized with Nomadic People Optimizer

Accurate and early detection of malignant pelvic mass is important for a suitable referral, triage, and for further care for the women diagnosed with a pelvic mass. Several deep learning (DL) methods have been proposed to detect pelvic masses but other methods cannot provide sufficient accuracy and increase the computational time while classifying the pelvic mass. To overcome these issues, in this manuscript, the evolutionary gravitational neocognitron neural network optimized with nomadic people optimizer for gynecological abdominal pelvic masses classification is proposed for classifying the pelvic masses (EGNNN-NPOA-PM-UI). The real time ultrasound pelvic mass images are augmented using random transformation. Then the augmented images are given to the 3D Tsallis entropy-based multilevel thresholding technique for extraction of the ROI region and its features are further extracted with the help of fast discrete curvelet transform with the wrapping (FDCT-WRP) method. Therefore, in this work, EGNNN optimized with nomadic people optimizer (NPOA) was utilized for classifying the gynecological abdominal pelvic masses. It was executed in PYTHON and the efficiency of the proposed method analyzed under several performance metrics. The proposed EGNNN-NPOA-PM-UI methods attained 99.8%. Ultrasound image analysis using the proposed EGNNN-NPOA-PM-UI methods can accurately predict pelvic masses analyzed with the existing methods.

Preoperative prediction of extrathyroidal extension: radiomics signature based on multimodal ultrasound to papillary thyroid carcinoma

BACKGROUND

There is a recognized need for additional approaches to improve the accuracy of extrathyroidal extension (ETE) diagnosis in papillary thyroid carcinoma (PTC) before surgery. Up to now, multimodal ultrasound has been widely applied in disease diagnosis. We investigated the value of radiomic features extracted from multimodal ultrasound in the preoperative prediction of ETE.

METHODS

We retrospectively pathologically confirmed PTC lesions in 235 patients from January 2019 to April 2022 in our hospital, including 45 ETE lesions and 205 non-ETE lesions. MaZda software was employed to obtain radiomics parameters in multimodal sonography. The most valuable radiomics features were selected by the Fisher coefficient, mutual information, probability of classification error and average correlation coefficient methods (F + MI + PA) in combination with the least absolute shrinkage and selection operator (LASSO) method. Finally, the multimodal model was developed by incorporating the clinical records and radiomics features through fivefold cross-validation with a linear support vector machine algorithm. The predictive performance was evaluated by sensitivity, specificity, accuracy, F1 scores and the area under the receiver operating characteristic curve (AUC) in the training and test sets.

RESULTS

A total of 5972 radiomics features were extracted from multimodal sonography, and the 13 most valuable radiomics features were selected from the training set using the F + MI + PA method combined with LASSO regression. The multimodal prediction model yielded AUCs of 0.911 (95% CI 0.866-0.957) and 0.716 (95% CI 0.522-0.910) in the cross-validation and test sets, respectively. The multimodal model and radiomics model showed good discrimination between ETE and non-ETE lesions.

CONCLUSION

Radiomics features based on multimodal ultrasonography could play a promising role in detecting ETE before surgery.

Deep convolutional neural networks for multiple histologic types of ovarian tumors classification in ultrasound images

Objective

This study aimed to evaluate and validate the performance of deep convolutional neural networks when discriminating different histologic types of ovarian tumor in ultrasound (US) images.

Material and methods

Our retrospective study took 1142 US images from 328 patients from January 2019 to June 2021. Two tasks were proposed based on US images. Task 1 was to classify benign and high-grade serous carcinoma in original ovarian tumor US images, in which benign ovarian tumor was divided into six classes: mature cystic teratoma, endometriotic cyst, serous cystadenoma, granulosa-theca cell tumor, mucinous cystadenoma and simple cyst. The US images in task 2 were segmented. Deep convolutional neural networks (DCNN) were applied to classify different types of ovarian tumors in detail. We used transfer learning on six pre-trained DCNNs: VGG16, GoogleNet, ResNet34, ResNext50, DensNet121 and DensNet201. Several metrics were adopted to assess the model performance: accuracy, sensitivity, specificity, FI-score and the area under the receiver operating characteristic curve (AUC).

Results

The DCNN performed better in labeled US images than in original US images. The best predictive performance came from the ResNext50 model. The model had an overall accuracy of 0.952 for in directly classifying the seven histologic types of ovarian tumors. It achieved a sensitivity of 90% and a specificity of 99.2% for high-grade serous carcinoma, and a sensitivity of over 90% and a specificity of over 95% in most benign pathological categories.

Conclusion

DCNN is a promising technique for classifying different histologic types of ovarian tumors in US images, and provide valuable computer-aided information.

Machine learning combined with radiomics and deep learning features extracted from CT images: a novel AI model to distinguish benign from malignant ovarian tumors

BACKGROUND

To develop an artificial intelligence (AI) model with radiomics and deep learning (DL) features extracted from CT images to distinguish benign from malignant ovarian tumors.

METHODS

We enrolled 149 patients with pathologically confirmed ovarian tumors. A total of 185 tumors were included and divided into training and testing sets in a 7:3 ratio. All tumors were manually segmented from preoperative contrast-enhanced CT images. CT image features were extracted using radiomics and DL. Five models with different combinations of feature sets were built. Benign and malignant tumors were classified using machine learning (ML) classifiers. The model performance was compared with five radiologists on the testing set.

RESULTS

 Among the five models, the best performing model is the ensemble model with a combination of radiomics, DL, and clinical feature sets. The model achieved an accuracy of 82%, specificity of 89% and sensitivity of 68%. Compared with junior radiologists averaged results, the model had a higher accuracy (82% vs 66%) and specificity (89% vs 65%) with comparable sensitivity (68% vs 67%). With the assistance of the model, the junior radiologists achieved a higher average accuracy (81% vs 66%), specificity (80% vs 65%), and sensitivity (82% vs 67%), approaching to the performance of senior radiologists.

CONCLUSIONS

 We developed a CT-based AI model that can differentiate benign and malignant ovarian tumors with high accuracy and specificity. This model significantly improved the performance of less-experienced radiologists in ovarian tumor assessment, and may potentially guide gynecologists to provide better therapeutic strategies for these patients.

Analysis of computer-aided diagnostics in the preoperative diagnosis of ovarian cancer: a systematic review

OBJECTIVES

Different noninvasive imaging methods to predict the chance of malignancy of ovarian tumors are available. However, their predictive value is limited due to subjectivity of the reviewer. Therefore, more objective prediction models are needed. Computer-aided diagnostics (CAD) could be such a model, since it lacks bias that comes with currently used models. In this study, we evaluated the available data on CAD in predicting the chance of malignancy of ovarian tumors.

METHODS

We searched for all published studies investigating diagnostic accuracy of CAD based on ultrasound, CT and MRI in pre-surgical patients with an ovarian tumor compared to reference standards.

RESULTS

In thirty-one included studies, extracted features from three different imaging techniques were used in different mathematical models. All studies assessed CAD based on machine learning on ultrasound, CT scan and MRI scan images. Per imaging method, subsequently ultrasound, CT and MRI, sensitivities ranged from 40.3 to 100%; 84.6-100% and 66.7-100% and specificities ranged from 76.3-100%; 69-100% and 77.8-100%. Results could not be pooled, due to broad heterogeneity. Although the majority of studies report high performances, they are at considerable risk of overfitting due to the absence of an independent test set.

CONCLUSION

Based on this literature review, different CAD for ultrasound, CT scans and MRI scans seem promising to aid physicians in assessing ovarian tumors through their objective and potentially cost-effective character. However, performance should be evaluated per imaging technique. Prospective and larger datasets with external validation are desired to make their results generalizable.

A Deep Learning Fusion Approach to Diagnosis the Polycystic Ovary Syndrome (PCOS)

One of the leading causes of female infertility is PCOS, which is a hormonal disorder affecting women of childbearing age. The common symptoms of PCOS include increased acne, irregular period, increase in body hair, and overweight. Early diagnosis of PCOS is essential to manage the symptoms and reduce the associated health risks. Nonetheless, the diagnosis is based on Rotterdam criteria, including a high level of androgen hormones, ovulation failure, and polycystic ovaries on the ultrasound image (PCOM). At present, doctors and radiologists manually perform PCOM detection using ovary ultrasound by counting the number of follicles and determining their volume in the ovaries, which is one of the challenging PCOS diagnostic criteria. Moreover, such physicians require more tests and checks for biochemical/clinical signs in addition to the patient’s symptoms in order to decide the PCOS diagnosis. Furthermore, clinicians do not utilize a single diagnostic test or specific method to examine patients. This paper introduces the data set that includes the ultrasound image of the ovary with clinical data related to the patient that has been classified as PCOS and non-PCOS. Next, we proposed a deep learning model that can diagnose the PCOM based on the ultrasound image, which achieved 84.81% accuracy using the Inception model. Then, we proposed a fusion model that includes the ultrasound image with clinical data to diagnose the patient if they have PCOS or not. The best model that has been developed achieved 82.46% accuracy by extracting the image features using MobileNet architecture and combine with clinical features.

Evaluating the Risk of Inguinal Lymph Node Metastases before Surgery Using the Morphonode Predictive Model: A Prospective Diagnostic Study in Vulvar Cancer Patients

Ultrasound examination is an accurate method in the preoperative evaluation of the inguinofemoral lymph nodes when performed by experienced operators. The purpose of the study was to build a robust, multi-modular model based on machine learning to discriminate between metastatic and non-metastatic inguinal lymph nodes in patients with vulvar cancer. One hundred and twenty-seven women were selected at our center from March 2017 to April 2020, and 237 inguinal regions were analyzed (75 were metastatic and 162 were non-metastatic at histology). Ultrasound was performed before surgery by experienced examiners. Ultrasound features were defined according to previous studies and collected prospectively. Fourteen informative features were used to train and test the machine to obtain a diagnostic model (Morphonode Predictive Model). The following data classifiers were integrated: (I) random forest classifiers (RCF), (II) regression binomial model (RBM), (III) decisional tree (DT), and (IV) similarity profiling (SP). RFC predicted metastatic/non-metastatic lymph nodes with an accuracy of 93.3% and a negative predictive value of 97.1%. DT identified four specific signatures correlated with the risk of metastases and the point risk of each signature was 100%, 81%, 16% and 4%, respectively. The Morphonode Predictive Model could be easily integrated into the clinical routine for preoperative stratification of vulvar cancer patients.

Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting

Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence (AI) in image recognition. These symbols are widely distributed within the lesion's boundary, which can also affect the useful feature-extraction-utilizing networks and thus decrease the accuracy of lesion classification and segmentation. Image inpainting techniques are used for noise and object elimination from images. To solve this problem, we observed the MMOTU dataset and built a 2D ovarian-tumor ultrasound image inpainting dataset by finely annotating the various symbols in the images. A novel framework called mask-guided generative adversarial network (MGGAN) is presented in this paper for 2D ovarian-tumor ultrasound images to remove various symbols from the images. The MGGAN performs to a high standard in corrupted regions by using an attention mechanism in the generator to pay more attention to valid information and ignore symbol information, making lesion boundaries more realistic. Moreover, fast Fourier convolutions (FFCs) and residual networks are used to increase the global field of perception; thus, our model can be applied to high-resolution ultrasound images. The greatest benefit of this algorithm is that it achieves pixel-level inpainting of distorted regions without clean images. Compared with other models, our model achieveed better results with only one stage in terms of objective and subjective evaluations. Our model obtained the best results for 256 × 256 and 512 × 512 resolutions. At a resolution of 256 × 256, our model achieved 0.9246 for SSIM, 22.66 for FID, and 0.07806 for LPIPS. At a resolution of 512 × 512, our model achieved 0.9208 for SSIM, 25.52 for FID, and 0.08300 for LPIPS. Our method can considerably improve the accuracy of computerized ovarian tumor diagnosis. The segmentation accuracy was improved from 71.51% to 76.06% for the Unet model and from 61.13% to 66.65% for the PSPnet model in clean images.

Artificial intelligence in diagnostic ultrasonography

Artificial intelligence (AI) continues to change paradigms in the field of medicine with new applications that are applicable to daily life. The field of ultrasonography, which has been developing since the 1950s and continues to be one of the most powerful tools in the field of diagnosis, is also the subject of AI studies, despite its unique problems. It is predicted that many operations, such as appropriate diagnostic tool selection, use of the most relevant parameters, improvement of low-quality images, automatic lesion detection and diagnosis from the image, and classification of pathologies, will be performed using AI tools in the near future. Especially with the use of convolutional neural networks, successful results can be obtained for lesion detection, segmentation, and classification from images. In this review, relevant developments are summarized based on the literature, and examples of the tools used in the field are presented.

Application of Deep Learning Model in the Sonographic Diagnosis of Uterine Adenomyosis

BACKGROUND

This study aims to evaluate the diagnostic performance of Deep Learning (DL) machine for the detection of adenomyosis on uterine ultrasonographic images and compare it to intermediate ultrasound skilled trainees.

METHODS

Prospective observational study were conducted between 1 and 30 April 2022. Transvaginal ultrasound (TVUS) diagnosis of adenomyosis was investigated by an experienced sonographer on 100 fertile-age patients. Videoclips of the uterine corpus were recorded and sequential ultrasound images were extracted. Intermediate ultrasound-skilled trainees and DL machine were asked to make a diagnosis reviewing uterine images. We evaluated and compared the accuracy, sensitivity, positive predictive value, F1-score, specificity and negative predictive value of the DL model and the trainees for adenomyosis diagnosis.

RESULTS

Accuracy of DL and intermediate ultrasound-skilled trainees for the diagnosis of adenomyosis were 0.51 (95% CI, 0.48-0.54) and 0.70 (95% CI, 0.60-0.79), respectively. Sensitivity, specificity and F1-score of DL were 0.43 (95% CI, 0.38-0.48), 0.82 (95% CI, 0.79-0.85) and 0.46 (0.42-0.50), respectively, whereas intermediate ultrasound-skilled trainees had sensitivity of 0.72 (95% CI, 0.52-0.86), specificity of 0.69 (95% CI, 0.58-0.79) and F1-score of 0.55 (95% CI, 0.43-0.66).

CONCLUSIONS

In this preliminary study DL model showed a lower accuracy but a higher specificity in diagnosing adenomyosis on ultrasonographic images compared to intermediate-skilled trainees.

AI diagnostic performance based on multiple imaging modalities for ovarian tumor: A systematic review and meta-analysis

Background

In recent years, AI has been applied to disease diagnosis in many medical and engineering researches. We aimed to explore the diagnostic performance of the models based on different imaging modalities for ovarian cancer.

Methods

PubMed, EMBASE, Web of Science, and Wanfang Database were searched. The search scope was all published Chinese and English literatures about AI diagnosis of benign and malignant ovarian tumors. The literature was screened and data extracted according to inclusion and exclusion criteria. Quadas-2 was used to evaluate the quality of the included literature, STATA 17.0. was used for statistical analysis, and forest plots and funnel plots were drawn to visualize the study results.

Results

A total of 11 studies were included, 3 of them were modeled based on ultrasound, 6 based on MRI, and 2 based on CT. The pooled AUROCs of studies based on ultrasound, MRI and CT were 0.94 (95% CI 0.88-1.00), 0.82 (95% CI 0.71-0.93) and 0.82 (95% Cl 0.78-0.86), respectively. The values of I² were 99.92%, 99.91% and 92.64% based on ultrasound, MRI and CT. Funnel plot suggested no publication bias.

Conclusion

The models based on ultrasound have the best performance in diagnostic of ovarian cancer.

Predicting the Likelihood of Colorectal Cancer with Artificial Intelligence Tools Using Fourier Transform Infrared Signals Obtained from Tumor Samples

The early and accurate detection of colorectal cancer (CRC) significantly affects its prognosis and clinical management. However, current standard diagnostic procedures for CRC often lack sensitivity and specificity since most rely on visual examination. Hence, there is a need to develop more accurate methods for its diagnosis. Support vector machine (SVM) and feedforward neural network (FNN) models were designed using the Fourier transform infrared (FT-IR) spectral data of several colorectal tissues that were unanimously identified as either benign or malignant by different unrelated pathologists. The set of samples in which the pathologists had discordant readings were then analyzed using the AI models described above. Between the SVM and NN models, the NN model was able to outperform the SVM model based on their prediction confidence scores. Using the spectral data of the concordant samples as training set, the FNN was able to predict the histologically diagnosed malignant tissues (n = 118) at 59.9-99.9% confidence (average = 93.5%). Of the 118 samples, 84 (71.18%) were classified with an above average confidence score, 34 (28.81%) classified below the average confidence score, and none was misclassified. Moreover, it was able to correctly identify the histologically confirmed benign samples (n = 83) at 51.5-99.7% confidence (average = 91.64%). Of the 83 samples, 60 (72.29%) were classified with an above average confidence score, 22 (26.51%) classified below the average confidence score, and only 1 sample (1.20%) was misclassified. The study provides additional proof of the ability of attenuated total reflection (ATR) FT-IR enhanced by AI tools to predict the likelihood of CRC without dependence on morphological changes in tissues.

Automatic ovarian tumors recognition system based on ensemble convolutional neural network with ultrasound imaging

Background

Upon the discovery of ovarian cysts, obstetricians, gynecologists, and ultrasound examiners must address the common clinical challenge of distinguishing between benign and malignant ovarian tumors. Numerous types of ovarian tumors exist, many of which exhibit similar characteristics that increase the ambiguity in clinical diagnosis. Using deep learning technology, we aimed to develop a method that rapidly and accurately assists the different diagnosis of ovarian tumors in ultrasound images.

Methods

Based on deep learning method, we used ten well-known convolutional neural network models (e.g., Alexnet, GoogleNet, and ResNet) for training of transfer learning. To ensure method stability and robustness, we repeated the random sampling of the training and validation data ten times. The mean of the ten test results was set as the final assessment data. After the training process was completed, the three models with the highest ratio of calculation accuracy to time required for classification were used for ensemble learning pertaining. Finally, the interpretation results of the ensemble classifier were used as the final results. We also applied ensemble gradient-weighted class activation mapping (Grad-CAM) technology to visualize the decision-making results of the models.

Results

The highest mean accuracy, mean sensitivity, and mean specificity of ten single CNN models were 90.51 ± 4.36%, 89.77 ± 4.16%, and 92.00 ± 5.95%, respectively. The mean accuracy, mean sensitivity, and mean specificity of the ensemble classifier method were 92.15 ± 2.84%, 91.37 ± 3.60%, and 92.92 ± 4.00%, respectively. The performance of the ensemble classifier is better than that of a single classifier in three evaluation metrics. Moreover, the standard deviation is also better which means the ensemble classifier is more stable and robust.

Conclusion

From the comprehensive perspective of data quantity, data diversity, robustness of validation strategy, and overall accuracy, the proposed method outperformed the methods used in previous studies. In future studies, we will continue to increase the number of authenticated images and apply our proposed method in clinical settings to increase its robustness and reliability.

Artificial intelligence performance in image-based ovarian cancer identification: A systematic review and meta-analysis

BACKGROUND

Accurate identification of ovarian cancer (OC) is of paramount importance in clinical treatment success. Artificial intelligence (AI) is a potentially reliable assistant for the medical imaging recognition. We systematically review articles on the diagnostic performance of AI in OC from medical imaging for the first time.

METHODS

The Medline, Embase, IEEE, PubMed, Web of Science, and the Cochrane library databases were searched for related studies published until August 1, 2022. Inclusion criteria were studies that developed or used AI algorithms in the diagnosis of OC from medical images. The binary diagnostic accuracy data were extracted to derive the outcomes of interest: sensitivity (SE), specificity (SP), and Area Under the Curve (AUC). The study was registered with the PROSPERO, CRD42022324611.

FINDINGS

Thirty-four eligible studies were identified, of which twenty-eight studies were included in the meta-analysis with a pooled SE of 88% (95%CI: 85-90%), SP of 85% (82-88%), and AUC of 0.93 (0.91-0.95). Analysis for different algorithms revealed a pooled SE of 89% (85-92%) and SP of 88% (82-92%) for machine learning; and a pooled SE of 88% (84-91%) and SP of 84% (80-87%) for deep learning. Acceptable diagnostic performance was demonstrated in subgroup analyses stratified by imaging modalities (Ultrasound, Magnetic Resonance Imaging, or Computed Tomography), sample size (≤300 or >300), AI algorithms versus clinicians, year of publication (before or after 2020), geographical distribution (Asia or non Asia), and the different risk of bias levels (≥3 domain low risk or < 3 domain low risk).

INTERPRETATION

AI algorithms exhibited favorable performance for the diagnosis of OC through medical imaging. More rigorous reporting standards that address specific challenges of AI research could improve future studies.

FUNDING

This work was supported by the Natural Science Foundation of China (No. 82073647 to Q-JW and No. 82103914 to T-TG), LiaoNing Revitalization Talents Program (No. XLYC1907102 to Q-JW), and 345 Talent Project of Shengjing Hospital of China Medical University (No. M0268 to Q-JW and No. M0952 to T-TG).

Ovarian tumor diagnosis using deep convolutional neural networks and a denoising convolutional autoencoder

Discrimination of ovarian tumors is necessary for proper treatment. In this study, we developed a convolutional neural network model with a convolutional autoencoder (CNN-CAE) to classify ovarian tumors. A total of 1613 ultrasound images of ovaries with known pathological diagnoses were pre-processed and augmented for deep learning analysis. We designed a CNN-CAE model that removes the unnecessary information (e.g., calipers and annotations) from ultrasound images and classifies ovaries into five classes. We used fivefold cross-validation to evaluate the performance of the CNN-CAE model in terms of accuracy, sensitivity, specificity, and the area under the receiver operating characteristic curve (AUC). Gradient-weighted class activation mapping (Grad-CAM) was applied to visualize and verify the CNN-CAE model results qualitatively. In classifying normal versus ovarian tumors, the CNN-CAE model showed 97.2% accuracy, 97.2% sensitivity, and 0.9936 AUC with DenseNet121 CNN architecture. In distinguishing malignant ovarian tumors, the CNN-CAE model showed 90.12% accuracy, 86.67% sensitivity, and 0.9406 AUC with DenseNet161 CNN architecture. Grad-CAM showed that the CNN-CAE model recognizes valid texture and morphology features from the ultrasound images and classifies ovarian tumors from these features. CNN-CAE is a feasible diagnostic tool that is capable of robustly classifying ovarian tumors by eliminating marks on ultrasound images. CNN-CAE demonstrates an important application value in clinical conditions.

Wright D, V. Gregory A, D. Warner J, Korfiatis P, C. Green I, L. Rassier S, Mariani A, Kim B, K. Laughlin-Tommaso S, L. Kline T. A systematic review on the use of artificial intelligence in gynecologic imaging – Background, state of the art, and future directions

OBJECTIVE

Machine learning, deep learning, and artificial intelligence (AI) are terms that have made their way into nearly all areas of medicine. In the case of medical imaging, these methods have become the state of the art in nearly all areas from image reconstruction to image processing and automated analysis. In contrast to other areas, such as brain and breast imaging, the impacts of AI have not been as strongly felt in gynecologic imaging. In this review article, we: (i) provide a background of clinically relevant AI concepts, (ii) describe methods and approaches in computer vision, and (iii) highlight prior work related to image classification tasks utilizing AI approaches in gynecologic imaging.

DATA SOURCES

A comprehensive search of several databases from each database's inception to March 18th, 2021, English language, was conducted. The databases included Ovid MEDLINE(R) and Epub Ahead of Print, In-Process & Other Non-Indexed Citations, and Daily, Ovid EMBASE, Ovid Cochrane Central Register of Controlled Trials, and Ovid Cochrane Database of Systematic Reviews and ClinicalTrials.gov.

METHODS OF STUDY SELECTION

We performed an extensive literature review with 61 articles curated by three reviewers and subsequent sorting by specialists using specific inclusion and exclusion criteria.

TABULATION, INTEGRATION, AND RESULTS

We summarize the literature grouped by each of the three most common gynecologic malignancies: endometrial, cervical, and ovarian. For each, a brief introduction encapsulating the AI methods, imaging modalities, and clinical parameters in the selected articles is presented. We conclude with a discussion of current developments, trends and limitations, and suggest directions for future study.

CONCLUSION

This review article should prove useful for collaborative teams performing research studies targeted at the incorporation of radiological imaging and AI methods into gynecological clinical practice.

Artificial neural network in the discrimination of lung cancer based on infrared spectroscopy

Given the increasing prevalence of lung cancer worldwide, an auxiliary diagnostic method is needed alongside the microscopic examination of biopsy samples, which is dependent on the skills and experience of pathologists. Thus, this study aimed to advance lung cancer diagnosis by developing five (5) artificial neural network (NN) models that can discriminate malignant from benign samples based on infrared spectral data of lung tumors (n = 122; 56 malignant, 66 benign). NNs were benchmarked with classical machine learning (CML) models. Stratified 10-fold cross-validation was performed to evaluate the NN models, and the performance metrics—area under the curve (AUC), accuracy (ACC) positive predictive value (PPV), negative predictive value (NPV), specificity rate (SR), and recall rate (RR)—were averaged for comparison. All NNs were able to outperform the CML models, however, support vector machine is relatively comparable to NNs. Among the NNs, CNN performed best with an AUC of 92.28% ± 7.36%, ACC of 98.45% ± 1.72%, PPV of 96.62% ± 2.30%, NPV of 90.50% ± 11.92%, SR of 96.01% ± 3.09%, and RR of 89.21% ± 12.93%. In conclusion, NNs can be potentially used as a computational tool in lung cancer diagnosis based on infrared spectroscopy of lung tissues.

Deep Learning Prediction of Ovarian Malignancy at US Compared with O-RADS and Expert Assessment

Background Deep learning (DL) algorithms could improve the classification of ovarian tumors assessed with multimodal US. Purpose To develop DL algorithms for the automated classification of benign versus malignant ovarian tumors assessed with US and to compare algorithm performance to Ovarian-Adnexal Reporting and Data System (O-RADS) and subjective expert assessment for malignancy. Materials and Methods This retrospective study included consecutive women with ovarian tumors undergoing gray scale and color Doppler US from January 2019 to November 2019. Histopathologic analysis was the reference standard. The data set was divided into training (70%), validation (10%), and test (20%) sets. Algorithms modified from residual network (ResNet) with two fusion strategies (feature fusion [hereafter, DL_feature] or decision fusion [hereafter, DL_decision]) were developed. DL prediction of malignancy was compared with O-RADS risk categorization and expert assessment by area under the receiver operating characteristic curve (AUC) analysis in the test set. Results A total of 422 women (mean age, 46.4 years ± 14.8 [SD]) with 304 benign and 118 malignant tumors were included; there were 337 women in the training and validation data set and 85 women in the test data set. DL_feature had an AUC of 0.93 (95% CI: 0.85, 0.97) for classifying malignant from benign ovarian tumors, comparable with O-RADS (AUC, 0.92; 95% CI: 0.85, 0.97; P = .88) and expert assessment (AUC, 0.97; 95% CI: 0.91, 0.99; P = .07), and similar to DL_decision (AUC, 0.90; 95% CI: 0.82, 0.96; P = .29). DL_decision, DL_feature, O-RADS, and expert assessment achieved sensitivities of 92%, 92%, 92%, and 96%, respectively, and specificities of 80%, 85%, 89%, and 87%, respectively, for malignancy. Conclusion Deep learning algorithms developed by using multimodal US images may distinguish malignant from benign ovarian tumors with diagnostic performance comparable to expert subjective and Ovarian-Adnexal Reporting and Data System assessment. © RSNA, 2022 Online supplemental material is available for this article.

Novel artificial intelligence approach for automatic differentiation of fetal occiput anterior and non-occiput anterior positions during labor

OBJECTIVES

To describe a newly developed machine-learning (ML) algorithm for the automatic recognition of fetal head position using transperineal ultrasound (TPU) during the second stage of labor and to describe its performance in differentiating between occiput anterior (OA) and non-OA positions.

METHODS

This was a prospective cohort study including singleton term (> 37 weeks of gestation) pregnancies in the second stage of labor, with a non-anomalous fetus in cephalic presentation. Transabdominal ultrasound was performed to determine whether the fetal head position was OA or non-OA. For each case, one sonographic image of the fetal head was then acquired in an axial plane using TPU and saved for later offline analysis. Using the transabdominal sonographic diagnosis as the gold standard, a ML algorithm based on a pattern-recognition feed-forward neural network was trained on the TPU images to discriminate between OA and non-OA positions. In the training phase, the model tuned its parameters to approximate the training data (i.e. the training dataset) such that it would identify correctly the fetal head position, by exploiting geometric, morphological and intensity-based features of the images. In the testing phase, the algorithm was blinded to the occiput position as determined by transabdominal ultrasound. Using the test dataset, the ability of the ML algorithm to differentiate OA from non-OA fetal positions was assessed in terms of diagnostic accuracy. The F₁ -score and precision-recall area under the curve (PR-AUC) were calculated to assess the algorithm's performance. Cohen's kappa (κ) was calculated to evaluate the agreement between the algorithm and the gold standard.

RESULTS

Over a period of 24 months (February 2018 to January 2020), at 15 maternity hospitals affiliated to the International Study group on Labor ANd Delivery Sonography (ISLANDS), we enrolled into the study 1219 women in the second stage of labor. On the basis of transabdominal ultrasound, they were classified as OA (n = 801 (65.7%)) or non-OA (n = 418 (34.3%)). From the entire cohort (OA and non-OA), approximately 70% (n = 824) of the patients were assigned randomly to the training dataset and the rest (n = 395) were used as the test dataset. The ML-based algorithm correctly classified the fetal occiput position in 90.4% (357/395) of the test dataset, including 224/246 with OA (91.1%) and 133/149 with non-OA (89.3%) fetal head position. Evaluation of the algorithm's performance gave an F₁ -score of 88.7% and a PR-AUC of 85.4%. The algorithm showed a balanced performance in the recognition of both OA and non-OA positions. The robustness of the algorithm was confirmed by high agreement with the gold standard (κ = 0.81; P < 0.0001).

CONCLUSIONS

This newly developed ML-based algorithm for the automatic assessment of fetal head position using TPU can differentiate accurately, in most cases, between OA and non-OA positions in the second stage of labor. This algorithm has the potential to support not only obstetricians but also midwives and accoucheurs in the clinical use of TPU to determine fetal occiput position in the labor ward. © 2021 International Society of Ultrasound in Obstetrics and Gynecology.

The Use of Artificial Intelligence in Automation in the Fields of Gynaecology and Obstetrics - an Assessment of the State of Play

The long-awaited progress in digitalisation is generating huge amounts of medical data every day, and manual analysis and targeted, patient-oriented evaluation of this data is becoming increasingly difficult or even infeasible. This state of affairs and the associated, increasingly complex requirements for individualised precision medicine underline the need for modern software solutions and algorithms across the entire healthcare system. The utilisation of state-of-the-art equipment and techniques in almost all areas of medicine over the past few years has now indeed enabled automation processes to enter - at least in part - into routine clinical practice. Such systems utilise a wide variety of artificial intelligence (AI) techniques, the majority of which have been developed to optimise medical image reconstruction, noise reduction, quality assurance, triage, segmentation, computer-aided detection and classification and, as an emerging field of research, radiogenomics. Tasks handled by AI are completed significantly faster and more precisely, clearly demonstrated by now in the annual findings of the ImageNet Large-Scale Visual Recognition Challenge (ILSVCR), first conducted in 2015, with error rates well below those of humans. This review article will discuss the potential capabilities and currently available applications of AI in gynaecological-obstetric diagnostics. The article will focus, in particular, on automated techniques in prenatal sonographic diagnostics.

Diagnosis of Ovarian Neoplasms Using Nomogram in Combination With Ultrasound Image-Based Radiomics Signature and Clinical Factors

Objectives: To establish and validate a nomogram integrating radiomics signatures from ultrasound and clinical factors to discriminate between benign, borderline, and malignant serous ovarian tumors. Materials and methods: In this study, a total of 279 pathology-confirmed serous ovarian tumors collected from 265 patients between March 2013 and December 2016 were used. The training cohort was generated by randomly selecting 70% of each of the three types (benign, borderline, and malignant) of tumors, while the remaining 30% was included in the validation cohort. From the transabdominal ultrasound scanning of ovarian tumors, the radiomics features were extracted, and a score was calculated. The ability of radiomics to differentiate between the grades of ovarian tumors was tested by comparing benign vs borderline and malignant (task 1) and borderline vs malignant (task 2). These results were compared with the diagnostic performance and subjective assessment by junior and senior sonographers. Finally, a clinical-feature alone model and a combined clinical-radiomics (CCR) model were built using predictive nomograms for the two tasks. Receiver operating characteristic (ROC) analysis, calibration curve, and decision curve analysis (DCA) were performed to evaluate the model performance. Results: The US-based radiomics models performed satisfactorily in both the tasks, showing especially higher accuracy in the second task by successfully discriminating borderline and malignant ovarian serous tumors compared to the evaluations by senior sonographers (AUC = 0.789 for seniors and 0.877 for radiomics models in task one; AUC = 0.612 for senior and 0.839 for radiomics model in task 2). We showed that the CCR model, comprising CA125 level, lesion location, ascites, and radiomics signatures, performed the best (AUC = 0.937, 95%CI 0.905-0.969 in task 1, AUC = 0.924, 95%CI 0.876-0.971 in task 2) in the training as well as in the validation cohorts (AUC = 0.914, 95%CI 0.851-0.976 in task 1, AUC = 0.890, 95%CI 0.794-0.987 in task 2). The calibration curve and DCA analysis of the CCR model more accurately predicted the classification of the tumors than the clinical features alone. Conclusion: This study integrates novel radiomics signatures from ultrasound and clinical factors to create a nomogram to provide preoperative diagnostic information for differentiating between benign, borderline, and malignant ovarian serous tumors, thereby reducing unnecessary and risky biopsies and surgeries.

Risk Prediction of Cardiovascular Events by Exploration of Molecular Data with Explainable Artificial Intelligence

Cardiovascular diseases (CVD) annually take almost 18 million lives worldwide. Most lethal events occur months or years after the initial presentation. Indeed, many patients experience repeated complications or require multiple interventions (recurrent events). Apart from affecting the individual, this leads to high medical costs for society. Personalized treatment strategies aiming at prediction and prevention of recurrent events rely on early diagnosis and precise prognosis. Complementing the traditional environmental and clinical risk factors, multi-omics data provide a holistic view of the patient and disease progression, enabling studies to probe novel angles in risk stratification. Specifically, predictive molecular markers allow insights into regulatory networks, pathways, and mechanisms underlying disease. Moreover, artificial intelligence (AI) represents a powerful, yet adaptive, framework able to recognize complex patterns in large-scale clinical and molecular data with the potential to improve risk prediction. Here, we review the most recent advances in risk prediction of recurrent cardiovascular events, and discuss the value of molecular data and biomarkers for understanding patient risk in a systems biology context. Finally, we introduce explainable AI which may improve clinical decision systems by making predictions transparent to the medical practitioner.

Towards Clinical Application of Artificial Intelligence in Ultrasound Imaging

Artificial intelligence (AI) is being increasingly adopted in medical research and applications. Medical AI devices have continuously been approved by the Food and Drug Administration in the United States and the responsible institutions of other countries. Ultrasound (US) imaging is commonly used in an extensive range of medical fields. However, AI-based US imaging analysis and its clinical implementation have not progressed steadily compared to other medical imaging modalities. The characteristic issues of US imaging owing to its manual operation and acoustic shadows cause difficulties in image quality control. In this review, we would like to introduce the global trends of medical AI research in US imaging from both clinical and basic perspectives. We also discuss US image preprocessing, ingenious algorithms that are suitable for US imaging analysis, AI explainability for obtaining informed consent, the approval process of medical AI devices, and future perspectives towards the clinical application of AI-based US diagnostic support technologies.

Artificial intelligence (AI) in the detection of rectosigmoid deep endometriosis

OBJECTIVES

The aim of this study was to compare the accuracy of seven classical Machine Learning (ML) models trained with ultrasound (US) soft markers to raise suspicion of endometriotic bowel involvement.

MATERIALS AND METHODS

Input data to the models was retrieved from a database of a previously published study on bowel endometriosis performed on 333 patients. The following models have been tested: k-nearest neighbors algorithm (k-NN), Naive Bayes, Neural Networks (NNET-neuralnet), Support Vector Machine (SVM), Decision Tree, Random Forest, and Logistic Regression. The data driven strategy has been to split randomly the complete dataset in two different datasets. The training dataset and the test dataset with a 67 % and 33 % of the original cases respectively. All models were trained on the training dataset and the predictions have been evaluated using the test dataset. The best model was chosen based on the accuracy demonstrated on the test dataset. The information used in all the models were: age; presence of US signs of uterine adenomyosis; presence of an endometrioma; adhesions of the ovary to the uterus; presence of "kissing ovaries"; absence of sliding sign. All models have been trained using CARET package in R with ten repeated 10-fold cross-validation. Accuracy, Sensitivity, Specificity, positive (PPV) and negative (NPV) predictive value were calculated using a 50 % threshold. Presence of intestinal involvement was defined in all cases in the test dataset with an estimated probability greater than 0.5.

RESULTS

In our previous study from where the inputs were retrieved, 106 women had a final expert US diagnosis of rectosigmoid endometriosis. In term of diagnostic accuracy the best model was the Neural Net (Accuracy, 0.73; sensitivity, 0.72; specificity 0.73; PPV 0.52; and NPV 0.86) but without significant difference with the others.

CONCLUSIONS

The accuracy of ultrasound soft markers in raising suspicion of rectosigmoid endometriosis using Artificial Intelligence (AI) models showed similar results to the logistic model.