A new deep‐learning model using YOLOv3 to support sperm selection during intracytoplasmic sperm injection procedure

Testing the generalizability and effectiveness of deep learning models among clinics: sperm detection as a pilot study

BACKGROUND

Deep learning has been increasingly investigated for assisting clinical in vitro fertilization (IVF). The first technical step in many tasks is to visually detect and locate sperm, oocytes, and embryos in images. For clinical deployment of such deep learning models, different clinics use different image acquisition hardware and different sample preprocessing protocols, raising the concern over whether the reported accuracy of a deep learning model by one clinic could be reproduced in another clinic. Here we aim to investigate the effect of each imaging factor on the generalizability of object detection models, using sperm analysis as a pilot example.

METHODS

Ablation studies were performed using state-of-the-art models for detecting human sperm to quantitatively assess how model precision (false-positive detection) and recall (missed detection) were affected by imaging magnification, imaging mode, and sample preprocessing protocols. The results led to the hypothesis that the richness of image acquisition conditions in a training dataset deterministically affects model generalizability. The hypothesis was tested by first enriching the training dataset with a wide range of imaging conditions, then validated through internal blind tests on new samples and external multi-center clinical validations.

RESULTS

Ablation experiments revealed that removing subsets of data from the training dataset significantly reduced model precision. Removing raw sample images from the training dataset caused the largest drop in model precision, whereas removing 20x images caused the largest drop in model recall. by incorporating different imaging and sample preprocessing conditions into a rich training dataset, the model achieved an intraclass correlation coefficient (ICC) of 0.97 (95% CI: 0.94-0.99) for precision, and an ICC of 0.97 (95% CI: 0.93-0.99) for recall. Multi-center clinical validation showed no significant differences in model precision or recall across different clinics and applications.

CONCLUSIONS

The results validated the hypothesis that the richness of data in the training dataset is a key factor impacting model generalizability. These findings highlight the importance of diversity in a training dataset for model evaluation and suggest that future deep learning models in andrology and reproductive medicine should incorporate comprehensive feature sets for enhanced generalizability across clinics.

Current Updates on Involvement of Artificial Intelligence and Machine Learning in Semen Analysis

Background and Objectives: Infertility rates and the number of couples undergoing reproductive care have both increased substantially during the last few decades. Semen analysis is a crucial step in both the diagnosis and the treatment of male infertility. The accuracy of semen analysis results remains quite poor despite years of practice and advancements. Artificial intelligence (AI) algorithms, which can analyze and synthesize large amounts of data, can address the unique challenges involved in semen analysis due to the high objectivity of current methodologies. This review addresses recent AI advancements in semen analysis. Materials and Methods: A systematic literature search was performed in the PubMed database. Non-English articles and studies not related to humans were excluded. We extracted data related to AI algorithms or models used to evaluate semen parameters from the original studies, excluding abstracts, case reports, and meeting reports. Results: Of the 306 articles identified, 225 articles were rejected in the preliminary screening. The evaluation of the full texts of the remaining 81 publications resulted in the exclusion of another 48 articles, with a final inclusion of 33 original articles in this review. Conclusions: AI and machine learning are becoming increasingly popular in biomedical applications. The examination and selection of sperm by andrologists and embryologists may benefit greatly from using these algorithms. Furthermore, when bigger and more reliable datasets become accessible for training, these algorithms may improve over time.

Improving outcomes of assisted reproductive technologies using artificial intelligence for sperm selection

Within the field of assisted reproductive technology, artificial intelligence has become an attractive tool for potentially improving success rates. Recently, artificial intelligence-based tools for sperm evaluation and selection during intracytoplasmic sperm injection (ICSI) have been explored, mainly to improve fertilization outcomes and decrease variability within ICSI procedures. Although significant advances have been achieved in developing algorithms that track and rank single sperm in real-time during ICSI, the clinical benefits these might have in improving pregnancy rates from a single assisted reproductive technology cycle remain to be established.

Application of artificial intelligence in gametes and embryos selection

Gamete and embryo quality are critical to the success rate of Assisted Reproductive Technology (ART) cycles, but there remains a lack of methods to accurately measure the quality of sperm, oocytes and embryos. The ability of Artificial Intelligence (AI) technology to analyze large amounts of data, especially video and images, is particularly useful in gamete and embryo assessment and selection. The well-trained model has fast calculation speed and high accuracy, which can help embryologists to perform more objective gamete and embryo selection. Various artificial intelligence models have been developed for gamete and embryo assessment, some of which exhibit good performance. In this review, we summarize the latest applications of AI technology in semen analysis, as well as selection for sperm, oocyte and embryo, and discuss the existing problems and development directions of artificial intelligence in this field.