Automatic classification of human sperm head morphology

Evolution of intracytoplasmic sperm injection: From initial challenges to wider applications

Background

In vitro fertilization (IVF) has revolutionized infertility treatment. Nevertheless, male infertility requires more effective solutions. In 1992, the first-ever case of human birth via intracytoplasmic sperm injection (ICSI) was reported. ICSI involves microscopically injecting a sperm into an ovum. Successful ICSI has become a reliable therapy for couples facing infertility, a significant milestone. However, it has also introduced various challenges. This study also delves into ethical dilemmas arising from widespread ICSI use.

Methods

This review traces the history of ICSI, presenting pioneering attempts, first successful attempts, and critical reports on account of the initial skepticism toward the technology. The review also focuses on chronological progress until ICSI was recognized as effective and became widely applied.

Main findings

The review reveals that ICSI, although transformative, presents challenges. Successes include addressing male infertility and aiding fertilization. However, concerns arise regarding optimal sperm and embryo selection, genetic mutations, and long-term health implications. Ethical considerations surrounding ICSI's broad applications also surface.

Conclusions

Despite its success and effectiveness, ICSI is still evolving as a therapeutic method. By comprehensively evaluating the historical progress and the current status of ICSI and exploring its future prospects, this study highlights the importance of ICSI in infertility treatment.

Ensembling noisy segmentation masks of blurred sperm images

BACKGROUND

Sperm tail morphology and motility have been demonstrated to be important factors in determining sperm quality for in vitro fertilization. However, many existing computer-aided sperm analysis systems leave the sperm tail out of the analysis, as detecting a few tail pixels is challenging. Moreover, some publicly available datasets for classifying morphological defects contain images limited only to the sperm head. This study focuses on the segmentation of full sperm, which consists of the head and tail parts, and appear alone and in groups.

METHODS

We re-purpose the Feature Pyramid Network to ensemble an input image with multiple masks from state-of-the-art segmentation algorithms using a scale-specific cross-attention module. We normalize homogeneous backgrounds for improved training. The low field depth of microscopes blurs the images, easily confusing human raters in discerning minuscule sperm from large backgrounds. We thus propose evaluation protocols for scoring segmentation models trained on imbalanced data and noisy ground truth.

RESULTS

The neural ensembling of noisy segmentation masks outperforms all single, state-of-the-art segmentation algorithms in full sperm segmentation. Human raters agree more on the head than tail masks. The algorithms also segment the head better than the tail.

CONCLUSIONS

The extensive evaluation of state-of-the-art segmentation algorithms shows that full sperm segmentation is challenging. We release the SegSperm dataset of images from Intracytoplasmic Sperm Injection procedures to spur further progress on full sperm segmentation with noisy and imbalanced ground truth. The dataset is publicly available at https://doi.org/10.34808/6wm7-1159.

A Dual Architecture Fusion and AutoEncoder for Automatic Morphological Classification of Human Sperm

Infertility has become a common problem in global health, and unsurprisingly, many couples need medical assistance to achieve reproduction. Many human behaviors can lead to infertility, which is none other than unhealthy sperm. The important thing is that assisted reproductive techniques require selecting healthy sperm. Hence, machine learning algorithms are presented as the subject of this research to effectively modernize and make accurate standards and decisions in classifying sperm. In this study, we developed a deep learning fusion architecture called SwinMobile that combines the Shifted Windows Vision Transformer (Swin) and MobileNetV3 into a unified feature space and classifies sperm from impurities in the SVIA Subset-C. Swin Transformer provides long-range feature extraction, while MobileNetV3 is responsible for extracting local features. We also explored incorporating an autoencoder into the architecture for an automatic noise-removing model. Our model was tested on SVIA, HuSHem, and SMIDS. Comparison to the state-of-the-art models was based on F1-score and accuracy. Our deep learning results accurately classified sperm and performed well in direct comparisons with previous approaches despite the datasets' different characteristics. We compared the model from Xception on the SVIA dataset, the MC-HSH model on the HuSHem dataset, and Ilhan et al.'s model on the SMIDS dataset and the astonishing results given by our model. The proposed model, especially SwinMobile-AE, has strong classification capabilities that enable it to function with high classification results on three different datasets. We propose that our deep learning approach to sperm classification is suitable for modernizing the clinical world. Our work leverages the potential of artificial intelligence technologies to rival humans in terms of accuracy, reliability, and speed of analysis. The SwinMobile-AE method we provide can achieve better results than state-of-the-art, even for three different datasets. Our results were benchmarked by comparisons with three datasets, which included SVIA, HuSHem, and SMIDS, respectively (95.4% vs. 94.9%), (97.6% vs. 95.7%), and (91.7% vs. 90.9%). Thus, the proposed model can realize technological advances in classifying sperm morphology based on the evidential results with three different datasets, each having its characteristics related to data size, number of classes, and color space.

Looking with new eyes: advanced microscopy and artificial intelligence in reproductive medicine

Microscopy has long played a pivotal role in the field of assisted reproductive technology (ART). The advent of artificial intelligence (AI) has opened the door for new approaches to sperm and oocyte assessment and selection, with the potential for improved ART outcomes.

Multi-model CNN fusion for sperm morphology analysis

Infertility is a common disorder affecting 20% of couples worldwide. Furthermore, 40% of all cases are related to male infertility. The first step in the determination of male infertility is semen analysis. The morphology, concentration, and motility of sperm are important characteristics evaluated by experts during semen analysis. Most laboratories perform the tests manually. However, manual semen analysis requires much time and is subject to observer variability during the evaluation. Therefore, computer-assisted systems are required. Additionally, to obtain more objective results, a large amount of data is necessary. Deep learning networks, which have become popular in recent years, are used for processing and analysing such quantities of data. Convolutional neural networks (CNNs) are a class of deep learning algorithm that are used extensively for processing and analysing images. In this study, six different CNN models were created for completely automating the morphological classification of sperm images. Additionally, two decision-level fusion techniques namely hard-voting and soft-voting were applied over these CNNs. To evaluate the performance of the proposed approach, three publicly available sperm morphology data sets were used in the experimental tests. For an objective analysis, a cross-validation technique was applied by dividing the data sets into five sub-sets. In addition, various data augmentation scales and mini-batch analysis were employed to obtain the highest classification accuracies. Finally, in the classification, accuracies 90.73%, 85.18% and 71.91% were obtained for the SMIDS, HuSHeM and SCIAN-Morpho data sets, respectively, using the soft-voting based fusion approach over the six created CNN models. The results suggested that the proposed approach could automatically classify as well as achieve high success in three different data sets.

Impact of transfer learning for human sperm segmentation using deep learning

BACKGROUND AND OBJECTIVE

Infertility affects approximately one in ten couples, and almost half of the infertility cases are due to the malefactor. To diagnose infertility and determine future treatment, a semen analysis is performed. Evaluation of sperm morphology is one of several steps in semen analysis, in which the shape and size of sperm parts are examined. The laboratories dedicated to this use traditional methods susceptible to errors. An alternative to replace the poor visual ability to assess sperm size and shape is to analyze sperm morphology with a computer's help. However, since the automatic sperm classification rates do not show an acceptable precision rate for use in the clinical setting, it is considered an exciting approach to focus efforts on improving the precision in sperm segmentation to extract the contour sperm before classification. This work aims to assess the utility of two image segmentation deep learning models for segmenting human sperm heads, acrosome, and nucleus.

METHODS

In this work, we evaluate the use of two well-known deep learning architectures (U-Net and Mask-RCNN) to segment parts of human sperm cells using data augmentation, cross-validation, hyperparameter tuning, and transfer learning. The experimental results are carried out using SCIAN-SpermSegGS, a public dataset with more than two hundred manually segmented sperm cells and widely used to validate segmentation methods of human sperm parts.

RESULTS

Experimental evaluation shows that U-net with transfer learning achieves up to 95% overlapping against hand-segmented masks for sperm head (0.96), acrosome (0.94), and nucleus (0.95), using Dice coefficient as the evaluation metric. These results outperform state-of-the-art sperm parts segmentation methods.

CONCLUSIONS

The impact of transfer learning is substantial, significantly improving the results of state-of-the-art methods with a higher Dice coefficient, less dispersion, and fewer cases where the model failed to segment sperm parts. These results represent a promising advance in the ultimate goal of performing computer-assisted morphological sperm analysis.

Machine learning for sperm selection

Infertility rates and the number of couples seeking fertility care have increased worldwide over the past few decades. Over 2.5 million cycles of assisted reproductive technologies are being performed globally every year, but the success rate has remained at ~33%. Machine learning, an automated method of data analysis based on patterns and inference, is increasingly being deployed within the health-care sector to improve diagnostics and therapeutics. This technique is already aiding embryo selection in some fertility clinics, and has also been applied in research laboratories to improve sperm analysis and selection. Tremendous opportunities exist for machine learning to advance male fertility treatments. The fundamental challenge of sperm selection - selecting the most promising candidate from 10⁸ gametes - presents a challenge that is uniquely well-suited to the high-throughput capabilities of machine learning algorithms paired with modern data processing capabilities.

Automatic Microscopy Analysis with Transfer Learning for Classification of Human Sperm

Infertility is a global problem that affects many couples. Sperm analysis plays an essential role in the clinical diagnosis of human fertility. The examination of sperm morphology is an essential technique because sperm morphology is a proven indicator of biological functions. At present, the morphological classification of human sperm is conducted manually by medical experts. However, manual classification is laborious and highly dependent on the experience and capability of clinicians. To address these limitations, we propose a transfer learning method based on AlexNet to automatically classify the sperms into four different categories in terms of the World Health Organization (WHO) standards by analyzing their morphology. We adopt the feature extraction architecture of AlexNet as well as its pre-training parameters. Besides, we redesign the classification network by adding the Batch Normalization layers to improve the performance. The proposed method achieves an average accuracy of 96.0% and an average precision of 96.4% in the freely-available HuSHeM dataset, which exceeds the performance of previous algorithms. Our method shows that automatic sperm classification has great potential to replace manual sperm classification in the future.

Importance of real-time measurement of sperm head morphology in intracytoplasmic sperm injection

Intracytoplasmic sperm injection (ICSI) is an important technique in male infertility treatment. Currently, sperm selection for ICSI in human assisted reproductive technology (ART) is subjective, based on a visual assessment by the operator. Therefore, it is desirable to develop methods that can objectively provide an accurate assessment of the shape and size of sperm heads that use low-magnification microscopy available in most standard fertility clinics. Recent studies have shown a correlation between sperm head size and shape and chromosomal abnormalities, and fertilization rate, and various attempts have been made to establish automated computer-based measurement of the sperm head itself. For example, a dictionary-learning technique and a deep-learning-based method have both been developed. Recently, an automatic algorithm was reported that detects sperm head malformations in real time for selection of the best sperm for ICSI. These data suggest that a real-time sperm selection system for use in ICSI is necessary. Moreover, these systems should incorporate inverted microscopes (×400-600 magnification) but not the fluorescence microscopy techniques often used for a dictionary-learning technique and a deep-learning-based method. These advances are expected to improve future success rates of ARTs. In this review, we summarize recent reports on the assessment of sperm head shape, size, and acrosome status in relation to fertility, and propose further improvements that can be made to the ARTs used in infertility treatments.

Faster region convolutional neural network and semen tracking algorithm for sperm analysis

BACKGROUND AND OBJECTIVES

Semen analysis is a primary and mandatory procedure to evaluate the infertility during clinical examination. This procedure includes the analysis and classification of normal and abnormal Sperm, selection and efficient tracking of healthy sperm in the sample. Many methods were proposed earlier for the analysis of semen. The fast sperm movement and high dense cluster of sperm is a challenging task for researchers.

METHODS

The paper proposes a novel Faster Region Convolutional Neural Network (FRCNN) with Elliptic Scanning Algorithm (ESA) for classifying human sperm and a Novel Tail to Head movement algorithm (THMA) for the motility analysis and tracking. This proposed method improves the accuracy of computer assisted semen analysis (CASA).

RESULTS

The proposed method outperforms and provides better results than existing methods. Method provides better accuracy of 97.37%. Sperm detection and identifying the sperm motility in the group is performed with minimum execution time of 1.12 s.

CONCLUSIONS

A novel FRCNN with ESA detection algorithm is proposed for the analysis of human sperm classification. This method provides an accuracy of 97.37%. A Tail head movement-based (THMA) algorithm is explained for the motility analysis.

Effect of deep transfer and multi-task learning on sperm abnormality detection

Analyzing the abnormality of morphological characteristics of male human sperm has been studied for a long time mainly because it has many implications on the male infertility problem, which accounts for approximately half of the infertility problems in the world. Yet, detecting such abnormalities by embryologists has several downsides. To clarify, analyzing sperms through visual inspection of an expert embryologist is a highly subjective and biased process. Furthermore, it takes much time for a specialist to make a diagnosis. Hence, in this paper, we proposed two deep learning algorithms that are able to automate this process. The first algorithm uses a network-based deep transfer learning approach, while the second technique, named Deep Multi-task Transfer Learning (DMTL), employs a novel combination of network-based deep transfer learning and multi-task learning to classify sperm's head, vacuole, and acrosome as either normal or abnormal. This DMTL technique is capable of classifying all the aforementioned parts of the sperm in a single prediction. Moreover, this is the first time that the concept of multi-task learning has been introduced to the field of Sperm Morphology Analysis (SMA). To benchmark our algorithms, we employed a freely-available SMA dataset named MHSMA. During our experiments, our algorithms reached the state-of-the-art results on the accuracy, precision, and f_0.5, as well as other important metrics, such as the Matthews Correlation Coefficient on one, two, or all three labels. Notably, our algorithms increased the accuracy of the head, acrosome, and vacuole by 6.66%, 3.00%, and 1.33%, and reached the accuracy of 84.00%, 80.66%, and 94.00% on these labels, respectively. Consequently, our algorithms can be used in health institutions, such as fertility clinics, with further recommendations to practically improve the performance of our algorithms.

Deep Learning-Based Morphological Classification of Human Sperm Heads

Human infertility is considered as a serious disease of the reproductive system that affects more than 10% of couples across the globe and over 30% of the reported cases are related to men. The crucial step in the assessment of male infertility and subfertility is semen analysis that strongly depends on the sperm head morphology, i.e., the shape and size of the head of a spermatozoon. However, in medical diagnosis, the morphology of the sperm head is determined manually, and heavily depends on the expertise of the clinician. Moreover, this assessment as well as the morphological classification of human sperm heads are laborious and non-repeatable, and there is also a high degree of inter and intra-laboratory variability in the results. In order to overcome these problems, we propose a specialized convolutional neural network (CNN) architecture to accurately classify human sperm heads based on sperm images. It is carefully designed with several layers, and multiple filter sizes, but fewer filters and parameters to improve efficiency and effectiveness. It is demonstrated that our proposed architecture outperforms state-of-the-art methods, exhibiting 88% recall on the SCIAN dataset in the total agreement setting and 95% recall on the HuSHeM dataset for the classification of human sperm heads. Our proposed method shows the potential of deep learning to surpass embryologists in terms of reliability, throughput, and accuracy.

Ultra-structural analysis of human spermatozoa by aperture scanning near-field optical microscopy

Scanning near-field optical microscopy (SNOM) represents a potential candidate for investigation of ultrastructure in human spermatozoa. It is a noninvasive optical technique that offers two main advantages: minimal sample preparation and simultaneous topographical and optical images acquisition with a spatial resolution beyond the diffraction limit. This enables the combination of surface characterization and information from the inner cellular organization in a single acquisition providing an immediate and comprehensive analysis of the cellular portions. In this work spermatozoa are immobilized on poly-L-lysine coated coverslips, fixed according to a standard protocol and imaged by aperture-SNOM in air. In the SNOM images, all peculiar sperm portions show well-resolved optical features, which exhibit good similarities with the structures revealed in transmission electron microscopy images, as compared with literature data. The optical features of anomalous spermatozoa are clearly different as respect with those observed for healthy ones. This analysis reveals the potentialities of SNOM and opens to its application to high-resolution analysis of sperm morphological alterations, which might be relevant in reproductive medicine.

Prepubertal acrylamide exposure causes dose-response decreases in spermatic production and functionality with modulation of genes involved in the spermatogenesis in rats

The increase in human infertility prevalence due to male reproductive disorders has been associated with extensive endocrine-disrupting chemical (EDC) exposure. Acrylamide (AA) is a compound formed spontaneously during heat processing of some foods that are mainly consumed by children and adolescents. In this study, we evaluated the prepubertal AA exposure effects on male adult reproductive physiology using a prepubertal experimental model to analyze the pubertal development, spermatogenesis hormones levels and genes expression involved in male reproductive function. This study is the first one to use the validated protocol to correlate the AA exposure with puberty development, as well as the AA-induced endocrine disrupting effects on reproductive axis. AA did not affect the age at puberty, the reproductive organ's weight and serum hormonal levels. AA reduces spermatogenesis, induces morphological and functional defects on sperm and alters transcript expression of sexual hormone receptors (Ar and Esr2), the transcript expression of Tnf, Egr2, Rhcg and Lrrc34. These findings suggest that excessive AA consumption may impair their reproductive capacity at adulthood, despite no changes in hormonal profile being observed.

Deep learning-based selection of human sperm with high DNA integrity

Despite the importance of sperm DNA to human reproduction, currently no method exists to assess individual sperm DNA quality prior to clinical selection. Traditionally, skilled clinicians select sperm based on a variety of morphological and motility criteria, but without direct knowledge of their DNA cargo. Here, we show how a deep convolutional neural network can be trained on a collection of ~1000 sperm cells of known DNA quality, to predict DNA quality from brightfield images alone. Our results demonstrate moderate correlation (bivariate correlation ~0.43) between a sperm cell image and DNA quality and the ability to identify higher DNA integrity cells relative to the median. This deep learning selection process is directly compatible with current, manual microscopy-based sperm selection and could assist clinicians, by providing rapid DNA quality predictions (under 10 ms per cell) and sperm selection within the 86th percentile from a given sample.

Sperm Morphology: History, Challenges, and Impact on Natural and Assisted Fertility

PURPOSE OF REVIEW

The classification of morphologically normal sperm has been progressively redefined. Concurrently, our understanding of the significance of sperm morphology in relation to male factor infertility has evolved. In this review, we will discuss the evolution of sperm morphology assessment and factors that contribute to its measurement variability. We will examine the impact of sperm morphology on natural pregnancy, IUI, IVF, and ICSI outcomes.

RECENT FINDINGS

There is a lack of consensus on sperm morphology classification, technique, and inter-observer grading variability. Current evidence suggests sperm morphology has low predictive value for pregnancy success, for both natural and assisted reproduction. Additionally, the threshold for what is considered an adequate percentage of morphologically normal sperm has changed over time. These variables have called into question the relevance of this variable in predicting fertility outcomes. Our understanding of the impact of sperm morphology on reproductive outcomes continues to evolve and seems to play less of a role than initially thought.