A proof of concept for a deep learning system that can aid embryologists in predicting blastocyst survival after thaw

Deep learning applications for human embryo assessment using time-lapse imaging: scoping review

Background

The integration of deep learning (DL) and time-lapse imaging technologies offers new possibilities for improving embryo assessment and selection in clinical in vitro Fertilization (IVF).

Objectives

This scoping review aims to explore the range of deep learning model applications in the evaluation and selection of embryos monitored through time-lapse imaging systems.

Methods

A total of 6 electronic databases (Scopus, MEDLINE, EMBASE, ACM Digital Library, IEEE Xplore, and Google Scholar) were searched for peer-reviewed literature published before May 2024. We adhered to the PRISMA guidelines for reporting scoping reviews.

Results

Out of the 773 articles reviewed, 77 met the inclusion criteria. Over the past four years, the use of DL in embryo analysis has increased rapidly. The primary applications of DL in the reviewed studies included predicting embryo development and quality (61%, n = 47) and forecasting clinical outcomes, such as pregnancy and implantation (35%, n = 27). The number of embryos involved in the studies exhibited significant variation, with a mean of 10,485 (SD = 35,593) and a range from 20 to 249,635 embryos. A variety of data types have been used, namely images of blastocyst-stage embryos (47%, n = 36), followed by combined images of cleavage and blastocyst stages (23%, n = 18). Most of the studies did not provide maternal age details (82%, n = 63). Convolutional neural networks (CNNs) were the predominant deep learning architecture used, accounting for 81% (n = 62) of the studies. All studies utilized time-lapse video images (100%) as training data, while some also incorporated demographics, clinical and reproductive histories, and IVF cycle parameters. Most studies utilized accuracy as the discriminative measure (58%, n = 45).

Conclusion

Our results highlight the diverse applications and potential of deep learning in clinical IVF and suggest directions for future advancements in embryo evaluation and selection techniques.

Testing an artificial intelligence algorithm to predict fetal heartbeat of vitrified-warmed blastocysts from a single image: predictive ability in different settings

STUDY QUESTION

Could an artificial intelligence (AI) algorithm predict fetal heartbeat from images of vitrified-warmed embryos?

SUMMARY ANSWER

Applying AI to vitrified-warmed blastocysts may help predict which ones will result in implantation failure early enough to thaw another.

WHAT IS KNOWN ALREADY

The application of AI in the field of embryology has already proven effective in assessing the quality of fresh embryos. Therefore, it could also be useful to predict the outcome of frozen embryo transfers, some of which do not recover their pre-vitrification volume, collapse, or degenerate after warming without prior evidence.

STUDY DESIGN, SIZE, DURATION

This retrospective cohort study included 1109 embryos from 792 patients. Of these, 568 were vitrified blastocysts cultured in time-lapse systems in the period between warming and transfer, from February 2022 to July 2023. The other 541 were fresh-transferred blastocysts serving as controls.

PARTICIPANTS/MATERIALS, SETTING, METHODS

Four types of time-lapse images were collected: last frame of development of 541 fresh-transferred blastocysts (FTi), last frame of 467 blastocysts to be vitrified (PVi), first frame post-warming of 568 vitrified embryos (PW1i), and last frame post-warming of 568 vitrified embryos (PW2i). After providing the images to the AI algorithm, the returned scores were compared with the conventional morphology and fetal heartbeat outcomes of the transferred embryos (n = 1098). The contribution of the AI score to fetal heartbeat was analyzed by multivariate logistic regression in different patient populations, and the predictive ability of the models was measured by calculating the area under the receiver-operating characteristic curve (ROC-AUC).

MAIN RESULTS AND THE ROLE OF CHANCE

Fetal heartbeat rate was related to AI score from FTi (P < 0.001), PW1i (P < 0.05), and PW2i (P < 0.001) images. The contribution of AI score to fetal heartbeat was significant in the oocyte donation program for PW2i (odds ratio (OR)=1.13; 95% CI [1.04-1.23]; P < 0.01), and in cycles with autologous oocytes for PW1i (OR = 1.18; 95% CI [1.01-1.38]; P < 0.05) and PW2i (OR = 1.15; 95% CI [1.02-1.30]; P < 0.05), but was not significantly associated with fetal heartbeat in genetically analyzed embryos. AI scores from the four groups of images varied according to morphological category (P < 0.001). The PW2i score differed in collapsed, non-re-expanded, or non-viable embryos compared to normal/viable embryos (P < 0.001). The predictability of the AI score was optimal at a post-warming incubation time of 3.3-4 h (AUC = 0.673).

LIMITATIONS, REASONS FOR CAUTION

The algorithm was designed to assess fresh embryos prior to vitrification, but not thawed ones, so this study should be considered an external trial.

WIDER IMPLICATIONS OF THE FINDINGS

The application of predictive software in the management of frozen embryo transfers may be a useful tool for embryologists, reducing the cancellation rates of cycles in which the blastocyst does not recover from vitrification. Specifically, the algorithm tested in this research could be used to evaluate thawed embryos both in clinics with time-lapse systems and in those with conventional incubators only, as just a single photo is required.

STUDY FUNDING/COMPETING INTERESTS

This study was supported by the Regional Ministry of Innovation, Universities, Science and Digital Society of the Valencian Community (CIACIF/2021/019) and by Instituto de Salud Carlos III (PI21/00283), and co-funded by European Union (ERDF, 'A way to make Europe'). M.M. received personal fees in the last 5 years as honoraria for lectures from Merck, Vitrolife, MSD, Ferring, AIVF, Theramex, Gedeon Richter, Genea Biomedx, and Life Whisperer. There are no other competing interests.

TRIAL REGISTRATION NUMBER

N/A.

EVATOM: an optical, label-free, machine learning assisted embryo health assessment tool

The combination of a good quality embryo and proper maternal health factors promise higher chances of a successful in vitro fertilization (IVF) procedure leading to clinical pregnancy and live birth. Of these two factors, selection of a good embryo is a controllable aspect. The current gold standard in clinical practice is visual assessment of an embryo based on its morphological appearance by trained embryologists. More recently, machine learning has been incorporated into embryo selection "packages". Here, we report EVATOM: a machine-learning assisted embryo health assessment tool utilizing an optical quantitative phase imaging technique called artificial confocal microscopy (ACM). We present a label-free nucleus detection method with, to the best of our knowledge, novel quantitative embryo health biomarkers. Two viability assessment models are presented for grading embryos into two classes: healthy/intermediate (H/I) or sick (S) class. The models achieve a weighted F1 score of 1.0 and 0.99 respectively on the in-distribution test set of 72 fixed embryos and a weighted F1 score of 0.9 and 0.95 respectively on the out-of-distribution test dataset of 19 time-instances from 8 live embryos.

Using blastocyst re-expansion rate for deciding when to warm a new blastocyst for single vitrified-warmed blastocyst transfer

RESEARCH QUESTION

Can predictive post-warm parameters that support the decision to transfer a warmed blastocyst or to warm another blastocyst be identified in women with multiple frozen-vitrified blastocysts?

DESIGN

Retrospective single-centre observational cohort analysis. A total of 1092 single vitrified-warmed blastocyst transfers (SVBT) with known Gardner score, maternal age and live birth were used to develop live birth prediction models based on logistic regression, including post-warm re-expansion parameters. Time-lapse incubation was used for pre-vitrification and post-warm embryo culture. A dataset of 558 SVBT with the same inclusion criteria was used to validate the model, but with known clinical pregnancy outcome instead of live birth outcome.

RESULTS

Three different logistic regression models were developed for predicting live birth based on post-warm blastocyst re-expansion. Different post-warm assessment times indicated that a 2-h post-warm culture period was optimal for live birth prediction (model 1). Adjusting for pre-vitrification Gardner score (model 2) and in combination with maternal age (model 3) further increased predictability (area under the curve [AUC] = 0.623, 0.633, 0.666, respectively). Model validation gave an AUC of 0.617, 0.609 and 0.624, respectively. The false negative rate and true negative rate for model 3 were 2.0 and 10.1 in the development dataset and 3.5 and 8.0 in the validation dataset.

CONCLUSIONS

Clinical application of a simple model based on 2 h of post-warm re-expansion data, pre-vitrification Gardner score and maternal age can support a standardized approach for deciding if warming another blastocyst may increase the likelihood of live birth in SVBT.

Deep learning for embryo evaluation using time-lapse: a systematic review of diagnostic test accuracy

OBJECTIVE

This study aimed to investigate the accuracy of convolutional neural network models in the assessment of embryos using time-lapse monitoring.

DATA SOURCES

A systematic search was conducted in PubMed and Web of Science databases from January 2016 to December 2022. The search strategy was carried out by using key words and MeSH (Medical Subject Headings) terms.

STUDY ELIGIBILITY CRITERIA

Studies were included if they reported the accuracy of convolutional neural network models for embryo evaluation using time-lapse monitoring. The review was registered with PROSPERO (International Prospective Register of Systematic Reviews; identification number CRD42021275916).

METHODS

Two reviewer authors independently screened results using the Covidence systematic review software. The full-text articles were reviewed when studies met the inclusion criteria or in any uncertainty. Nonconsensus was resolved by a third reviewer. Risk of bias and applicability were evaluated using the QUADAS-2 tool and the modified Joanna Briggs Institute or JBI checklist.

RESULTS

Following a systematic search of the literature, 22 studies were identified as eligible for inclusion. All studies were retrospective. A total of 522,516 images of 222,998 embryos were analyzed. Three main outcomes were evaluated: successful in vitro fertilization, blastocyst stage classification, and blastocyst quality. Most studies reported >80% accuracy, and embryologists were outperformed in some. Ten studies had a high risk of bias, mostly because of patient bias.

CONCLUSION

The application of artificial intelligence in time-lapse monitoring has the potential to provide more efficient, accurate, and objective embryo evaluation. Models that examined blastocyst stage classification showed the best predictions. Models that predicted live birth had a low risk of bias, used the largest databases, and had external validation, which heightens their relevance to clinical application. Our systematic review is limited by the high heterogeneity among the included studies. Researchers should share databases and standardize reporting.

Machine learning assisted health viability assay for mouse embryos with artificial confocal microscopy (ACM)

The combination of a good quality embryo and proper maternal health factors promise higher chances of a successful in vitro fertilization (IVF) procedure leading to clinical pregnancy and live birth. Of these two factors, selection of a good embryo is a controllable aspect. The current gold standard in clinical practice is visual assessment of an embryo based on its morphological appearance by trained embryologists. More recently, machine learning has been incorporated into embryo selection "packages". Here, we report a machine-learning assisted embryo health assessment tool utilizing a quantitative phase imaging technique called artificial confocal microscopy (ACM). We present a label-free nucleus detection method with novel quantitative embryo health biomarkers. Two viability assessment models are presented for grading embryos into two classes: healthy/intermediate (H/I) or sick (S) class. The models achieve a weighted F1 score of 1.0 and 0.99 respectively on the in-distribution test set of 72 fixed embryos and a weighted F1 score of 0.9 and 0.95 respectively on the out-of-distribution test dataset of 19 time-instances from 8 live embryos.