1
|
Cao P, Derhaag J, Coonen E, Brunner H, Acharya G, Salumets A, Zamani Esteki M. Generative artificial intelligence to produce high-fidelity blastocyst-stage embryo images. Hum Reprod 2024; 39:1197-1207. [PMID: 38600621 PMCID: PMC11145014 DOI: 10.1093/humrep/deae064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 02/13/2024] [Indexed: 04/12/2024] Open
Abstract
STUDY QUESTION Can generative artificial intelligence (AI) models produce high-fidelity images of human blastocysts? SUMMARY ANSWER Generative AI models exhibit the capability to generate high-fidelity human blastocyst images, thereby providing substantial training datasets crucial for the development of robust AI models. WHAT IS KNOWN ALREADY The integration of AI into IVF procedures holds the potential to enhance objectivity and automate embryo selection for transfer. However, the effectiveness of AI is limited by data scarcity and ethical concerns related to patient data privacy. Generative adversarial networks (GAN) have emerged as a promising approach to alleviate data limitations by generating synthetic data that closely approximate real images. STUDY DESIGN, SIZE, DURATION Blastocyst images were included as training data from a public dataset of time-lapse microscopy (TLM) videos (n = 136). A style-based GAN was fine-tuned as the generative model. PARTICIPANTS/MATERIALS, SETTING, METHODS We curated a total of 972 blastocyst images as training data, where frames were captured within the time window of 110-120 h post-insemination at 1-h intervals from TLM videos. We configured the style-based GAN model with data augmentation (AUG) and pretrained weights (Pretrained-T: with translation equivariance; Pretrained-R: with translation and rotation equivariance) to compare their optimization on image synthesis. We then applied quantitative metrics including Fréchet Inception Distance (FID) and Kernel Inception Distance (KID) to assess the quality and fidelity of the generated images. Subsequently, we evaluated qualitative performance by measuring the intelligence behavior of the model through the visual Turing test. To this end, 60 individuals with diverse backgrounds and expertise in clinical embryology and IVF evaluated the quality of synthetic embryo images. MAIN RESULTS AND THE ROLE OF CHANCE During the training process, we observed consistent improvement of image quality that was measured by FID and KID scores. Pretrained and AUG + Pretrained initiated with remarkably lower FID and KID values compared to both Baseline and AUG + Baseline models. Following 5000 training iterations, the AUG + Pretrained-R model showed the highest performance of the evaluated five configurations with FID and KID scores of 15.2 and 0.004, respectively. Subsequently, we carried out the visual Turing test, such that IVF embryologists, IVF laboratory technicians, and non-experts evaluated the synthetic blastocyst-stage embryo images and obtained similar performance in specificity with marginal differences in accuracy and sensitivity. LIMITATIONS, REASONS FOR CAUTION In this study, we primarily focused the training data on blastocyst images as IVF embryos are primarily assessed in blastocyst stage. However, generation of an array of images in different preimplantation stages offers further insights into the development of preimplantation embryos and IVF success. In addition, we resized training images to a resolution of 256 × 256 pixels to moderate the computational costs of training the style-based GAN models. Further research is needed to involve a more extensive and diverse dataset from the formation of the zygote to the blastocyst stage, e.g. video generation, and the use of improved image resolution to facilitate the development of comprehensive AI algorithms and to produce higher-quality images. WIDER IMPLICATIONS OF THE FINDINGS Generative AI models hold promising potential in generating high-fidelity human blastocyst images, which allows the development of robust AI models as it can provide sufficient training datasets while safeguarding patient data privacy. Additionally, this may help to produce sufficient embryo imaging training data with different (rare) abnormal features, such as embryonic arrest, tripolar cell division to avoid class imbalances and reach to even datasets. Thus, generative models may offer a compelling opportunity to transform embryo selection procedures and substantially enhance IVF outcomes. STUDY FUNDING/COMPETING INTEREST(S) This study was supported by a Horizon 2020 innovation grant (ERIN, grant no. EU952516) and a Horizon Europe grant (NESTOR, grant no. 101120075) of the European Commission to A.S. and M.Z.E., the Estonian Research Council (grant no. PRG1076) to A.S., and the EVA (Erfelijkheid Voortplanting & Aanleg) specialty program (grant no. KP111513) of Maastricht University Medical Centre (MUMC+) to M.Z.E. TRIAL REGISTRATION NUMBER Not applicable.
Collapse
Affiliation(s)
- Ping Cao
- Department of Clinical Genetics, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands
- Department of Genetics and Cell Biology, GROW Research Institute for Oncology and Reproduction, Faculty of Health, Medicine and Life Sciences (FHML), Maastricht University, Maastricht, The Netherlands
| | - Josien Derhaag
- Department of Reproductive Medicine, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands
| | - Edith Coonen
- Department of Clinical Genetics, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands
- Department of Reproductive Medicine, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands
| | - Han Brunner
- Department of Clinical Genetics, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands
- Department of Genetics and Cell Biology, GROW Research Institute for Oncology and Reproduction, Faculty of Health, Medicine and Life Sciences (FHML), Maastricht University, Maastricht, The Netherlands
- Department of Human Genetics, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Ganesh Acharya
- Division of Obstetrics and Gynecology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, and Karolinska University Hospital, Stockholm, Sweden
- Women’s Health and Perinatology Research Group, Department of Clinical Medicine, UiT—The Arctic University of Norway, Tromsø, Norway
| | - Andres Salumets
- Division of Obstetrics and Gynecology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, and Karolinska University Hospital, Stockholm, Sweden
- Competence Centre on Health Technologies, Tartu, Estonia
- Department of Obstetrics and Gynecology, Institute of Clinical Medicine, University of Tartu, Tartu, Estonia
| | - Masoud Zamani Esteki
- Department of Clinical Genetics, Maastricht University Medical Center+ (MUMC+), Maastricht, The Netherlands
- Department of Genetics and Cell Biology, GROW Research Institute for Oncology and Reproduction, Faculty of Health, Medicine and Life Sciences (FHML), Maastricht University, Maastricht, The Netherlands
- Division of Obstetrics and Gynecology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, and Karolinska University Hospital, Stockholm, Sweden
| |
Collapse
|
2
|
Kim HM, Kang H, Lee C, Park JH, Chung MK, Kim M, Kim NY, Lee HJ. Evaluation of the Clinical Efficacy and Trust in AI-Assisted Embryo Ranking: Survey-Based Prospective Study. J Med Internet Res 2024; 26:e52637. [PMID: 38830209 DOI: 10.2196/52637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 10/23/2023] [Accepted: 05/06/2024] [Indexed: 06/05/2024] Open
Abstract
BACKGROUND Current embryo assessment methods for in vitro fertilization depend on subjective morphological assessments. Recently, artificial intelligence (AI) has emerged as a promising tool for embryo assessment; however, its clinical efficacy and trustworthiness remain unproven. Simulation studies may provide additional evidence, provided that they are meticulously designed to mitigate bias and variance. OBJECTIVE The primary objective of this study was to evaluate the benefits of an AI model for predicting clinical pregnancy through well-designed simulations. The secondary objective was to identify the characteristics of and potential bias in the subgroups of embryologists with varying degrees of experience. METHODS This simulation study involved a questionnaire-based survey conducted on 61 embryologists with varying levels of experience from 12 in vitro fertilization clinics. The survey was conducted via Google Forms (Google Inc) in three phases: (1) phase 1, an initial assessment (December 23, 2022, to January 22, 2023); (2) phase 2, a validation assessment (March 6, 2023, to April 5, 2023); and (3) phase 3 an AI-guided assessment (March 6, 2023, to April 5, 2023). Inter- and intraobserver assessments and the accuracy of embryo selection from 360 day-5 embryos before and after AI guidance were analyzed for all embryologists and subgroups of senior and junior embryologists. RESULTS With AI guidance, the interobserver agreement increased from 0.355 to 0.527 and from 0.440 to 0.524 for junior and senior embryologists, respectively, thus reaching similar levels of agreement. In a test of accurate embryo selection with 90 questions, the numbers of correct responses by the embryologists only, embryologists with AI guidance, and AI only were 34 (38%), 45 (50%), and 59 (66%), respectively. Without AI, the average score (accuracy) of the junior group was 33.516 (37%), while that of the senior group was 35.967 (40%), with P<.001 in the t test. With AI guidance, the average score (accuracy) of the junior group increased to 46.581 (52%), reaching a level similar to that of the senior embryologists of 44.833 (50%), with P=.34. Junior embryologists had a higher level of trust in the AI score. CONCLUSIONS This study demonstrates the potential benefits of AI in selecting embryos with high chances of pregnancy, particularly for embryologists with 5 years or less of experience, possibly due to their trust in AI. Thus, using AI as an auxiliary tool in clinical practice has the potential to improve embryo assessment and increase the probability of a successful pregnancy.
Collapse
Affiliation(s)
| | - Hyoeun Kang
- AI Lab, Kai Health, Seoul, Republic of Korea
| | | | - Jong Hyuk Park
- IVF Clinic, Miraewaheemang Hospital, Seoul, Republic of Korea
| | - Mi Kyung Chung
- IVF Clinic, Seoul Rachel Fertility Center, Seoul, Republic of Korea
| | - Miran Kim
- Department of Obstetrics & Gynecology, Ajou University School of Medicine, Suwon, Republic of Korea
| | - Na Young Kim
- IVF Clinic, HI Fertility Center, Seoul, Republic of Korea
| | | |
Collapse
|
3
|
Wang J, Jin Y, Jiang A, Chen W, Shan G, Gu Y, Ming Y, Li J, Yue C, Huang Z, Librach C, Lin G, Wang X, Zhao H, Sun Y, Zhang Z. Testing the generalizability and effectiveness of deep learning models among clinics: sperm detection as a pilot study. Reprod Biol Endocrinol 2024; 22:59. [PMID: 38778327 PMCID: PMC11110326 DOI: 10.1186/s12958-024-01232-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Accepted: 05/14/2024] [Indexed: 05/25/2024] Open
Abstract
BACKGROUND Deep learning has been increasingly investigated for assisting clinical in vitro fertilization (IVF). The first technical step in many tasks is to visually detect and locate sperm, oocytes, and embryos in images. For clinical deployment of such deep learning models, different clinics use different image acquisition hardware and different sample preprocessing protocols, raising the concern over whether the reported accuracy of a deep learning model by one clinic could be reproduced in another clinic. Here we aim to investigate the effect of each imaging factor on the generalizability of object detection models, using sperm analysis as a pilot example. METHODS Ablation studies were performed using state-of-the-art models for detecting human sperm to quantitatively assess how model precision (false-positive detection) and recall (missed detection) were affected by imaging magnification, imaging mode, and sample preprocessing protocols. The results led to the hypothesis that the richness of image acquisition conditions in a training dataset deterministically affects model generalizability. The hypothesis was tested by first enriching the training dataset with a wide range of imaging conditions, then validated through internal blind tests on new samples and external multi-center clinical validations. RESULTS Ablation experiments revealed that removing subsets of data from the training dataset significantly reduced model precision. Removing raw sample images from the training dataset caused the largest drop in model precision, whereas removing 20x images caused the largest drop in model recall. by incorporating different imaging and sample preprocessing conditions into a rich training dataset, the model achieved an intraclass correlation coefficient (ICC) of 0.97 (95% CI: 0.94-0.99) for precision, and an ICC of 0.97 (95% CI: 0.93-0.99) for recall. Multi-center clinical validation showed no significant differences in model precision or recall across different clinics and applications. CONCLUSIONS The results validated the hypothesis that the richness of data in the training dataset is a key factor impacting model generalizability. These findings highlight the importance of diversity in a training dataset for model evaluation and suggest that future deep learning models in andrology and reproductive medicine should incorporate comprehensive feature sets for enhanced generalizability across clinics.
Collapse
Affiliation(s)
- Jiaqi Wang
- School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China
| | - Yufei Jin
- School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China
| | - Aojun Jiang
- Department of Mechanical Engineering, University of Toronto, Toronto, Canada
| | - Wenyuan Chen
- Department of Mechanical Engineering, University of Toronto, Toronto, Canada
| | - Guanqiao Shan
- Department of Mechanical Engineering, University of Toronto, Toronto, Canada
| | - Yifan Gu
- Institute of Reproductive and Stem Cell Engineering, School of Basic Medical Science, Central South University, Changsha, China
- Reproductive & Genetic Hospital of Citic-Xiangya, Changsha, China
| | - Yue Ming
- School of Medicine, The Chinese University of Hong Kong, Shenzhen, China
| | - Jichang Li
- School of Medicine, The Chinese University of Hong Kong, Shenzhen, China
| | - Chunfeng Yue
- Suzhou Boundless Medical Technology Ltd., Co., Suzhou, China
| | - Zongjie Huang
- Suzhou Boundless Medical Technology Ltd., Co., Suzhou, China
| | | | - Ge Lin
- Institute of Reproductive and Stem Cell Engineering, School of Basic Medical Science, Central South University, Changsha, China
- Reproductive & Genetic Hospital of Citic-Xiangya, Changsha, China
| | - Xibu Wang
- The 3rd Affiliated Hospital of Shenzhen University, Shenzhen, China
| | - Huan Zhao
- The 3rd Affiliated Hospital of Shenzhen University, Shenzhen, China.
| | - Yu Sun
- Department of Mechanical Engineering, University of Toronto, Toronto, Canada.
- Department of Computer Science, University of Toronto, Toronto, Canada.
- Institute of Biomedical Engineering, University of Toronto, Toronto, Canada.
- Department of Electrical and Computer Engineering, University of Toronto, Toronto, Canada.
| | - Zhuoran Zhang
- School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China.
| |
Collapse
|
4
|
Yang HY, Leahy BD, Jang WD, Wei D, Kalma Y, Rahav R, Carmon A, Kopel R, Azem F, Venturas M, Kelleher CP, Cam L, Pfister H, Needleman DJ, Ben-Yosef D. BlastAssist: a deep learning pipeline to measure interpretable features of human embryos. Hum Reprod 2024; 39:698-708. [PMID: 38396213 DOI: 10.1093/humrep/deae024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 01/05/2024] [Indexed: 02/25/2024] Open
Abstract
STUDY QUESTION Can the BlastAssist deep learning pipeline perform comparably to or outperform human experts and embryologists at measuring interpretable, clinically relevant features of human embryos in IVF? SUMMARY ANSWER The BlastAssist pipeline can measure a comprehensive set of interpretable features of human embryos and either outperform or perform comparably to embryologists and human experts in measuring these features. WHAT IS KNOWN ALREADY Some studies have applied deep learning and developed 'black-box' algorithms to predict embryo viability directly from microscope images and videos but these lack interpretability and generalizability. Other studies have developed deep learning networks to measure individual features of embryos but fail to conduct careful comparisons to embryologists' performance, which are fundamental to demonstrate the network's effectiveness. STUDY DESIGN, SIZE, DURATION We applied the BlastAssist pipeline to 67 043 973 images (32 939 embryos) recorded in the IVF lab from 2012 to 2017 in Tel Aviv Sourasky Medical Center. We first compared the pipeline measurements of individual images/embryos to manual measurements by human experts for sets of features, including: (i) fertilization status (n = 207 embryos), (ii) cell symmetry (n = 109 embryos), (iii) degree of fragmentation (n = 6664 images), and (iv) developmental timing (n = 21 036 images). We then conducted detailed comparisons between pipeline outputs and annotations made by embryologists during routine treatments for features, including: (i) fertilization status (n = 18 922 embryos), (ii) pronuclei (PN) fade time (n = 13 781 embryos), (iii) degree of fragmentation on Day 2 (n = 11 582 embryos), and (iv) time of blastulation (n = 3266 embryos). In addition, we compared the pipeline outputs to the implantation results of 723 single embryo transfer (SET) cycles, and to the live birth results of 3421 embryos transferred in 1801 cycles. PARTICIPANTS/MATERIALS, SETTING, METHODS In addition to EmbryoScope™ image data, manual embryo grading and annotations, and electronic health record (EHR) data on treatment outcomes were also included. We integrated the deep learning networks we developed for individual features to construct the BlastAssist pipeline. Pearson's χ2 test was used to evaluate the statistical independence of individual features and implantation success. Bayesian statistics was used to evaluate the association of the probability of an embryo resulting in live birth to BlastAssist inputs. MAIN RESULTS AND THE ROLE OF CHANCE The BlastAssist pipeline integrates five deep learning networks and measures comprehensive, interpretable, and quantitative features in clinical IVF. The pipeline performs similarly or better than manual measurements. For fertilization status, the network performs with very good parameters of specificity and sensitivity (area under the receiver operating characteristics (AUROC) 0.84-0.94). For symmetry score, the pipeline performs comparably to the human expert at both 2-cell (r = 0.71 ± 0.06) and 4-cell stages (r = 0.77 ± 0.07). For degree of fragmentation, the pipeline (acc = 69.4%) slightly under-performs compared to human experts (acc = 73.8%). For developmental timing, the pipeline (acc = 90.0%) performs similarly to human experts (acc = 91.4%). There is also strong agreement between pipeline outputs and annotations made by embryologists during routine treatments. For fertilization status, the pipeline and embryologists strongly agree (acc = 79.6%), and there is strong correlation between the two measurements (r = 0.683). For degree of fragmentation, the pipeline and embryologists mostly agree (acc = 55.4%), and there is also strong correlation between the two measurements (r = 0.648). For both PN fade time (r = 0.787) and time of blastulation (r = 0.887), there's strong correlation between the pipeline and embryologists. For SET cycles, 2-cell time (P < 0.01) and 2-cell symmetry (P < 0.03) are significantly correlated with implantation success rate, while other features showed correlations with implantation success without statistical significance. In addition, 2-cell time (P < 5 × 10-11), PN fade time (P < 5 × 10-10), degree of fragmentation on Day 3 (P < 5 × 10-4), and 2-cell symmetry (P < 5 × 10-3) showed statistically significant correlation with the probability of the transferred embryo resulting in live birth. LIMITATIONS, REASONS FOR CAUTION We have not tested the BlastAssist pipeline on data from other clinics or other time-lapse microscopy (TLM) systems. The association study we conducted with live birth results do not take into account confounding variables, which will be necessary to construct an embryo selection algorithm. Randomized controlled trials (RCT) will be necessary to determine whether the pipeline can improve success rates in clinical IVF. WIDER IMPLICATIONS OF THE FINDINGS BlastAssist provides a comprehensive and holistic means of evaluating human embryos. Instead of using a black-box algorithm, BlastAssist outputs meaningful measurements of embryos that can be interpreted and corroborated by embryologists, which is crucial in clinical decision making. Furthermore, the unprecedentedly large dataset generated by BlastAssist measurements can be used as a powerful resource for further research in human embryology and IVF. STUDY FUNDING/COMPETING INTEREST(S) This work was supported by Harvard Quantitative Biology Initiative, the NSF-Simons Center for Mathematical and Statistical Analysis of Biology at Harvard (award number 1764269), the National Institute of Heath (award number R01HD104969), the Perelson Fund, and the Sagol fund for embryos and stem cells as part of the Sagol Network. The authors declare no competing interests. TRIAL REGISTRATION NUMBER Not applicable.
Collapse
Affiliation(s)
- Helen Y Yang
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
- Department of Biophysics, Harvard Graduate School of Arts and Sciences, Cambridge, MA, USA
| | - Brian D Leahy
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
- Department of Applied Physics, Harvard School of Engineering and Applied Sciences, Cambridge, MA, USA
| | - Won-Dong Jang
- Department of Computer Science, Harvard School of Engineering and Applied Sciences, Cambridge, MA, USA
| | - Donglai Wei
- Department of Computer Science, Harvard School of Engineering and Applied Sciences, Cambridge, MA, USA
| | - Yael Kalma
- Department of Reproduction and IVF, Lis Maternity Hospital Tel-Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Roni Rahav
- Department of Reproduction and IVF, Lis Maternity Hospital Tel-Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Ariella Carmon
- Department of Reproduction and IVF, Lis Maternity Hospital Tel-Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Rotem Kopel
- Department of Reproduction and IVF, Lis Maternity Hospital Tel-Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Foad Azem
- Department of Reproduction and IVF, Lis Maternity Hospital Tel-Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Marta Venturas
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
| | - Colm P Kelleher
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
| | - Liz Cam
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
| | - Hanspeter Pfister
- Department of Computer Science, Harvard School of Engineering and Applied Sciences, Cambridge, MA, USA
| | - Daniel J Needleman
- Department of Molecular and Cellular Biology, Harvard University, Cambridge, MA, USA
- Department of Applied Physics, Harvard School of Engineering and Applied Sciences, Cambridge, MA, USA
| | - Dalit Ben-Yosef
- Department of Reproduction and IVF, Lis Maternity Hospital Tel-Aviv Sourasky Medical Center, Tel Aviv, Israel
- Department of Cell and Developmental Biology, Sackler Faculty of Medicine, Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
| |
Collapse
|
5
|
Chien CW, Tang YA, Jeng SL, Pan HA, Sun HS. Blastocyst telomere length predicts successful implantation after frozen-thawed embryo transfer. Hum Reprod Open 2024; 2024:hoae012. [PMID: 38515829 PMCID: PMC10955253 DOI: 10.1093/hropen/hoae012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Revised: 02/04/2024] [Indexed: 03/23/2024] Open
Abstract
STUDY QUESTION Do embryos with longer telomere length (TL) at the blastocyst stage have a higher capacity to survive after frozen-thawed embryo transfer (FET)? SUMMARY ANSWER Digitally estimated TL using low-pass whole genome sequencing (WGS) data from the preimplantation genetic testing for aneuploidy (PGT-A) process demonstrates that blastocyst TL is the most essential factor associated with likelihood of implantation. WHAT IS KNOWN ALREADY The lifetime TL is established in the early cleavage cycles following fertilization through a recombination-based lengthening mechanism and starts erosion beyond the blastocyst stage. In addition, a telomerase-mediated slow erosion of TL in human fetuses has been observed from a gestational age of 6-11 weeks. Finally, an abnormal shortening of telomeres is likely involved in embryo loss during early development. STUDY DESIGN SIZE DURATION Blastocyst samples were obtained from patients who underwent PGT-A and FET in an IVF center from March 2015 to May 2018. Digitally estimated mitochondrial copy number (mtCN) and TL were used to study associations with the implantation potential of each embryo. PARTICIPANTS/MATERIALS SETTING AND METHODS In total, 965 blastocysts from 232 cycles (164 patients) were available to investigate the biological and clinical relevance of TL. A WGS-based workflow was applied to determine the ploidy of each embryo. Data from low-pass WGS-PGT-A were used to estimate the mtCN and TL for each embryo. Single-variant and multi-variant logistic regression, decision tree, and random forest models were applied to study various factors in association with the implantation potential of each embryo. MAIN RESULTS AND THE ROLE OF CHANCE Of the 965 blastocysts originally available, only 216 underwent FET. While mtCN from the transferred embryos is significantly associated with the ploidy call of each embryo, mtCN has no role in impacting IVF outcomes after an embryo transfer in these women. The results indicate that mtCN is a marker of embryo aneuploidy. On the other hand, digitally estimated TL is the most prominent univariant factor and showed a significant positive association with pregnancy outcomes (P < 0.01, odds ratio 79.1). We combined several maternal and embryo parameters to study the joint effects on successful implantation. The machine learning models, namely decision tree and random forest, were trained and yielded classification accuracy of 0.82 and 0.91, respectively. Taken together, these results support the vital role of TL in governing implantation potential, perhaps through the ability to control embryo survival after transfer. LIMITATIONS REASONS FOR CAUTION The small sample size limits our study as only 216 blastocysts were transferred. The number was further reduced to 153 blastocysts, where pregnancy outcomes could be accurately traced. The other limitation of this study is that all data were collected from a single IVF center. The uniform and controlled operation of IVF cycles in a single center may cause selection bias. WIDER IMPLICATIONS OF THE FINDINGS We present novel findings to show that digitally estimated TL at the blastocyst stage is a predictor of pregnancy capacity after a FET cycle. As elective single-embryo transfer has become the mainstream direction in reproductive medicine, prioritizing embryos based on their implantation potential is crucial for clinical infertility treatment in order to reduce twin pregnancy rate and the time to pregnancy in an IVF center. The AI-powered, random forest prediction model established in this study thus provides a way to improve clinical practice and optimize the chances for people with fertility problems to achieve parenthood. STUDY FUNDING/COMPETING INTERESTS This study was supported by a grant from the National Science and Technology Council, Taiwan (MOST 108-2321-B-006-013 -). There were no competing interests. TRIAL REGISTRATION NUMBER N/A.
Collapse
Affiliation(s)
- Chun-Wei Chien
- Center for Genomic Medicine, Innovation Headquarters, National Cheng Kung University, Tainan, Taiwan
| | - Yen-An Tang
- Center for Genomic Medicine, Innovation Headquarters, National Cheng Kung University, Tainan, Taiwan
- Institute of Molecular Medicine, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Shuen-Lin Jeng
- Department of Statistics, Institute of Data Science, National Cheng Kung University, Tainan, Taiwan
- Center for Innovative FinTech Business Models, National Cheng Kung University, Tainan, Taiwan
| | - Hsien-An Pan
- IVF center, An-An Women and Children Clinic, Tainan, Taiwan
- Department of Obstetrics and Gynecology, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - H Sunny Sun
- Center for Genomic Medicine, Innovation Headquarters, National Cheng Kung University, Tainan, Taiwan
- Institute of Molecular Medicine, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| |
Collapse
|
6
|
Lee CI, Huang CC, Lee TH, Chen HH, Cheng EH, Lin PY, Yu TN, Chen CI, Chen CH, Lee MS. Associations between the artificial intelligence scoring system and live birth outcomes in preimplantation genetic testing for aneuploidy cycles. Reprod Biol Endocrinol 2024; 22:12. [PMID: 38233926 PMCID: PMC10792866 DOI: 10.1186/s12958-024-01185-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 01/12/2024] [Indexed: 01/19/2024] Open
Abstract
BACKGROUND Several studies have demonstrated that iDAScore is more accurate in predicting pregnancy outcomes in cycles without preimplantation genetic testing for aneuploidy (PGT-A) compared to KIDScore and the Gardner criteria. However, the effectiveness of iDAScore in cycles with PGT-A has not been thoroughly investigated. Therefore, this study aims to assess the association between artificial intelligence (AI)-based iDAScore (version 1.0) and pregnancy outcomes in single-embryo transfer (SET) cycles with PGT-A. METHODS This retrospective study was approved by the Institutional Review Board of Chung Sun Medical University, Taichung, Taiwan. Patients undergoing SET cycles (n = 482) following PGT-A at a single reproductive center between January 2017 and June 2021. The blastocyst morphology and morphokinetics of all embryos were evaluated using a time-lapse system. The blastocysts were ranked based on the scores generated by iDAScore, which were defined as AI scores, or by KIDScore D5 (version 3.2) following the manufacturer's protocols. A single blastocyst without aneuploidy was transferred after examining the embryonic ploidy status using a next-generation sequencing-based PGT-A platform. Logistic regression analysis with generalized estimating equations was conducted to assess whether AI scores are associated with the probability of live birth (LB) while considering confounding factors. RESULTS Logistic regression analysis revealed that AI score was significantly associated with LB probability (adjusted odds ratio [OR] = 2.037, 95% confidence interval [CI]: 1.632-2.542) when pulsatility index (PI) level and types of chromosomal abnormalities were controlled. Blastocysts were divided into quartiles in accordance with their AI score (group 1: 3.0-7.8; group 2: 7.9-8.6; group 3: 8.7-8.9; and group 4: 9.0-9.5). Group 1 had a lower LB rate (34.6% vs. 59.8-72.3%) and a higher rate of pregnancy loss (26% vs. 4.7-8.9%) compared with the other groups (p < 0.05). The receiver operating characteristic curve analysis verified that the iDAScore had a significant but limited ability to predict LB (area under the curve [AUC] = 0.64); this ability was significantly weaker than that of the combination of iDAScore, type of chromosomal abnormalities, and PI level (AUC = 0.67). In the comparison of the LB groups with the non-LB groups, the AI scores were significantly lower in the non-LB groups, both for euploid (median: 8.6 vs. 8.8) and mosaic (median: 8.0 vs. 8.6) SETs. CONCLUSIONS Although its predictive ability can be further enhanced, the AI score was significantly associated with LB probability in SET cycles. Euploid or mosaic blastocysts with low AI scores (≤ 7.8) were associated with a lower LB rate, indicating the potential of this annotation-free AI system as a decision-support tool for deselecting embryos with poor pregnancy outcomes following PGT-A.
Collapse
Affiliation(s)
- Chun-I Lee
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
- Department of Obstetrics and Gynecology, Chung Shan Medical University Hospital, Taichung, Taiwan
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan
| | - Chun-Chia Huang
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan
| | - Tsung-Hsien Lee
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
- Department of Obstetrics and Gynecology, Chung Shan Medical University Hospital, Taichung, Taiwan
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan
| | - Hsiu-Hui Chen
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan
| | - En-Hui Cheng
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan
| | - Pin-Yao Lin
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan
| | - Tzu-Ning Yu
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | - Chung-I Chen
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | - Chien-Hong Chen
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan.
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan.
| | - Maw-Sheng Lee
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan.
- Department of Obstetrics and Gynecology, Chung Shan Medical University Hospital, Taichung, Taiwan.
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan.
- Department of Post-Baccalaureate Medicine, National Chung Hsing University, Taichung, Taiwan.
| |
Collapse
|
7
|
Jiang VS, Pavlovic ZJ, Hariton E. The Role of Artificial Intelligence and Machine Learning in Assisted Reproductive Technologies. Obstet Gynecol Clin North Am 2023; 50:747-762. [PMID: 37914492 DOI: 10.1016/j.ogc.2023.09.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2023]
Abstract
Artificial intelligence (AI) and machine learning, the form most commonly used in medicine, offer powerful tools utilizing the strengths of large data sets and intelligent algorithms. These systems can help to revolutionize delivery of treatments, access to medical care, and improvement of outcomes, particularly in the realm of reproductive medicine. Whether that is more robust oocyte and embryo grading or more accurate follicular measurement, AI will be able to aid clinicians, and most importantly patients, in providing the best possible and individualized care. However, despite all of the potential strengths of AI, algorithms are not immune to bias and are vulnerable to the many socioeconomic and demographic biases that current healthcare systems suffer from. Wrong diagnoses as well is furthering of healthcare discrimination are real possibilities if both the capabilities and limitations of AI are not well understood. Armed with appropriate knowledge of how AI can most appropriately operate within medicine, and specifically reproductive medicine, will enable clinicians to both create and utilize machine learning-based innovations for the furthering of reproductive medicine and ultimately achieving the goal of building of healthy families.
Collapse
Affiliation(s)
- Victoria S Jiang
- Division of Reproductive Endocrinology & Infertility, Vincent Department of Obstetrics and Gynecology, Massachusetts General Hospital/Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02116, USA
| | - Zoran J Pavlovic
- Department of Obstetrics and Gynecology/Reproductive Endocrinology and Infertility, University of South Florida, Morsani College of Medicine, 2 Tampa General Circle, 6th Floor, Suite 6022, Tampa, FL 33602, USA
| | - Eduardo Hariton
- Reproductive Science Center of the San Francisco Bay Area, 100 Park Place #200, San Ramon, CA 94583, USA.
| |
Collapse
|
8
|
Yuan G, Lv B, Hao C. Application of artificial neural networks in reproductive medicine. HUM FERTIL 2023; 26:1195-1201. [PMID: 36628627 DOI: 10.1080/14647273.2022.2156301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Accepted: 09/01/2022] [Indexed: 01/12/2023]
Abstract
With the emergence of the age of information, the data on reproductive medicine has improved immensely. Nonetheless, healthcare workers who wish to utilise the relevance and implied value of the various data available to aid clinical decision-making encounter the difficulty of statistically analysing such large data. The application of artificial intelligence becoming widespread in recent years has emerged as a turning point in this regard. Artificial neural networks (ANNs) exhibit beneficial characteristics of comprehensive analysis and autonomous learning, owing to which these are being applied to disease diagnosis, embryo quality assessment, and prediction of pregnancy outcomes. The present report aims to summarise the application of ANNs in the field of reproduction and analyse its further application potential.
Collapse
Affiliation(s)
- Guanghui Yuan
- Department of Qingdao Medical College, Qingdao University, Qingdao, Shandong, China
| | - Bohan Lv
- Department of Intensive Care Unit, The Affiliated Hospital of Qingdao University, Qingdao, Shandong, China
| | - Cuifang Hao
- Department of Reproductive Medicine, The Affiliated Women and Children's Hospital of Qingdao University, Qingdao, Shandong, China
| |
Collapse
|
9
|
Berman A, Anteby R, Efros O, Klang E, Soffer S. Deep learning for embryo evaluation using time-lapse: a systematic review of diagnostic test accuracy. Am J Obstet Gynecol 2023; 229:490-501. [PMID: 37116822 DOI: 10.1016/j.ajog.2023.04.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Revised: 03/28/2023] [Accepted: 04/19/2023] [Indexed: 04/30/2023]
Abstract
OBJECTIVE This study aimed to investigate the accuracy of convolutional neural network models in the assessment of embryos using time-lapse monitoring. DATA SOURCES A systematic search was conducted in PubMed and Web of Science databases from January 2016 to December 2022. The search strategy was carried out by using key words and MeSH (Medical Subject Headings) terms. STUDY ELIGIBILITY CRITERIA Studies were included if they reported the accuracy of convolutional neural network models for embryo evaluation using time-lapse monitoring. The review was registered with PROSPERO (International Prospective Register of Systematic Reviews; identification number CRD42021275916). METHODS Two reviewer authors independently screened results using the Covidence systematic review software. The full-text articles were reviewed when studies met the inclusion criteria or in any uncertainty. Nonconsensus was resolved by a third reviewer. Risk of bias and applicability were evaluated using the QUADAS-2 tool and the modified Joanna Briggs Institute or JBI checklist. RESULTS Following a systematic search of the literature, 22 studies were identified as eligible for inclusion. All studies were retrospective. A total of 522,516 images of 222,998 embryos were analyzed. Three main outcomes were evaluated: successful in vitro fertilization, blastocyst stage classification, and blastocyst quality. Most studies reported >80% accuracy, and embryologists were outperformed in some. Ten studies had a high risk of bias, mostly because of patient bias. CONCLUSION The application of artificial intelligence in time-lapse monitoring has the potential to provide more efficient, accurate, and objective embryo evaluation. Models that examined blastocyst stage classification showed the best predictions. Models that predicted live birth had a low risk of bias, used the largest databases, and had external validation, which heightens their relevance to clinical application. Our systematic review is limited by the high heterogeneity among the included studies. Researchers should share databases and standardize reporting.
Collapse
Affiliation(s)
- Aya Berman
- Faculty of Health Sciences, Ben-Gurion University of the Negev, Be'er Sheva, Israel.
| | - Roi Anteby
- Department of Surgery and Transplantation B, Chaim Sheba Medical Center, Tel Hashomer, Israel; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Orly Efros
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; National Hemophilia Center and Institute of Thrombosis & Hemostasis, Chaim Sheba Medical Center, Tel Hashomer, Israel
| | - Eyal Klang
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Institute for Health Care Delivery Science, Department of Population Health Science and Policy, Icahn School of Medicine at Mount Sinai, New York, NY; Deep Vision Lab, Chaim Sheba Medical Center, Ramat Gan, Israel; Division of Diagnostic Imaging, Chaim Sheba Medical Center, Tel Hashomer, Israel
| | - Shelly Soffer
- Deep Vision Lab, Chaim Sheba Medical Center, Ramat Gan, Israel; Internal Medicine B, Assuta Medical Center, Ashdod, Israel; Ben-Gurion University of the Negev, Be'er Sheva, Israel
| |
Collapse
|
10
|
Si K, Huang B, Jin L. Application of artificial intelligence in gametes and embryos selection. HUM FERTIL 2023; 26:757-777. [PMID: 37705466 DOI: 10.1080/14647273.2023.2256980] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 07/22/2023] [Indexed: 09/15/2023]
Abstract
Gamete and embryo quality are critical to the success rate of Assisted Reproductive Technology (ART) cycles, but there remains a lack of methods to accurately measure the quality of sperm, oocytes and embryos. The ability of Artificial Intelligence (AI) technology to analyze large amounts of data, especially video and images, is particularly useful in gamete and embryo assessment and selection. The well-trained model has fast calculation speed and high accuracy, which can help embryologists to perform more objective gamete and embryo selection. Various artificial intelligence models have been developed for gamete and embryo assessment, some of which exhibit good performance. In this review, we summarize the latest applications of AI technology in semen analysis, as well as selection for sperm, oocyte and embryo, and discuss the existing problems and development directions of artificial intelligence in this field.
Collapse
Affiliation(s)
- Keyi Si
- Reproductive Medicine Center, Tongji Hospital, Tongji Medicine College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Bo Huang
- Reproductive Medicine Center, Tongji Hospital, Tongji Medicine College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| | - Lei Jin
- Reproductive Medicine Center, Tongji Hospital, Tongji Medicine College, Huazhong University of Science and Technology, Wuhan, People's Republic of China
| |
Collapse
|
11
|
Tzukerman N, Rotem O, Shapiro MT, Maor R, Meseguer M, Gilboa D, Seidman DS, Zaritsky A. Using Unlabeled Information of Embryo Siblings from the Same Cohort Cycle to Enhance In Vitro Fertilization Implantation Prediction. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2207711. [PMID: 37507828 PMCID: PMC10520665 DOI: 10.1002/advs.202207711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Revised: 07/03/2023] [Indexed: 07/30/2023]
Abstract
High-content time-lapse embryo imaging assessed by machine learning is revolutionizing the field of in vitro fertilization (IVF). However, the vast majority of IVF embryos are not transferred to the uterus, and these masses of embryos with unknown implantation outcomes are ignored in current efforts that aim to predict implantation. Here, whether, and to what extent the information encoded within "sibling" embryos from the same IVF cohort contributes to the performance of machine learning-based implantation prediction is explored. First, it is shown that the implantation outcome is correlated with attributes derived from the cohort siblings. Second, it is demonstrated that this unlabeled data boosts implantation prediction performance. Third, the cohort properties driving embryo prediction, especially those that rescued erroneous predictions, are characterized. The results suggest that predictive models for embryo implantation can benefit from the overlooked, widely available unlabeled data of sibling embryos by reducing the inherent noise of the individual transferred embryo.
Collapse
Affiliation(s)
- Noam Tzukerman
- Department of Software and Information Systems EngineeringBen‐Gurion University of the NegevBeer‐Sheva84105Israel
| | - Oded Rotem
- Department of Software and Information Systems EngineeringBen‐Gurion University of the NegevBeer‐Sheva84105Israel
| | | | - Ron Maor
- Research DivisionAIVF Ltd.Tel Aviv69271Israel
| | - Marcos Meseguer
- IVI FoundationInstituto de Investigación Sanitaria La FeValencia46026Spain
- Department of Reproductive MedicineIVIRMAValencia46015ValenciaSpain
| | | | - Daniel S. Seidman
- Research DivisionAIVF Ltd.Tel Aviv69271Israel
- The Sackler Faculty of MedicineTel‐Aviv UniversityTel‐Aviv69978Israel
| | - Assaf Zaritsky
- Department of Software and Information Systems EngineeringBen‐Gurion University of the NegevBeer‐Sheva84105Israel
| |
Collapse
|
12
|
Salih M, Austin C, Warty RR, Tiktin C, Rolnik DL, Momeni M, Rezatofighi H, Reddy S, Smith V, Vollenhoven B, Horta F. Embryo selection through artificial intelligence versus embryologists: a systematic review. Hum Reprod Open 2023; 2023:hoad031. [PMID: 37588797 PMCID: PMC10426717 DOI: 10.1093/hropen/hoad031] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 07/17/2023] [Indexed: 08/18/2023] Open
Abstract
STUDY QUESTION What is the present performance of artificial intelligence (AI) decision support during embryo selection compared to the standard embryo selection by embryologists? SUMMARY ANSWER AI consistently outperformed the clinical teams in all the studies focused on embryo morphology and clinical outcome prediction during embryo selection assessment. WHAT IS KNOWN ALREADY The ART success rate is ∼30%, with a worrying trend of increasing female age correlating with considerably worse results. As such, there have been ongoing efforts to address this low success rate through the development of new technologies. With the advent of AI, there is potential for machine learning to be applied in such a manner that areas limited by human subjectivity, such as embryo selection, can be enhanced through increased objectivity. Given the potential of AI to improve IVF success rates, it remains crucial to review the performance between AI and embryologists during embryo selection. STUDY DESIGN SIZE DURATION The search was done across PubMed, EMBASE, Ovid Medline, and IEEE Xplore from 1 June 2005 up to and including 7 January 2022. Included articles were also restricted to those written in English. Search terms utilized across all databases for the study were: ('Artificial intelligence' OR 'Machine Learning' OR 'Deep learning' OR 'Neural network') AND ('IVF' OR 'in vitro fertili*' OR 'assisted reproductive techn*' OR 'embryo'), where the character '*' refers the search engine to include any auto completion of the search term. PARTICIPANTS/MATERIALS SETTING METHODS A literature search was conducted for literature relating to AI applications to IVF. Primary outcomes of interest were accuracy, sensitivity, and specificity of the embryo morphology grade assessments and the likelihood of clinical outcomes, such as clinical pregnancy after IVF treatments. Risk of bias was assessed using the Modified Down and Black Checklist. MAIN RESULTS AND THE ROLE OF CHANCE Twenty articles were included in this review. There was no specific embryo assessment day across the studies-Day 1 until Day 5/6 of embryo development was investigated. The types of input for training AI algorithms were images and time-lapse (10/20), clinical information (6/20), and both images and clinical information (4/20). Each AI model demonstrated promise when compared to an embryologist's visual assessment. On average, the models predicted the likelihood of successful clinical pregnancy with greater accuracy than clinical embryologists, signifying greater reliability when compared to human prediction. The AI models performed at a median accuracy of 75.5% (range 59-94%) on predicting embryo morphology grade. The correct prediction (Ground Truth) was defined through the use of embryo images according to post embryologists' assessment following local respective guidelines. Using blind test datasets, the embryologists' accuracy prediction was 65.4% (range 47-75%) with the same ground truth provided by the original local respective assessment. Similarly, AI models had a median accuracy of 77.8% (range 68-90%) in predicting clinical pregnancy through the use of patient clinical treatment information compared to 64% (range 58-76%) when performed by embryologists. When both images/time-lapse and clinical information inputs were combined, the median accuracy by the AI models was higher at 81.5% (range 67-98%), while clinical embryologists had a median accuracy of 51% (range 43-59%). LIMITATIONS REASONS FOR CAUTION The findings of this review are based on studies that have not been prospectively evaluated in a clinical setting. Additionally, a fair comparison of all the studies were deemed unfeasible owing to the heterogeneity of the studies, development of the AI models, database employed and the study design and quality. WIDER IMPLICATIONS OF THE FINDINGS AI provides considerable promise to the IVF field and embryo selection. However, there needs to be a shift in developers' perception of the clinical outcome from successful implantation towards ongoing pregnancy or live birth. Additionally, existing models focus on locally generated databases and many lack external validation. STUDY FUNDING/COMPETING INTERESTS This study was funded by Monash Data Future Institute. All authors have no conflicts of interest to declare. REGISTRATION NUMBER CRD42021256333.
Collapse
Affiliation(s)
- M Salih
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
- Department of Data Science and Artificial Intelligence, Faculty of Information Technology, Monash University, Clayton, Victoria, Australia
| | - C Austin
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
- Department of Data Science and Artificial Intelligence, Faculty of Information Technology, Monash University, Clayton, Victoria, Australia
| | - R R Warty
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
| | - C Tiktin
- School of Engineering, RMIT University, Melbourne, Victoria, Australia
| | - D L Rolnik
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
- Women’s and Newborn Program, Monash Health, Melbourne, Victoria, Australia
| | - M Momeni
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
| | - H Rezatofighi
- Department of Data Science and Artificial Intelligence, Faculty of Information Technology, Monash University, Clayton, Victoria, Australia
- Monash Data Future Institute, Monash University, Clayton, Victoria, Australia
| | - S Reddy
- School of Medicine, Deakin University, Geelong, Victoria, Australia
| | - V Smith
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
| | - B Vollenhoven
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
- Women’s and Newborn Program, Monash Health, Melbourne, Victoria, Australia
- Monash IVF, Melbourne, Victoria, Australia
| | - F Horta
- Department of Obstetrics and Gynaecology, Monash University, Clayton, Victoria, Australia
- Monash Data Future Institute, Monash University, Clayton, Victoria, Australia
- City Fertility, Melbourne, Victoria, Australia
| |
Collapse
|
13
|
Paya E, Pulgarín C, Bori L, Colomer A, Naranjo V, Meseguer M. Deep learning system for classification of ploidy status using time-lapse videos. F&S SCIENCE 2023; 4:211-218. [PMID: 37394179 DOI: 10.1016/j.xfss.2023.06.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 06/27/2023] [Accepted: 06/27/2023] [Indexed: 07/04/2023]
Abstract
OBJECTIVE To develop a spatiotemporal model for de prediction of euploid and aneuploid embryos using time-lapse videos from 10-115 hours after insemination (hpi). DESIGN Retrospective study. MAIN OUTCOME MEASURES The research used an end-to-end approach to develop an automated artificial intelligence system capable of extracting features from images and classifying them, considering spatiotemporal dependencies. A convolutional neural network extracted the most relevant features from each video frame. A bidirectional long short-term memory layer received this information and analyzed the temporal dependencies, obtaining a low-dimensional feature vector that characterized each video. A multilayer perceptron classified them into 2 groups, euploid and noneuploid. RESULTS The model performance in accuracy fell between 0.6170 and 0.7308. A multi-input model with a gate recurrent unit module performed better than others; the precision (or positive predictive value) is 0.8205 for predicting euploidy. Sensitivity, specificity, F1-Score and accuracy are 0.6957, 0.7813, 0.7042, and 0.7308, respectively. CONCLUSIONS This article proposes an artificial intelligence solution for prioritizing euploid embryo transfer. We can highlight the identification of a noninvasive method for chromosomal status diagnosis using a deep learning approach that analyzes raw data provided by time-lapse incubators. This method demonstrated potential automation of the evaluation process, allowing spatial and temporal information to encode.
Collapse
Affiliation(s)
- Elena Paya
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politècnica de Valencia, Spain; IVIRMA Valencia, Spain.
| | - Cristian Pulgarín
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politècnica de Valencia, Spain
| | | | - Adrián Colomer
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politècnica de Valencia, Spain
| | - Valery Naranjo
- Instituto de Investigación e Innovación en Bioingeniería (I3B), Universitat Politècnica de Valencia, Spain
| | - Marcos Meseguer
- IVIRMA Valencia, Spain; Health Research Institute la Fe, Valencia, Spain
| |
Collapse
|
14
|
Stafie CS, Sufaru IG, Ghiciuc CM, Stafie II, Sufaru EC, Solomon SM, Hancianu M. Exploring the Intersection of Artificial Intelligence and Clinical Healthcare: A Multidisciplinary Review. Diagnostics (Basel) 2023; 13:1995. [PMID: 37370890 DOI: 10.3390/diagnostics13121995] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2023] [Revised: 05/31/2023] [Accepted: 06/05/2023] [Indexed: 06/29/2023] Open
Abstract
Artificial intelligence (AI) plays a more and more important role in our everyday life due to the advantages that it brings when used, such as 24/7 availability, a very low percentage of errors, ability to provide real time insights, or performing a fast analysis. AI is increasingly being used in clinical medical and dental healthcare analyses, with valuable applications, which include disease diagnosis, risk assessment, treatment planning, and drug discovery. This paper presents a narrative literature review of AI use in healthcare from a multi-disciplinary perspective, specifically in the cardiology, allergology, endocrinology, and dental fields. The paper highlights data from recent research and development efforts in AI for healthcare, as well as challenges and limitations associated with AI implementation, such as data privacy and security considerations, along with ethical and legal concerns. The regulation of responsible design, development, and use of AI in healthcare is still in early stages due to the rapid evolution of the field. However, it is our duty to carefully consider the ethical implications of implementing AI and to respond appropriately. With the potential to reshape healthcare delivery and enhance patient outcomes, AI systems continue to reveal their capabilities.
Collapse
Affiliation(s)
- Celina Silvia Stafie
- Department of Preventive Medicine and Interdisciplinarity, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Irina-Georgeta Sufaru
- Department of Periodontology, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Cristina Mihaela Ghiciuc
- Department of Morpho-Functional Sciences II-Pharmacology and Clinical Pharmacology, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Ingrid-Ioana Stafie
- Endocrinology Residency Program, Sf. Spiridon Clinical Emergency Hospital, Independentei 1, 700111 Iasi, Romania
| | | | - Sorina Mihaela Solomon
- Department of Periodontology, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| | - Monica Hancianu
- Pharmacognosy-Phytotherapy, Grigore T. Popa University of Medicine and Pharmacy Iasi, Universitatii Street 16, 700115 Iasi, Romania
| |
Collapse
|
15
|
Kromp F, Wagner R, Balaban B, Cottin V, Cuevas-Saiz I, Schachner C, Fancsovits P, Fawzy M, Fischer L, Findikli N, Kovačič B, Ljiljak D, Martínez-Rodero I, Parmegiani L, Shebl O, Min X, Ebner T. An annotated human blastocyst dataset to benchmark deep learning architectures for in vitro fertilization. Sci Data 2023; 10:271. [PMID: 37169791 PMCID: PMC10175281 DOI: 10.1038/s41597-023-02182-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 04/25/2023] [Indexed: 05/13/2023] Open
Abstract
Medical Assisted Reproduction proved its efficacy to treat the vast majority forms of infertility. One of the key procedures in this treatment is the selection and transfer of the embryo with the highest developmental potential. To assess this potential, clinical embryologists routinely work with static images (morphological assessment) or short video sequences (time-lapse annotation). Recently, Artificial Intelligence models were utilized to support the embryo selection procedure. Even though they have proven their great potential in different in vitro fertilization settings, there is still considerable room for improvement. To support the advancement of algorithms in this research field, we built a dataset consisting of static blastocyst images and additional annotations. As such, Gardner criteria annotations, depicting a morphological blastocyst rating scheme, and collected clinical parameters are provided. The presented dataset is intended to be used to train deep learning models on static morphological images to predict Gardner's criteria and clinical outcomes such as live birth. A benchmark of human expert's performance in annotating Gardner criteria is provided.
Collapse
Affiliation(s)
- Florian Kromp
- Software Competence Center Hagenberg, Data Science, Hagenberg, Austria.
| | - Raphael Wagner
- Software Competence Center Hagenberg, Data Science, Hagenberg, Austria
| | - Basak Balaban
- American Hospital of Istanbul, In vitro fertilization lab, Istanbul, Turkey
| | - Véronique Cottin
- Viollier AG, Assisted Reproduction Technologies, Basel, Switzerland
| | - Irene Cuevas-Saiz
- Hospital General Universitario de Valencia, In vitro fertilization lab, Valencia, Spain
| | - Clara Schachner
- Software Competence Center Hagenberg, Data Science, Hagenberg, Austria
| | - Peter Fancsovits
- Semmelweis University, Department of Obstetrics and Gynecology, Division of Assisted Reproduction, Budapest, Hungary
| | - Mohamed Fawzy
- IbnSina and Banon IVF Centers, In vitro fertilization lab, Sohag, Egypt
| | - Lukas Fischer
- Software Competence Center Hagenberg, Data Science, Hagenberg, Austria
| | - Necati Findikli
- Bahceci Fulya IVF Centre Istanbul, In vitro fertilization lab, Istanbul, Turkey
| | - Borut Kovačič
- University Medical Centre Maribor, Department of Reproductive Medicine and Gynecological Endocrinology, Maribor, Slovenia
| | - Dejan Ljiljak
- Sestre Milosrdnice University Hospital Center, Department of Gynecology and Obstetrics, Zagreb, Croatia
| | - Iris Martínez-Rodero
- Universitat Autònoma de Barcelona, Laboratori de Fecundació In Vitro, Barcelona, Spain
| | | | - Omar Shebl
- Kepler University Linz, Department of Gynecology, Obstetrics and Gynecological Endocrinology, Linz, Austria
| | - Xie Min
- University Hospital Zurich, Department of Reproductive Endocrinology, Zurich, Switzerland
| | - Thomas Ebner
- Kepler University Linz, Department of Gynecology, Obstetrics and Gynecological Endocrinology, Linz, Austria
| |
Collapse
|
16
|
Theilgaard Lassen J, Fly Kragh M, Rimestad J, Nygård Johansen M, Berntsen J. Development and validation of deep learning based embryo selection across multiple days of transfer. Sci Rep 2023; 13:4235. [PMID: 36918648 PMCID: PMC10015019 DOI: 10.1038/s41598-023-31136-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 03/07/2023] [Indexed: 03/16/2023] Open
Abstract
This work describes the development and validation of a fully automated deep learning model, iDAScore v2.0, for the evaluation of human embryos incubated for 2, 3, and 5 or more days. We trained and evaluated the model on an extensive and diverse dataset including 181,428 embryos from 22 IVF clinics across the world. To discriminate the transferred embryos with known outcome, we show areas under the receiver operating curve ranging from 0.621 to 0.707 depending on the day of transfer. Predictive performance increased over time and showed a strong correlation with morphokinetic parameters. The model's performance is equivalent to the KIDScore D3 model on day 3 embryos while it significantly surpasses the performance of KIDScore D5 v3 on day 5+ embryos. This model provides an analysis of time-lapse sequences without the need for user input, and provides a reliable method for ranking embryos for their likelihood of implantation, at both cleavage and blastocyst stages. This greatly improves embryo grading consistency and saves time compared to traditional embryo evaluation methods.
Collapse
|
17
|
Wang B, Li Y, Zhou M, Han Y, Zhang M, Gao Z, Liu Z, Chen P, Du W, Zhang X, Feng X, Liu BF. Smartphone-based platforms implementing microfluidic detection with image-based artificial intelligence. Nat Commun 2023; 14:1341. [PMID: 36906581 PMCID: PMC10007670 DOI: 10.1038/s41467-023-36017-x] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 01/10/2023] [Indexed: 03/13/2023] Open
Abstract
The frequent outbreak of global infectious diseases has prompted the development of rapid and effective diagnostic tools for the early screening of potential patients in point-of-care testing scenarios. With advances in mobile computing power and microfluidic technology, the smartphone-based mobile health platform has drawn significant attention from researchers developing point-of-care testing devices that integrate microfluidic optical detection with artificial intelligence analysis. In this article, we summarize recent progress in these mobile health platforms, including the aspects of microfluidic chips, imaging modalities, supporting components, and the development of software algorithms. We document the application of mobile health platforms in terms of the detection objects, including molecules, viruses, cells, and parasites. Finally, we discuss the prospects for future development of mobile health platforms.
Collapse
Affiliation(s)
- Bangfeng Wang
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Yiwei Li
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Mengfan Zhou
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Yulong Han
- School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA
| | - Mingyu Zhang
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Zhaolong Gao
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Zetai Liu
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Peng Chen
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Wei Du
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Xingcai Zhang
- School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, 02138, USA.
| | - Xiaojun Feng
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China.
| | - Bi-Feng Liu
- The Key Laboratory for Biomedical Photonics of MOE at Wuhan National Laboratory for Optoelectronics - Hubei Bioinformatics & Molecular Imaging Key Laboratory, Systems Biology Theme, Department of Biomedical Engineering, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China.
| |
Collapse
|
18
|
Curchoe CL. Proceedings of the first world conference on AI in fertility. J Assist Reprod Genet 2023; 40:215-222. [PMID: 36598733 PMCID: PMC9935785 DOI: 10.1007/s10815-022-02704-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 12/22/2022] [Indexed: 01/05/2023] Open
|
19
|
Cherouveim P, Jiang VS, Kanakasabapathy MK, Thirumalaraju P, Souter I, Dimitriadis I, Bormann CL, Shafiee H. Quality assurance (QA) for monitoring the performance of assisted reproductive technology (ART) staff using artificial intelligence (AI). J Assist Reprod Genet 2023; 40:241-249. [PMID: 36374394 PMCID: PMC9935795 DOI: 10.1007/s10815-022-02649-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 10/20/2022] [Indexed: 11/16/2022] Open
Abstract
PURPOSE Deep learning neural networks have been used to predict the developmental fate and implantation potential of embryos with high accuracy. Such networks have been used as an assistive quality assurance (QA) tool to identify perturbations in the embryo culture environment which may impact clinical outcomes. The present study aimed to evaluate the utility of an AI-QA tool to consistently monitor ART staff performance (MD and embryologist) in embryo transfer (ET), embryo vitrification (EV), embryo warming (EW), and trophectoderm biopsy (TBx). METHODS Pregnancy outcomes from groups of 20 consecutive elective single day 5 blastocyst transfers were evaluated for the following procedures: MD performed ET (N = 160 transfers), embryologist performed ET (N = 160 transfers), embryologist performed EV (N = 160 vitrification procedures), embryologist performed EW (N = 160 warming procedures), and embryologist performed TBx (N = 120 biopsies). AI-generated implantation probabilities for the same embryo cohorts were estimated, as were mean AI-predicted and actual implantation rates for each provider and compared using Wilcoxon singed-rank test. RESULTS Actual implantation rates following ET performed by one MD provider: "H" was significantly lower than AI-predicted (20% vs. 61%, p = 0.001). Similar results were observed for one embryologist, "H" (30% vs. 60%, p = 0.011). Embryos thawed by embryologist "H" had lower implantation rates compared to AI prediction (25% vs. 60%, p = 0.004). There were no significant differences between actual and AI-predicted implantation rates for EV, TBx, or for the rest of the clinical staff performing ET or EW. CONCLUSIONS AI-based QA tools could provide accurate, reproducible, and efficient staff performance monitoring in an ART practice.
Collapse
Affiliation(s)
- Panagiotis Cherouveim
- Division of Reproductive Endocrinology and Infertility, Vincent Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA, 02114, USA
| | - Victoria S Jiang
- Division of Reproductive Endocrinology and Infertility, Vincent Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA, 02114, USA
| | - Manoj Kumar Kanakasabapathy
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA
| | - Prudhvi Thirumalaraju
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA
| | - Irene Souter
- Division of Reproductive Endocrinology and Infertility, Vincent Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA, 02114, USA
| | - Irene Dimitriadis
- Division of Reproductive Endocrinology and Infertility, Vincent Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA, 02114, USA
| | - Charles L Bormann
- Division of Reproductive Endocrinology and Infertility, Vincent Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA, 02114, USA
| | - Hadi Shafiee
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA.
| |
Collapse
|
20
|
Kato K, Ueno S, Berntsen J, Kragh MF, Okimura T, Kuroda T. Does embryo categorization by existing artificial intelligence, morphokinetic or morphological embryo selection models correlate with blastocyst euploidy rates? Reprod Biomed Online 2023; 46:274-281. [PMID: 36470714 DOI: 10.1016/j.rbmo.2022.09.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 08/28/2022] [Accepted: 09/12/2022] [Indexed: 02/07/2023]
Abstract
RESEARCH QUESTION Does embryo categorization by existing artificial intelligence (AI), morphokinetic or morphological embryo selection models correlate with blastocyst euploidy? DESIGN A total of 834 patients (mean maternal age 40.5 ± 3.4 years) who underwent preimplantation genetic testing for aneuploidies (PGT-A) on a total of 3573 tested blastocysts were included in this retrospective study. The cycles were stratified into five maternal age groups according to the Society for Assisted Reproductive Technology age groups (<35, 35-37, 38-40, 41-42 and >42 years). The main outcome of this study was the correlation of euploidy rates in stratified maternal age groups and an automated AI model (iDAScore® v1.0), a morphokinetic embryo selection model (KIDScore Day 5 ver 3, KS-D5) and a traditional morphological grading model (Gardner criteria), respectively. RESULTS Euploidy rates were significantly correlated with iDAScore (P = 0.0035 to <0.001) in all age groups, and expect for the youngest age group, with KS-D5 and Gardner criteria (all P < 0.0001). Additionally, multivariate logistic regression analysis showed that for all models, higher scores were significantly correlated with euploidy (all P < 0.0001). CONCLUSION These results show that existing blastocyst scoring models correlate with ploidy status. However, as these models were developed to indicate implantation potential, they cannot accurately diagnose if an embryo is euploid or aneuploid. Instead, they may be used to support the decision of how many and which blastocysts to biopsy, thus potentially reducing patient costs.
Collapse
Affiliation(s)
- Keiichi Kato
- Kato Ladies Clinic, 7-20-3, Nishishinjuku, Shinjuku Tokyo 160-0023, Japan.
| | - Satoshi Ueno
- Kato Ladies Clinic, 7-20-3, Nishishinjuku, Shinjuku Tokyo 160-0023, Japan
| | | | | | - Tadashi Okimura
- Kato Ladies Clinic, 7-20-3, Nishishinjuku, Shinjuku Tokyo 160-0023, Japan
| | - Tomoko Kuroda
- Kato Ladies Clinic, 7-20-3, Nishishinjuku, Shinjuku Tokyo 160-0023, Japan
| |
Collapse
|
21
|
Jiang VS, Kandula H, Thirumalaraju P, Kanakasabapathy MK, Cherouveim P, Souter I, Dimitriadis I, Bormann CL, Shafiee H. The use of voting ensembles to improve the accuracy of deep neural networks as a non-invasive method to predict embryo ploidy status. J Assist Reprod Genet 2023; 40:301-308. [PMID: 36640251 PMCID: PMC9935776 DOI: 10.1007/s10815-022-02707-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 12/23/2022] [Indexed: 01/15/2023] Open
Abstract
PURPOSE To determine if creating voting ensembles combining convolutional neural networks (CNN), support vector machine (SVM), and multi-layer neural networks (NN) alongside clinical parameters improves the accuracy of artificial intelligence (AI) as a non-invasive method for predicting aneuploidy. METHODS A cohort of 699 day 5 PGT-A tested blastocysts was used to train, validate, and test a CNN to classify embryos as euploid/aneuploid. All embryos were analyzed using a modified FAST-SeqS next-generation sequencing method. Patient characteristics such as maternal age, AMH level, paternal sperm quality, and total number of normally fertilized (2PN) embryos were processed using SVM and NN. To improve model performance, we created voting ensembles using CNN, SVM, and NN to combine our imaging data with clinical parameter variations. Statistical significance was evaluated with a one-sample t-test with 2 degrees of freedom. RESULTS When assessing blastocyst images alone, the CNN test accuracy was 61.2% (± 1.32% SEM, n = 3 models) in correctly classifying euploid/aneuploid embryos (n = 140 embryos). When the best CNN model was assessed as a voting ensemble, the test accuracy improved to 65.0% (AMH; p = 0.1), 66.4% (maternal age; p = 0.06), 65.7% (maternal age, AMH; p = 0.08), 66.4% (maternal age, AMH, number of 2PNs; p = 0.06), and 71.4% (maternal age, AMH, number of 2PNs, sperm quality; p = 0.02) (n = 140 embryos). CONCLUSIONS By combining CNNs with patient characteristics, voting ensembles can be created to improve the accuracy of classifying embryos as euploid/aneuploid from CNN alone, allowing for AI to serve as a potential non-invasive method to aid in karyotype screening and selection of embryos.
Collapse
Affiliation(s)
- Victoria S Jiang
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, VincentBoston, MA, 02114, USA
| | - Hemanth Kandula
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA
| | - Prudhvi Thirumalaraju
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA
| | - Manoj Kumar Kanakasabapathy
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA
| | - Panagiotis Cherouveim
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, VincentBoston, MA, 02114, USA
| | - Irene Souter
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, VincentBoston, MA, 02114, USA
| | - Irene Dimitriadis
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, VincentBoston, MA, 02114, USA
| | - Charles L Bormann
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, VincentBoston, MA, 02114, USA.
| | - Hadi Shafiee
- Division of Engineering in Medicine, Brigham and Women's Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA, 02139, USA.
| |
Collapse
|
22
|
Barnes J, Brendel M, Gao VR, Rajendran S, Kim J, Li Q, Malmsten JE, Sierra JT, Zisimopoulos P, Sigaras A, Khosravi P, Meseguer M, Zhan Q, Rosenwaks Z, Elemento O, Zaninovic N, Hajirasouliha I. A non-invasive artificial intelligence approach for the prediction of human blastocyst ploidy: a retrospective model development and validation study. Lancet Digit Health 2023; 5:e28-e40. [PMID: 36543475 PMCID: PMC10193126 DOI: 10.1016/s2589-7500(22)00213-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 10/19/2022] [Accepted: 10/28/2022] [Indexed: 12/24/2022]
Abstract
BACKGROUND One challenge in the field of in-vitro fertilisation is the selection of the most viable embryos for transfer. Morphological quality assessment and morphokinetic analysis both have the disadvantage of intra-observer and inter-observer variability. A third method, preimplantation genetic testing for aneuploidy (PGT-A), has limitations too, including its invasiveness and cost. We hypothesised that differences in aneuploid and euploid embryos that allow for model-based classification are reflected in morphology, morphokinetics, and associated clinical information. METHODS In this retrospective study, we used machine-learning and deep-learning approaches to develop STORK-A, a non-invasive and automated method of embryo evaluation that uses artificial intelligence to predict embryo ploidy status. Our method used a dataset of 10 378 embryos that consisted of static images captured at 110 h after intracytoplasmic sperm injection, morphokinetic parameters, blastocyst morphological assessments, maternal age, and ploidy status. Independent and external datasets, Weill Cornell Medicine EmbryoScope+ (WCM-ES+; Weill Cornell Medicine Center of Reproductive Medicine, NY, USA) and IVI Valencia (IVI Valencia, Health Research Institute la Fe, Valencia, Spain) were used to test the generalisability of STORK-A and were compared measuring accuracy and area under the receiver operating characteristic curve (AUC). FINDINGS Analysis and model development included the use of 10 378 embryos, all with PGT-A results, from 1385 patients (maternal age range 21-48 years; mean age 36·98 years [SD 4·62]). STORK-A predicted aneuploid versus euploid embryos with an accuracy of 69·3% (95% CI 66·9-71·5; AUC 0·761; positive predictive value [PPV] 76·1%; negative predictive value [NPV] 62·1%) when using images, maternal age, morphokinetics, and blastocyst score. A second classification task trained to predict complex aneuploidy versus euploidy and single aneuploidy produced an accuracy of 74·0% (95% CI 71·7-76·1; AUC 0·760; PPV 54·9%; NPV 87·6%) using an image, maternal age, morphokinetic parameters, and blastocyst grade. A third classification task trained to predict complex aneuploidy versus euploidy had an accuracy of 77·6% (95% CI 75·0-80·0; AUC 0·847; PPV 76·7%; NPV 78·0%). STORK-A reported accuracies of 63·4% (AUC 0·702) on the WCM-ES+ dataset and 65·7% (AUC 0·715) on the IVI Valencia dataset, when using an image, maternal age, and morphokinetic parameters, similar to the STORK-A test dataset accuracy of 67·8% (AUC 0·737), showing generalisability. INTERPRETATION As a proof of concept, STORK-A shows an ability to predict embryo ploidy in a non-invasive manner and shows future potential as a standardised supplementation to traditional methods of embryo selection and prioritisation for implantation or recommendation for PGT-A. FUNDING US National Institutes of Health.
Collapse
Affiliation(s)
- Josue Barnes
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA
| | - Matthew Brendel
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA
| | - Vianne R Gao
- Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Tri-Institutional Computational Biology & Medicine Program, Cornell University, NY, USA
| | - Suraj Rajendran
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Tri-Institutional Computational Biology & Medicine Program, Cornell University, NY, USA
| | - Junbum Kim
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA
| | - Qianzi Li
- Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Tri-Institutional Computational Biology & Medicine Program, Cornell University, NY, USA
| | - Jonas E Malmsten
- Ronald O Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York, NY, USA
| | | | - Pantelis Zisimopoulos
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Caryl and Israel Englander Institute for Precision Medicine, Weill Cornell Medicine, New York, NY, USA
| | - Alexandros Sigaras
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Caryl and Israel Englander Institute for Precision Medicine, Weill Cornell Medicine, New York, NY, USA
| | - Pegah Khosravi
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Caryl and Israel Englander Institute for Precision Medicine, Weill Cornell Medicine, New York, NY, USA; Computational Oncology, Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Marcos Meseguer
- IVI Valencia, Health Research Institute la Fe, Valencia, Spain
| | - Qiansheng Zhan
- Ronald O Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York, NY, USA
| | - Zev Rosenwaks
- Ronald O Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York, NY, USA
| | - Olivier Elemento
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Caryl and Israel Englander Institute for Precision Medicine, Weill Cornell Medicine, New York, NY, USA; Meyer Cancer Center, Weill Cornell Medicine, New York, NY, USA; WorldQuant Initiative for Quantitative Prediction, Weill Cornell Medicine, New York, NY, USA
| | - Nikica Zaninovic
- Ronald O Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York, NY, USA
| | - Iman Hajirasouliha
- Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA; Institute for Computational Biomedicine, Weill Cornell Medicine, New York, NY, USA; Caryl and Israel Englander Institute for Precision Medicine, Weill Cornell Medicine, New York, NY, USA; Meyer Cancer Center, Weill Cornell Medicine, New York, NY, USA.
| |
Collapse
|
23
|
Hammer KC, Jiang VS, Kanakasabapathy MK, Thirumalaraju P, Kandula H, Dimitriadis I, Souter I, Bormann CL, Shafiee H. Using artificial intelligence to avoid human error in identifying embryos: a retrospective cohort study. J Assist Reprod Genet 2022; 39:2343-2348. [PMID: 35962845 PMCID: PMC9596636 DOI: 10.1007/s10815-022-02585-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 07/19/2022] [Indexed: 10/15/2022] Open
Abstract
PURPOSE To determine whether convolutional neural networks (CNN) can be used to accurately ascertain the patient identity (ID) of cleavage and blastocyst stage embryos based on image data alone. METHODS A CNN model was trained and validated over three replicates on a retrospective cohort of 4889 time-lapse embryo images. The algorithm processed embryo images for each patient and produced a unique identification key that was associated with the patient ID at a timepoint on day 3 (~ 65 hours post-insemination (hpi)) and day 5 (~ 105 hpi) forming our data library. When the algorithm evaluated embryos at a later timepoint on day 3 (~ 70 hpi) and day 5 (~ 110 hpi), it generates another key that was matched with the patient's unique key available in the library. This approach was tested using 400 patient embryo cohorts on day 3 and day 5 and number of correct embryo identifications with the CNN algorithm was measured. RESULTS CNN technology matched the patient identification within random pools of 8 patient embryo cohorts on day 3 with 100% accuracy (n = 400 patients; 3 replicates). For day 5 embryo cohorts, the accuracy within random pools of 8 patients was 100% (n = 400 patients; 3 replicates). CONCLUSIONS This study describes an artificial intelligence-based approach for embryo identification. This technology offers a robust witnessing step based on unique morphological features of each embryo. This technology can be integrated with existing imaging systems and laboratory protocols to improve specimen tracking.
Collapse
Affiliation(s)
- Karissa C. Hammer
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Victoria S. Jiang
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Manoj Kumar Kanakasabapathy
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| | - Prudhvi Thirumalaraju
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| | - Hemanth Kandula
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| | - Irene Dimitriadis
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Irene Souter
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Charles L. Bormann
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Hadi Shafiee
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| |
Collapse
|
24
|
Fordham DE, Rosentraub D, Polsky AL, Aviram T, Wolf Y, Perl O, Devir A, Rosentraub S, Silver DH, Gold Zamir Y, Bronstein AM, Lara Lara M, Ben Nagi J, Alvarez A, Munné S. Embryologist agreement when assessing blastocyst implantation probability: is data-driven prediction the solution to embryo assessment subjectivity? Hum Reprod 2022; 37:2275-2290. [PMID: 35944167 DOI: 10.1093/humrep/deac171] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 06/21/2022] [Indexed: 11/13/2022] Open
Abstract
STUDY QUESTION What is the accuracy and agreement of embryologists when assessing the implantation probability of blastocysts using time-lapse imaging (TLI), and can it be improved with a data-driven algorithm? SUMMARY ANSWER The overall interobserver agreement of a large panel of embryologists was moderate and prediction accuracy was modest, while the purpose-built artificial intelligence model generally resulted in higher performance metrics. WHAT IS KNOWN ALREADY Previous studies have demonstrated significant interobserver variability amongst embryologists when assessing embryo quality. However, data concerning embryologists' ability to predict implantation probability using TLI is still lacking. Emerging technologies based on data-driven tools have shown great promise for improving embryo selection and predicting clinical outcomes. STUDY DESIGN, SIZE, DURATION TLI video files of 136 embryos with known implantation data were retrospectively collected from two clinical sites between 2018 and 2019 for the performance assessment of 36 embryologists and comparison with a deep neural network (DNN). PARTICIPANTS/MATERIALS, SETTING, METHODS We recruited 39 embryologists from 13 different countries. All participants were blinded to clinical outcomes. A total of 136 TLI videos of embryos that reached the blastocyst stage were used for this experiment. Each embryo's likelihood of successfully implanting was assessed by 36 embryologists, providing implantation probability grades (IPGs) from 1 to 5, where 1 indicates a very low likelihood of implantation and 5 indicates a very high likelihood. Subsequently, three embryologists with over 5 years of experience provided Gardner scores. All 136 blastocysts were categorized into three quality groups based on their Gardner scores. Embryologist predictions were then converted into predictions of implantation (IPG ≥ 3) and no implantation (IPG ≤ 2). Embryologists' performance and agreement were assessed using Fleiss kappa coefficient. A 10-fold cross-validation DNN was developed to provide IPGs for TLI video files. The model's performance was compared to that of the embryologists. MAIN RESULTS AND THE ROLE OF CHANCE Logistic regression was employed for the following confounding variables: country of residence, academic level, embryo scoring system, log years of experience and experience using TLI. None were found to have a statistically significant impact on embryologist performance at α = 0.05. The average implantation prediction accuracy for the embryologists was 51.9% for all embryos (N = 136). The average accuracy of the embryologists when assessing top quality and poor quality embryos (according to the Gardner score categorizations) was 57.5% and 57.4%, respectively, and 44.6% for fair quality embryos. Overall interobserver agreement was moderate (κ = 0.56, N = 136). The best agreement was achieved in the poor + top quality group (κ = 0.65, N = 77), while the agreement in the fair quality group was lower (κ = 0.25, N = 59). The DNN showed an overall accuracy rate of 62.5%, with accuracies of 62.2%, 61% and 65.6% for the poor, fair and top quality groups, respectively. The AUC for the DNN was higher than that of the embryologists overall (0.70 DNN vs 0.61 embryologists) as well as in all of the Gardner groups (DNN vs embryologists-Poor: 0.69 vs 0.62; Fair: 0.67 vs 0.53; Top: 0.77 vs 0.54). LIMITATIONS, REASONS FOR CAUTION Blastocyst assessment was performed using video files acquired from time-lapse incubators, where each video contained data from a single focal plane. Clinical data regarding the underlying cause of infertility and endometrial thickness before the transfer was not available, yet may explain implantation failure and lower accuracy of IPGs. Implantation was defined as the presence of a gestational sac, whereas the detection of fetal heartbeat is a more robust marker of embryo viability. The raw data were anonymized to the extent that it was not possible to quantify the number of unique patients and cycles included in the study, potentially masking the effect of bias from a limited patient pool. Furthermore, the lack of demographic data makes it difficult to draw conclusions on how representative the dataset was of the wider population. Finally, embryologists were required to assess the implantation potential, not embryo quality. Although this is not the traditional approach to embryo evaluation, morphology/morphokinetics as a means of assessing embryo quality is believed to be strongly correlated with viability and, for some methods, implantation potential. WIDER IMPLICATIONS OF THE FINDINGS Embryo selection is a key element in IVF success and continues to be a challenge. Improving the predictive ability could assist in optimizing implantation success rates and other clinical outcomes and could minimize the financial and emotional burden on the patient. This study demonstrates moderate agreement rates between embryologists, likely due to the subjective nature of embryo assessment. In particular, we found that average embryologist accuracy and agreement were significantly lower for fair quality embryos when compared with that for top and poor quality embryos. Using data-driven algorithms as an assistive tool may help IVF professionals increase success rates and promote much needed standardization in the IVF clinic. Our results indicate a need for further research regarding technological advancement in this field. STUDY FUNDING/COMPETING INTEREST(S) Embryonics Ltd is an Israel-based company. Funding for the study was partially provided by the Israeli Innovation Authority, grant #74556. TRIAL REGISTRATION NUMBER N/A.
Collapse
Affiliation(s)
| | | | | | - Talia Aviram
- Embryonics, Embryonics R&D Center, Haifa, Israel
| | - Yotam Wolf
- Embryonics, Embryonics R&D Center, Haifa, Israel
| | - Oriel Perl
- Embryonics, Embryonics R&D Center, Haifa, Israel
| | - Asnat Devir
- Embryonics, Embryonics R&D Center, Haifa, Israel
| | | | | | | | - Alex M Bronstein
- Embryonics, Embryonics R&D Center, Haifa, Israel.,Computer Science, Technion-Israel Institute of Technology, Haifa, Israel
| | | | - Jara Ben Nagi
- Centre for Reproductive and Genetic Health, London, UK
| | | | | |
Collapse
|
25
|
Ueno S, Berntsen J, Ito M, Okimura T, Kato K. Correlation between an annotation-free embryo scoring system based on deep learning and live birth/neonatal outcomes after single vitrified-warmed blastocyst transfer: a single-centre, large-cohort retrospective study. J Assist Reprod Genet 2022; 39:2089-2099. [PMID: 35881272 PMCID: PMC9475010 DOI: 10.1007/s10815-022-02562-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Accepted: 07/04/2022] [Indexed: 11/30/2022] Open
Abstract
Propose Does an annotation-free embryo scoring system based on deep learning and time-lapse sequence images correlate with live birth (LB) and neonatal outcomes? Methods Patients who underwent SVBT cycles (3010 cycles, mean age: 39.3 ± 4.0). Scores were calculated using the iDAScore software module in the Vitrolife Technology Hub (Vitrolife, Gothenburg, Sweden). The correlation between iDAScore, LB rates, and total miscarriage (TM), including 1st- and 2nd-trimester miscarriage, was analysed using a trend test and multivariable logistic regression analysis. Furthermore, the correlation between the iDAScore and neonatal outcomes was analysed. Results LB rates decreased as iDAScore decreased (P < 0.05), and a similar inverse trend was observed for the TM rates. Additionally, multivariate logistic regression analysis showed that iDAScore significantly correlated with increased LB (adjusted odds ratio: 1.811, 95% CI: 1.666–1.976, P < 0.05) and decreased TM (adjusted odds ratio: 0.799, 95% CI: 0.706–0.905, P < 0.05). There was no significant correlation between iDAScore and neonatal outcomes, including congenital malformations, sex, gestational age, and birth weight. Multivariate logistic regression analysis, which included maternal and paternal age, maternal body mass index, parity, smoking, and presence or absence of caesarean section as confounding factors, revealed no significant difference in any neonatal characteristics. Conclusion Automatic embryo scoring using iDAScore correlates with decreased miscarriage and increased LB and has no correlation with neonatal outcomes. Supplementary information The online version contains supplementary material available at 10.1007/s10815-022-02562-5.
Collapse
Affiliation(s)
- Satoshi Ueno
- Kato Ladies Clinic, 7-20-3, Nishi-shinjuku, Shinjuku, Tokyo, 160-0023, Japan
| | | | - Motoki Ito
- Kato Ladies Clinic, 7-20-3, Nishi-shinjuku, Shinjuku, Tokyo, 160-0023, Japan
| | - Tadashi Okimura
- Kato Ladies Clinic, 7-20-3, Nishi-shinjuku, Shinjuku, Tokyo, 160-0023, Japan
| | - Keiichi Kato
- Kato Ladies Clinic, 7-20-3, Nishi-shinjuku, Shinjuku, Tokyo, 160-0023, Japan.
| |
Collapse
|
26
|
Unique Deep Radiomic Signature Shows NMN Treatment Reverses Morphology of Oocytes from Aged Mice. Biomedicines 2022; 10:biomedicines10071544. [PMID: 35884850 PMCID: PMC9313081 DOI: 10.3390/biomedicines10071544] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Revised: 06/20/2022] [Accepted: 06/27/2022] [Indexed: 01/02/2023] Open
Abstract
The purpose of this study is to develop a deep radiomic signature based on an artificial intelligence (AI) model. This radiomic signature identifies oocyte morphological changes corresponding to reproductive aging in bright field images captured by optical light microscopy. Oocytes were collected from three mice groups: young (4- to 5-week-old) C57BL/6J female mice, aged (12-month-old) mice, and aged mice treated with the NAD+ precursor nicotinamide mononucleotide (NMN), a treatment recently shown to rejuvenate aspects of fertility in aged mice. We applied deep learning, swarm intelligence, and discriminative analysis to images of mouse oocytes taken by bright field microscopy to identify a highly informative deep radiomic signature (DRS) of oocyte morphology. Predictive DRS accuracy was determined by evaluating sensitivity, specificity, and cross-validation, and was visualized using scatter plots of the data associated with three groups: Young, old and Old + NMN. DRS could successfully distinguish morphological changes in oocytes associated with maternal age with 92% accuracy (AUC~1), reflecting this decline in oocyte quality. We then employed the DRS to evaluate the impact of the treatment of reproductively aged mice with NMN. The DRS signature classified 60% of oocytes from NMN-treated aged mice as having a ‘young’ morphology. In conclusion, the DRS signature developed in this study was successfully able to detect aging-related oocyte morphological changes. The significance of our approach is that DRS applied to bright field oocyte images will allow us to distinguish and select oocytes originally affected by reproductive aging and whose quality has been successfully restored by the NMN therapy.
Collapse
|
27
|
Payá E, Bori L, Colomer A, Meseguer M, Naranjo V. Automatic characterization of human embryos at day 4 post-insemination from time-lapse imaging using supervised contrastive learning and inductive transfer learning techniques. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 221:106895. [PMID: 35609359 DOI: 10.1016/j.cmpb.2022.106895] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Revised: 05/03/2022] [Accepted: 05/15/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Embryo morphology is a predictive marker for implantation success and ultimately live births. Viability evaluation and quality grading are commonly used to select the embryo with the highest implantation potential. However, the traditional method of manual embryo assessment is time-consuming and highly susceptible to inter- and intra-observer variability. Automation of this process results in more objective and accurate predictions. METHOD In this paper, we propose a novel methodology based on deep learning to automatically evaluate the morphological appearance of human embryos from time-lapse imaging. A supervised contrastive learning framework is implemented to predict embryo viability at day 4 and day 5, and an inductive transfer approach is applied to classify embryo quality at both times. RESULTS Results showed that both methods outperformed conventional approaches and improved state-of-the-art embryology results for an independent test set. The viability result achieved an accuracy of 0.8103 and 0.9330 and the quality results reached values of 0.7500 and 0.8001 for day 4 and day 5, respectively. Furthermore, qualitative results kept consistency with the clinical interpretation. CONCLUSIONS The proposed methods are up to date with the artificial intelligence literature and have been proven to be promising. Furthermore, our findings represent a breakthrough in the field of embryology in that they study the possibilities of embryo selection at day 4. Moreover, the grad-CAMs findings are directly in line with embryologists' decisions. Finally, our results demonstrated excellent potential for the inclusion of the models in clinical practice.
Collapse
Affiliation(s)
- Elena Payá
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, 46022, Spain; IVI-RMA Valencia, Spain.
| | | | - Adrián Colomer
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, 46022, Spain
| | | | - Valery Naranjo
- Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, 46022, Spain
| |
Collapse
|
28
|
Nosrati R. Lab on a chip devices for fertility: from proof-of-concept to clinical impact. LAB ON A CHIP 2022; 22:1680-1689. [PMID: 35417508 DOI: 10.1039/d1lc01144h] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Microfluidics offers tremendous opportunities to understand the underlying biology of fertilization at the single-cell level and improve infertility management, however, its true clinical impact is yet to be realized. Lab-on-a-chip devices have generally failed to diffuse into clinical practice due to issues associated with their translation or their practicality and performance in clinical settings. In this perspective, I reflect on how the full potential of microfluidic technologies for fertility can be realized by considering regulatory and manufacturing considerations at the development stage and by redefining our developmental goals to directly target the ultimate clinical needs. I also challenge the common rationale around developing technologies for infertility treatment based on reducing cost and complexity in operation as the ultimate outcome is invaluable, human life.
Collapse
Affiliation(s)
- Reza Nosrati
- Department of Mechanical and Aerospace Engineering, Monash University, Clayton Campus, VIC 3800, Australia.
| |
Collapse
|
29
|
Reporting on the Value of Artificial Intelligence in Predicting the Optimal Embryo for Transfer: A Systematic Review including Data Synthesis. Biomedicines 2022; 10:biomedicines10030697. [PMID: 35327499 PMCID: PMC8945147 DOI: 10.3390/biomedicines10030697] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 03/08/2022] [Accepted: 03/13/2022] [Indexed: 12/04/2022] Open
Abstract
Artificial intelligence (AI) has been gaining support in the field of in vitro fertilization (IVF). Despite the promising existing data, AI cannot yet claim gold-standard status, which serves as the rationale for this study. This systematic review and data synthesis aims to evaluate and report on the predictive capabilities of AI-based prediction models regarding IVF outcome. The study has been registered in PROSPERO (CRD42021242097). Following a systematic search of the literature in Pubmed/Medline, Embase, and Cochrane Central Library, 18 studies were identified as eligible for inclusion. Regarding live-birth, the Area Under the Curve (AUC) of the Summary Receiver Operating Characteristics (SROC) was 0.905, while the partial AUC (pAUC) was 0.755. The Observed: Expected ratio was 1.12 (95%CI: 0.26–2.37; 95%PI: 0.02–6.54). Regarding clinical pregnancy with fetal heartbeat, the AUC of the SROC was 0.722, while the pAUC was 0.774. The O:E ratio was 0.77 (95%CI: 0.54–1.05; 95%PI: 0.21–1.62). According to this data synthesis, the majority of the AI-based prediction models are successful in accurately predicting the IVF outcome regarding live birth, clinical pregnancy, clinical pregnancy with fetal heartbeat, and ploidy status. This review attempted to compare between AI and human prediction capabilities, and although studies do not allow for a meta-analysis, this systematic review indicates that the AI-based prediction models perform rather similarly to the embryologists’ evaluations. While AI models appear marginally more effective, they still have some way to go before they can claim to significantly surpass the clinical embryologists’ predictive competence.
Collapse
|
30
|
Quan Y, Wang X, Li L. In vitro investigation of mammalian peri-implantation embryogenesis†. Biol Reprod 2022; 107:205-211. [PMID: 35294001 DOI: 10.1093/biolre/ioac055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Revised: 03/02/2022] [Accepted: 03/03/2022] [Indexed: 11/14/2022] Open
Abstract
The embryos attach and invade into the uterus and establish the connection with their mother in peri-implantation development. During this period, the pluripotent epiblast cells of embryo undergo symmetry breaking, cell lineage allocation, and morphogenetic remodeling, accompanying with the dramatic changes of transcriptome, epigenome, and signal pathways, to prepare a state for their differentiation and gastrulation. The progresses in mouse genetics and stem cell biology have largely advanced the knowledge of these transformations which are largely hindered by the hard accessibility of natural embryos. To gain insight into mammalian peri-implantation development, great efforts have been made in the field. Recently, the advances in the prolonged in vitro culture of blastocysts, the derivation of multiple pluripotent stem cells, as well as the construction of stem cell-based embryo-like models have opened novel avenues to investigate peri-implantation development in mammals, especially for the humans. Combining with other emerging new technologies, these new models will substantially promote the comprehension of mammalian peri-implantation development, accelerating the progress of reproductive and regenerative medicine.
Collapse
Affiliation(s)
- Yujun Quan
- State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Stem Cell and Regeneration, Beijing Institute of Stem Cell and Regenerative Medicine, Institute of Zoology, Chinese Academy of Sciences, Beijing 100101, China.,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Xiaoxiao Wang
- State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Stem Cell and Regeneration, Beijing Institute of Stem Cell and Regenerative Medicine, Institute of Zoology, Chinese Academy of Sciences, Beijing 100101, China.,University of Chinese Academy of Sciences, Beijing 100049, China
| | - Lei Li
- State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Stem Cell and Regeneration, Beijing Institute of Stem Cell and Regenerative Medicine, Institute of Zoology, Chinese Academy of Sciences, Beijing 100101, China.,University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
31
|
Stain-free detection of embryo polarization using deep learning. Sci Rep 2022; 12:2404. [PMID: 35165311 PMCID: PMC8844381 DOI: 10.1038/s41598-022-05990-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Accepted: 01/10/2022] [Indexed: 11/22/2022] Open
Abstract
Polarization of the mammalian embryo at the right developmental time is critical for its development to term and would be valuable in assessing the potential of human embryos. However, tracking polarization requires invasive fluorescence staining, impermissible in the in vitro fertilization clinic. Here, we report the use of artificial intelligence to detect polarization from unstained time-lapse movies of mouse embryos. We assembled a dataset of bright-field movie frames from 8-cell-stage embryos, side-by-side with corresponding images of fluorescent markers of cell polarization. We then used an ensemble learning model to detect whether any bright-field frame showed an embryo before or after onset of polarization. Our resulting model has an accuracy of 85% for detecting polarization, significantly outperforming human volunteers trained on the same data (61% accuracy). We discovered that our self-learning model focuses upon the angle between cells as one known cue for compaction, which precedes polarization, but it outperforms the use of this cue alone. By compressing three-dimensional time-lapsed image data into two-dimensions, we are able to reduce data to an easily manageable size for deep learning processing. In conclusion, we describe a method for detecting a key developmental feature of embryo development that avoids clinically impermissible fluorescence staining.
Collapse
|
32
|
Characterization of an artificial intelligence model for ranking static images of blastocyst stage embryos. Fertil Steril 2022; 117:528-535. [PMID: 34998577 DOI: 10.1016/j.fertnstert.2021.11.022] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2021] [Revised: 11/09/2021] [Accepted: 11/10/2021] [Indexed: 11/21/2022]
Abstract
OBJECTIVE To perform a series of analyses characterizing an artificial intelligence (AI) model for ranking blastocyst-stage embryos. The primary objective was to evaluate the benefit of the model for predicting clinical pregnancy, whereas the secondary objective was to identify limitations that may impact clinical use. DESIGN Retrospective study. SETTING Consortium of 11 assisted reproductive technology centers in the United States. PATIENT(S) Static images of 5,923 transferred blastocysts and 2,614 nontransferred aneuploid blastocysts. INTERVENTION(S) None. MAIN OUTCOME MEASURE(S) Prediction of clinical pregnancy (fetal heartbeat). RESULT(S) The area under the curve of the AI model ranged from 0.6 to 0.7 and outperformed manual morphology grading overall and on a per-site basis. A bootstrapped study predicted improved pregnancy rates between +5% and +12% per site using AI compared with manual grading using an inverted microscope. One site that used a low-magnification stereo zoom microscope did not show predicted improvement with the AI. Visualization techniques and attribution algorithms revealed that the features learned by the AI model largely overlap with the features of manual grading systems. Two sources of bias relating to the type of microscope and presence of embryo holding micropipettes were identified and mitigated. The analysis of AI scores in relation to pregnancy rates showed that score differences of ≥0.1 (10%) correspond with improved pregnancy rates, whereas score differences of <0.1 may not be clinically meaningful. CONCLUSION(S) This study demonstrates the potential of AI for ranking blastocyst stage embryos and highlights potential limitations related to image quality, bias, and granularity of scores.
Collapse
|
33
|
Zhang Y, Shen L, Yin X, Chen W. Live-Birth Prediction of Natural-Cycle In Vitro Fertilization Using 57,558 Linked Cycle Records: A Machine Learning Perspective. Front Endocrinol (Lausanne) 2022; 13:838087. [PMID: 35527994 PMCID: PMC9072737 DOI: 10.3389/fendo.2022.838087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 03/07/2022] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND Natural-cycle in vitro fertilization (NC-IVF) is an in vitro fertilization (IVF) cycle without gonadotropins or any other stimulation of follicular growth. Previous studies on live-birth prediction of NC-IVF were very few; the sample size was very limited. This study aims to construct a machine learning model to predict live-birth occurrence of NC-IVF using 57,558 linked cycle records and help clinicians develop treatment strategies. DESIGN AND METHODS The dataset contained 57,558 anonymized register patient records undergoing NC-IVF cycles from 2005 to 2016 filtered from 7bsp;60,732 records in the Human Fertilisation and Embryology Authority (HFEA) data. We selected matching records and features through data filtering and feature selection methods. Two groups of twelve machine learning models were trained and tested. Eight metrics, e.g., F1 score, Matthews correlation coefficient (MCC), the area under the receiver operating characteristic curve (AUC), etc., were computed to evaluate the performance of each model. RESULTS Two groups of twelve models were trained and tested. The artificial neural network (ANN) model performed the best in the machine learning group (F1 score, 70.87%; MCC, 50.37%; and AUC score, 0.7939). The LogitBoost model obtained the best scores in the ensemble learning group (F1 score, 70.57%; MCC, 50.75%; and AUC score, 0.7907). After the comparison between the two models, the LogitBoost model was recognized as an optimal one. CONCLUSION In this study, NC-IVF-related datasets were extracted from the HFEA data, and a machine learning-based prediction model was successfully constructed through this largest NC-IVF dataset currently. This model is universal and stable, which can help clinicians predict the live-birth success rate of NC-IVF in advance before developing IVF treatment strategies and then choose the best benefit treatment strategy according to the patients' wishes. As "use less stimulation and back to natural condition" becomes more and more popular, this model is more meaningful in the decision-making assistance system for IVF.
Collapse
Affiliation(s)
- Yanran Zhang
- Medical School of Nanjing University, Nanjing, China
- *Correspondence: Yanran Zhang,
| | - Lei Shen
- College of Computer and Information, Hohai University, Nanjing, China
- Nanjing Marine Radar Institute, Nanjing, China
| | - Xinghui Yin
- College of Computer and Information, Hohai University, Nanjing, China
| | | |
Collapse
|
34
|
Bormann CL, Curchoe CL. AIM in Medical Disorders in Pregnancy. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
35
|
Benchaib M, Labrune E, Giscard d'Estaing S, Salle B, Lornage J. Shallow artificial networks with morphokinetic time‐lapse parameters coupled to
ART
data allow to predict live birth. Reprod Med Biol 2022; 21:e12486. [PMID: 36310657 PMCID: PMC9601773 DOI: 10.1002/rmb2.12486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 08/10/2022] [Accepted: 09/08/2022] [Indexed: 12/02/2022] Open
Abstract
Purpose The purpose of this work was to construct shallow neural networks (SNN) using time‐lapse technology (TLT) from morphokinetic parameters coupled to assisted reproductive technology (ART) parameters in order to assist the choice of embryo(s) to be transferred with the highest probability of achieving a live birth (LB). Methods A retrospective observational single‐center study was performed, 654 cycles were included. Three SNN: multilayers perceptron (MLP), simple recurrent neuronal network (simple RNN) and long short term memory RNN (LSTM‐RNN) were trained with K‐fold cross‐validation to avoid sampling bias. The predictive power of SNNs was measured using performance scores as AUC (area under curve), accuracy, precision, Recall and F1 score. Results In the training data group, MLP and simple RNN provide the best performance scores; however, all AUCs were above 0.8. In the validating data group, all networks were equivalent with no performance scores difference and all AUC values were above 0.8. Conclusion Coupling morphokinetic parameters with ART parameters allows to SNNs to predict the probability of LB, and all SNNs seems to be efficient according to the performance scores. An automatic time recognition system coupled to one of these SNNs could allow a complete automation to choose the blastocyst(s) to be transferred.
Collapse
Affiliation(s)
- Mehdi Benchaib
- Hospices Civil de Lyon, HFME, Médecine de la Reproduction & Préservation de la Fertilité Féminine Bron cedex France
- UMR CNRS 5558 LBBE Villeurbanne Cedex France
- Université Lyon I, Faculté de Médecine Lyon Est Lyon France
| | - Elsa Labrune
- Hospices Civil de Lyon, HFME, Médecine de la Reproduction & Préservation de la Fertilité Féminine Bron cedex France
- Université Lyon I, Faculté de Médecine Lyon Est Lyon France
- Inserm U1208 Bron cedex France
| | - Sandrine Giscard d'Estaing
- Hospices Civil de Lyon, HFME, Médecine de la Reproduction & Préservation de la Fertilité Féminine Bron cedex France
- Inserm U1208 Bron cedex France
- Université Lyon I, Faculté de Médecine Lyon Sud Oullins cedex France
| | - Bruno Salle
- Hospices Civil de Lyon, HFME, Médecine de la Reproduction & Préservation de la Fertilité Féminine Bron cedex France
- Inserm U1208 Bron cedex France
- Université Lyon I, Faculté de Médecine Lyon Sud Oullins cedex France
| | - Jacqueline Lornage
- Hospices Civil de Lyon, HFME, Médecine de la Reproduction & Préservation de la Fertilité Féminine Bron cedex France
- Inserm U1208 Bron cedex France
- Université Lyon I, Faculté de Médecine Lyon Sud Oullins cedex France
| |
Collapse
|
36
|
Human Oocyte Morphology and Outcomes of Infertility Treatment: a Systematic Review. Reprod Sci 2021; 29:2768-2785. [PMID: 34816375 DOI: 10.1007/s43032-021-00723-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Accepted: 08/22/2021] [Indexed: 10/19/2022]
Abstract
Oocyte morphology assessment is easy to implement in any laboratory with possible quality grading prior to fertilization. At present, comprehensive oocyte morphology scoring is not performed as a routine procedure. However, it may augment chances for successful treatment outcomes if a correlation with certain dysmorphisms can be proven. In order to determine a correlation between oocyte morphology and treatment outcome, we performed a systematic search in PubMed and Cochrane Controlled Trials Register following PRISMA guidelines. A total of 52 articles out of 6,755 search results met the inclusion criteria. Dark colour of the cytoplasm (observed with an incidence rate of 7%), homogeneous granularity of the cytoplasm (19%) and ovoid shape of oocytes (7%) appeared to have no influence on treatment outcome. Abnormalities such as refractile bodies (10%), fragmented first polar body (37%), dark zona pellucida (9%), enlarged perivitelline space (18%) and debris in it (21%) are likely to affect the treatment outcome to some extent. Finally, cytoplasmic vacuoles (4%), centrally located cytoplasmic granularity (12%) and clusters of smooth endoplasmic reticulum (4%) negatively impact infertility treatment outcomes. Nonetheless, morphological assessment is informative rather than predictive. Adding oocyte morphology to the artificial intelligence (AI)-driven selection process may improve the precision of the algorithms. Oocyte morphology assessment can be especially useful in oocyte donation cycles, during oocyte freezing for fertility preservation and finally, objective oocyte scoring can be important in cases of very poor treatment outcome as a tool for explanation of results to the patient.
Collapse
|
37
|
Dimitriadis I, Zaninovic N, Badiola AC, Bormann CL. Artificial intelligence in the embryology laboratory: a review. Reprod Biomed Online 2021; 44:435-448. [PMID: 35027326 DOI: 10.1016/j.rbmo.2021.11.003] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 10/07/2021] [Accepted: 11/04/2021] [Indexed: 02/03/2023]
Abstract
The goal of an IVF cycle is a healthy live-born baby. Despite the many advances in the field of assisted reproductive technologies, accurately predicting the outcome of an IVF cycle has yet to be achieved. One reason for this is the method of selecting an embryo for transfer. Morphological assessment of embryos is the traditional method of evaluating embryo quality and selecting which embryo to transfer. However, this subjective method of assessing embryos leads to inter- and intra-observer variability, resulting in less than optimal IVF success rates. To overcome this, it is common practice to transfer more than one embryo, potentially resulting in high-risk multiple pregnancies. Although time-lapse incubators and preimplantation genetic testing for aneuploidy have been introduced to help increase the chances of live birth, the outcomes remain less than ideal. Utilization of artificial intelligence (AI) has become increasingly popular in the medical field and is increasingly being leveraged in the embryology laboratory to help improve IVF outcomes. Many studies have been published investigating the use of AI as an unbiased, automated approach to embryo assessment. This review summarizes recent AI advancements in the embryology laboratory.
Collapse
Affiliation(s)
- Irene Dimitriadis
- Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston MA, USA
| | - Nikica Zaninovic
- The Ronald O Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York NY, USA
| | - Alejandro Chavez Badiola
- New Hope Fertility Center, Av. Prado Norte 135, Lomas de Chapultepec, Mexico City, Mexico; IVF 2.0 LTD, 1 Liverpool Rd, Maghull, Merseyside, UK; School of Biosciences, University of Kent Kent, UK
| | - Charles L Bormann
- Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston MA, USA.
| |
Collapse
|
38
|
Lencz T, Backenroth D, Granot-Hershkovitz E, Green A, Gettler K, Cho JH, Weissbrod O, Zuk O, Carmi S. Utility of polygenic embryo screening for disease depends on the selection strategy. eLife 2021; 10:e64716. [PMID: 34635206 PMCID: PMC8510582 DOI: 10.7554/elife.64716] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 08/09/2021] [Indexed: 12/13/2022] Open
Abstract
Polygenic risk scores (PRSs) have been offered since 2019 to screen in vitro fertilization embryos for genetic liability to adult diseases, despite a lack of comprehensive modeling of expected outcomes. Here we predict, based on the liability threshold model, the expected reduction in complex disease risk following polygenic embryo screening for a single disease. A strong determinant of the potential utility of such screening is the selection strategy, a factor that has not been previously studied. When only embryos with a very high PRS are excluded, the achieved risk reduction is minimal. In contrast, selecting the embryo with the lowest PRS can lead to substantial relative risk reductions, given a sufficient number of viable embryos. We systematically examine the impact of several factors on the utility of screening, including: variance explained by the PRS, number of embryos, disease prevalence, parental PRSs, and parental disease status. We consider both relative and absolute risk reductions, as well as population-averaged and per-couple risk reductions, and also examine the risk of pleiotropic effects. Finally, we confirm our theoretical predictions by simulating 'virtual' couples and offspring based on real genomes from schizophrenia and Crohn's disease case-control studies. We discuss the assumptions and limitations of our model, as well as the potential emerging ethical concerns.
Collapse
Affiliation(s)
- Todd Lencz
- Departments of Psychiatry and Molecular Medicine, Zucker School of Medicine at Hofstra/NorthwellHempsteadUnited States
- Department of Psychiatry, Division of Research, The Zucker Hillside Hospital Division of Northwell HealthGlen OaksUnited States
- Institute for Behavioral Science, The Feinstein Institutes for Medical ResearchManhassetUnited States
| | - Daniel Backenroth
- Braun School of Public Health and Community Medicine, The Hebrew University of JerusalemJerusalemIsrael
| | - Einat Granot-Hershkovitz
- Braun School of Public Health and Community Medicine, The Hebrew University of JerusalemJerusalemIsrael
| | - Adam Green
- Braun School of Public Health and Community Medicine, The Hebrew University of JerusalemJerusalemIsrael
| | - Kyle Gettler
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount SinaiNew YorkUnited States
| | - Judy H Cho
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount SinaiNew YorkUnited States
- The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount SinaiNew YorkUnited States
- Department of Medicine, Icahn School of Medicine at Mount SinaiNew YorkUnited States
| | - Omer Weissbrod
- Department of Epidemiology, Harvard T.H. Chan School of Public HealthBostonUnited States
| | - Or Zuk
- Department of Statistics and Data Science, The Hebrew University of JerusalemJerusalemIsrael
| | - Shai Carmi
- Braun School of Public Health and Community Medicine, The Hebrew University of JerusalemJerusalemIsrael
| |
Collapse
|
39
|
Should there be an "AI" in TEAM? Embryologists selection of high implantation potential embryos improves with the aid of an artificial intelligence algorithm. J Assist Reprod Genet 2021; 38:2663-2670. [PMID: 34535847 DOI: 10.1007/s10815-021-02318-7] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Accepted: 09/09/2021] [Indexed: 10/20/2022] Open
Abstract
PURPOSE A deep learning artificial intelligence (AI) algorithm has been demonstrated to outperform embryologists in identifying euploid embryos destined to implant with an accuracy of 75.3% (1). Our aim was to evaluate the performance of highly trained embryologists in selecting top quality day 5 euploid blastocysts with and without the aid of a deep learning algorithm. MATERIALS AND METHODS A non-overlapping series of 200 sets of day 5 euploid embryo images with known implantation outcomes was distributed to 17 highly trained embryologists. One embryo in each set was known to have implanted and one failed implantation. They were asked to select which embryo to transfer from each set. The same 200 sets of embryos, with indication of which embryo in each set had been identified by the algorithm as more likely to implant was then distributed. Chi-squared, t-test, and receiver operating curves were performed to compare the embryologist performeance with and without AI. RESULTS Fourteen embryologists completed both assessments. Embryologists provided with AI results selected successfully implanted embryos in 73.6% of cases compared to 65.5% for those selected using visual assessments alone (p < 0.001). All embryologists improved in their ability to select embryos with the aid of the AI algorithm with a mean percent improvement of 11.1% (range 1.4% to 15.5%). There were no differences in degree of improvement by embryologist level of experience (junior, intermediate, senior). CONCLUSIONS The incorporation of an AI framework for blastocyst selection enhanced the performance of trained embryologists in identifying PGT-A euploid embryos destined to implant.
Collapse
|
40
|
Riegler MA, Stensen MH, Witczak O, Andersen JM, Hicks SA, Hammer HL, Delbarre E, Halvorsen P, Yazidi A, Holst N, Haugen TB. Artificial intelligence in the fertility clinic: status, pitfalls and possibilities. Hum Reprod 2021; 36:2429-2442. [PMID: 34324672 DOI: 10.1093/humrep/deab168] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 06/21/2021] [Indexed: 12/15/2022] Open
Abstract
In recent years, the amount of data produced in the field of ART has increased exponentially. The diversity of data is large, ranging from videos to tabular data. At the same time, artificial intelligence (AI) is progressively used in medical practice and may become a promising tool to improve success rates with ART. AI models may compensate for the lack of objectivity in several critical procedures in fertility clinics, especially embryo and sperm assessments. Various models have been developed, and even though several of them show promising performance, there are still many challenges to overcome. In this review, we present recent research on AI in the context of ART. We discuss the strengths and weaknesses of the presented methods, especially regarding clinical relevance. We also address the pitfalls hampering successful use of AI in the clinic and discuss future possibilities and important aspects to make AI truly useful for ART.
Collapse
Affiliation(s)
- M A Riegler
- Department of Holistic Systems, Simula Metropolitan Center for Digital Engineering, Oslo, Norway
| | | | - O Witczak
- Department of Life Sciences and Health, Faculty of Health Sciences, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - J M Andersen
- Department of Life Sciences and Health, Faculty of Health Sciences, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - S A Hicks
- Department of Holistic Systems, Simula Metropolitan Center for Digital Engineering, Oslo, Norway.,Department of Computer Science, Faculty of Technology, Art and Design, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - H L Hammer
- Department of Holistic Systems, Simula Metropolitan Center for Digital Engineering, Oslo, Norway.,Department of Computer Science, Faculty of Technology, Art and Design, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - E Delbarre
- Department of Life Sciences and Health, Faculty of Health Sciences, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - P Halvorsen
- Department of Holistic Systems, Simula Metropolitan Center for Digital Engineering, Oslo, Norway.,Department of Computer Science, Faculty of Technology, Art and Design, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - A Yazidi
- Department of Computer Science, Faculty of Technology, Art and Design, OsloMet-Oslo Metropolitan University, Oslo, Norway
| | - N Holst
- Fertilitetssenteret, Oslo, Norway
| | - T B Haugen
- Department of Life Sciences and Health, Faculty of Health Sciences, OsloMet-Oslo Metropolitan University, Oslo, Norway
| |
Collapse
|
41
|
Hariton E, Chi EA, Chi G, Morris JR, Braatz J, Rajpurkar P, Rosen M. A machine learning algorithm can optimize the day of trigger to improve in vitro fertilization outcomes. Fertil Steril 2021; 116:1227-1235. [PMID: 34256948 DOI: 10.1016/j.fertnstert.2021.06.018] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 06/07/2021] [Accepted: 06/08/2021] [Indexed: 10/20/2022]
Abstract
OBJECTIVE To determine whether a machine learning causal inference model can optimize trigger injection timing to maximize the yield of fertilized oocytes (2PNs) and total usable blastocysts for a given cohort of stimulated follicles. DESIGN Descriptive and comparative study of new technology. SETTING Tertiary academic medical center. PATIENT(S) Patients undergoing IVF with intracytoplasmic sperm injection from 2008 to 2019 (n = 7,866). INTERVENTION(S) Causal inference was performed with the use of a T-learner. Bagged decision trees were used to perform inference. The decision was framed as either triggering on that day or waiting another day. All patient characteristics and stimulation parameters on a given day were used to determine the recommendation. MAIN OUTCOME MEASURE(S) Average outcome improvement in total 2PNs and usable blastocysts compared with the physician's decision. RESULT(S) For evaluation of average outcome improvement on 2PNs, the benefit of following the model's recommendation was 3.015 (95% CI 2.626, 3.371) more 2PNs. For total usable blastocysts, the benefit was 1.515 (95% CI 1.134, 1.871) more usable blastocysts. Given that the physicians-model agreement was 52.57% and 61.89%, respectively, algorithm-assisted trigger decisions yield, on average, 1.430 more 2PNs and 0.577 more total usable blastocysts per stimulation. The most important features weighted in the model's decision were the number of follicles 16-20 mm in diameter, the number of follicles 11-15 mm in diameter, and estradiol level, in that order. CONCLUSION(S) The use of this machine learning algorithm to optimize trigger injection timing may lead to a significant increase in the number of 2PNs and total usable blastocysts obtained from an IVF stimulation cycle when compared with physician decisions. Future research is required to confirm these findings prospectively.
Collapse
Affiliation(s)
- Eduardo Hariton
- Department of Obstetrics, Gynecology and Reproductive Sciences, University of California San Francisco, San Francisco, California.
| | - Ethan A Chi
- Department of Artificial Intelligence, Stanford University, Palo Alto, California
| | - Gordon Chi
- Department of Artificial Intelligence, Stanford University, Palo Alto, California
| | - Jerrine R Morris
- Department of Obstetrics, Gynecology and Reproductive Sciences, University of California San Francisco, San Francisco, California
| | - Jon Braatz
- Department of Artificial Intelligence, Stanford University, Palo Alto, California
| | - Pranav Rajpurkar
- Department of Artificial Intelligence, Stanford University, Palo Alto, California
| | - Mitchell Rosen
- Department of Obstetrics, Gynecology and Reproductive Sciences, University of California San Francisco, San Francisco, California
| |
Collapse
|
42
|
Firmin J, Maître JL. Morphogenesis of the human preimplantation embryo: bringing mechanics to the clinics. Semin Cell Dev Biol 2021; 120:22-31. [PMID: 34253437 DOI: 10.1016/j.semcdb.2021.07.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 06/15/2021] [Accepted: 07/01/2021] [Indexed: 12/19/2022]
Abstract
During preimplantation development, the human embryo forms the blastocyst, the structure enabling uterine implantation. The blastocyst consists of an epithelial envelope, the trophectoderm, encompassing a fluid-filled lumen, the blastocoel, and a cluster of pluripotent stem cells, the inner cell mass. This specific architecture is crucial for the implantation and further development of the human embryo. Furthermore, the morphology of the human embryo is a prime determinant for clinicians to assess the implantation potential of in vitro fertilized human embryos, which constitutes a key aspect of assisted reproduction technology. Therefore, it is crucial to understand how the human embryo builds the blastocyst. As any material, the human embryo changes shape under the action of forces. Here, we review recent advances in our understanding of the mechanical forces shaping the blastocyst. We discuss the cellular processes responsible for generating morphogenetic forces that were studied mostly in the mouse and review the literature on human embryos to see which of them may be conserved. Based on the specific morphological defects commonly observed in clinics during human preimplantation development, we discuss how mechanical forces and their underlying cellular processes may be affected. Together, we propose that bringing tissue mechanics to the clinics will advance our understanding of human preimplantation development, as well as our ability to help infertile couples to have babies.
Collapse
Affiliation(s)
- Julie Firmin
- Institut Curie, PSL Research University, Sorbonne Université, CNRS UMR3215, INSERM, U934 Paris, France
| | - Jean-Léon Maître
- Institut Curie, PSL Research University, Sorbonne Université, CNRS UMR3215, INSERM, U934 Paris, France.
| |
Collapse
|
43
|
Ueno S, Berntsen J, Ito M, Uchiyama K, Okimura T, Yabuuchi A, Kato K. Pregnancy prediction performance of an annotation-free embryo scoring system on the basis of deep learning after single vitrified-warmed blastocyst transfer: a single-center large cohort retrospective study. Fertil Steril 2021; 116:1172-1180. [PMID: 34246469 DOI: 10.1016/j.fertnstert.2021.06.001] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 06/01/2021] [Accepted: 06/02/2021] [Indexed: 12/26/2022]
Abstract
OBJECTIVE To analyze the performance of an annotation-free embryo scoring system on the basis of deep learning for pregnancy prediction after single vitrified blastocyst transfer (SVBT) compared with the performance of other blastocyst grading systems dependent on annotation or morphology scores. DESIGN A single-center large cohort retrospective study from an independent validation test. SETTING Infertility clinic. PATIENT(S) Patients who underwent SVBT cycles (3,018 cycles, mean ± SD patient age 39.3 ± 4.0 years). INTERVENTION(S) None. MAIN OUTCOME MEASURE(S) The pregnancy prediction performances of each embryo scoring model were compared using the area under curve (AUC) for predicting the fetal heartbeat status for each maternal age group. RESULT(S) The AUCs of the <35 years age group (n = 389) for pregnancy prediction were 0.72 for iDAScore, 0.66 for KIDScore, and 0.64 for the Gardner criteria. The AUC of iDAScore was significantly greater than those of the other two models. For the 35-37 years age group (n = 514), the AUCs were 0.68, 0.68, and 0.65 for iDAScore, KIDScore, and the Gardner criteria, respectively, and were not significantly different. The AUCs of the 38-40 years age group (n = 796) were 0.67 for iDAScore, 0.65 for KIDScore, and 0.64 for the Gardner criteria, and there were no significant differences. The AUCs of the 41-42 years age group (n = 636) were 0.66, 0.66, and 0.63 for iDAScore, KIDScore, and the Gardner criteria, respectively, and there were no significant differences among the pregnancy prediction models. For the >42 years age group (n = 389), the AUCs were 0.76 for iDAScore, 0.75 for KIDScore, and 0.75 for the Gardner criteria, and there were no significant differences. Thus, iDAScore AUC was either the highest or equal to the highest AUC for all age groups, although a significant difference was observed only in the youngest age group. CONCLUSION(S) Our results showed that objective embryo assessment by a completely automatic and annotation-free model, iDAScore, performed as well as or even better than more traditional embryo assessment or annotation-dependent ranking tools. iDAScore could be an optimal pregnancy prediction model after SVBT, especially in young patients.
Collapse
|
44
|
Kragh MF, Karstoft H. Embryo selection with artificial intelligence: how to evaluate and compare methods? J Assist Reprod Genet 2021; 38:1675-1689. [PMID: 34173914 PMCID: PMC8324599 DOI: 10.1007/s10815-021-02254-6] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 06/02/2021] [Indexed: 12/19/2022] Open
Abstract
Embryo selection within in vitro fertilization (IVF) is the process of evaluating qualities of fertilized oocytes (embryos) and selecting the best embryo(s) available within a patient cohort for subsequent transfer or cryopreservation. In recent years, artificial intelligence (AI) has been used extensively to improve and automate the embryo ranking and selection procedure by extracting relevant information from embryo microscopy images. The AI models are evaluated based on their ability to identify the embryo(s) with the highest chance(s) of achieving a successful pregnancy. Whether such evaluations should be based on ranking performance or pregnancy prediction, however, seems to divide studies. As such, a variety of performance metrics are reported, and comparisons between studies are often made on different outcomes and data foundations. Moreover, superiority of AI methods over manual human evaluation is often claimed based on retrospective data, without any mentions of potential bias. In this paper, we provide a technical view on some of the major topics that divide how current AI models are trained, evaluated and compared. We explain and discuss the most common evaluation metrics and relate them to the two separate evaluation objectives, ranking and prediction. We also discuss when and how to compare AI models across studies and explain in detail how a selection bias is inevitable when comparing AI models against current embryo selection practice in retrospective cohort studies.
Collapse
Affiliation(s)
- Mikkel Fly Kragh
- Department of Electrical and Computer Engineering, Aarhus University, Aarhus N, Denmark.
- Vitrolife A/S, Viby J, Denmark.
| | - Henrik Karstoft
- Department of Electrical and Computer Engineering, Aarhus University, Aarhus N, Denmark
| |
Collapse
|
45
|
Trolice MP, Curchoe C, Quaas AM. Artificial intelligence-the future is now. J Assist Reprod Genet 2021; 38:1607-1612. [PMID: 34231110 PMCID: PMC8260235 DOI: 10.1007/s10815-021-02272-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 06/29/2021] [Indexed: 11/25/2022] Open
Abstract
The pros and cons of artificial intelligence in assisted reproductive technology are presented.
Collapse
Affiliation(s)
- Mark P Trolice
- Obstetrics and Gynecology, University of Central Florida, Orlando, USA.
- The IVF Center, Orlando, FL, USA.
| | | | - Alexander M Quaas
- Division of Reproductive Endocrinology and Infertility, University of California, San Diego, CA, USA
- Reproductive Partners San Diego, San Diego, CA, USA
| |
Collapse
|
46
|
Adaptive adversarial neural networks for the analysis of lossy and domain-shifted datasets of medical images. Nat Biomed Eng 2021; 5:571-585. [PMID: 34112997 PMCID: PMC8943917 DOI: 10.1038/s41551-021-00733-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 04/15/2021] [Indexed: 01/30/2023]
Abstract
In machine learning for image-based medical diagnostics, supervised convolutional neural networks are typically trained with large and expertly annotated datasets obtained using high-resolution imaging systems. Moreover, the network's performance can degrade substantially when applied to a dataset with a different distribution. Here, we show that adversarial learning can be used to develop high-performing networks trained on unannotated medical images of varying image quality. Specifically, we used low-quality images acquired using inexpensive portable optical systems to train networks for the evaluation of human embryos, the quantification of human sperm morphology and the diagnosis of malarial infections in the blood, and show that the networks performed well across different data distributions. We also show that adversarial learning can be used with unlabelled data from unseen domain-shifted datasets to adapt pretrained supervised networks to new distributions, even when data from the original distribution are not available. Adaptive adversarial networks may expand the use of validated neural-network models for the evaluation of data collected from multiple imaging systems of varying quality without compromising the knowledge stored in the network.
Collapse
|
47
|
Zaninovic N, Rosenwaks Z. Artificial intelligence in human in vitro fertilization and embryology. Fertil Steril 2021; 114:914-920. [PMID: 33160513 DOI: 10.1016/j.fertnstert.2020.09.157] [Citation(s) in RCA: 65] [Impact Index Per Article: 21.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Accepted: 09/23/2020] [Indexed: 02/06/2023]
Abstract
Embryo evaluation and selection embody the aggregate manifestation of the entire in vitro fertilization (IVF) process. It aims to choose the "best" embryos from the larger cohort of fertilized oocytes, the majority of which will be determined to be not viable either as a result of abnormal development or due to chromosomal imbalances. Indeed, it is generally acknowledged that even after embryo selection based on morphology, time-lapse microscopic photography, or embryo biopsy with preimplantation genetic testing, implantation rates in the human are difficult to predict. Our pursuit of enhancing embryo evaluation and selection, as well as increasing live birth rates, will require the adoption of novel technologies. Recently, several artificial intelligence (AI)-based methods have emerged as objective, standardized, and efficient tools for evaluating human embryos. Moreover, AI-based methods can be implemented for other clinical aspects of IVF, such as assessing patient reproductive potential and individualizing gonadotropin stimulation protocols. As AI has the capability to analyze "big" data, the ultimate goal will be to apply AI tools to the analysis of all embryological, clinical, and genetic data in an effort to provide patient-tailored treatments. In this chapter, we present an overview of existing AI technologies in reproductive medicine and envision their potential future applications in the field.
Collapse
Affiliation(s)
- Nikica Zaninovic
- The Ronald O. Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York, New York.
| | - Zev Rosenwaks
- The Ronald O. Perelman and Claudia Cohen Center for Reproductive Medicine, Weill Cornell Medicine, New York, New York
| |
Collapse
|
48
|
Letterie G. Three ways of knowing: the integration of clinical expertise, evidence-based medicine, and artificial intelligence in assisted reproductive technologies. J Assist Reprod Genet 2021; 38:1617-1625. [PMID: 33870475 DOI: 10.1007/s10815-021-02159-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Accepted: 03/16/2021] [Indexed: 12/12/2022] Open
Abstract
Decision-making in fertility care is on the cusp of a significant frameshift. Online tools to integrate artificial intelligence into the decision-making process across all aspects of ART are rapidly emerging. These tools have the potential to improve outcomes and transition decision-making from one based on traditional provider centric assessments toward a hybrid triad of expertise, evidence, and algorithmic data analytics using AI. We can look forward to a time when AI will be the third part of a provider's tool box to complement expertise and medical literature to enable ever more accurate predictions and outcomes in ART. In their fully integrated format, these tools will be part of a digital fertility ecosystem of analytics embedded within an EMR. To date, the impact of AI on ART outcomes is inconclusive. No prospective studies have shown clear cut benefit or cost reductions over current practices, but we are very early in the process of developing and evaluating these tools. We owe it to ourselves to begin to examine these AI-driven analytics and develop a very clear idea about where we can and should go before we roll these tools into clinical care. Thoughtful scrutiny is essential lest we find ourselves in a position of trying to modulate and modify after entry of these tools into our clinics and patient care. The purpose of this commentary is to highlight the evolution and impact AI has had in other fields relevant to the fertility sector and describe a vision for applications within ART that could improve outcomes, reduce costs, and positively impact clinical care.
Collapse
Affiliation(s)
- Gerard Letterie
- Seattle Reproductive Medicine, 1505 Westlake Avenue, Suite 400, Seattle, WA, 98104, USA.
| |
Collapse
|
49
|
Review of computer vision application in in vitro fertilization: the application of deep learning-based computer vision technology in the world of IVF. J Assist Reprod Genet 2021; 38:1627-1639. [PMID: 33811587 DOI: 10.1007/s10815-021-02123-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Accepted: 02/21/2021] [Indexed: 12/30/2022] Open
Abstract
In vitro fertilization has been regarded as a forefront solution in treating infertility for over four decades, yet its effectiveness has remained relatively low. This could be attributed to the lack of advancements for the method of observing and selecting the most viable embryos for implantation. The conventional morphological assessment of embryos exhibits inevitable drawbacks which include time- and effort-consuming, and imminent risks of bias associated with subjective assessments performed by individual embryologists. A combination of these disadvantages, undeterred by the introduction of the time-lapse incubator technology, has been considered as a prominent contributor to the less preferable success rate of IVF cycles. Nonetheless, a recent surge of AI-based solutions for tasks automation in IVF has been observed. An AI-powered assistant could improve the efficiency of performing certain tasks in addition to offering accurate algorithms that behave as baselines to minimize the subjectivity of the decision-making process. Through a comprehensive review, we have discovered multiple approaches of implementing deep learning technology, each with varying degrees of success, for constructing the automated systems in IVF which could evaluate and even annotate the developmental stages of an embryo.
Collapse
|
50
|
Curchoe CL. The paper chase and the big data arms race. J Assist Reprod Genet 2021; 38:1613-1615. [PMID: 33715133 DOI: 10.1007/s10815-021-02122-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/03/2021] [Indexed: 12/15/2022] Open
|