1
|
Liu M, Lee CI, Tzeng CR, Lai HH, Huang Y, Chang TA. WISE: whole-scenario embryo identification using self-supervised learning encoder in IVF. J Assist Reprod Genet 2024; 41:967-978. [PMID: 38470553 PMCID: PMC11052951 DOI: 10.1007/s10815-024-03080-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 02/28/2024] [Indexed: 03/14/2024] Open
Abstract
PURPOSE To study the effectiveness of whole-scenario embryo identification using a self-supervised learning encoder (WISE) in in vitro fertilization (IVF) on time-lapse, cross-device, and cryo-thawed scenarios. METHODS WISE was based on the vision transformer (ViT) architecture and masked autoencoders (MAE), a self-supervised learning (SSL) method. To train WISE, we prepared three datasets including the SSL pre-training dataset, the time-lapse identification dataset, and the cross-device identification dataset. To identify whether pairs of images were from the same embryos in different scenarios in the downstream identification tasks, embryo images including time-lapse and microscope images were first pre-processed through object detection, cropping, padding, and resizing, and then fed into WISE to get predictions. RESULTS WISE could accurately identify embryos in the three scenarios. The accuracy was 99.89% on the time-lapse identification dataset, and 83.55% on the cross-device identification dataset. Besides, we subdivided a cryo-thawed evaluation set from the cross-device test set to have a better estimation of how WISE performs in the real-world, and it reached an accuracy of 82.22%. There were approximately 10% improvements in cross-device and cryo-thawed identification tasks after the SSL method was applied. Besides, WISE demonstrated improvements in the accuracy of 9.5%, 12%, and 18% over embryologists in the three scenarios. CONCLUSION SSL methods can improve embryo identification accuracy even when dealing with cross-device and cryo-thawed paired images. The study is the first to apply SSL in embryo identification, and the results show the promise of WISE for future application in embryo witnessing.
Collapse
Affiliation(s)
- Mark Liu
- Binflux, Inc., 4F.-1, No. 9, Dehui St., Zhongshan Dist., Taipei City, 10461, Taiwan.
| | - Chun-I Lee
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan
- Department of Obstetrics and Gynecology, Chung Shan Medical University, Taichung, Taiwan
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | | | - Hsing-Hua Lai
- Stork Fertility Center, Stork Ladies Clinic, Hsinchu City, Taiwan
| | - Yulun Huang
- Binflux, Inc., 4F.-1, No. 9, Dehui St., Zhongshan Dist., Taipei City, 10461, Taiwan
| | - T Arthur Chang
- Department of Obstetrics and Gynecology, University of Texas Health Science Center, San Antonio, TX, USA
| |
Collapse
|
2
|
Palmer GA, Tomkin G, Martín-Alcalá HE, Mendizabal-Ruiz G, Cohen J. The Internet of Things in assisted reproduction. Reprod Biomed Online 2023; 47:103338. [PMID: 37757612 DOI: 10.1016/j.rbmo.2023.103338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 08/06/2023] [Accepted: 08/07/2023] [Indexed: 09/29/2023]
Abstract
The Internet of Things (IoT) is a network connecting physical objects with sensors, software and internet connectivity for data exchange. Integrating the IoT with medical devices shows promise in healthcare, particularly in IVF laboratories. By leveraging telecommunications, cybersecurity, data management and intelligent systems, the IoT can enable a data-driven laboratory with automation, improved conditions, personalized treatment and efficient workflows. The integration of 5G technology ensures fast and reliable connectivity for real-time data transmission, while blockchain technology secures patient data. Fog computing reduces latency and enables real-time analytics. Microelectromechanical systems enable wearable IoT and miniaturized monitoring devices for tracking IVF processes. However, challenges such as security risks and network issues must be addressed through cybersecurity measures and networking advancements. Clinical embryologists should maintain their expertise and knowledge for safety and oversight, even with IoT in the IVF laboratory.
Collapse
Affiliation(s)
- Giles A Palmer
- IVF2.0 Ltd, London, UK; International IVF Initiative, New York, New York, USA
| | | | | | - Gerardo Mendizabal-Ruiz
- Conceivable Life Sciences, New York, New York, USA; Departamento de Bioingeniería Traslacional, Universidad de Guadalajara, Guadalajara, Mexico
| | - Jacques Cohen
- IVF2.0 Ltd, London, UK; International IVF Initiative, New York, New York, USA; Althea Science Inc, New York, New York, USA; Conceivable Life Sciences, New York, New York, USA.
| |
Collapse
|
3
|
Canosa S, Maggiulli R, Cimadomo D, Innocenti F, Fabozzi G, Gennarelli G, Revelli A, Bongioanni F, Vaiarelli A, Ubaldi FM, Rienzi L, Palmer GA, Nijs M. Cryostorage management of reproductive cells and tissues in ART: status, needs, opportunities and potential new challenges. Reprod Biomed Online 2023; 47:103252. [PMID: 37451970 DOI: 10.1016/j.rbmo.2023.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 06/12/2023] [Accepted: 06/14/2023] [Indexed: 07/18/2023]
Abstract
Among the wide range of procedures performed by clinical embryologists, the cryopreservation of reproductive cells and tissues represents a fundamental task in the daily routine. Indeed, cryopreservation procedures can be considered a subspecialty of medically assisted reproductive technology (ART), having the same relevance as sperm injection or embryo biopsy for preimplantation genetic testing. However, although a great deal of care has been devoted to optimizing cryopreservation protocols, the same energy has only recently been spent on developing and implementing strategies for the safe and reliable storage and transport of reproductive specimens. Herein, we have summarized the content of the available guidelines, the risks, the needs and the future perspectives regarding the management of cryopreservation biorepositories used in ART.
Collapse
Affiliation(s)
| | | | - Danilo Cimadomo
- IVIRMA Global Research Alliance, Clinica Valle Giulia, Rome, Italy
| | | | - Gemma Fabozzi
- IVIRMA Global Research Alliance, Clinica Valle Giulia, Rome, Italy
| | | | | | | | | | - Flippo M Ubaldi
- IVIRMA Global Research Alliance, Clinica Valle Giulia, Rome, Italy
| | - Laura Rienzi
- IVIRMA Global Research Alliance, Clinica Valle Giulia, Rome, Italy; Department of Biomolecular Sciences, University of Urbino 'Carlo Bo', Urbino, Italy
| | - Giles A Palmer
- International IVF Initiative Inc, New York, NY, USA; Institute of Life, IASO Hospital, Athens, Greece; IVF 2.0 Ltd, London, UK
| | | |
Collapse
|
4
|
Hammer KC, Jiang VS, Kanakasabapathy MK, Thirumalaraju P, Kandula H, Dimitriadis I, Souter I, Bormann CL, Shafiee H. Using artificial intelligence to avoid human error in identifying embryos: a retrospective cohort study. J Assist Reprod Genet 2022; 39:2343-2348. [PMID: 35962845 PMCID: PMC9596636 DOI: 10.1007/s10815-022-02585-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 07/19/2022] [Indexed: 10/15/2022] Open
Abstract
PURPOSE To determine whether convolutional neural networks (CNN) can be used to accurately ascertain the patient identity (ID) of cleavage and blastocyst stage embryos based on image data alone. METHODS A CNN model was trained and validated over three replicates on a retrospective cohort of 4889 time-lapse embryo images. The algorithm processed embryo images for each patient and produced a unique identification key that was associated with the patient ID at a timepoint on day 3 (~ 65 hours post-insemination (hpi)) and day 5 (~ 105 hpi) forming our data library. When the algorithm evaluated embryos at a later timepoint on day 3 (~ 70 hpi) and day 5 (~ 110 hpi), it generates another key that was matched with the patient's unique key available in the library. This approach was tested using 400 patient embryo cohorts on day 3 and day 5 and number of correct embryo identifications with the CNN algorithm was measured. RESULTS CNN technology matched the patient identification within random pools of 8 patient embryo cohorts on day 3 with 100% accuracy (n = 400 patients; 3 replicates). For day 5 embryo cohorts, the accuracy within random pools of 8 patients was 100% (n = 400 patients; 3 replicates). CONCLUSIONS This study describes an artificial intelligence-based approach for embryo identification. This technology offers a robust witnessing step based on unique morphological features of each embryo. This technology can be integrated with existing imaging systems and laboratory protocols to improve specimen tracking.
Collapse
Affiliation(s)
- Karissa C. Hammer
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Victoria S. Jiang
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Manoj Kumar Kanakasabapathy
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| | - Prudhvi Thirumalaraju
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| | - Hemanth Kandula
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| | - Irene Dimitriadis
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Irene Souter
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Charles L. Bormann
- Division of Reproductive Endocrinology and Infertility, Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Suite 10A, Boston, MA 02114 USA
| | - Hadi Shafiee
- Division of Engineering in Medicine, Brigham and Women’s Hospital, Harvard Medical School, 65 Landsdowne Street, Cambridge, MA 02139 USA
| |
Collapse
|