1
|
Hao M, Zhai R, Wang Y, Ru C, Yang B. A Stained-Free Sperm Morphology Measurement Method Based on Multi-Target Instance Parsing and Measurement Accuracy Enhancement. SENSORS (BASEL, SWITZERLAND) 2025; 25:592. [PMID: 39943231 PMCID: PMC11821022 DOI: 10.3390/s25030592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2024] [Revised: 01/17/2025] [Accepted: 01/18/2025] [Indexed: 02/16/2025]
Abstract
Sperm morphology assessment plays a vital role in semen analysis and the diagnosis of male infertility. By quantitatively analyzing the morphological characteristics of the sperm head, midpiece, and tail, it provides essential insights for assisted reproductive technologies (ARTs), such as in vitro fertilization (IVF). However, traditional manual evaluation methods not only rely on staining procedures that can damage the cells but also suffer from strong subjectivity and inconsistent results, underscoring the urgent need for an automated, accurate, and non-invasive method for multi-sperm morphology assessment. To address the limitations of existing techniques, this study proposes a novel method that combines a multi-scale part parsing network with a measurement accuracy enhancement strategy for non-stained sperm morphology analysis. First, a multi-scale part parsing network integrating semantic segmentation and instance segmentation is introduced to achieve instance-level parsing of sperm, enabling precise measurement of morphological parameters for each individual sperm instance. Second, to eliminate measurement errors caused by the reduced resolution of non-stained sperm images, a measurement accuracy enhancement method based on statistical analysis and signal processing is designed. This method employs an interquartile range (IQR) method to exclude outliers, Gaussian filtering to smooth data, and robust correction techniques to extract the maximum morphological features of sperm. Experimental results demonstrate that the proposed multi-scale part parsing network achieves 59.3% APvolp, surpassing the state-of-the-art AIParsing by 9.20%. Compared to evaluations based solely on segmentation results, the integration of the measurement accuracy enhancement strategy significantly reduces measurement errors, with the largest reduction in errors for head, midpiece, and tail measurements reaching up to 35.0%.
Collapse
Affiliation(s)
- Miao Hao
- Research Center of Robotics and Micro Systems, School of Mechanical and Electrical Engineering, Soochow University, Suzhou 215021, China;
| | - Rongan Zhai
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China;
| | - Yong Wang
- School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China; (Y.W.); (C.R.)
| | - Changhai Ru
- School of Electronic and Information Engineering, Suzhou University of Science and Technology, Suzhou 215009, China; (Y.W.); (C.R.)
| | - Bin Yang
- The First Affiliated Hospital of Soochow University, Suzhou 215129, China
| |
Collapse
|
2
|
Klingner A, Kovalenko A, Magdanz V, Khalil IS. Exploring sperm cell motion dynamics: Insights from genetic algorithm-based analysis. Comput Struct Biotechnol J 2024; 23:2837-2850. [PMID: 39660215 PMCID: PMC11630665 DOI: 10.1016/j.csbj.2024.06.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2024] [Revised: 06/05/2024] [Accepted: 06/06/2024] [Indexed: 12/12/2024] Open
Abstract
Accurate analysis of sperm cell flagellar dynamics plays a crucial role in understanding sperm motility as flagella parameters determine cell behavior in the spatiotemporal domain. In this study, we introduce a novel approach by harnessing Genetic Algorithms (GA) to analyze sperm flagellar motion characteristics and compare the results with the traditional decomposition method based on Fourier analysis. Our analysis focuses on extracting key parameters of the equation approximating flagellar shape, including beating period time, bending amplitude, mean curvature, and wavelength. Additionally, we delve into the extraction of phase constants and initial swimming directions, vital for the comprehensive study of sperm cell pairs and bundling phenomena. One significant advantage of GA over Fourier analysis is its ability to integrate sperm cell motion data, enabling a more comprehensive analysis. In contrast, Fourier analysis neglects sperm cell motion by transitioning to a sperm-centered coordinate system (material system). In our comparative study, GA consistently outperform the Fourier analysis-based method, yielding a remarkable reduction in fitting error of up to 70% and on average by 45%. An in-depth exploration of the sperm cell motion becomes indispensable in a wide range of applications from complexities of reproductive biology and medicine, to developing soft flagellated microrobots.
Collapse
Affiliation(s)
- Anke Klingner
- Department of Physics, German University in Cairo, New Cairo, 11835, Egypt
| | - Alexander Kovalenko
- Faculty of Information Technology, Czech Technical University in Prague, Prague, 16000, Czech Republic
| | - Veronika Magdanz
- Department of Systems Design Engineering, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - Islam S.M. Khalil
- Department of Biomechanical Engineering, University of Twente, Twente, 7500 AE, the Netherlands
| |
Collapse
|
3
|
Ghayda RA, Cannarella R, Calogero AE, Shah R, Rambhatla A, Zohdy W, Kavoussi P, Avidor-Reiss T, Boitrelle F, Mostafa T, Saleh R, Toprak T, Birowo P, Salvio G, Calik G, Kuroda S, Kaiyal RS, Ziouziou I, Crafa A, Phuoc NHV, Russo GI, Durairajanayagam D, Al-Hashimi M, Hamoda TAAAM, Pinggera GM, Adriansjah R, Maldonado Rosas I, Arafa M, Chung E, Atmoko W, Rocco L, Lin H, Huyghe E, Kothari P, Solorzano Vazquez JF, Dimitriadis F, Garrido N, Homa S, Falcone M, Sabbaghian M, Kandil H, Ko E, Martinez M, Nguyen Q, Harraz AM, Serefoglu EC, Karthikeyan VS, Tien DMB, Jindal S, Micic S, Bellavia M, Alali H, Gherabi N, Lewis S, Park HJ, Simopoulou M, Sallam H, Ramirez L, Colpi G, Agarwal A. Artificial Intelligence in Andrology: From Semen Analysis to Image Diagnostics. World J Mens Health 2024; 42:39-61. [PMID: 37382282 PMCID: PMC10782130 DOI: 10.5534/wjmh.230050] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 03/10/2023] [Accepted: 03/17/2023] [Indexed: 06/30/2023] Open
Abstract
Artificial intelligence (AI) in medicine has gained a lot of momentum in the last decades and has been applied to various fields of medicine. Advances in computer science, medical informatics, robotics, and the need for personalized medicine have facilitated the role of AI in modern healthcare. Similarly, as in other fields, AI applications, such as machine learning, artificial neural networks, and deep learning, have shown great potential in andrology and reproductive medicine. AI-based tools are poised to become valuable assets with abilities to support and aid in diagnosing and treating male infertility, and in improving the accuracy of patient care. These automated, AI-based predictions may offer consistency and efficiency in terms of time and cost in infertility research and clinical management. In andrology and reproductive medicine, AI has been used for objective sperm, oocyte, and embryo selection, prediction of surgical outcomes, cost-effective assessment, development of robotic surgery, and clinical decision-making systems. In the future, better integration and implementation of AI into medicine will undoubtedly lead to pioneering evidence-based breakthroughs and the reshaping of andrology and reproductive medicine.
Collapse
Affiliation(s)
- Ramy Abou Ghayda
- Urology Institute, University Hospitals, Case Western Reserve University, Cleveland, OH, USA
| | - Rossella Cannarella
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
- Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Aldo E. Calogero
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
| | - Rupin Shah
- Department of Urology, Lilavati Hospital and Research Centre, Mumbai, India
| | - Amarnath Rambhatla
- Department of Urology, Henry Ford Health System, Vattikuti Urology Institute, Detroit, MI, USA
| | - Wael Zohdy
- Andrology and STDs, Cairo University, Cairo, Egypt
| | - Parviz Kavoussi
- Department of Urology, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Tomer Avidor-Reiss
- Department of Biological Sciences, University of Toledo, Toledo, OH, USA
- Department of Urology, College of Medicine and Life Sciences, University of Toledo, Toledo, OH, USA
| | - Florence Boitrelle
- Reproductive Biology, Fertility Preservation, Andrology, CECOS, Poissy Hospital, Poissy, France
- Department of Biology, Reproduction, Epigenetics, Environment, and Development, Paris Saclay University, UVSQ, INRAE, BREED, Paris, France
| | - Taymour Mostafa
- Andrology, Sexology & STIs Department, Faculty of Medicine, Cairo University, Cairo, Egypt
| | - Ramadan Saleh
- Department of Dermatology, Venereology and Andrology, Faculty of Medicine, Sohag University, Sohag, Egypt
| | - Tuncay Toprak
- Department of Urology, Fatih Sultan Mehmet Training and Research Hospital, University of Health Sciences, Istanbul, Turkey
| | - Ponco Birowo
- Department of Urology, Dr. Cipto Mangunkusumo Hospital, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia
| | - Gianmaria Salvio
- Department of Endocrinology, Polytechnic University of Marche, Ancona, Italy
| | - Gokhan Calik
- Department of Urology, Istanbul Medipol University, Istanbul, Turkey
| | - Shinnosuke Kuroda
- Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
- Department of Urology, Reproduction Center, Yokohama City University Medical Center, Yokohama, Japan
| | - Raneen Sawaid Kaiyal
- Glickman Urological & Kidney Institute, Cleveland Clinic Foundation, Cleveland, OH, USA
| | - Imad Ziouziou
- Department of Urology, College of Medicine and Pharmacy, Ibn Zohr University, Agadir, Morocco
| | - Andrea Crafa
- Department of Clinical and Experimental Medicine, University of Catania, Catania, Italy
| | - Nguyen Ho Vinh Phuoc
- Department of Andrology, Binh Dan Hospital, Ho Chi Minh City, Vietnam
- Department of Urology and Andrology, Pham Ngoc Thach University of Medicine, Ho Chi Minh City, Vietnam
| | | | - Damayanthi Durairajanayagam
- Department of Physiology, Faculty of Medicine, Universiti Teknologi MARA, Sungai Buloh Campus, Selangor, Malaysia
| | - Manaf Al-Hashimi
- Department of Urology, Burjeel Hospital, Abu Dhabi, United Arab Emirates (UAE)
- Khalifa University, College of Medicine and Health Science, Abu Dhabi, United Arab Emirates (UAE)
| | - Taha Abo-Almagd Abdel-Meguid Hamoda
- Department of Urology, King Abdulaziz University, Jeddah, Saudi Arabia
- Department of Urology, Faculty of Medicine, Minia University, El-Minia, Egypt
| | | | - Ricky Adriansjah
- Department of Urology, Hasan Sadikin General Hospital, Universitas Padjadjaran, Banding, Indonesia
| | | | - Mohamed Arafa
- Department of Urology, Hamad Medical Corporation, Doha, Qatar
- Department of Urology, Weill Cornell Medical-Qatar, Doha, Qatar
| | - Eric Chung
- Department of Urology, Princess Alexandra Hospital, University of Queensland, Brisbane QLD, Australia
| | - Widi Atmoko
- Department of Urology, Dr. Cipto Mangunkusumo Hospital, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia
| | - Lucia Rocco
- Department of Environmental, Biological and Pharmaceutical Sciences and Technologies, University of Campania “Luigi Vanvitelli”, Caserta, Italy
| | - Haocheng Lin
- Department of Urology, Peking University Third Hospital, Peking University, Beijing, China
| | - Eric Huyghe
- Department of Urology and Andrology, University Hospital of Toulouse, Toulouse, France
| | - Priyank Kothari
- Department of Urology, B.Y.L. Nair Charitable Hospital, Topiwala National Medical College, Mumbai, India
| | | | - Fotios Dimitriadis
- Department of Urology, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Nicolas Garrido
- IVIRMA Global Research Alliance, IVI Foundation, Instituto de Investigación Sanitaria La Fe (IIS La Fe), Valencia, Spain
| | - Sheryl Homa
- Department of Biosciences, University of Kent, Canterbury, United Kingdom
| | - Marco Falcone
- Department of Urology, Molinette Hospital, A.O.U. Città della Salute e della Scienza, University of Turin, Torino, Italy
| | - Marjan Sabbaghian
- Department of Andrology, Reproductive Biomedicine Research Center, Royan Institute for Reproductive Biomedicine, ACECR, Tehran, Iran
| | | | - Edmund Ko
- Department of Urology, Loma Linda University Health, Loma Linda, CA, USA
| | - Marlon Martinez
- Section of Urology, Department of Surgery, University of Santo Tomas Hospital, Manila, Philippines
| | - Quang Nguyen
- Section of Urology, Department of Surgery, University of Santo Tomas Hospital, Manila, Philippines
- Center for Andrology and Sexual Medicine, Viet Duc University Hospital, Hanoi, Vietnam
- Department of Urology, Andrology and Sexual Medicine, University of Medicine and Pharmacy, Vietnam National University, Hanoi, Vietnam
| | - Ahmed M. Harraz
- Urology and Nephrology Center, Mansoura University, Mansoura, Egypt
- Department of Surgery, Urology Unit, Farwaniya Hospital, Farwaniya, Kuwait
- Department of Urology, Sabah Al Ahmad Urology Center, Kuwait City, Kuwait
| | - Ege Can Serefoglu
- Department of Urology, Biruni University School of Medicine, Istanbul, Turkey
| | | | - Dung Mai Ba Tien
- Department of Andrology, Binh Dan Hospital, Ho Chi Minh City, Vietnam
| | - Sunil Jindal
- Department of Andrology and Reproductive Medicine, Jindal Hospital, Meerut, India
| | - Sava Micic
- Department of Andrology, Uromedica Polyclinic, Belgrade, Serbia
| | - Marina Bellavia
- Andrology and IVF Center, Next Fertility Procrea, Lugano, Switzerland
| | - Hamed Alali
- King Fahad Specialist Hospital, Dammam, Saudi Arabia
| | - Nazim Gherabi
- Andrology Committee of the Algerian Association of Urology, Algiers, Algeria
| | - Sheena Lewis
- Examen Lab Ltd., Northern Ireland, United Kingdom
| | - Hyun Jun Park
- Department of Urology, Pusan National University School of Medicine, Busan, Korea
- Medical Research Institute of Pusan National University Hospital, Busan, Korea
| | - Mara Simopoulou
- Department of Experimental Physiology, School of Health Sciences, Faculty of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Hassan Sallam
- Alexandria University Faculty of Medicine, Alexandria, Egypt
| | - Liliana Ramirez
- IVF Laboratory, CITMER Reproductive Medicine, Mexico City, Mexico
| | - Giovanni Colpi
- Andrology and IVF Center, Next Fertility Procrea, Lugano, Switzerland
| | - Ashok Agarwal
- Global Andrology Forum, Moreland Hills, OH, USA
- Cleveland Clinic, Cleveland, OH, USA
| | | |
Collapse
|
4
|
Lewandowska E, Węsierski D, Mazur-Milecka M, Liss J, Jezierska A. Ensembling noisy segmentation masks of blurred sperm images. Comput Biol Med 2023; 166:107520. [PMID: 37804777 DOI: 10.1016/j.compbiomed.2023.107520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 08/11/2023] [Accepted: 09/19/2023] [Indexed: 10/09/2023]
Abstract
BACKGROUND Sperm tail morphology and motility have been demonstrated to be important factors in determining sperm quality for in vitro fertilization. However, many existing computer-aided sperm analysis systems leave the sperm tail out of the analysis, as detecting a few tail pixels is challenging. Moreover, some publicly available datasets for classifying morphological defects contain images limited only to the sperm head. This study focuses on the segmentation of full sperm, which consists of the head and tail parts, and appear alone and in groups. METHODS We re-purpose the Feature Pyramid Network to ensemble an input image with multiple masks from state-of-the-art segmentation algorithms using a scale-specific cross-attention module. We normalize homogeneous backgrounds for improved training. The low field depth of microscopes blurs the images, easily confusing human raters in discerning minuscule sperm from large backgrounds. We thus propose evaluation protocols for scoring segmentation models trained on imbalanced data and noisy ground truth. RESULTS The neural ensembling of noisy segmentation masks outperforms all single, state-of-the-art segmentation algorithms in full sperm segmentation. Human raters agree more on the head than tail masks. The algorithms also segment the head better than the tail. CONCLUSIONS The extensive evaluation of state-of-the-art segmentation algorithms shows that full sperm segmentation is challenging. We release the SegSperm dataset of images from Intracytoplasmic Sperm Injection procedures to spur further progress on full sperm segmentation with noisy and imbalanced ground truth. The dataset is publicly available at https://doi.org/10.34808/6wm7-1159.
Collapse
Affiliation(s)
| | - Daniel Węsierski
- Cameras and Algorithms Lab, Gdańsk University of Technology, Poland; Multimedia Systems Department, Faculty of Electronics, Telecommunication, and Informatics, Gdańsk University of Technology, Poland
| | - Magdalena Mazur-Milecka
- Department of Biomedical Engineering, Faculty of Electronics, Telecommunications, and Informatics, Gdańsk University of Technology, Poland
| | - Joanna Liss
- Invicta Research and Development Center, Sopot, Poland; Department of Medical Biology and Genetics, University of Gdańsk, Poland
| | - Anna Jezierska
- Cameras and Algorithms Lab, Gdańsk University of Technology, Poland; Department of Biomedical Engineering, Faculty of Electronics, Telecommunications, and Informatics, Gdańsk University of Technology, Poland; Department of Modelling and Optimization of Dynamical Systems, Systems Research Institute Warsaw, Poland.
| |
Collapse
|
5
|
Christensen BW, Meyers S. Canine Semen Evaluation and Processing. Vet Clin North Am Small Anim Pract 2023:S0195-5616(23)00079-7. [PMID: 37400342 DOI: 10.1016/j.cvsm.2023.05.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/05/2023]
Abstract
Advances in canine semen evaluation have progressed over time in fits and spurts, interspersed with long periods of relative inactivity. Despite exciting advances in the semen analysis, clinical canine theriogenology has been in a period of relative inactivity for a number of decades since initial advances in canine semen freezing in the mid 20th century. This review describes ways that the clinical practice of canine semen evaluation should improve, given the state of current knowledge.
Collapse
Affiliation(s)
| | - Stuart Meyers
- School of Veterinary Medicine, University of California, One Shields Avenue, Davis, CA 95616, USA
| |
Collapse
|
6
|
Liu G, Shi H, Zhang H, Zhou Y, Sun Y, Li W, Huang X, Jiang Y, Fang Y, Yang G. Fast Noninvasive Morphometric Characterization of Free Human Sperms Using Deep Learning. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2022; 28:1-13. [PMID: 35748406 DOI: 10.1017/s1431927622012132] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The selection of high-quality sperms is critical to intracytoplasmic sperm injection, which accounts for 70–80% of in vitro fertilization (IVF) treatments. So far, sperm screening is usually performed manually by clinicians. However, the performance of manual screening is limited in its objectivity, consistency, and efficiency. To overcome these limitations, we have developed a fast and noninvasive three-stage method to characterize morphology of freely swimming human sperms in bright-field microscopy images using deep learning models. Specifically, we use an object detection model to identify sperm heads, a classification model to select in-focus images, and a segmentation model to extract geometry of sperm heads and vacuoles. The models achieve an F1-score of 0.951 in sperm head detection, a z-position estimation error within ±1.5 μm in in-focus image selection, and a Dice score of 0.948 in sperm head segmentation, respectively. Customized lightweight architectures are used for the models to achieve real-time analysis of 200 frames per second. Comprehensive morphological parameters are calculated from sperm head geometry extracted by image segmentation. Overall, our method provides a reliable and efficient tool to assist clinicians in selecting high-quality sperms for successful IVF. It also demonstrates the effectiveness of deep learning in real-time analysis of live bright-field microscopy images.
Collapse
Affiliation(s)
- Guole Liu
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Hao Shi
- Sperm Capturer (Beijing) Biotechnology Co. Ltd., Beijing 100070, China
| | - Huan Zhang
- Reproductive Medicine Center, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang 325000, China
| | - Yating Zhou
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Yujiao Sun
- State Key Laboratory of Molecular Developmental Biology, Institute of Genetics and Developmental Biology, Chinese Academy of Sciences, Beijing 100101, China
| | - Wei Li
- Beijing Children's Hospital, Capital Medical University, Beijing 100045, China
| | - Xuefeng Huang
- Reproductive Medicine Center, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang 325000, China
| | - Yuqiang Jiang
- State Key Laboratory of Molecular Developmental Biology, Institute of Genetics and Developmental Biology, Chinese Academy of Sciences, Beijing 100101, China
| | - Yaliang Fang
- Sperm Capturer (Beijing) Biotechnology Co. Ltd., Beijing 100070, China
| | - Ge Yang
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
- National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| |
Collapse
|
7
|
A hybrid IMM-JPDAF algorithm for tracking multiple sperm targets and motility analysis. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07390-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
8
|
Zhuang S, Dai C, Shan G, Ru C, Zhang Z, Sun Y. Robotic Rotational Positioning of End-Effectors for Micromanipulation. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2022.3142671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
9
|
Alameri M, Hasikin K, Kadri NA, Nasir NFM, Mohandas P, Anni JS, Azizan MM. Multistage Optimization Using a Modified Gaussian Mixture Model in Sperm Motility Tracking. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:6953593. [PMID: 34497665 PMCID: PMC8421170 DOI: 10.1155/2021/6953593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/08/2021] [Revised: 06/24/2021] [Accepted: 08/12/2021] [Indexed: 11/17/2022]
Abstract
Infertility is a condition whereby pregnancy does not occur despite having unprotected sexual intercourse for at least one year. The main reason could originate from either the male or the female, and sometimes, both contribute to the fertility disorder. For the male, sperm disorder was found to be the most common reason for infertility. In this paper, we proposed male infertility analysis based on automated sperm motility tracking. The proposed method worked in multistages, where the first stage focused on the sperm detection process using an improved Gaussian Mixture Model. A new optimization protocol was proposed to accurately detect the motile sperms prior to the sperm tracking process. Since the optimization protocol was imposed in the proposed system, the sperm tracking and velocity estimation processes are improved. The proposed method attained the highest average accuracy, sensitivity, and specificity of 92.3%, 96.3%, and 72.4%, respectively, when tested on 10 different samples. Our proposed method depicted better sperm detection quality when qualitatively observed as compared to other state-of-the-art techniques.
Collapse
Affiliation(s)
- Mohammed Alameri
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Lembah Pantai, 50603 Kuala Lumpur, Malaysia
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Lembah Pantai, 50603 Kuala Lumpur, Malaysia
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Lembah Pantai, 50603 Kuala Lumpur, Malaysia
| | - Nashrul Fazli Mohd Nasir
- Biomedical Electronic Engineering Program, Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, Malaysia
- Sport Engineering Research Centre (SERC), Universiti Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, Malaysia
| | - Prabu Mohandas
- Department of Computer Science and Engineering, National Institute of Technology Calicut, Kerala, India
| | - Jerline Sheeba Anni
- Department of Computer Science and Engineering, MEA Engineering College, Kerala, India
| | - Muhammad Mokhzaini Azizan
- Department of Electrical and Electronic Engineering, Faculty of Engineering and Built Environment, Universiti Sains Islam Malaysia, Bandar Baru Nilai, 71800 Nilai, Negeri Sembilan, Malaysia
| |
Collapse
|
10
|
Dai C, Zhang Z, Shan G, Chu LT, Huang Z, Moskovtsev S, Librach C, Jarvi K, Sun Y. Advances in sperm analysis: techniques, discoveries and applications. Nat Rev Urol 2021; 18:447-467. [PMID: 34075227 DOI: 10.1038/s41585-021-00472-2] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/20/2021] [Indexed: 02/05/2023]
Abstract
Infertility affects one in six couples worldwide, and fertility continues to deteriorate globally, partly owing to a decline in semen quality. Sperm analysis has a central role in diagnosing and treating male factor infertility. Many emerging techniques, such as digital holography, super-resolution microscopy and next-generation sequencing, have been developed that enable improved analysis of sperm motility, morphology and genetics to help overcome limitations in accuracy and consistency, and improve sperm selection for infertility treatment. These techniques have also improved our understanding of fundamental sperm physiology by enabling discoveries in sperm behaviour and molecular structures. Further progress in sperm analysis and integrating these techniques into laboratories and clinics requires multidisciplinary collaboration, which will increase discovery and improve clinical outcomes.
Collapse
Affiliation(s)
- Changsheng Dai
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada
| | - Zhuoran Zhang
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada
| | - Guanqiao Shan
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada
| | - Lap-Tak Chu
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada
| | - Zongjie Huang
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada
| | | | | | - Keith Jarvi
- Division of Urology, Mount Sinai Hospital, Toronto, Canada. .,Department of Surgery, University of Toronto, Toronto, Canada.
| | - Yu Sun
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, Canada. .,Institute of Biomaterials & Biomedical Engineering, University of Toronto, Toronto, Canada. .,Department of Electrical and Computer Engineering, University of Toronto, Toronto, Canada. .,Department of Computer Science, University of Toronto, Toronto, Canada.
| |
Collapse
|
11
|
Zhang Z, Dai C, Shan G, Chen X, Liu H, Abdalla K, Kuznyetsova I, Moskovstev S, Huang X, Librach C, Jarvi K, Sun Y. Quantitative selection of single human sperm with high DNA integrity for intracytoplasmic sperm injection. Fertil Steril 2021; 116:1308-1318. [PMID: 34266663 DOI: 10.1016/j.fertnstert.2021.06.016] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 06/06/2021] [Accepted: 06/08/2021] [Indexed: 12/01/2022]
Abstract
OBJECTIVE To study at the single-cell level whether a sperm's motility and morphology parameters reflect its DNA integrity, and to establish a set of quantitative criteria for selecting single sperm with high DNA integrity. DESIGN Prospective study. SETTING In vitro fertilization center and university laboratories. PATIENT(S) Male patients undergoing infertility treatments. INTERVENTION(S) None. MAIN OUTCOME MEASURE(S) The motility and morphology parameters of each sperm were measured with the use of computer vision algorithms. The sperm was then aspirated and transferred for DNA fragmentation measurement by single-cell gel electrophoresis (comet assay). RESULT(S) We adapted the World Health Organization criteria, which were originally defined for semen analysis, and established a set of quantitative criteria for single-sperm selection in intracytoplasmic sperm injection. Sperm satisfying the criteria had significantly lower DNA fragmentation levels than the sample population. Both normal motility and normal morphology were required for a sperm to have low DNA fragmentation. The quantitative criteria were integrated into a software program for sperm selection. In blind tests in which our software and three embryologists selected sperm from the same patient samples, our software outperformed the embryologists and selected sperm with the highest DNA integrity. CONCLUSION(S) At the single-cell level, a sperm's motility and morphology parameters reflect its DNA integrity. The developed technique and criteria hold the potential to mitigate the risk factor of sperm DNA fragmentation in intracytoplasmic sperm injection.
Collapse
Affiliation(s)
- Zhuoran Zhang
- Department of Mechanical Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Changsheng Dai
- Department of Mechanical Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Guanqiao Shan
- Department of Mechanical Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Xin Chen
- The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Hang Liu
- Department of Mechanical Engineering, University of Toronto, Toronto, Ontario, Canada
| | | | | | | | - Xi Huang
- The Hospital for Sick Children, Toronto, Ontario, Canada
| | | | - Keith Jarvi
- Mount Sinai Hospital, Toronto, Ontario, Canada
| | - Yu Sun
- Department of Mechanical Engineering, University of Toronto, Toronto, Ontario, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada; Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada; Department of Computer Science, University of Toronto, Toronto, Ontario, Canada.
| |
Collapse
|
12
|
You JB, McCallum C, Wang Y, Riordon J, Nosrati R, Sinton D. Machine learning for sperm selection. Nat Rev Urol 2021; 18:387-403. [PMID: 34002070 DOI: 10.1038/s41585-021-00465-1] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/30/2021] [Indexed: 02/04/2023]
Abstract
Infertility rates and the number of couples seeking fertility care have increased worldwide over the past few decades. Over 2.5 million cycles of assisted reproductive technologies are being performed globally every year, but the success rate has remained at ~33%. Machine learning, an automated method of data analysis based on patterns and inference, is increasingly being deployed within the health-care sector to improve diagnostics and therapeutics. This technique is already aiding embryo selection in some fertility clinics, and has also been applied in research laboratories to improve sperm analysis and selection. Tremendous opportunities exist for machine learning to advance male fertility treatments. The fundamental challenge of sperm selection - selecting the most promising candidate from 108 gametes - presents a challenge that is uniquely well-suited to the high-throughput capabilities of machine learning algorithms paired with modern data processing capabilities.
Collapse
Affiliation(s)
- Jae Bem You
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada.,Department of Chemical Engineering, Kyungpook National University, Daegu, Republic of Korea
| | - Christopher McCallum
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Yihe Wang
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Jason Riordon
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Reza Nosrati
- Department of Mechanical & Aerospace Engineering, Monash University, Clayton, VIC, Australia
| | - David Sinton
- Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
13
|
Dai C, Zhang Z, Jahangiri S, Shan G, Moskovstev S, Librach C, Jarvi K, Sun Y. Automated motility and morphology measurement of live spermatozoa. Andrology 2021; 9:1205-1213. [PMID: 33740840 DOI: 10.1111/andr.13002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Revised: 03/05/2021] [Accepted: 03/16/2021] [Indexed: 12/17/2022]
Abstract
BACKGROUND Automated sperm analysis has wide applications in infertility diagnosis. Existing systems are not able to measure sperm count and both motility and morphology of individual live spermatozoa. Morphology measurement requires invasive staining, making the spermatozoa after morphology measurement not applicable to infertility treatment. OBJECTIVE To evaluate the reproducibility and reliability of automated measurement of individual live sperm's motility and morphology. MATERIALS AND METHODS Fresh semen samples were obtained from twenty male partners attending for fertility investigations. The system firstly measured motility for all the spermatozoa within the field of view under a low magnification (20×), then a spermatozoa of interest is selected by the user and automatically relocated by the system after switching to a high magnification (100×) for morphology measurement. Reproducibility of sperm measurements was evaluated by intraclass correlation coefficients on consecutive measurement. Reliability of motility and morphology measurement was evaluated by tracking error rate and limits of agreement, respectively, with manual measurement as benchmark. RESULTS Measurement of all motility and morphology parameters had intraclass correlation coefficients higher than 0.94. Sperm motility measurement had a tracking error rate of 2.1%. Limit of agreement analysis indicated that automated measurement and manual measurement of sperm morphology were interchangeable. Automated measurement of all morphology parameters was not statistically different from manual measurement, as confirmed by the paired sample t test. DISCUSSION Automated motility and morphology measurement of single sperm revealed high reproducibility and reliability. The system also achieved a high efficiency for motility and morphology measurement. In addition to the intracytoplasmic sperm injection (ICSI) samples with polyvinylpyrrolidone (PVP), the developed sperm measurement technique is also effective for analyzing semen and washed samples. The system provides a valuable tool for quantitative measurement and selection of single spermatozoa for ICSI. It can also be used for sperm motility and morphology analysis in andrology laboratories.
Collapse
Affiliation(s)
- Changsheng Dai
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | - Zhuoran Zhang
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | | | - Guanqiao Shan
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON, Canada
| | | | | | - Keith Jarvi
- Division of Urology, Mount Sinai Hospital, Toronto, ON, Canada
| | - Yu Sun
- Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON, Canada.,Institute of Biomaterials & Biomedical Engineering, University of Toronto, Toronto, ON, Canada.,Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada.,Department of Computer Science, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
14
|
McCallum C, Riordon J, Wang Y, Kong T, You JB, Sanner S, Lagunov A, Hannam TG, Jarvi K, Sinton D. Deep learning-based selection of human sperm with high DNA integrity. Commun Biol 2019; 2:250. [PMID: 31286067 PMCID: PMC6610103 DOI: 10.1038/s42003-019-0491-6] [Citation(s) in RCA: 44] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2018] [Accepted: 06/05/2019] [Indexed: 12/13/2022] Open
Abstract
Despite the importance of sperm DNA to human reproduction, currently no method exists to assess individual sperm DNA quality prior to clinical selection. Traditionally, skilled clinicians select sperm based on a variety of morphological and motility criteria, but without direct knowledge of their DNA cargo. Here, we show how a deep convolutional neural network can be trained on a collection of ~1000 sperm cells of known DNA quality, to predict DNA quality from brightfield images alone. Our results demonstrate moderate correlation (bivariate correlation ~0.43) between a sperm cell image and DNA quality and the ability to identify higher DNA integrity cells relative to the median. This deep learning selection process is directly compatible with current, manual microscopy-based sperm selection and could assist clinicians, by providing rapid DNA quality predictions (under 10 ms per cell) and sperm selection within the 86th percentile from a given sample.
Collapse
Affiliation(s)
- Christopher McCallum
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Jason Riordon
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Yihe Wang
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Tian Kong
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Jae Bem You
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Scott Sanner
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| | - Alexander Lagunov
- Hannam Fertility Centre, 160 Bloor St. East, Toronto, ON Canada M4W 3R2
| | - Thomas G. Hannam
- Hannam Fertility Centre, 160 Bloor St. East, Toronto, ON Canada M4W 3R2
| | - Keith Jarvi
- Department of Surgery, Division of Urology, Mount Sinai Hospital, University of Toronto, 60 Murray Street, 6th Floor, Toronto, ON Canada M5T 3L9
| | - David Sinton
- Department of Mechanical and Industrial Engineering, University of Toronto, 5 King’s College Road, Toronto, ON Canada M5S 3G8
| |
Collapse
|
15
|
Javadi S, Mirroshandel SA. A novel deep learning method for automatic assessment of human sperm images. Comput Biol Med 2019; 109:182-194. [DOI: 10.1016/j.compbiomed.2019.04.030] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Revised: 04/22/2019] [Accepted: 04/22/2019] [Indexed: 10/26/2022]
|