1
|
Lundin J, Suutala A, Holmström O, Henriksson S, Valkamo S, Kaingu H, Kinyua F, Muinde M, Lundin M, Diwan V, Mårtensson A, Linder N. Diagnosis of soil-transmitted helminth infections with digital mobile microscopy and artificial intelligence in a resource-limited setting. PLoS Negl Trop Dis 2024; 18:e0012041. [PMID: 38602896 PMCID: PMC11008773 DOI: 10.1371/journal.pntd.0012041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Accepted: 02/28/2024] [Indexed: 04/13/2024] Open
Abstract
BACKGROUND Infections caused by soil-transmitted helminths (STHs) are the most prevalent neglected tropical diseases and result in a major disease burden in low- and middle-income countries, especially in school-aged children. Improved diagnostic methods, especially for light intensity infections, are needed for efficient, control and elimination of STHs as a public health problem, as well as STH management. Image-based artificial intelligence (AI) has shown promise for STH detection in digitized stool samples. However, the diagnostic accuracy of AI-based analysis of entire microscope slides, so called whole-slide images (WSI), has previously not been evaluated on a sample-level in primary healthcare settings in STH endemic countries. METHODOLOGY/PRINCIPAL FINDINGS Stool samples (n = 1,335) were collected during 2020 from children attending primary schools in Kwale County, Kenya, prepared according to the Kato-Katz method at a local primary healthcare laboratory and digitized with a portable whole-slide microscopy scanner and uploaded via mobile networks to a cloud environment. The digital samples of adequate quality (n = 1,180) were split into a training (n = 388) and test set (n = 792) and a deep-learning system (DLS) developed for detection of STHs. The DLS findings were compared with expert manual microscopy and additional visual assessment of the digital samples in slides with discordant results between the methods. Manual microscopy detected 15 (1.9%) Ascaris lumbricoides, 172 (21.7%) Tricuris trichiura and 140 (17.7%) hookworm (Ancylostoma duodenale or Necator americanus) infections in the test set. Importantly, more than 90% of all STH positive cases represented light intensity infections. With manual microscopy as the reference standard, the sensitivity of the DLS as the index test for detection of A. lumbricoides, T. trichiura and hookworm was 80%, 92% and 76%, respectively. The corresponding specificity was 98%, 90% and 95%. Notably, in 79 samples (10%) classified as negative by manual microscopy for a specific species, STH eggs were detected by the DLS and confirmed correct by visual inspection of the digital samples. CONCLUSIONS/SIGNIFICANCE Analysis of digitally scanned stool samples with the DLS provided high diagnostic accuracy for detection of STHs. Importantly, a substantial number of light intensity infections were missed by manual microscopy but detected by the DLS. Thus, analysis of WSIs with image-based AI may provide a future tool for improved detection of STHs in a primary healthcare setting, which in turn could facilitate monitoring and evaluation of control programs.
Collapse
Affiliation(s)
- Johan Lundin
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden
- Institute for Molecular Medicine Finland (FIMM), HiLIFE, University of Helsinki, Helsinki, Finland
| | - Antti Suutala
- Institute for Molecular Medicine Finland (FIMM), HiLIFE, University of Helsinki, Helsinki, Finland
| | - Oscar Holmström
- Institute for Molecular Medicine Finland (FIMM), HiLIFE, University of Helsinki, Helsinki, Finland
| | - Samuel Henriksson
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden
| | - Severi Valkamo
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden
| | | | - Felix Kinyua
- Kinondo Kwetu Hospital, Kinondo, Kwale County, Kenya
| | - Martin Muinde
- Kinondo Kwetu Hospital, Kinondo, Kwale County, Kenya
| | - Mikael Lundin
- Institute for Molecular Medicine Finland (FIMM), HiLIFE, University of Helsinki, Helsinki, Finland
| | - Vinod Diwan
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden
| | - Andreas Mårtensson
- Global Health & Migration Unit, Department of Women’s and Children’s Health, Uppsala University, Uppsala, Sweden
| | - Nina Linder
- Institute for Molecular Medicine Finland (FIMM), HiLIFE, University of Helsinki, Helsinki, Finland
- Global Health & Migration Unit, Department of Women’s and Children’s Health, Uppsala University, Uppsala, Sweden
| |
Collapse
|
2
|
Holmström O, Stenman S, Suutala A, Moilanen H, Kücükel H, Ngasala B, Mårtensson A, Mhamilawa L, Aydin-Schmidt B, Lundin M, Diwan V, Linder N, Lundin J. A novel deep learning-based point-of-care diagnostic method for detecting Plasmodium falciparum with fluorescence digital microscopy. PLoS One 2020; 15:e0242355. [PMID: 33201905 PMCID: PMC7671488 DOI: 10.1371/journal.pone.0242355] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 10/30/2020] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Malaria remains a major global health problem with a need for improved field-usable diagnostic tests. We have developed a portable, low-cost digital microscope scanner, capable of both brightfield and fluorescence imaging. Here, we used the instrument to digitize blood smears, and applied deep learning (DL) algorithms to detect Plasmodium falciparum parasites. METHODS Thin blood smears (n = 125) were collected from patients with microscopy-confirmed P. falciparum infections in rural Tanzania, prior to and after initiation of artemisinin-based combination therapy. The samples were stained using the 4',6-diamidino-2-phenylindole fluorogen and digitized using the prototype microscope scanner. Two DL algorithms were trained to detect malaria parasites in the samples, and results compared to the visual assessment of both the digitized samples, and the Giemsa-stained thick smears. RESULTS Detection of P. falciparum parasites in the digitized thin blood smears was possible both by visual assessment and by DL-based analysis with a strong correlation in results (r = 0.99, p < 0.01). A moderately strong correlation was observed between the DL-based thin smear analysis and the visual thick smear-analysis (r = 0.74, p < 0.01). Low levels of parasites were detected by DL-based analysis on day three following treatment initiation, but a small number of fluorescent signals were detected also in microscopy-negative samples. CONCLUSION Quantification of P. falciparum parasites in DAPI-stained thin smears is feasible using DL-supported, point-of-care digital microscopy, with a high correlation to visual assessment of samples. Fluorescent signals from artefacts in samples with low infection levels represented the main challenge for the digital analysis, thus highlighting the importance of minimizing sample contaminations. The proposed method could support malaria diagnostics and monitoring of treatment response through automated quantification of parasitaemia and is likely to be applicable also for diagnostics of other Plasmodium species and other infectious diseases.
Collapse
Affiliation(s)
- Oscar Holmström
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
- * E-mail:
| | - Sebastian Stenman
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
| | - Antti Suutala
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
| | - Hannu Moilanen
- Center of Microscopy and Nanotechnology, University of Oulu, Oulu, Finland
| | - Hakan Kücükel
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
| | - Billy Ngasala
- Department of Women’s and Children’s Health, International Maternal and Child Health (IMCH), Uppsala University, Uppsala, Sweden
- Department of Medical Entomology and Parasitology, School of Public Health, Muhimbili University of Health and Allied Sciences, Dar es Salaam, Tanzania
| | - Andreas Mårtensson
- Department of Women’s and Children’s Health, International Maternal and Child Health (IMCH), Uppsala University, Uppsala, Sweden
| | - Lwidiko Mhamilawa
- Department of Women’s and Children’s Health, International Maternal and Child Health (IMCH), Uppsala University, Uppsala, Sweden
- Department of Medical Entomology and Parasitology, School of Public Health, Muhimbili University of Health and Allied Sciences, Dar es Salaam, Tanzania
| | - Berit Aydin-Schmidt
- Department of Microbiology, Tumor and Cell Biology, Karolinska Institutet, Stockholm, Sweden
| | - Mikael Lundin
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
| | - Vinod Diwan
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden
| | - Nina Linder
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
- Department of Women’s and Children’s Health, International Maternal and Child Health (IMCH), Uppsala University, Uppsala, Sweden
| | - Johan Lundin
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
3
|
Holmström O, Linder N, Moilanen H, Suutala A, Nordling S, Ståhls A, Lundin M, Diwan V, Lundin J. Detection of breast cancer lymph node metastases in frozen sections with a point-of-care low-cost microscope scanner. PLoS One 2019; 14:e0208366. [PMID: 30889174 PMCID: PMC6424449 DOI: 10.1371/journal.pone.0208366] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2018] [Accepted: 03/05/2019] [Indexed: 01/05/2023] Open
Abstract
Background Detection of lymph node metastases is essential in breast cancer diagnostics and staging, affecting treatment and prognosis. Intraoperative microscopy analysis of sentinel lymph node frozen sections is standard for detection of axillary metastases but requires access to a pathologist for sample analysis. Remote analysis of digitized samples is an alternative solution but is limited by the requirement for high-end slide scanning equipment. Objective To determine whether the image quality achievable with a low-cost, miniature digital microscope scanner is sufficient for detection of metastases in breast cancer lymph node frozen sections. Methods Lymph node frozen sections from 79 breast cancer patients were digitized using a prototype miniature microscope scanner and a high-end slide scanner. Images were independently reviewed by two pathologists and results compared between devices with conventional light microscopy analysis as ground truth. Results Detection of metastases in the images acquired with the miniature scanner yielded an overall sensitivity of 91% and specificity of 99% and showed strong agreement when compared to light microscopy (k = 0.91). Strong agreement was also observed when results were compared to results from the high-end slide scanner (k = 0.94). A majority of discrepant cases were micrometastases and sections of which no anticytokeratin staining was available. Conclusion Accuracy of detection of metastatic cells in breast cancer sentinel lymph node frozen sections by visual analysis of samples digitized using low-cost, point-of-care microscopy is comparable to analysis of digital samples scanned using a high-end, whole slide scanner. This technique could potentially provide a workflow for digital diagnostics in resource-limited settings, facilitate sample analysis at the point-of-care and reduce the need for trained experts on-site during surgical procedures.
Collapse
Affiliation(s)
- Oscar Holmström
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
- * E-mail:
| | - Nina Linder
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
- Department of Women's and Children's Health, International Maternal and Child health, Uppsala University, Uppsala, Sweden
| | - Hannu Moilanen
- Center of Microscopy and Nanotechnology, University of Oulu, Oulu, Finland
| | - Antti Suutala
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
| | - Stig Nordling
- Department of Pathology, University of Helsinki, Helsinki, Finland
| | - Anders Ståhls
- Helsinki University Hospital and HUSLAB Pathology laboratory, Helsinki, Finland
| | - Mikael Lundin
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
| | - Vinod Diwan
- Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
| | - Johan Lundin
- Institute for Molecular Medicine Finland (FIMM), University of Helsinki, Helsinki, Finland
- Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
4
|
Holmström O, Linder N, Ngasala B, Mårtensson A, Linder E, Lundin M, Moilanen H, Suutala A, Diwan V, Lundin J. Point-of-care mobile digital microscopy and deep learning for the detection of soil-transmitted helminths and Schistosoma haematobium. Glob Health Action 2018; 10:1337325. [PMID: 28838305 PMCID: PMC5645671 DOI: 10.1080/16549716.2017.1337325] [Citation(s) in RCA: 40] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
Background: Microscopy remains the gold standard in the diagnosis of neglected tropical diseases. As resource limited, rural areas often lack laboratory equipment and trained personnel, new diagnostic techniques are needed. Low-cost, point-of-care imaging devices show potential in the diagnosis of these diseases. Novel, digital image analysis algorithms can be utilized to automate sample analysis. Objective: Evaluation of the imaging performance of a miniature digital microscopy scanner for the diagnosis of soil-transmitted helminths and Schistosoma haematobium, and training of a deep learning-based image analysis algorithm for automated detection of soil-transmitted helminths in the captured images. Methods: A total of 13 iodine-stained stool samples containing Ascaris lumbricoides, Trichuris trichiura and hookworm eggs and 4 urine samples containing Schistosoma haematobium were digitized using a reference whole slide-scanner and the mobile microscopy scanner. Parasites in the images were identified by visual examination and by analysis with a deep learning-based image analysis algorithm in the stool samples. Results were compared between the digital and visual analysis of the images showing helminth eggs. Results: Parasite identification by visual analysis of digital slides captured with the mobile microscope was feasible for all analyzed parasites. Although the spatial resolution of the reference slide-scanner is higher, the resolution of the mobile microscope is sufficient for reliable identification and classification of all parasites studied. Digital image analysis of stool sample images captured with the mobile microscope showed high sensitivity for detection of all helminths studied (range of sensitivity = 83.3–100%) in the test set (n = 217) of manually labeled helminth eggs. Conclusions: In this proof-of-concept study, the imaging performance of a mobile, digital microscope was sufficient for visual detection of soil-transmitted helminths and Schistosoma haematobium. Furthermore, we show that deep learning-based image analysis can be utilized for the automated detection and classification of helminths in the captured images.
Collapse
Affiliation(s)
- Oscar Holmström
- a Institute for Molecular Medicine Finland (FIMM) , University of Helsinki , Helsinki , Finland
| | - Nina Linder
- a Institute for Molecular Medicine Finland (FIMM) , University of Helsinki , Helsinki , Finland.,b Department of Women's and Children's Health, International Maternal and Child Health (IMCH) , Uppsala University , Uppsala , Sweden
| | - Billy Ngasala
- c Department of Medical Entomology and Parasitology, School of Public Health , Muhimbili University of Health and Allied Sciences , Dar es Salaam , Tanzania
| | - Andreas Mårtensson
- b Department of Women's and Children's Health, International Maternal and Child Health (IMCH) , Uppsala University , Uppsala , Sweden
| | - Ewert Linder
- d Center of Microscopy and Nanotechnology , University of Oulu , Oulu , Finland
| | - Mikael Lundin
- a Institute for Molecular Medicine Finland (FIMM) , University of Helsinki , Helsinki , Finland
| | - Hannu Moilanen
- d Center of Microscopy and Nanotechnology , University of Oulu , Oulu , Finland
| | - Antti Suutala
- a Institute for Molecular Medicine Finland (FIMM) , University of Helsinki , Helsinki , Finland
| | - Vinod Diwan
- e Department of Public Health Sciences , Karolinska Institutet , Stockholm , Sweden
| | - Johan Lundin
- a Institute for Molecular Medicine Finland (FIMM) , University of Helsinki , Helsinki , Finland.,e Department of Public Health Sciences , Karolinska Institutet , Stockholm , Sweden
| |
Collapse
|
5
|
Holmström O, Linder N, Lundin M, Moilanen H, Suutala A, Turkki R, Joensuu H, Isola J, Diwan V, Lundin J. Quantification of Estrogen Receptor-Alpha Expression in Human Breast Carcinomas With a Miniaturized, Low-Cost Digital Microscope: A Comparison with a High-End Whole Slide-Scanner. PLoS One 2015; 10:e0144688. [PMID: 26659386 PMCID: PMC4684374 DOI: 10.1371/journal.pone.0144688] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2015] [Accepted: 11/23/2015] [Indexed: 01/07/2023] Open
Abstract
Introduction A significant barrier to medical diagnostics in low-resource environments is the lack of medical care and equipment. Here we present a low-cost, cloud-connected digital microscope for applications at the point-of-care. We evaluate the performance of the device in the digital assessment of estrogen receptor-alpha (ER) expression in breast cancer samples. Studies suggest computer-assisted analysis of tumor samples digitized with whole slide-scanners may be comparable to manual scoring, here we study whether similar results can be obtained with the device presented. Materials and Methods A total of 170 samples of human breast carcinoma, immunostained for ER expression, were digitized with a high-end slide-scanner and the point-of-care microscope. Corresponding regions from the samples were extracted, and ER status was determined visually and digitally. Samples were classified as ER negative (<1% ER positivity) or positive, and further into weakly (1–10% positivity) and strongly positive. Interobserver agreement (Cohen’s kappa) was measured and correlation coefficients (Pearson’s product-momentum) were calculated for comparison of the methods. Results Correlation and interobserver agreement (r = 0.98, p < 0.001, kappa = 0.84, CI95% = 0.75–0.94) were strong in the results from both devices. Concordance of the point-of-care microscope and the manual scoring was good (r = 0.94, p < 0.001, kappa = 0.71, CI95% = 0.61–0.80), and comparable to the concordance between the slide scanner and manual scoring (r = 0.93, p < 0.001, kappa = 0.69, CI95% = 0.60–0.78). Fourteen (8%) discrepant cases between manual and device-based scoring were present with the slide scanner, and 16 (9%) with the point-of-care microscope, all representing samples of low ER expression. Conclusions Tumor ER status can be accurately quantified with a low-cost imaging device and digital image-analysis, with results comparable to conventional computer-assisted or manual scoring. This technology could potentially be expanded for other histopathological applications at the point-of-care.
Collapse
Affiliation(s)
- Oscar Holmström
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
- Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| | - Nina Linder
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
- Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
| | - Mikael Lundin
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
| | - Hannu Moilanen
- Center of Microscopy and Nanotechnology, University of Oulu, Oulu, Finland
| | - Antti Suutala
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
| | - Riku Turkki
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
| | - Heikki Joensuu
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
- Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| | - Jorma Isola
- BioMediTech, University of Tampere, Tampere, Finland
| | - Vinod Diwan
- Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
| | - Johan Lundin
- Institute for Molecular Medicine Finland (FIMM), Helsinki, Finland
- Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
- * E-mail:
| |
Collapse
|