1
|
Nagasato D, Sogawa T, Tanabe M, Tabuchi H, Numa S, Oishi A, Ohashi Ikeda H, Tsujikawa A, Maeda T, Takahashi M, Ito N, Miura G, Shinohara T, Egawa M, Mitamura Y. Estimation of Visual Function Using Deep Learning From Ultra-Widefield Fundus Images of Eyes With Retinitis Pigmentosa. JAMA Ophthalmol 2023; 141:305-313. [PMID: 36821134 PMCID: PMC9951103 DOI: 10.1001/jamaophthalmol.2022.6393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
Abstract
Importance There is no widespread effective treatment to halt the progression of retinitis pigmentosa. Consequently, adequate assessment and estimation of residual visual function are important clinically. Objective To examine whether deep learning can accurately estimate the visual function of patients with retinitis pigmentosa by using ultra-widefield fundus images obtained on concurrent visits. Design, Setting, and Participants Data for this multicenter, retrospective, cross-sectional study were collected between January 1, 2012, and December 31, 2018. This study included 695 consecutive patients with retinitis pigmentosa who were examined at 5 institutions. Each of the 3 types of input images-ultra-widefield pseudocolor images, ultra-widefield fundus autofluorescence images, and both ultra-widefield pseudocolor and fundus autofluorescence images-was paired with 1 of the 31 types of ensemble models constructed from 5 deep learning models (Visual Geometry Group-16, Residual Network-50, InceptionV3, DenseNet121, and EfficientNetB0). We used 848, 212, and 214 images for the training, validation, and testing data, respectively. All data from 1 institution were used for the independent testing data. Data analysis was performed from June 7, 2021, to December 5, 2022. Main Outcomes and Measures The mean deviation on the Humphrey field analyzer, central retinal sensitivity, and best-corrected visual acuity were estimated. The image type-ensemble model combination that yielded the smallest mean absolute error was defined as the model with the best estimation accuracy. After removal of the bias of including both eyes with the generalized linear mixed model, correlations between the actual values of the testing data and the estimated values by the best accuracy model were examined by calculating standardized regression coefficients and P values. Results The study included 1274 eyes of 695 patients. A total of 385 patients were female (55.4%), and the mean (SD) age was 53.9 (17.2) years. Among the 3 types of images, the model using ultra-widefield fundus autofluorescence images alone provided the best estimation accuracy for mean deviation, central sensitivity, and visual acuity. Standardized regression coefficients were 0.684 (95% CI, 0.567-0.802) for the mean deviation estimation, 0.697 (95% CI, 0.590-0.804) for the central sensitivity estimation, and 0.309 (95% CI, 0.187-0.430) for the visual acuity estimation (all P < .001). Conclusions and Relevance Results of this study suggest that the visual function estimation in patients with retinitis pigmentosa from ultra-widefield fundus autofluorescence images using deep learning might help assess disease progression objectively. Findings also suggest that deep learning models might monitor the progression of retinitis pigmentosa efficiently during follow-up.
Collapse
Affiliation(s)
- Daisuke Nagasato
- Department of Ophthalmology, Saneikai Tsukazaki Hospital, Himeji, Japan,Department of Ophthalmology, Institute of Biomedical Sciences, Tokushima University Graduate School, Tokushima, Japan,Department of Technology and Design Thinking for Medicine, Hiroshima University Graduate School, Hiroshima, Japan
| | - Takahiro Sogawa
- Department of Ophthalmology, Saneikai Tsukazaki Hospital, Himeji, Japan
| | - Mao Tanabe
- Department of Ophthalmology, Saneikai Tsukazaki Hospital, Himeji, Japan
| | - Hitoshi Tabuchi
- Department of Ophthalmology, Saneikai Tsukazaki Hospital, Himeji, Japan,Department of Ophthalmology, Institute of Biomedical Sciences, Tokushima University Graduate School, Tokushima, Japan,Department of Technology and Design Thinking for Medicine, Hiroshima University Graduate School, Hiroshima, Japan
| | - Shogo Numa
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Akio Oishi
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan,Department of Ophthalmology and Visual Sciences, Graduate School of Biomedical Sciences, Nagasaki University, Nagasaki, Japan
| | - Hanako Ohashi Ikeda
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Akitaka Tsujikawa
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Tadao Maeda
- Research Center, Kobe City Eye Hospital, Kobe, Japan,Laboratory for Retinal Regeneration, RIKEN Center for Biosystems Dynamics Research, Kobe, Japan
| | - Masayo Takahashi
- Research Center, Kobe City Eye Hospital, Kobe, Japan,Laboratory for Retinal Regeneration, RIKEN Center for Biosystems Dynamics Research, Kobe, Japan,Vision Care Inc, Kobe, Japan
| | - Nana Ito
- Department of Ophthalmology and Visual Science, Chiba University Graduate School of Medicine, Chiba, Japan
| | - Gen Miura
- Department of Ophthalmology and Visual Science, Chiba University Graduate School of Medicine, Chiba, Japan
| | - Terumi Shinohara
- Department of Ophthalmology, Institute of Biomedical Sciences, Tokushima University Graduate School, Tokushima, Japan
| | - Mariko Egawa
- Department of Ophthalmology, Institute of Biomedical Sciences, Tokushima University Graduate School, Tokushima, Japan
| | - Yoshinori Mitamura
- Department of Ophthalmology, Institute of Biomedical Sciences, Tokushima University Graduate School, Tokushima, Japan
| |
Collapse
|
2
|
Asaoka R, Oishi A, Fujino Y, Murata H, Azuma K, Miyata M, Obata R, Inoue T. Association between the number of visual fields and the accuracy of future prediction in eyes with retinitis pigmentosa. BMJ Open Ophthalmol 2021; 6:e000900. [PMID: 34869907 PMCID: PMC8603256 DOI: 10.1136/bmjophth-2021-000900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 10/21/2021] [Indexed: 11/15/2022] Open
Abstract
Purpose To evaluate the minimum number of visual fields (VFs) required to precisely predict future VFs in eyes with retinitis pigmentosa (RP). Methods A series of 12 VFs (Humphrey Field Analyzer 10–2 test (8.9 years in average) were analysed from 102 eyes of 52 patients with RP. The absolute error to predict the 12th VF using the prior 11 VFs was calculated in a pointwise manner, using the linear regression, and the 95% CI range was determined. Then, using 3–10 initial VFs, next VFs (4th to 11th VFs, respectively) were also predicted. The minimum number of VFs required for the mean absolute prediction error to reach the 95% CI was identified. Similar analyses were iterated for the second and third next VF predictions. Similar analyses were conducted using mean deviation (MD). Results In the pointwise analysis, the minimum number of VFs required to reach the 95% CI for the 12th VF was five (first and second next VF predictions) and six (third next VF prediction). For the MD analysis, three (first and second next VF predictions) and four (third next VF prediction) VFs were required to reach 95% CI for the 12th VF. Conclusions The minimum number of VFs required to obtain accurate predictions of the future VF was five or six in the pointwise analysis and three or four in the analysis with MD.
Collapse
Affiliation(s)
- Ryo Asaoka
- Department of Ophthalmology, The University of Tokyo Hospital, Bunkyo-ku, Tokyo, Japan.,Nanovision Research Division, Research Institute of Electronics, Shizuoka University, Shizuoka, Japan.,The Graduate School for the Creation of New Photonics Industries, Shizuoka, Japan.,Seirei Christopher University, Shizuoka, Japan
| | - Akio Oishi
- Department of Ophthalmology, The University of Tokyo Hospital, Bunkyo-ku, Tokyo, Japan
| | - Yuri Fujino
- Department of Ophthalmology, The University of Tokyo Hospital, Bunkyo-ku, Tokyo, Japan.,Department of Ophthalmology, Shimane University Faculty of Medicine, Izumo, Japan
| | - Hiroshi Murata
- Department of Ophthalmology, University of Tokyo, Tokyo, Japan.,Department of Ophthalmology, National Center for Global Health and Medicine, Tokyo, Japan
| | - Keiko Azuma
- Department of Ophthalmology, Graduate School of Medicine, Tokyo, Japan
| | - Manabu Miyata
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto City, Kyoto Prefecture, Japan
| | - Ryo Obata
- Department of Ophthalmology, University of Tokyo Graduate School of Medichine, Tokyo, Japan
| | - Tatsuya Inoue
- Department of Ophthalmology, The University of Tokyo Hospital, Bunkyo-ku, Tokyo, Japan.,Department of Ophthalmology and Micro-Technology, Yokohama City University, Kanagawa, Japan
| |
Collapse
|
3
|
Asano S, Oishi A, Asaoka R, Fujino Y, Murata H, Azuma K, Miyata M, Obata R, Inoue T. Detecting Progression of Retinitis Pigmentosa Using the Binomial Pointwise Linear Regression Method. Transl Vis Sci Technol 2021; 10:15. [PMID: 34757391 PMCID: PMC8590177 DOI: 10.1167/tvst.10.13.15] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Purpose A method of evaluating central visual field (VF) progression in eyes with retinitis pigmentosa (RP) has still to be established. We previously reported the potential merit of applying a binomial test to pointwise linear regression (binomial PLR) in glaucoma progression. In the current study, we investigated the usefulness of binomial PLR in eyes with RP. Methods A series of 10 VFs (VF 1–10, Humphrey field analyzer, 10-2 test) from 196 eyes of 103 patients with RP were collected retrospectively. The PLR was performed by regressing the total deviation of all test points with the complete series of 10 VFs. The accuracy (positive predictive value, negative predictive value, and false-positive rate) and the time required to detect VF progression with shorter VF series (from VF 1–5 to VF 1–9) were compared across the binomial PLR, a permutation analysis of PLR (PoPLR), and a mean deviation (MD) trend analysis. Results In evaluating VF progression, the binomial PLR was comparable with the PoPLR and MD trend analyses in its positive predictive value (0.55 to 0.95), negative predictive value (0.67 to 0.92), and false-positive rate (0.01 to 0.05). The binomial PLR required significantly less time to detect VF progression (5.0 ± 2.0 years) than the PoPLR and MD trend analyses (P < 0.01, P < 0.001, respectively). Conclusions The application of a binomial PLR achieved reliable and earlier detection of central VF progression in eyes with RP. Translational Relevance A binomial PLR was useful in assessing VF progression in RP.
Collapse
Affiliation(s)
- Shotaro Asano
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan.,Department of Ophthalmology, Asahi General Hospital, Asahi, Chiba, Japan
| | - Akio Oishi
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan.,Department of Ophthalmology and Visual Sciences, Nagasaki University, Nagasaki, Japan
| | - Ryo Asaoka
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan.,Department of Ophthalmology, Seirei Hamamatsu General Hospital, Shizuoka, Japan.,Seirei Christopher University, Shizuoka, Japan.,Nanovision Research Division, Research Institute of Electronics, Shizuoka University, Shizuoka, Japan.,The Graduate School for the Creation of New Photonics Industries, Shizuoka, Japan
| | - Yuri Fujino
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan.,Department of Ophthalmology, Seirei Hamamatsu General Hospital, Shizuoka, Japan.,Department of Ophthalmology, Shimane University Faculty of Medicine, Izumo, Japan
| | - Hiroshi Murata
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan
| | - Keiko Azuma
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan
| | - Manabu Miyata
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Ryo Obata
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan
| | - Tatsuya Inoue
- Department of Ophthalmology, The University of Tokyo, Graduate School of Medicine, Tokyo, Japan.,Department of Ophthalmology and Micro-Technology, Yokohama City University, Kanagawa, Japan
| |
Collapse
|
4
|
Omoto T, Oishi A, Asaoka R, Fujino Y, Murata H, Azuma K, Miyata M, Obata R, Inoue T. Development and validation of a visual field cluster in retinitis pigmentosa. Sci Rep 2021; 11:9671. [PMID: 33958698 PMCID: PMC8102544 DOI: 10.1038/s41598-021-89233-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 03/31/2021] [Indexed: 12/26/2022] Open
Abstract
The aim was to establish and evaluate a new clustering method for visual field (VF) test points to predict future VF in retinitis pigmentosa. A Humphrey Field Analyzer 10-2 test was clustered using total deviation values from 858 VFs. We stratified 68 test points into 24 sectors. Then, mean absolute error (MAE) of the sector-wise regression with them (S1) was evaluated using 196 eyes with 10 VF sequences and compared to pointwise linear regression (PLR), mean sensitivity of total area (MS) and also another sector-wise regression basing on VF mapping for glaucoma (29 sectors; S2). MAE with S1 were smaller than with PLR when between the first-third and first-seventh VFs were used. MAE with the method were significantly smaller than those of S2 when between the first-sixth and first-ninth VFs were used. The MAE of MS was smaller than those with S1 only when first to 3rd and first to 4th VFs were used; however, the prediction accuracy became far larger than any other methods when larger number of VFs were used. More accurate prediction was achieved using this new sector-wise regression than with PLR. In addition, the obtained cluster was more useful than that for glaucoma to predict progression.
Collapse
Affiliation(s)
- Takashi Omoto
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Akio Oishi
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan.,Department of Ophthalmology and Visual Sciences, Nagasaki University, Nagasaki, Japan
| | - Ryo Asaoka
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan. .,Department of Ophthalmology, Seirei Hamamatsu General Hospital, Shizuoka, Japan. .,Seirei Christopher University, Shizuoka, Japan. .,Nanovision Research Division, Research Institute of Electronics, Shizuoka University, Shizuoka, Japan. .,The Graduate School for the Creation of New Photonics Industries, Shizuoka, Japan.
| | - Yuri Fujino
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan.,Department of Ophthalmology, Seirei Hamamatsu General Hospital, Shizuoka, Japan.,Department of Ophthalmology, Shimane University Faculty of Medicine, Izumo, Japan
| | - Hiroshi Murata
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Keiko Azuma
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Manabu Miyata
- Department of Ophthalmology and Visual Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Ryo Obata
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Tatsuya Inoue
- Department of Ophthalmology, University of Tokyo Graduate School of Medicine, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan.,Department of Ophthalmology and Micro-Technology, Yokohama City University, Kanagawa, Japan
| |
Collapse
|