1
|
Danesh H, Steel DH, Hogg J, Ashtari F, Innes W, Bacardit J, Hurlbert A, Read JCA, Kafieh R. Synthetic OCT Data Generation to Enhance the Performance of Diagnostic Models for Neurodegenerative Diseases. Transl Vis Sci Technol 2022; 11:10. [PMID: 36201202 PMCID: PMC9554224 DOI: 10.1167/tvst.11.10.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose Optical coherence tomography (OCT) has recently emerged as a source for powerful biomarkers in neurodegenerative diseases such as multiple sclerosis (MS) and neuromyelitis optica (NMO). The application of machine learning techniques to the analysis of OCT data has enabled automatic extraction of information with potential to aid the timely diagnosis of neurodegenerative diseases. These algorithms require large amounts of labeled data, but few such OCT data sets are available now. Methods To address this challenge, here we propose a synthetic data generation method yielding a tailored augmentation of three-dimensional (3D) OCT data and preserving differences between control and disease data. A 3D active shape model is used to produce synthetic retinal layer boundaries, simulating data from healthy controls (HCs) as well as from patients with MS or NMO. Results To evaluate the generated data, retinal thickness maps are extracted and evaluated under a broad range of quality metrics. The results show that the proposed model can generate realistic-appearing synthetic maps. Quantitatively, the image histograms of the synthetic thickness maps agree with the real thickness maps, and the cross-correlations between synthetic and real maps are also high. Finally, we use the generated data as an augmentation technique to train stronger diagnostic models than those using only the real data. Conclusions This approach provides valuable data augmentation, which can help overcome key bottlenecks of limited data. Translational Relevance By addressing the challenge posed by limited data, the proposed method helps apply machine learning methods to diagnose neurodegenerative diseases from retinal imaging.
Collapse
Affiliation(s)
- Hajar Danesh
- School of Advanced Technologies in Medicine, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Isfahan, Iran
| | - David H Steel
- Sunderland Eye Infirmary, Sunderland, Tyne and Wear, UK.,Centre for Transformative Neuroscience and Institute of Biosciences, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK
| | - Jeffry Hogg
- Royal Victoria Infirmary Eye Department, Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, Newcastle Upon Tyne, UK.,Population Health Sciences Institute, Newcastle University, Newcastle Upon Tyne, Tyne and Wear, UK
| | - Fereshteh Ashtari
- Isfahan Neurosciences Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Will Innes
- Royal Victoria Infirmary Eye Department, Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, Newcastle Upon Tyne, UK.,School of Computing, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK
| | - Jaume Bacardit
- School of Computing, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK
| | - Anya Hurlbert
- Centre for Transformative Neuroscience and Institute of Biosciences, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK
| | - Jenny C A Read
- Centre for Transformative Neuroscience and Institute of Biosciences, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK
| | - Rahele Kafieh
- School of Advanced Technologies in Medicine, Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Isfahan, Iran.,Centre for Transformative Neuroscience and Institute of Biosciences, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK.,Department of Engineering, Durham University, South Road, Durham, UK
| |
Collapse
|
2
|
Synthetic OCT data in challenging conditions: three-dimensional OCT and presence of abnormalities. Med Biol Eng Comput 2021; 60:189-203. [PMID: 34792759 PMCID: PMC8724113 DOI: 10.1007/s11517-021-02469-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Accepted: 11/06/2021] [Indexed: 12/09/2022]
Abstract
Nowadays, retinal optical coherence tomography (OCT) plays an important role in ophthalmology and automatic analysis of the OCT is of real importance: image denoising facilitates a better diagnosis and image segmentation and classification are undeniably critical in treatment evaluation. Synthetic OCT was recently considered to provide a benchmark for quantitative comparison of automatic algorithms and to be utilized in the training stage of novel solutions based on deep learning. Due to complicated data structure in retinal OCTs, a limited number of delineated OCT datasets are already available in presence of abnormalities; furthermore, the intrinsic three-dimensional (3D) structure of OCT is ignored in many public 2D datasets. We propose a new synthetic method, applicable to 3D data and feasible in presence of abnormalities like diabetic macular edema (DME). In this method, a limited number of OCT data is used during the training step and the Active Shape Model is used to produce synthetic OCTs plus delineation of retinal boundaries and location of abnormalities. Statistical comparison of thickness maps showed that synthetic dataset can be used as a statistically acceptable representative of the original dataset (p > 0.05). Visual inspection of the synthesized vessels was also promising. Regarding the texture features of the synthesized datasets, Q-Q plots were used, and even in cases that the points have slightly digressed from the straight line, the p-values of the Kolmogorov–Smirnov test rejected the null hypothesis and showed the same distribution in texture features of the real and the synthetic data. The proposed algorithm provides a unique benchmark for comparison of OCT enhancement methods and a tailored augmentation method to overcome the limited number of OCTs in deep learning algorithms.
Collapse
|
3
|
Samieinasab M, Amini Z, Rabbani H. Multivariate Statistical Modeling of Retinal Optical Coherence Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:3475-3487. [PMID: 32746098 DOI: 10.1109/tmi.2020.2998066] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
In this paper a new statistical multivariate model for retinal Optical Coherence Tomography (OCT) B-scans is proposed. Due to the layered structure of OCT images, there is a horizontal dependency between adjacent pixels at specific distances, which led us to propose a more accurate multivariate statistical model to be employed in OCT processing applications such as denoising. Due to the asymmetric form of the probability density function (pdf) in each retinal layer, a generalized version of multivariate Gaussian Scale Mixture (GSM) model, which we refer to as GM-GSM model, is proposed for each retinal layer. In this model, the pixel intensities in each retinal layer are modeled with an asymmetric Bessel K Form (BKF) distribution as a specific form of the GM-GSM model. Then, by combining some layers together, a mixture of GM-GSM model with eight components is proposed. The proposed model is then easily converted to a multivariate Gaussian Mixture model (GMM) to be employed in the spatially constrained GMM denoising algorithm. The Q-Q plot is utilized to evaluate goodness of fit of each component of the final mixture model. The improvement in the noise reduction results based on the GM-GSM model, indicates that the proposed statistical model describes the OCT data more accurately than other competing methods that do not consider spatial dependencies between neighboring pixels.
Collapse
|