Research Article Volume 6 Issue 1
Department of Ophthalmology, East Kent Hospital University Foundation Trust, UK
Correspondence: Ruhella R Hossain, Department of Ophthalmology, East Kent Hospital University Foundation Trust, Kent CT1 3NG, UK
Received: November 02, 2016 | Published: January 11, 2017
Citation: Hossain RR, Moosa AR, Patel N. Automatic versus manual segmentation of choroidal neovascularization lesions using optical coherence tomography. Adv Ophthalmol Vis Syst. 2017;6(1):1-6. DOI: 10.15406/aovs.2017.06.00163
Purpose: To measure and quantify choroidal neovascularization (CNV) lesion size in classic lesions visualized on Spectral Domain–Optical Coherence Tomography (SD–OCT) using automated segmentation analysis and confirm whether further refinement improves the accuracy of disease regression after loading dose Anti–VEGF injections.
Methodology: A retrospective study of 10 macular degeneration patients diagnosed with CNV. Blinded observers, trained to detect changes on OCT, delineated boundaries of CNV lesions using SD–OCT (Topcon 2000) with automated software and then modified segmentation manually before and after loading dose Ranbizumab injections. Automated measurements were then compared to manual segmentation values. Statistical analysis was performed, taking into account inter–observer variability.
Results: Automatic and manual segmentation measurements are similar in 1) retinal area and fovea center values both pre–and post–injection; and 2) retinal volume post–injection. Retinal volume pre–injection is 1) similar between the two blinded observers; 2) varies between automatic measurements and observers in some patients; and 3) underestimated for all patients in the automatic measurements. Overall, automatic segmentation detects a general reduction in CNV lesion size following loading dose injections.
Conclusion: SD–OCT automated segmentation software detects CNV lesions and reports size reduction after the third anti–VEGF injection. SD–OCT automatic segmentation using Topcon segmentation analysis in this small cohort is an accurate diagnostic tool to measure CNV surface area and volume as a biomarker of CNV regression.
Keywords: wet AMD, segmentation software, CNV, OCT, biomarker, subretinal hyper reflective material
OCT, optical coherence tomography; RPE, retinal pigment epithelium; ILM, internal limiting membrane; nAMD, neovascular age–related macular degeneration; CNV, choroidal neovascularization; FA, fluorescein angiography; Anti–VEGF, anti–vascular endothelial growth factor; SD–OCT, spectral–domain optical coherence tomography
Optical coherence tomography (OCT) is a non–invasive imaging modality that provides detailed qualitative and quantitative information about the retinal structure. It produces anatomic images of the posterior vitreous, retina, retinal pigment epithelium (RPE) and anterior choroid by recording optical reflectivity and segmenting the different image layers, including the RPE and internal limiting membrane (ILM); and measures the distance between the ILM and RPE. Segmentation software can calculate the area and volume of half–ellipsoid deviations from the normal RPE curvature; and constructs retinal thickness maps at multiple locations.1,2
Concurrent pharmacological and imaging technology advancements allowed for improved outcomes in exudative retinal diseases, including neovascular (wet) age–related macular degeneration (nAMD). Historically, diagnosis and classification of choroidal neovascularization (CNV) lesions in nAMD was based on fluorescein angiography (FA) defined morphology of the choroidal membrane (Figure 1).3,4 However, the invasive nature of FA poses a dilemma for follow up, making it difficult to individualize injection frequency schedules in response to anti–vascular endothelial growth factor (anti–VEGF) injections, a previously validated therapy for reducing lesion size and restoring vision in nAMD.2,4–12
The validation of anti–VEGF therapy for nAMD created the need for non–invasive imaging modalities to monitor patient responses to treatment. Previous studies showed the usefulness of OCT automated segmentation software for monitoring retinal disease in response to therapy.13–15 Using OCT, clinicians are able to individualize injection frequencies according to individual patient’s visual needs. Although useful, the automated built in segmentation algorithms are known to have errors. Initial OCT segmentation software had a high error rate, partly due to the image–processing techniques and how to handle pathology, thus limiting its diagnostic utility.16–18 However, Spectral Domain–OCT (SD–OCT) systems integrated newer technology and improved segmentation software, allowing for improved image–analysis, including subretinal hyper reflective material (SHRM), and evaluation of pathology.19–22 In addition to segmentation software, SD–OCT systems are integrated with analysis software designed to automatically detect deviations from the RPE contour and quantify their surface area and volume.23–29 Assuming classic CNV lesions form half–ellipsoid shapes; one can use such tools with automatic segmentation software in serial imaging to monitor nAMD disease progression and response to therapy (Figure 2).30–32
Figure 2 OCT software identification of CNV lesions showing automatic delineation of the RPE and accompanying fundal view A) Pre-treatment and B) Post-treatment.
In this paper we attempt to measure and quantify CNV lesion size only in classic lesions visualized on SD–OCT using automated drusen analysis and further fine–tune the accuracy to confirm whether optimization can be achieved and whether modification is required. We hypothesize that 1) using surface area and volume as biomarkers for classic CNC lesions, OCT automatic segmentation is as accurate as manual segmentation for delineating lesion borders both pre– and post– anti–VEGF therapy; and 2) OCT automatic segmentation with drusen analysis is an accurate diagnostic tool for measuring classic CNV lesions.
This was a retrospective study of 10 AMD patients previously diagnosed with CNV using FA morphology. Two blinded observers, trained to detect RPE changes, manually delineated boundaries of CNV lesions on the inner surface of the RPE using SD–OCT (Topcon 2000) with software analysis before and after three anti–VEGF Lucentis (Ranubizumab) injections. The accompanying segmentation software measured the distance in micrometers between the RPE and Bruch’s membrane and automatically calculated the foveal center thickness, surface area and volume of the CNV lesion. The generated automatic segmentation measurements were compared against the manual segmented measurements. Statistical analysis was performed using Microsoft Excel and an online statistical calculator, GraphPad (http://graphpad.com/quickcalcs/kappa1/) for calculating Cohen’s kappa score to determine statistical agreement between the automatic segmentation and blinded observers. The average of the two blinded observers was used as the standard. Ethics committee approval was not needed as this study involved a review of data generated from our regular clinical practice. This research followed the tenants of the Declaration of Helsinki.
SD–OCT serial B–scan images of classic CNV lesions in patients previously diagnosed with nAMD according to FA morphology were assessed for thickness, surface area and volume both pre– and post–treatment. Qualitatively, the automatic segmentation of the RPE closely mimicked that of the manual segmentation in classic CNV lesions. Using RPE segmentation, the SD–OCT software measured foveal center thickness and calculated values for retinal area and volume of the classic CNV lesions. When comparing the values calculated after automatic segmentation against the two blinded observers we found that the surface area measurements of the CNV lesions were similar both pre– and post–treatment (Figure 3A&B). Retinal volume measurements varied between automatic and manual pre–injection but were similar post–injection (Figure 3C&D).
The automatic segmentation underestimated the volume of the CNV lesions for nearly all patients in comparison to manual segmentation. Using the foveal center measurement as a surrogate for CNV lesion thickness, the software calculations for automatic and the two blinded observers were similar both pre– and post–injection (Figure 3E&F). Despite the quantitative differences between automated and manual segmentations, OCT automatic segmentation detected a general reduction in classic CNV lesion size qualitatively in all 10 patients (Figure 4). Cohen’s kappa score was calculated to determine statistical agreement between the automatic and average between the two blinded observers (Table 1). For foveal thickness, we found good and fair strengths of agreement pre– and post–treatment, respectively. For surface area and volume, we found fair and poor strengths of agreement pre– and post–treatment, respectively.
Figure 3 OCT automatic versus manual segmentation of two blinded observers. Pre-treatment measurements of A) Retinal area, B) Retinal volume, C) Foveal center thickness. Post-injection measurements of D) Retinal area, E) Retinal volume, F) Foveal center thickness.
Thickness |
Pre-treatment |
Post-treatment |
k |
0.6 |
0.4 |
SE of kappa |
0.232 |
0.232 |
95% CI |
0.146-1 |
-0.054 to 0.854 |
% obs agreed |
80 |
70 |
% agreements expected by chance alone |
50 |
50 |
Strength of agreement |
Good |
Fair |
Surface Area |
||
k |
0.31 |
0.074 |
SE of kappa |
0.193 |
0.258 |
95% CI |
-0.069 to 0.689 |
-0.432 to 0.581 |
% obs agreed |
60 |
50 |
% agreements expected by chance alone |
42 |
46 |
Strength of agreement |
Fair |
Poor |
Volume |
||
k |
4 |
0 |
SE of kappa |
0.232 |
NA |
95% CI |
-0.054 to 0.854 |
NA |
% obs agreed |
70 |
90 |
% agreements expected by chance alone |
50 |
90 |
Strength of agreement |
Fair |
Poor |
Table 1 Cohen’s kappa score for lesion thickness, surface area and volume to determine the statistical agreement between the automatic segmentation and blinded observers, using the average of the two blinded observers as the standard
We used serial SD–OCT B–scan images to monitor the progression of classic CNV lesions in patients both pre– and post–Lucentis treatment, one of the current recommended treatments for nAMD. We used the retinal fovea center thickness, surface area and volume of classic CNV lesions as biomarkers within a group of patients previously diagnosed with nAMD by FA. We compared the results of the automatic segmentation software on the TOPCON SD–OCT machine with that of two blinded observers trained to manually delineate RPE changes.
In our group of patient’s we found that the automatic and manual segmentation measurements were similar for 1) fovea center thickness both pre– and post–treatment; 2) retinal area both pre– and post–treatment; and 3) retinal volume post–treatment. Using Cohen’s kappa score to determine statistical agreement, we found a good strength of agreement pre–treatment and a fair strength of agreement post–treatment for foveal thickness. With regards to retinal area and volume, we found fair and poor strengths of agreement pre– and post–treatment, respectively. These discrepancies in statistical agreement were expected given that the foveal thickness is a direct measurement whereas the surface area and volume are calculations based on a direct measurement. Thus, the drusen analysis automatic segmentation software is as accurate as manual segmentation when performing direct measurements, not for calculations.
Additionally, we found that pre–injection retinal volume was 1) similar between the two blinded observers; 2) varied between automatic measurement and observers in some patients; and 3) underestimated by the automatic segmentation for all patients in comparison with the manual segmentation. One reason for the underestimation of pre–injection volume by automatic segmentation may be due to the software algorithms used for identifying RPE layers. Although proprietary information, one can assume that these algorithms use an “ideal” physiologic RPE line and follow the curvature of Bruch’s membrane. It is possible that any deviation from these ideal examples can lead to over– or under–estimation of volume in comparison to manual segmentation. However, as long as the algorithms are consistent then these over– and under–estimations should not impact the software clinical use for monitoring disease progression.
SD–OCT can be used to measure thickness of classic CNV lesions. Generally, SD–OCT is an accurate means of assessing CNV lesion area, volume, and retinal thickness. However, this relies on adequate quality of OCT B–scan images. We found that in the few cases where SD–OCT automatic segmentation differed from manual segmentation, it was due to poorer B–scan images. This may be due to patient factors such as a poorly dilated pupil or poor fixation. Another limitation of OCT technology is how it deals with areas of decreased brightness, which may represent fluid but does not necessarily correlate with the presence of nAMD. While SD–OCT automatic segmentation is reliable for classic CNV lesions, this assumes a classic half–ellipsoid shape of the lesion. The inability to process deviations from this shape is one limitation of the SD–OCT analysis software.
Despite these limitations, SD–OCT remains a useful and robust tool for assessing classic CNV lesion size. OCT cannot replace fundus FA to diagnose CNV as the sensitivity and specificity needs to be equivalent.33 However, by comparing serial B–scan images of patient’s before and after three anti–VEGF injections, clinicians can monitor disease regression in a non–invasive manner and personalize injection frequency according to patient’s visual needs. We anticipate that this approach to monitoring disease progression can be applied to non–classic CNV lesions in nAMD. OCT software will always be prone to segmentation errors and manual correction of automated measurements usually would refine the outputs produced.34,35 This study shows that there is good correlation between automated and manual corrected parameters. CNV Lesion size may become a biomarker for treatment response, however further optimization may be essential and necessary with devices such as OCT Angiography. Better and faster software algorithms may achieve even more accurate and predictable measures of disease regression on treatment and recurrence of activity to allow clinicians to make management decisions of types of regimes used for injection therapy.
In conclusion, we report that SD–OCT automatic segmentation using analysis software 1) can qualitatively show size reduction of classic CNV lesions in nAMD patients pre– versus post anti–VEGF treatment; and 2) in this small cohort is an accurate diagnostic tool to measure CNV lesion thickness and calculate surface area and volume as a further biomarker of disease progression and treatment frequency. This study has shown that quantification of SHRM using SD–OCT using automated software is reliable as a biomarker of disease onset and its regression and growth can be used in future studies where combination therapy with anti–VEGF and anti–platelet derived growth factor (PDGF) injections are used at variable time points.
None.
None.
The authors declare that there was no conflict of interest.
©2017 Hossain, et al. This is an open access article distributed under the terms of the, which permits unrestricted use, distribution, and build upon your work non-commercially.