Retinopathy online challenge: automatic detection of microaneurysms in digital color fundus photographs
- PMID: 19822469
- DOI: 10.1109/TMI.2009.2033909
Retinopathy online challenge: automatic detection of microaneurysms in digital color fundus photographs
Abstract
The detection of microaneurysms in digital color fundus photographs is a critical first step in automated screening for diabetic retinopathy (DR), a common complication of diabetes. To accomplish this detection numerous methods have been published in the past but none of these was compared with each other on the same data. In this work we present the results of the first international microaneurysm detection competition, organized in the context of the Retinopathy Online Challenge (ROC), a multiyear online competition for various aspects of DR detection. For this competition, we compare the results of five different methods, produced by five different teams of researchers on the same set of data. The evaluation was performed in a uniform manner using an algorithm presented in this work. The set of data used for the competition consisted of 50 training images with available reference standard and 50 test images where the reference standard was withheld by the organizers (M. Niemeijer, B. van Ginneken, and M. D. Abràmoff). The results obtained on the test data was submitted through a website after which standardized evaluation software was used to determine the performance of each of the methods. A human expert detected microaneurysms in the test set to allow comparison with the performance of the automatic methods. The overall results show that microaneurysm detection is a challenging task for both the automatic methods as well as the human expert. There is room for improvement as the best performing system does not reach the performance of the human expert. The data associated with the ROC microaneurysm detection competition will remain publicly available and the website will continue accepting submissions.
Similar articles
-
Blood vessel segmentation in color fundus images based on regional and Hessian features.Graefes Arch Clin Exp Ophthalmol. 2017 Aug;255(8):1525-1533. doi: 10.1007/s00417-017-3677-y. Epub 2017 May 4. Graefes Arch Clin Exp Ophthalmol. 2017. PMID: 28474130 Review.
-
Digital ocular fundus imaging: a review.Ophthalmologica. 2011;226(4):161-81. doi: 10.1159/000329597. Epub 2011 Sep 22. Ophthalmologica. 2011. PMID: 21952522 Review.
-
[Automatic detection of microaneurysms in colour fundus images].Arch Soc Esp Oftalmol. 2011 Sep;86(9):277-81. doi: 10.1016/j.oftal.2011.04.015. Epub 2011 Jul 29. Arch Soc Esp Oftalmol. 2011. PMID: 21893260 Clinical Trial. Spanish.
-
Computer-assisted microaneurysm turnover in the early stages of diabetic retinopathy.Ophthalmologica. 2009;223(5):284-91. doi: 10.1159/000213638. Epub 2009 Apr 16. Ophthalmologica. 2009. PMID: 19372722 Clinical Trial.
-
Evaluation of the effect of JPEG and JPEG2000 image compression on the detection of diabetic retinopathy.Eye (Lond). 2007 Apr;21(4):487-93. doi: 10.1038/sj.eye.6702238. Epub 2006 Feb 3. Eye (Lond). 2007. PMID: 16456597
Cited by
-
Rate and Predictors of Misclassification of Active Diabetic Macular Edema as Detected by an Automated Retinal Image Analysis System.Ophthalmol Ther. 2024 Jun;13(6):1553-1567. doi: 10.1007/s40123-024-00929-8. Epub 2024 Apr 8. Ophthalmol Ther. 2024. PMID: 38587776 Free PMC article.
-
DRAC 2022: A public benchmark for diabetic retinopathy analysis on ultra-wide optical coherence tomography angiography images.Patterns (N Y). 2024 Feb 8;5(3):100929. doi: 10.1016/j.patter.2024.100929. eCollection 2024 Mar 8. Patterns (N Y). 2024. PMID: 38487802 Free PMC article.
-
Differentiating localized autoimmune pancreatitis and pancreatic ductal adenocarcinoma using endoscopic ultrasound images with deep learning.DEN Open. 2024 Mar 2;4(1):e344. doi: 10.1002/deo2.344. eCollection 2024 Apr. DEN Open. 2024. PMID: 38434146 Free PMC article.
-
Perfused and Nonperfused Microaneurysms Identified and Characterized by Structural and Angiographic OCT.ArXiv [Preprint]. 2023 Oct 9:arXiv:2303.13611v2. ArXiv. 2023. Update in: Ophthalmol Retina. 2024 Feb;8(2):108-115. doi: 10.1016/j.oret.2023.08.019. PMID: 37873013 Free PMC article. Updated. Preprint.
-
An effective and comprehensible method to detect and evaluate retinal damage due to diabetes complications.PeerJ Comput Sci. 2023 Sep 26;9:e1585. doi: 10.7717/peerj-cs.1585. eCollection 2023. PeerJ Comput Sci. 2023. PMID: 37810367 Free PMC article.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
Miscellaneous