Content-Based Image Retrieval by Metric Learning From Radiology Reports: Application to Interstitial Lung Diseases
- PMID: 25438332
- DOI: 10.1109/JBHI.2014.2375491
Content-Based Image Retrieval by Metric Learning From Radiology Reports: Application to Interstitial Lung Diseases
Abstract
Content-based image retrieval (CBIR) is a search technology that could aid medical diagnosis by retrieving and presenting earlier reported cases that are related to the one being diagnosed. To retrieve relevant cases, CBIR systems depend on supervised learning to map low-level image contents to high-level diagnostic concepts. However, the annotation by medical doctors for training and evaluation purposes is a difficult and time-consuming task, which restricts the supervised learning phase to specific CBIR problems of well-defined clinical applications. This paper proposes a new technique that automatically learns the similarity between the several exams from textual distances extracted from radiology reports, thereby successfully reducing the number of annotations needed. Our method first infers the relation between patients by using information retrieval techniques to determine the textual distances between patient radiology reports. These distances are subsequently used to supervise a metric learning algorithm, that transforms the image space accordingly to textual distances. CBIR systems with different image descriptions and different levels of medical annotations were evaluated, with and without supervision from textual distances, using a database of computer tomography scans of patients with interstitial lung diseases. The proposed method consistently improves CBIR mean average precision, with improvements that can reach 38%, and more marked gains for small annotation sets. Given the overall availability of radiology reports in picture archiving and communication systems, the proposed approach can be broadly applied to CBIR systems in different medical problems, and may facilitate the introduction of CBIR in clinical practice.
Similar articles
-
Content-based Image Retrieval by Using Deep Learning for Interstitial Lung Disease Diagnosis with Chest CT.Radiology. 2022 Jan;302(1):187-197. doi: 10.1148/radiol.2021204164. Epub 2021 Oct 12. Radiology. 2022. PMID: 34636634
-
Adapting content-based image retrieval techniques for the semantic annotation of medical images.Comput Med Imaging Graph. 2016 Apr;49:37-45. doi: 10.1016/j.compmedimag.2016.01.001. Epub 2016 Feb 4. Comput Med Imaging Graph. 2016. PMID: 26890880
-
Content-based image retrieval in radiology: current status and future directions.J Digit Imaging. 2011 Apr;24(2):208-22. doi: 10.1007/s10278-010-9290-9. J Digit Imaging. 2011. PMID: 20376525 Free PMC article. Review.
-
A similarity learning approach to content-based image retrieval: application to digital mammography.IEEE Trans Med Imaging. 2004 Oct;23(10):1233-44. doi: 10.1109/TMI.2004.834601. IEEE Trans Med Imaging. 2004. PMID: 15493691 Clinical Trial.
-
A review of content-based image retrieval systems in medical applications-clinical benefits and future directions.Int J Med Inform. 2004 Feb;73(1):1-23. doi: 10.1016/j.ijmedinf.2003.11.024. Int J Med Inform. 2004. PMID: 15036075 Review.
Cited by
-
A novel image-based retrieval system for characterization of maxillofacial lesions in cone beam CT images.Int J Comput Assist Radiol Surg. 2019 May;14(5):785-796. doi: 10.1007/s11548-019-01946-w. Epub 2019 Mar 14. Int J Comput Assist Radiol Surg. 2019. PMID: 30877630
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
