The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia
- PMID: 24705629
- PMCID: PMC3976315
- DOI: 10.1371/journal.pone.0093757
The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia
Abstract
Objective: To determine the sensitivity and specificity of a Computer Aided Diagnosis (CAD) program for scoring chest x-rays (CXRs) of presumptive tuberculosis (TB) patients compared to Xpert MTB/RIF (Xpert).
Method: Consecutive presumptive TB patients with a cough of any duration were offered digital CXR, and opt out HIV testing. CXRs were electronically scored as normal (CAD score ≤ 60) or abnormal (CAD score > 60) using a CAD program. All patients regardless of CAD score were requested to submit a spot sputum sample for testing with Xpert and a spot and morning sample for testing with LED Fluorescence Microscopy-(FM).
Results: Of 350 patients with evaluable data, 291 (83.1%) had an abnormal CXR score by CAD. The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of CXR compared to Xpert were 100% (95%CI 96.2-100), 23.2% (95%CI 18.2-28.9), 33.0% (95%CI 27.6-38.7) and 100% (95% 93.9-100), respectively. The area under the receiver operator curve (AUC) for CAD was 0.71 (95%CI 0.66-0.77). CXR abnormality correlated with smear grade (r = 0.30, p<0.0001) and with Xpert CT(r = 0.37, p<0.0001).
Conclusions: To our knowledge this is the first time that a CAD program for TB has been successfully tested in a real world setting. The study shows that the CAD program had high sensitivity but low specificity and PPV. The use of CAD with digital CXR has the potential to increase the use and availability of chest radiography in screening for TB where trained human resources are scarce.
Conflict of interest statement
Figures
Similar articles
-
Chest X-ray interpretation does not complement Xpert MTB/RIF in diagnosis of smear-negative pulmonary tuberculosis among TB-HIV co-infected adults in a resource-limited setting.BMC Infect Dis. 2021 Jan 13;21(1):63. doi: 10.1186/s12879-020-05752-7. BMC Infect Dis. 2021. PMID: 33435896 Free PMC article.
-
Digital CXR with computer aided diagnosis versus symptom screen to define presumptive tuberculosis among household contacts and impact on tuberculosis diagnosis.BMC Infect Dis. 2017 Apr 24;17(1):301. doi: 10.1186/s12879-017-2388-7. BMC Infect Dis. 2017. PMID: 28438139 Free PMC article.
-
Systematic review: Comparison of Xpert MTB/RIF, LAMP and SAT methods for the diagnosis of pulmonary tuberculosis.Tuberculosis (Edinb). 2016 Jan;96:75-86. doi: 10.1016/j.tube.2015.11.005. Epub 2015 Nov 30. Tuberculosis (Edinb). 2016. PMID: 26786658 Review.
-
Xpert® MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults.Cochrane Database Syst Rev. 2014 Jan 21;2014(1):CD009593. doi: 10.1002/14651858.CD009593.pub3. Cochrane Database Syst Rev. 2014. Update in: Cochrane Database Syst Rev. 2019 Jun 07;6:CD009593. doi: 10.1002/14651858.CD009593.pub4. PMID: 24448973 Free PMC article. Updated. Review.
-
Use of the Xpert(®) MTB/RIF assay for diagnosing pulmonary tuberculosis comorbidity and multidrug-resistant TB in obstetrics and gynaecology inpatient wards at the University Teaching Hospital, Lusaka, Zambia.Trop Med Int Health. 2013 Sep;18(9):1134-1140. doi: 10.1111/tmi.12145. Epub 2013 Jul 3. Trop Med Int Health. 2013. PMID: 23834035 Free PMC article.
Cited by
-
Accuracy of digital chest x-ray analysis with artificial intelligence software as a triage and screening tool in hospitalized patients being evaluated for tuberculosis in Lima, Peru.PLOS Glob Public Health. 2024 Feb 7;4(2):e0002031. doi: 10.1371/journal.pgph.0002031. eCollection 2024. PLOS Glob Public Health. 2024. PMID: 38324610 Free PMC article.
-
Computer-aided detection thresholds for digital chest radiography interpretation in tuberculosis diagnostic algorithms.ERJ Open Res. 2024 Jan 8;10(1):00508-2023. doi: 10.1183/23120541.00508-2023. eCollection 2024 Jan. ERJ Open Res. 2024. PMID: 38196890 Free PMC article.
-
Computer-Aided Detection for Chest Radiography to Improve the Quality of Tuberculosis Diagnosis in Vietnam's District Health Facilities: An Implementation Study.Trop Med Infect Dis. 2023 Oct 29;8(11):488. doi: 10.3390/tropicalmed8110488. Trop Med Infect Dis. 2023. PMID: 37999607 Free PMC article.
-
Assessment of non-tuberculosis abnormalities on digital chest x-rays with high CAD4TB scores from a tuberculosis prevalence survey in Zambia and South Africa.BMC Infect Dis. 2023 Aug 8;23(1):518. doi: 10.1186/s12879-023-08460-0. BMC Infect Dis. 2023. PMID: 37553658 Free PMC article.
-
Machine and Deep Learning for Tuberculosis Detection on Chest X-Rays: Systematic Literature Review.J Med Internet Res. 2023 Jul 3;25:e43154. doi: 10.2196/43154. J Med Internet Res. 2023. PMID: 37399055 Free PMC article.
References
-
- Iademarco MF, O'Grady J, Lonnroth K (2012) Chest radiography for tuberculosis screening is back on the agenda. Int J Tuberc Lung Dis 16: 1421–1422. - PubMed
-
- Toman K, Frieden T (2004) Toman's tuberculosis: case detection, treatment and monitoring: questions and answers; TFrieden T, editor. Geneva: World Health Organisation.
-
- Hogeweg L, Mol C, de Jong PA, Dawson R, Ayles H, et al. (2010) Fusion of local and global detection systems to detect tuberculosis in chest radiographs. Med Image Comput Comput Assist Interv 13: 650–657. - PubMed
-
- Jaeger S, Karargyris A, Candemir S, Folio L, Siegelman J, et al... (2013) Automatic Tuberculosis Screening Using Chest Radiographs. IEEE Trans Med Imaging. - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous