False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study

doi:10.1093/neuonc/noac192

	False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study
	Luo, Xiao 1,2; Yang, Yadi 1,2; Yin, Shaohan 1,2; Li, Hui 1,2; Zhang, Weijing 1,2; Xu, Guixiao 1,2; Fan, Weixiong 3; Zheng, Dechun 4; Li, Jianpeng 5; Shen, Dinggang6,7 ; Gao, Yaozong 6; Shao, Ying 6; Ban, Xiaohua 1,2; Li, Jing 1,2; Lian, Shanshan 1,2; Zhang, Cheng 1,2; Ma, Lidi 1,2; Lin, Cuiping 1,2; Luo, Yingwei 1,2; Zhou, Fan 1,2; Wang, Shiyuan 1,2; Sun, Ying 1,8; Zhang, Rong 1,2; Xie, Chuanmiao 1,2
	2022-08
发表期刊	NEURO-ONCOLOGY (IF:16.4[JCR-2023],14.9[5-Year])
ISSN	1522-8517
EISSN	1523-5866
发表状态	已发表
DOI	10.1093/neuonc/noac192
摘要	Background Errors have seldom been evaluated in computer-aided detection on brain metastases. This study aimed to analyze false negatives (FNs) and false positives (FPs) generated by a brain metastasis detection system (BMDS) and by readers. Methods A deep learning-based BMDS was developed and prospectively validated in a multicenter, multireader study. Ad hoc secondary analysis was restricted to the prospective participants (148 with 1,066 brain metastases and 152 normal controls). Three trainees and 3 experienced radiologists read the MRI images without and with the BMDS. The number of FNs and FPs per patient, jackknife alternative free-response receiver operating characteristic figure of merit (FOM), and lesion features associated with FNs were analyzed for the BMDS and readers using binary logistic regression. Results The FNs, FPs, and the FOM of the stand-alone BMDS were 0.49, 0.38, and 0.97, respectively. Compared with independent reading, BMDS-assisted reading generated 79% fewer FNs (1.98 vs 0.42, P < .001); 41% more FPs (0.17 vs 0.24, P < .001) but 125% more FPs for trainees (P < .001); and higher FOM (0.87 vs 0.98, P < .001). Lesions with small size, greater number, irregular shape, lower signal intensity, and located on nonbrain surface were associated with FNs for readers. Small, irregular, and necrotic lesions were more frequently found in FNs for BMDS. The FPs mainly resulted from small blood vessels for the BMDS and the readers. Conclusions Despite the improvement in detection performance, attention should be paid to FPs and small lesions with lower enhancement for radiologists, especially for less-experienced radiologists.
关键词	brain neoplasms deep learning magnetic resonance imaging radiographic image interpretation ROC curve
URL	查看原文
收录类别	SCI ; SCIE
语种	英语
WOS研究方向	Oncology ; Neurosciences & Neurology
WOS类目	Oncology ; Clinical Neurology
WOS记录号	WOS:000853189400001
出版者	OXFORD UNIV PRESS INC
引用统计	正在获取...
文献类型	期刊论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/231982
专题	生物医学工程学院_PI研究组_沈定刚组
通讯作者	Zhang, Rong; Xie, Chuanmiao
作者单位	1.Sun Yat Sen Univ, Collaborat Innovat Ctr Canc Med, State Key Lab Oncol South China, Canc Ctr, Guangzhou, Peoples R China 2.Sun Yat Sen Univ, Dept Radiol, Canc Ctr, 651 Dongfeng Rd East, Guangzhou 510060, Peoples R China 3.Meizhou Peoples Hosp, Dept Radiol, Meizhou, Peoples R China 4.Fujian Med Univ, Fujian Canc Hosp, Dept Radiol, Canc Hosp, Fuzhou, Fujian, Peoples R China 5.Southern Med Univ, Affiliated Dongguan Hosp, Dept Radiol, Guangzhou, Peoples R China 6.Shanghai United Imaging Intelligence Co Ltd, R&D Dept, Shanghai, Peoples R China 7.ShanghaiTech Univ, Sch Biomed Engn, Shanghai, Peoples R China 8.Sun Yat Sen Univ, Dept Radiat Oncol, Canc Ctr, Guangzhou, Peoples R China
推荐引用方式 GB/T 7714	Luo, Xiao,Yang, Yadi,Yin, Shaohan,et al. False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study[J]. NEURO-ONCOLOGY,2022.
APA	Luo, Xiao.,Yang, Yadi.,Yin, Shaohan.,Li, Hui.,Zhang, Weijing.,...&Xie, Chuanmiao.(2022).False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study.NEURO-ONCOLOGY.
MLA	Luo, Xiao,et al."False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study".NEURO-ONCOLOGY (2022).