An integrated model incorporating deep learning, hand-crafted radiomics and clinical and US features to diagnose central lymph node metastasis in patients with papillary thyroid cancer

Table 4 Performance comparison of radiologists and integrated model in prediction of CLNM

Test cohort	AUC	95%CI	Undetected CLNM (%)	Unnecessary CLND (%)	ACC (%)	SEN (%)	SPE (%)	PPV (%)	NPV (%)
Junior Radiologists	0.5612*	[0.4852, 0.6371]	57.89 (44/76)	29.87 (23/77)	56.21	42.11	70.13	58.18	55.10
Senior Radiologists	0.6400*	[0.5646, 0.7153]	44.74 (34/76)	27.27 (21/77)	64.05	55.26	72.73	66.67	62.22
Integrated Model	0.8406	[0.7792, 0.9020]	27.63 (21/76)	18.18 (14/77)	77.12	72.37	81.82	79.71	75.00

Abbreviations: CLNM, central lymph node metastasis; CLND, central lymph node dissection; ACC, accuracy; SEN, sensitivity; SPE, specificity; PPV, positive predictive value; NPV, negative predictive value; AUC, area under the receiver operating curve; CI, confidence interval *Compared with integrated model, p < 0.05

ISSN: 1471-2407