Radiomics quality score | Median score (Interquartile range) | Clinical (n = 20) | Imaging (n = 31) | P | Diagnostic (n = 34) | Prognostic /Predictive†(n = 17) | P |
---|---|---|---|---|---|---|---|
Total 36 points | 11.00 (3–12.5) | 11.5 (3–13) | 10 (3.5–11.5) | .57 | 10 (3–11) | 12 (6–14) | .07 |
Domain 1: Protocol quality and stability in image and segmentation (0 to 5 points) | 1 (1–2) | 1.5 (1–2) | 1 (1–2) |  | 1 (1–2) | 1 (1–2) |  |
Protocol quality (2) | 1 (1–1.5) | 1 (1–1.25) | 1 (1–1) | .95 | 1 (1–1) | 1 (1–1.75) | .662 |
Test-retest (1) | 0 (0–0) | 0 (0–0) | 0 (0–0) | .228 | 0 (0–0) | 0 (0–0) | .169 |
Phantom study (1) | 0 (0–0) | 0 (0–0) | 0 (0–0) | NA | 0 (0–0) | 0 (0–0) | NA |
Multiple segmentation (1) | 0 (0–1) | 0 (0–0.25) | 0 (0–1) | .76 | 0 (0–1) | 0 (0–1) | .277 |
Domain 2: Feature selection and validation (−8 to 8 points) | 5 (−2–6) | 5 (−2–6) | 5 (−2–5) |  | 5 (− 2–6) | 5 (− 2–6) |  |
Feature reduction or adjustment of multiple testing (−3 or 3) | 3 (3–3) | 3 (3–3) | 3 (3–3) | .849 | 3 (3–3) | 3 (3–3) | 1 |
Validation (−5, 2, 3, 4, or 5) | 2 (− 5–3) | 2 (− 5–3) | 2 (− 5–2) | .975 | 2 (−5–3) | 2 (− 5–3) | .833 |
Domain 3: Biologic/clinical validation and utility (0 to 6 points) | 2 (1–3) | 2 (1–3) | 2 (1–2) |  | 2 (1–2) | 3 (2–4) |  |
Non-radiomics features (1) | 1 (0–1) | 1 (0–1) | 1 (0–1) | .799 | 1 (0–1) | 1 (0–1) | .159 |
Biologic correlates (1) | 1 (0–1) | 1 (0–1) | 1 (0–1) | 1 | 1 (1–1) | 1 (0–1) | .001 |
Comparison to ‘gold standard’ (2) | 0 (0–2) | 0 (0–2) | 0 (0–2) | .97 | 0 (0–0) | 2 (2–2) | <.001 |
Potential clinical utility (2) | 0 (0–0) | 0 (0–0) | 0 (0–0) | .44 | 0 (0–0) | 0 (0–0) | .50 |
Domain 4: Model performance index (0 to 5 points) | 2 (1–2) | 2 (1–3) | 2 (1–3) |  | 2 (1–2) | 2 (1–3) |  |
Discrimination statistics (2) | 2 (1–2) | 1.5 (1–2) | 2 (1–2) | .75 | 2 (1–2) | 2 (1–2) | .99 |
Calibration statistics (2) | 0 (0–0) | 0 (0–0) | 0 (0–0) | .84 | 0 (0–0) | 0 (0–1) | .02 |
Cut-off analysis (1) | 0 (0–0.5) | 0 (0–0) | 0 (0–1) | .48 | 0 (0–0) | 1 (0–1) | .001 |
Domain 5: High level of evidence (0 to 8 points) | 0 (0–0) | 0 (0–0) | 0 (0–0) |  | 0 (0–0) | 0 (0–0) |  |
Prospective study (7) | 0 (0–0) | 0 (0–0) | 0 (0–0) | .08 | 0 (0–0) | 0 (0–0) | .634 |
Cost-effective analysis (1) | 0 (0–0) | 0 (0–0) | 0 (0–0) | NA | 0 (0–0) | 0 (0–0) | NA |
Domain 6: Open science and data (0 to 4 points) | 0 (0–0) | 0 (0–0) | 0 (0–0) | .03 | 0 (0–0) | 0 (0–0) | 1 |