Table 2 Rating and ranking exercise results - the example of recall rate
A. Definitions of indicators under review | |||||
Name of indicators | Numerator | Denominator | |||
Recall rate | n° of women recalled for further assessment based on a positive screening examination | n° of women screened | |||
Positive predictive value of recall | n° of breast cancers detected | n° of women recalled for further assessment | |||
False positive rate | n° of women recalled for further assessment with no cancer diagnosis | n° of women screened | |||
Early recall rate | n° of women invited to undergo a re-screen at an interval less than the routine screening interval | n° of women screened | |||
False negative assessment after recall | n° of women diagnosed with breast cancer after recall and negative further assessment | n° of women screened | |||
B. Results | |||||
Indicator selection criteria | Ratinga (mean, SD) | ||||
Early recall rate | Recall rate | False negative | False positive | Positive predictive value | |
Relevant | 7.5 (2.8) | 9.4 (0.7) | 8.3 (1.2) | 9.1 (1.3) | 9.0 (1.0) |
Measurable | 7.4 (2.5) | 9.5 (0.9) | 6.6 (2.5) | 9.4 (0.7) | 9.5 (0.8) |
Accurate | 6.9 (3.1) | 9.4 (1.0) | 6.9 (1.9) | 9.4 (0.8) | 9.0 (1.3) |
Ethical | 9.3 (0.8) | 9.7 (0.5) | 9.4 (0.7) | 9.7 (0.5) | 9.7 (0.5) |
Understandable | 8.7 (1.6) | 9.4 (0.8) | 7.9 (3.2) | 9.0 (1.0) | 9.3 (1.0) |
Rank | Ranking | ||||
1 | 9 | 2 | |||
2 | 1 | 1 | 4 | 5 | |
3 | 2 | 3 | 3 | 2 | |
4 | 2 | 1 | |||
5 | 4 | 1 | |||
Not applicable | 2 | 2 | 2 | ||
No of participants ranking | 11 | 10 | 11 | 11 | 9 |
Weighted ranking score | 2.0 | 4.9 | 2.4 | 3.6 | 3.2 |