Skip to main content

Table 1 Summary of inter-rater reliability exercise for first half of data collection period, by type of data elements.

From: Automated inter-rater reliability assessment and electronic data collection in a multi-center breast cancer study

Site/Abstractor Tumor Treatment Treatment* w/o HT Date Recurrence Comorbidity Surveillance
A/1 3 6 2 3 2 12
A/2 1 6 3 1 3 19
B/3 3 6 2 7 0 11
B/4 1 9 4 6 4 10
B/5 0 5 1 1 0 15
C/6 0 5 2 0 1 27
C/7 0 3 2 1 5 13
D/8 2 5 3 1 3 15
D/10 5 7 6 0 0 5
D/11 1 7 3 2 1 11
E/12 2 7 5 1 3 8
F/15 8 7 2 0 1 7
#Disagreements 26 73 35 23 23 153
Total in section 420 360 360 360 1140 960
%Disagreement 6% 20% 10% 6% 2% 16%
  1. *Excluding 38 Disagreements on Last Known Date of Hormonal Therapy