Fig. 3
Measures of agreement and validity between claims-based methods for sepsis identification and sepsis definitions based on clinical criteria (N = 2217). Legend: Total N = 2217 adjudicated hospitalizations. Implicit/Explicit ICD-9 sepsis defined based on taxonomies of infection and organ dysfunction codes proposed by Angus, et al. in addition to explicit sepsis codes. CMS ICD-9 sepsis defined based on list of codes used in the CMS measure. REGARDS-EHR defined as infection event meeting modified EHR criteria proposed by Rhee, et al.4 REGARDS-SOFA defined as infection event with ≥2 SOFA points across all organ systems (respiratory, cardiovascular, renal, hematological, hepatic, and neurological). REGARDS-qSOFA defined as infection events meeting ≥2 qSOFA criteria. Panel A) Kappa statistics and observed agreement; Panel B) Sensitivity and specificity with clinical criteria as standards. Bias-corrected 95% confidence intervals obtained by bootstrapping and shown in parentheses for all measures. SOFA = sepsis-related organ failure assessment; qSOFA = “quick” sepsis-related organ failure assessment; EHR = electronic health record. CMS = Centers for Medicare and Medicaid Services; ICD-9 = International Classification of Diseases, Ninth Revision