Skip to main content

Table 4 Comparison of performance evaluation measures for primary and additional analyses

From: Predicting the presence of depressive symptoms in the HIV-HCV co-infected population in Canada using supervised machine learning

Sr. No

Analysis

OOB error

AUC (95% CI)

Sensitivity (95% CI)

Specificity (95% CI)

Primary Analyses

1

Full algorithm (x = 137)

0.16

0.82 (0.78–0.86)

0.77 (0.70–0.83)

0.73 (0.66–0.79)

2

Reduced algorithm (x = 46)

0.20

0.76 (0.71–0.81)

0.70 (0.63–0.76)

0.70 (0.63–0.76)

Additional Analyses

A

One visit per individual

1

Full algorithm (x = 137)

0.17

0.74 (0.66–0.82)

0.70 (0.58–0.80)

0.64 (0.52–0.76)

2

Reduced algorithm (x = 46)

0.23

0.60 (0.50–0.69)

0.73 (0.61–0.82)

0.37 (0.26–0.50)

B

Different CES-D-10 cut-offs

I

Cut-off – 8

1

Full algorithm (x = 137)

0.17

0.85 (0.81–0.89)

0.91 (0.87–0.95)

0.67 (0.59–0.74)

2

Reduced algorithm (x = 46)

0.19

0.79 (0.74–0.83)

0.83 (0.77–0.87)

0.60 (0.52–0.67)

II

Cut-off – 13

1

Full algorithm (x = 137)

0.15

0.80 (0.76–0.85)

0.62 (0.54–0.70)

0.81 (0.76–0.86)

2

Reduced algorithm (x = 46)

0.20

0.79 (0.74–0.83)

0.45 (0.37–054)

0.87 (0.82–0.91)

III

Cut-off—15

1

Full algorithm (x = 137)

0.14

0.87 (0.83–0.91)

0.55 (0.45–0.65)

0.95 (0.91–0.97)

2

Reduced algorithm (x = 46)

0.17

0.73 (0.67–0.79)

0.27 (0.19–0.36)

0.94 (0.91–0.97)

C

With food insecurity variable (x = 138)

0.16

0.84 (0.80–0.87)

0.77 (0.70–0.83)

0.73 (0.67–80)

  1. Abbreviations: OOB Out-of-Bag Samples, AUC Area under the Receiver Operating Characteristic curve, CI Confidence interval, CES-D-10 Center for Epidemiologic Studies Depression Scale-10