Skip to main content

Table 3 Summary measures for the initial parameter values: α1 = 0.5, α2 = 0.3, β5 = 1.0. The causal treatment effect was β1 = 3.0. Results are across 200 simulated data sets; values are: sample mean (Monte Carlo SD) unless otherwise stated

From: Assessing causal treatment effect estimation when using large observational datasets

  N = 2000 N = 20,000 N = 200,000
Adjusted Linear Model and Propensity Score IPTW
 Effect Estimate 3.47 (0.05) 3.47 (0.02) 3.47 (0.01)
 Bias 0.47 (0.05) 0.47 (0.02) 0.47 (0.01)
 Mean Square Error 0.23 (0.04) 0.22 (0.02) 0.22 (0.00)
 Z Statistic 9.41 (0.92) 29.97 (1.05) 94.92 (1.06)
 Coverage: n (%) 0 (0.00) 0 (0.00) 0 (0.00)
 Power: n (%) 200 (100.00) 200 (100.00) 200 (100.00)
2SLS IV
 Effect Estimate 2.62 (2.53) 3.06 (0.73) 2.98 (0.24)
 Bias −0.38 (2.53) 0.06 (0.73) −0.02 (0.24)
 Mean Square Error 12.90 (10.63) 1.06 (0.84) 0.12 (0.07)
 Z Statistic −0.12 (0.90) 0.08 (0.87) −0.07 (0.93)
 Coverage: n (%) 192 (96.00) 194 (97.00) 197 (98.50)
 Power: n (%) 27 (13.50) 191 (95.50) 200 (100.00)
Adjusted 2SLS IV
 Effect Estimate 3.03 (0.30) 3.00 (0.10) 3.00 (0.03)
 Bias 0.03 (0.30) 0.00 (0.10) 0.00 (0.03)
 Mean Square Error 0.18 (0.16) 0.02 (0.01) 0.00 (0.00)
 Z Statistic 0.15 (0.87) 0.04 (1.00) −0.07 (1.04)
 Coverage: n (%) 194 (97.00) 192 (96.00) 187 (93.50)
 Power: n (%) 200 (100.00) 200 (100.00) 200 (100.00)