Table 3 Feature Importance to the Definition of a CQI Initiative and Agreement between Panels
From: Conducting Online Expert panels: a feasibility and experimental replicability study
| Features |
Panel A, Phase I |
Panel B, Phase I |
Panel C, Phase I |
Panel D, Phase I |
Total,
Phase I |
Panel A, Phase III |
Panel B, Phase III |
Panel C, Phase III |
Panel D, Phase III |
Total,
Phase III |
|---|---|---|---|---|---|---|---|---|---|---|
| Feature 1 |
14 93.3% .53 |
12 100% .25 |
30 90.9% .39 |
30 96.8% .45 |
86 94.5% .42 |
10 100% .3 |
10 100% .2 |
32 97% .24 |
26 100% .27 |
78 98.7% .25 |
| Feature 2 |
13
92.9% .57 |
6 50% .92 |
28
82.4% .71 |
21
67.7% .87 |
68
74.7% .77 |
9
90% .6 |
5 50% .8 |
28
84.8% .64 |
18
69.2% .89 |
60
75.9% .69 |
| Feature 3 |
8 57.1% 1 |
5 41.7% .92 |
20 58.8% 1.03 |
16 51.6% .97 |
49 53.8% 1.01 |
5 50% .8 |
1 10% .3 |
19 59.4% .91 |
16 59.3% .85 |
41 51.9% .94 |
| Feature 4 |
13
92.9% .5 |
6 50% 1.17 |
25
3.5% 7 .91 |
26
74.2% .94 |
67
73.6% .97 |
8
80% .6 |
6 60% .6 |
28
84.8% .73 |
24
88.9% .63 |
66
82.5% .75 |
| Feature 5 |
6 42.9% 1.14 |
7 58.3% 1.08 |
18 54.5% 1 |
19 61.3% .68 |
50 55.6% .94 |
5 50% .8 |
7
70% .8 |
23
71.9% .69 |
15 55.6% .59 |
50 63.3% .68 |
| Feature 6 |
11
84.6% 1.21 |
9
75% .75 |
30
88.2% .62 |
27
87.1% .74 |
77
85.6% .77 |
9
90% .5 |
9
90% .4 |
29
90.6% .47 |
24
88.9% .52 |
71
89.9% .51 |
| Feature 7 |
11
78.6% 1 |
9
75% .58 |
27
79.4% .68 |
28
90.3% .55 |
75
82.4% .67 |
8
80% .9 |
9
90% .5 |
25
75.8% .73 |
26
96.3% .52 |
68
85% .65 |
| Feature 8 |
6 46.2% 1.15 |
8
66.7% .92 |
20 58.8%t 1.03 |
22
71% .77 |
56 62.2% .96 |
6
66.7% .67 |
7
70% .7 |
21 63.6% .76 |
18
66.7% .85 |
52 65.8% .77 |
| Feature 9 |
11
84.6% .46 |
10
83.3% .58 | N/A |
28
90.3% .48 |
49
87.5% .58 |
10
100% .1 |
10
100% .4 |
18 62.1% .79 |
26
96.3% .37 |
64
84.2% .73 |
| Feature 10 |
9 64.3% 1.07 |
6 50% .92 |
14 41.2% 1.38 |
16 51.6% 1.23 |
45 49.5% 1.27 |
4 40% 1.2 |
3 30% .6 |
9 28.1% 1.06 |
13 48.1% 1.48 |
29 36.7% 1.05 |
| Feature 11 |
13
92.9% .71 |
8
66.7% 1.17 |
22
75.9% .83 |
23
74.2% .84 |
66
76.7% .92 |
10
100% .5 |
6 60% 1 |
26
81.3% .59 |
19
70.4% .78 |
61
77.2% .82 |