From: Conducting Online Expert panels: a feasibility and experimental replicability study
Features | Panel A, Phase I | Panel B, Phase I | Panel C, Phase I | Panel D, Phase I | Total, Phase I | Panel A, Phase III | Panel B, Phase III | Panel C, Phase III | Panel D, Phase III | Total, Phase III |
---|---|---|---|---|---|---|---|---|---|---|
Feature 1 | 14 93.3% .53 | 12 100% .25 | 30 90.9% .39 | 30 96.8% .45 | 86 94.5% .42 | 10 100% .3 | 10 100% .2 | 32 97% .24 | 26 100% .27 | 78 98.7% .25 |
Feature 2 | 13 92.9% .57 | 6 50% .92 | 28 82.4% .71 | 21 67.7% .87 | 68 74.7% .77 | 9 90% .6 | 5 50% .8 | 28 84.8% .64 | 18 69.2% .89 | 60 75.9% .69 |
Feature 3 | 8 57.1% 1 | 5 41.7% .92 | 20 58.8% 1.03 | 16 51.6% .97 | 49 53.8% 1.01 | 5 50% .8 | 1 10% .3 | 19 59.4% .91 | 16 59.3% .85 | 41 51.9% .94 |
Feature 4 | 13 92.9% .5 | 6 50% 1.17 | 25 3.5% 7 .91 | 26 74.2% .94 | 67 73.6% .97 | 8 80% .6 | 6 60% .6 | 28 84.8% .73 | 24 88.9% .63 | 66 82.5% .75 |
Feature 5 | 6 42.9% 1.14 | 7 58.3% 1.08 | 18 54.5% 1 | 19 61.3% .68 | 50 55.6% .94 | 5 50% .8 | 7 70% .8 | 23 71.9% .69 | 15 55.6% .59 | 50 63.3% .68 |
Feature 6 | 11 84.6% 1.21 | 9 75% .75 | 30 88.2% .62 | 27 87.1% .74 | 77 85.6% .77 | 9 90% .5 | 9 90% .4 | 29 90.6% .47 | 24 88.9% .52 | 71 89.9% .51 |
Feature 7 | 11 78.6% 1 | 9 75% .58 | 27 79.4% .68 | 28 90.3% .55 | 75 82.4% .67 | 8 80% .9 | 9 90% .5 | 25 75.8% .73 | 26 96.3% .52 | 68 85% .65 |
Feature 8 | 6 46.2% 1.15 | 8 66.7% .92 | 20 58.8%t 1.03 | 22 71% .77 | 56 62.2% .96 | 6 66.7% .67 | 7 70% .7 | 21 63.6% .76 | 18 66.7% .85 | 52 65.8% .77 |
Feature 9 | 11 84.6% .46 | 10 83.3% .58 | N/A | 28 90.3% .48 | 49 87.5% .58 | 10 100% .1 | 10 100% .4 | 18 62.1% .79 | 26 96.3% .37 | 64 84.2% .73 |
Feature 10 | 9 64.3% 1.07 | 6 50% .92 | 14 41.2% 1.38 | 16 51.6% 1.23 | 45 49.5% 1.27 | 4 40% 1.2 | 3 30% .6 | 9 28.1% 1.06 | 13 48.1% 1.48 | 29 36.7% 1.05 |
Feature 11 | 13 92.9% .71 | 8 66.7% 1.17 | 22 75.9% .83 | 23 74.2% .84 | 66 76.7% .92 | 10 100% .5 | 6 60% 1 | 26 81.3% .59 | 19 70.4% .78 | 61 77.2% .82 |