Skip to main content

Table 4 Results of the Post-Completion Survey (N = 76)

From: Conducting Online Expert panels: a feasibility and experimental replicability study

Statement

Researchers

Researchers and Practitioners

Practitioners

Large Panels

Small Panels

Total

1. Participation in the exercise was interesting

5.68 (1.08)

4.96 (5.18)

5.18 (1.01)

5.29 (1.36)

5.39 (1.24)

5.31 (1.32)

2. The survey instrument was easy to use

5.42 (1.26)

5.03 (1.76)

4.11 (1.81)*

5.05 (1.52)

4.72 (2.05)

4.78 (1.40)

3. Participation in this exercise was frustrating

3.34 (1.58)

3.69 (2.24)

3.78 (1.48)

3.77 (1.82)

2.95 (1.61)†

3.57 (1.80)

4. I was comfortable expressing my views in the discussions

5.35 (1.33)

5.81 (1.11)

5.33 (1.19)

5.43 (1.29)

5.78 (1.00)

5.51 (1.23)

5. The exercise brought out views I hadn't considered

5.06 (1.03)

4.52 (1.87)

4.61 (1.50)

4.75 (1.54)

4.79 (1.36)

4.76 (1.49)

6. The discussions gave me a better understanding of the issues

4.75 (1.37)

4.35 (1.70)

4.72 (1.53)

4.51 (1.59)

4.89 (1.24)

4.61 (1.51)

7. Group members debated each others' viewpoints during the discussions .

4.66 (1.10)

4.04 (1.68)

4.78 (1.40)

4.74 (1.26)

3.63 (1.54)*

4.47 (1.41)

8. The discussion in Phase II caused me to revise my original responses

4.13 (1.45)

4.04 (1.72)

4.61 (1.46)

4.10 (1.53)

4.56 (1.62)

4.21 (1.55)

9. I had trouble following discussions

3.75 (1.67)

3.62 (1.86)

4.39 (1.42)

4.03 (1.71)

3.28 (1.53)†

3.86 (1.69)

10. I will participate in another ExpertLens process on minimum quality standards for CQI reporting

5.75 (1.01)

4.44 (2.10)

4.88 (1.65)**

5.02 (1.62)

5.32 (1.95)

5.09 (1.70)

  1. (Means and standard deviations)
  2. The first 9 statements were rated on a 7-point agreement scale, where 1 = Strongly Disagree, 4 = Neutral, and 7 = Strongly Agree.
  3. The last statement ware rated on a 7-point likelihood scale, where 1 = Very unlikely and 7 = Very likely.
  4. †p ≤ .1, * p ≤ .05; ** p ≤ .01; *** p ≤ .001
  5. Significance levels presented in the third column of the table refer to the differences in opinions between researchers, researchers and practitioners, and practitioners; significance levels presented in the sixth column refer to the differences in opinions between large and small panels.