Table 1 EMPOWER QUERI Implementation Evaluation: Summary of Methods (Reprinted with permission from Huynh et al. [76])

Month

1

2

3

4

5

6

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

1

2

3

4

Provider and Administrator Interviews

 • Phase 1: Intervention planning, needs assessment, and acceptability;

 • Phase 2: Factors likely to affect adoption, acceptability, feasibility, satisfaction, penetration/reach.

 • Phase 4: Experiences of intervention/implementation; adaptations made in practice; suggestion for future adaptations to inform effectiveness and spread.

Provider Surveys

 • Measuring Organizational Readiness for Patient Engagement (MORE)

Patient Interviews

 • Phase 3: Factors likely to affect adoption, acceptability, feasibility, satisfaction, penetration/reach.

 • Phase 4: Experiences of intervention/implementation; challenges, problem-solving, and suggestions for change/adaptation.

Patient Surveys (pre and post-intervention)

 • Primary outcomes: Program engagement and retention; change in targeted symptom or risk reduction behavior;

 • Secondary outcomes: Satisfaction (at f/u only), global health, out of role days;

 • Potential moderators: engagement, patient demographics, social support, mental health.

Periodic Reflections

 • History and trajectory of implementation events

 • Activities and interrelationships, including stakeholder engagement;

 • Adaptations to intervention components and/or implementation strategies;

 • Contextual factors with potential impact for implementation.

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Administrative Data

 • Referral monitoring

 • Patient engagement

 • Patient outcomes

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

Text Analysis

 • Review of changes occurring to intervention components and/or implementation strategies per T1 (Baseline) proposal materials and subsequent institutional review, amendments, and other study documentation.