Table 1 Data sources employed in CHL process evaluation
Data source | Collected from | Collection frequency (time) | Process evaluation data collected | Administration mode | CHL1 component(s) evaluated |
|---|---|---|---|---|---|
Surveys | |||||
A. PConnect2 training evaluation | PConnect2 facilitators | Annual (end of PConnect2 training, typically March) | • Training effectiveness • Training quality • PConnect2 program and materials quality | Paper | • PConnect2 |
B. PConnect2 evaluation | PConnect2 participants | Annual (at end of PConnect2) | • Quality of PConnect2 content • Quality of PConnect2 materials • Quality of PConnect2 facilitation | Paper | • PConnect2 |
C. Staff training evaluation | Head Start staff (teachers, family advocates) | Annual (fall) | • Clarity/complexity of staff role in CHL • Self-efficacy for using CHL resources | Paper | • Enhanced nutrition support • Media campaign |
D. Head Start staff survey | Head Start staff (health/nutrition, teachers, family advocates, administrators) | Biannual (fall, spring) | • Staff readiness to implement intervention • Staff use of CHL materials • Staff-perceived quality and usefulness of CHL materials | Paper, electronic | • Enhanced nutrition support • Media campaign |
E. Parent outcomes survey | Head Start parents (convenience sample) | Annual (spring) | • Parent experiences with CHL | Paper, electronic | • PConnect2 • Enhanced nutrition support • Media campaign |
Interviews and focus groups | |||||
F. PConnect2 facilitator interviews | PConnect2 facilitators | Annual (after PConnect2 ends) | • Adequacy of training, quality improvement coaching, and materials • Demands on facilitators • Impacts on facilitators (e.g., health behaviors, empowerment) • Appropriateness and acceptability of parent-staff co-facilitation model • Number of participants using social media and content of posts made | In-person, phone | • PConnect2 • Enhanced nutrition support |
G. PConnect2 participant interviews | PConnect2 participants (two randomly selected per PConnect2 program) | Annual (after PConnect2 ends) | • Impacts on participants (e.g., health behaviors, empowerment) • Appropriateness and acceptability of parent-staff co-facilitation model • Facilitation quality • Number of participants using social media and content of posts made | In-person, phone | • PConnect2 |
H. Head Start staff interviews and focus groups | Head Start staff (program directors, family engagement, health/nutrition) | Annual (spring) | • Barriers and facilitators to CHL implementation • Effects of CHL on Head Start as a whole | Phone (interviews), in-person (focus groups) | • PConnect2 • Enhanced nutrition support • Media campaign |
Administrative records | |||||
I. Administrative records | Varied | Varied | • Attendance • Material distribution | Paper, electronic | • PConnect2 • Enhanced nutrition support • Media campaign |
Website analytics | |||||
J. Website analytics | Neighborhood Resource Map website (accessible only to intervention group staff and parents) | Continuous | For each website visit: • Device-specific ID • Date • Time of day | Electronic | • Media campaign |
K. Neighborhood Resource Map database | Neighborhood Resource Map website (accessible only to intervention group staff and parents) | Continuous | Changes requested to Neighborhood Resource Map | Electronic | • Media campaign |
PConnect observations and checklists | |||||
L. PConnect2 session checklists | PConnect2 facilitators | One per PConnect2 session/program/year | For each session: • Activities completed • Activities modified | Paper | • PConnect2 |
M. PConnect2 coaching reflection sheet | PConnect2 facilitators and PConnect2 quality improvement coach | One per PConnect2 session/program/year | • Adherence • Adaptations • Facilitation quality • Participant responsiveness | Paper | • PConnect2 |
N. PConnect2 session observations | Trained observer | Annual (one session observed per PConnect2 program) | • Adherence • Adaptations • Facilitation quality • Participant responsiveness | Paper | • PConnect2 |