Implementation Survey

After the portfolio review process, a 24-item electronic survey (Appendix ²) was developed by the study team and administered to the designated principal investigators and/or project leads for each project identified during the portfolio review using Qualtrics software.¹⁷ The survey was designed to assess the implementation status of each access portfolio project meeting study criteria (“Has the deliverable from your project been implemented either in whole or in part?”), and to identify specific barriers and facilitators to the implementation of project deliverables. In this context, we specifically defined project deliverables to be effective interventions or usable tools that constituted the central work product of the project. The survey included both closed and open-ended questions. Survey development was informed by the Consolidated Framework for Implementation Research (CFIR), which provides a menu of constructs across five domains (innovation, inner setting, individuals, outer setting, process) associated with effective implementation.^18,19 The CFIR was developed as a theory-based way to understand the context within which evidence-based programs are implemented.^18,19

A draft survey instrument was developed and refined by the project team before finalization and dissemination. Principal investigators (PI) and/or project leads identified in the portfolio review were invited to participate between April 2021 and June 2021. Only projects that ended before 2020 were assessed via the survey to ensure that all projects were afforded sufficient time to implement deliverables (i.e., at least a year after completion of the funding period/project term).