Evaluation Plan and Timeline
Evaluation Plan
The proposed program is designed to adapt the Getting to Outcome (GTO) framework by employing a participatory performance assessment process (PPAP). This framework empowers program staff to work on planning, implementation, and evaluation facets of the program without requiring external evaluators (Lewis, 2017). The evaluation will be done quarterly to establish the program’s success in attaining program objectives to impact pediatric patients and their caregivers positively. The evaluation design is targeted to ensure regular reporting, identify barriers in implementation, and develop quality improvement strategies.
The proposed project proposes to the program associate to be the chief evaluator to extend practitioner capacity around evaluation. The evaluator will be responsible for designing both a formative and summative evaluation systems for the program. Additionally, the evaluator will, collaboratively with the Director, schedule biweekly meetings with program staff to review goals and milestones regarding admissions, data collection, and program delivery. Before each session, the program associate and the Director will be required to develop meeting agendas for discussion. The evaluator services also include monitoring, development of semi-annual progress reports, development of the quarterly evaluation reports, and conducting fidelity checks and audits.
The process evaluation will assess the effectiveness of the program activities in meeting the program’s objectives in conformance with the set timelines (Fry et al., 2018). In this line, the formative evaluation design will focus on data collection and analysis, which will, consequently, be reported to the program staff, community stakeholders, and grantors. The process evaluation will majorly focus on the following questions: (a) Whether the program has met its target in pediatric and patient outreach; (b) Whether the program staff is effectively using information collected in program improvement, and (c) Whether the project proposed activities were effectively implemented and within the pre-set timeline. Results from the evaluation will be communicated to project partners regularly by the project director.
Summative evaluation will address the impact and consequent outcome of Child Life services in pediatric care. Summative evaluation questions to be discussed will include: (a) Has the program desired outcome (both short-term and long-term) achieved? And (b) What are the program’s impact on pediatric patient’s attitude and medical adherence, as well as caregivers’ perspective and psychosocial state.
In the evaluation, the program proposes using the following assessment tools; CAMPIS-R (Child-Adult Medical Procedure Interaction Scale), STAI (State-Trait Anxiety Inventory), and PHBQ (Post Hospital Behavior Questionnaire). The CAMPIS-R tool will be used to collect both the patient’s and parents’ data on coping, distress, and behaviours in the procedure room. Data will be collected pre and post CLS intervention. According to Olson and Jacobson (2017), the STAI functions to assess caregiver anxiety levels and perception of the CLS preparation. PHBQ will measure the maladaptive behaviours of both the patient and the primary caregiver. PHBQ will be designed to limit child neglect by giving the parent opportunity to assess and understand behavioural changes such as withdrawal, separation anxiety, or even aggression after an invasive medical procedure. Lastly, the proposed program will utilize mandated Government Performance Reporting Act (GPRA) measurements for clinical care to evaluate the project’s progress.
Project Timeline
| Activities | Expected Completion Date | Responsible Party |
| The hiring of Program Associate and Certified Child Life Specialist (CCLS) | Month 1 | Program Director |
| Scheduled surveys created, community stakeholder meetings | Month 1 | Entire Program Staff |
| Collection of the parental consent forms and patient intake forms | Month 1 | CCLS |
| Pre-evaluation tests and assessments using CAMPIS-R and STAI tools | Month 2 | CCLS |
| Child Life Services to alleviate stress and stigma among patients and caregivers | Continuous | CCLS |
| 1st Evaluation Reports | Month 4 | Program Director and Program Associate |
| Community outreach meetings, events, and workshops | Continuous | Program Director and Program Associate |
| PHBQ follow-ups on patients completed treatments | continuous | Program associate and Interns |
| Semi-annual progress report | Month 6 | Program Associate |
| Staff meetings | Bi-weekly | Program Associate |
References
Fry, C., Nikpay, S., Leslie, E., & Buntin, M. (2018). Evaluating Community-Based Health Improvement Programs. Health Affairs, 37(1), 22-29. https://doi.org/10.1377/hlthaff.2017.1125
Lewis, S. (2017). The Practice of Health Program Evaluation. Health Promotion Practice, 18(6), 782-784. doi: 10.1177/1524839917711185
Olson, K., & Jacobson, K. (2017). The Importance of Assessing for Abuse and Neglect in Children With Chronic Health Conditions Referred for Neuropsychological Evaluation. Applied Neuropsychology: Child, 3(1), 66-72. https://doi.org/10.1080/21622965.2012.695881