06 / EVALUATIONMeasure more than participation.
Using Kirkpatrick and Kirkpatrick’s (2016) four levels, the coordinator will examine participant experience, learning, workplace application and program results. Confidence is analyzed separately from demonstrated knowledge.
01Reaction
Anonymous pulse survey following each session; midpoint and end-of-cycle mentor and mentee feedback. Coordinator examines relevance, engagement, psychological safety and support; adjusts delivery when concerns recur.
Supports all three objectives · pulse ratings and open feedback 02Learning
Baseline and Week 12 confidence survey and common case assessment. Coordinator compares paired confidence ratings and scores using a common proposed assessment rubric. The assessment is a program-developed instrument, not a validated test. Mentors offer formative case feedback.
Objectives 1 and 2 · 80% confidence improvement and 80% scoring at least 80% 03Behavior
Reflection logs, action checklist and completed resource or practice review at Week 12; follow-up six to eight weeks later documents actual application and barriers without identifying students.
Objective 3 · 90% resource creation, adaptation or implementation. Completion is a transfer-readiness indicator; actual workplace behavior is documented separately at follow-up. 04Results
The coordinator will establish a baseline of existing advising practices, compare aggregate objective attainment and participation at Week 12, and review sustained changes approximately one semester later. Where feasible and with appropriate permissions, participating school representatives may help document adoption of advising procedures and referral pathways. These proposed organizational process measures are distinct from satisfaction or learning scores. No causal claims about student outcomes will be made.
Objectives 1–3 · aggregate targets, sustained adoption, and advising-process improvements With 10 enrolled mentees, the proposed targets correspond to 8 improving confidence, 8 meeting the assessment threshold, and 9 completing a resource or practice. Report numerator, denominator, missing data and completion rates explicitly. No results have been collected.