• About us
  • Contact us
  • Search

You are not logged in:

Policy

Breadcrumbs

Step 5 - Example evaluation schedules using the Rugby Team Impact Framework

The most appropriate techniques for evaluation, such as interviews, survey, focus groups etc., should be straightforward if you are clear about what you want to evaluate. It is good practice to follow at least one cohort of participants throughout the evaluation process, ie before, during and after the intervention. An example evaluation schedule is given below.

(Also refer to Researcher development case studies)

Hypothesis: The workshop ‘Project Managing Your Research Degree' has a positive impact on the doctoral completion rates of participants

Evaluation level

Possible questions to evaluate

Possible evidence building methodology

0 - Foundation

What is the pedagogy of the planned session? What is the session plan? What support materials are there? What is the current level in project management of the participants as determined by, for example, a needs analysis assessment?

Training and development needs analysis. Focus group prior to workshop. Ask workshop participants to bring their project plan to a workshop

1 - Reaction

Was there a positive reaction to the provision shown by ‘Happy sheet' questionnaires? Did this exist in a follow up email questionnaire, e.g. one month after the workshop?

End of workshop ‘Happy sheets' Follow up email request for feedback. Follow up Focus group

2 - Learning

Did participants self-assess that they had learnt something? Design evaluation into the workshop, e.g. was there a difference in approach of participants to project planning when asked at the beginning and end of workshops?

Ask participants to create a project plan at the end of the workshop. How does it compare to the plan they brought to the workshop?

3 - Behaviour

Has there been any change in behaviour in project planning when back in the research situation? Evidence possible from focus groups, questionnaires, supervisor commentary in progress monitoring systems, etc.

In a follow up focus group are they planning differently? What does the supervisor think? Any change noted?

4 - Outcomes

Is there evidence that links the learning from a training workshop in any way with improved completion rates? Does data dredging correlate attendance at workshops with a better completion rate? Is there any support to the hypothesis from participant case studies

Cross correlate. What is the average University completion time for research degrees? What is the average for those attending workshops? Exit surveys/interviews, Case studies