Impact and evaluation - resources and publications

Impact Framework - Evaluation bibliography - Evaluation presentations

---

 

Rugby Team Impact Framework publications:

1. ‘The Rugby Team Impact Framework' Bromley, T, Metcalfe, J and Park, C. (Sep 08) - This is the original document that presents and explains the impact framework which is, ‘...an evaluation model for training and development activity specifically tailored to the context of training and development of researchers in higher education (HE).  It explores the potential benefits of investment in training and development activity for the many different stakeholder groups.' (www.vitae.ac.uk/rugbyteam)

2. 'Quick guide to the rugby team framework' Bromley,T. (2009)

3. ‘The Rugby Team Impact Framework: one year on' Bromley, T. (Sep 09) - This report is a summary of nearly 30 different evaluations and their outcomes from work across the sector in higher education institutions and national bodies. 

4. 'Evaluating Training and Development Programmes for Postgraduate and Newer Researchers' Bromley, T., (2009) Society for Research into Higher Education series Issues in Postgraduate Education: Management, Teaching and Supervision. Ed. Martin Gough ISBN 978-0-946376-14-8. Available at http://www.srhe.ac.uk/publications.gpi.asp - This publication provides a practical guide to using the ideas of the impact framework in actual evaluations.

 

---

 

Evaluation bibliography

The following are suggested reading for wider understanding of evaluation theory and application:

Bramley, P. (1996)  Evaluating Training Effectiveness: Benchmarking Your Training Activity against Best Practice. McGraw-Hill, London. ISBN-10 0077090284; ISBN-13 978-0077090289

Bramley, P. (2003) Evaluating Training. Chartered Institute of Personnel and Development. London,  ISBN-10: 1843980304; ISBN-13: 978-1843980308

Brinkerhoff, R. (2006) Telling Training's Story: Evaluation Made Simple, Credible and Effective. Berrett-Koehler. San Francisco CA, USA, ISBN-10: 1576751864; ISBN-13: 978-1576751862

Bromley, T., (2009) Evaluating Training and Development Programmes for Postgraduate and Newer Researchers Society for Research into Higher Education series Issues in Postgraduate Education: Management, Teaching and Supervision. Ed. Martin Gough ISBN 978-0-946376-14-8. Available at http://www.srhe.ac.uk/publications.gpi.asp

Hinchcliffe, R., Bromley, T. and Hutchinson, S. (2007) Skills Training in Research Degree Programmes - Politics and Practice. Open University Press/McGraw-Hill Education. Maidenhead, Berkshire, England, ISBN-13: 978-0-33-522148-6

Kearns, P. and Miller, T. (1997) Measuring the Impact of Training and Development on the Bottom Line. Pitman Publishing. London ISBN 0 273 63187 X

Kearns, P. (2005) Training Evaluation and ROI: How to Develop Value-based Training. Chartered Institute of Personnel and Development, London. ISBN-10: 1843980789; ISBN-13: 978-1843980780

Kirkpatrick, D. L. and Kirkpatrick, J. D. (2005) Transferring Learning to Behaviour; Using the Four Levels to Improve Performance. Berrett-Koehler. San Francisco, USA, ISBN-10: 1576753255; ISBN-13: 978-1576753255

Kirkpatrick, D. L. and Kirkpatrick, J. D. (2006) Evaluating Training Programmes: The Four Levels. 3rd Edition. Berrett-Koehler Publishers, Inc, San Francisco, USA, ISBN-10: 1-57675-384-4; ISBN-13: 978-1-57675-384-4

Pawson, R. and Tilley, N. (1997) Realistic Evaluation. SAGE Publications. London, England, ISBN 978-0-7619-5009-7

Philips, J. and Stone, R. (2002) How to Measure Training Results: A Practical Guide to Tracking the Six Key Indicators. McGraw-Hill Professional; New York, USA, New Ed edition. ISBN-10 0071387927, ISBN-13 978-0071387927

Tamkin, P., Yarnall, J. and Kerrin, M. (2002) Kirkpatrick and Beyond: a Review of Models of Training Evaluation. Institute for Employment Studies. Brighton, England ISBN-10: 1851843213; ISBN-13 978-1851843213

 

---

 

Presentations

The following presentations are drawn from a selection of Vitae events in the last 18 months on the topic of impact and evaluation. Presentations provide background information, theory overview, evaluation techniques and impact outcomes. 

1. Staff supporting researchers masterclass - ‘Evaluation and Feedback' 11 November 2009 Presentations Tony Bromley Paul Kearns

2. Vitae researcher development conference 2009, 08 - 09 September 2009:

 Workshop evaluation from the beginning! - An introduction to evaluating researcher training and development.  Includes ‘From the beginning' presentation which has a basic overview of the Rugby Team Impact Framework

3. Policy Forum 2010 

4. The original presentation on the Rugby Team Impact Framework given at the Vitae Roberts Policy Forum (January 2008)