The RLO-CETL evaluation team has developed and refined an evaluation toolkit comprising a set of evaluation tools covering a wide range of evaluation methods. The toolkit consists of:

1. RLO evaluation form. A short online survey added to each RLO comprising of 10 questions. Completed by any user of the RLO.
2. Routine data analysis. Tracking data from the server or repository holding the RLO.
3. Focused interview. Focused, semi-structured telephone interview that will provide the learning context to support the routine data collected in 1 and 2. Also to allow elaboration of barriers, affordances and user requirements (both technical and social).
4. Field notes. A diary completed by evaluators describing the experience of the RLO use for each mini-project.
5. Student questionnaire. An in-depth questionnaire to be completed by students who have used one or more RLOs in their module. The questionnaire includes compulsory and optional question sets.
6. Student focus groups. Questions for use in student focus groups after they have used RLOs in their modules.
7. Tutors’ forms (context of learning form and tutor’s evaluation of learning effectiveness). The context of learning form is a compulsory tool that aims to collect information about the module and the context for the RLOs’ use. The tutor's evaluation of learning effectiveness form is based on the JISC case study template, this is an optional tool designed to encourage tutors to reflect on the RLOs’ use.
8. Technology and deployment audit. These questions aim to understand the technical landscapes at each institution.

Using our evaluation toolkit

We are happy for other projects/institutions to make use of our toolkit (under the Creative Commons License - click on icon or text below to see full terms).

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 2.5 License.

You can download the complete evaluation toolkit as one document, but we ask that you complete a short form first to tell us who you are, so we can identify who is downloading the document, and so we can contact you to follow-up your use of it.

We would also be grateful if you could let us know if you use or reuse parts of the toolkit, as this helps us to monitor the interest in the CETL's work. Please email Claire Bradley

Download evaluation toolkit