Instruments of evaluation are used at all of the levels of Kirkpatrick’s (and Phillips’s) framework of evaluating outcomes. These instruments come in many forms but include questionnaires, interviews, monitoring with checklists, surveys, tests, benchmarking, and scorecards. Return on investment measurements are the fifth level of evaluation, and we have already discussed those.
This week, we will look at different instruments, discuss which level of evaluation they pertain to, and also discuss evaluation practices and designs. To start, let’s look back at last week’s training in the lecture on the decision tree tutorial. If you were going to design an evaluation method for that training, what method would you use? Include in your answer (a) the level of Kirkpatrick’s framework you would utilize and why (but not ROI), (b) which evaluation design type you would use and why (i.e., posttest, pre- or posttest, prepost with comparison, Solomon four-group, time series.), and (c) what instrument or instruments you would use.