The Retrospective Pretest and the Role of Pretest Information in Evaluative Studies
To test the effect of training programs, subjects are often given self-report questionnaires. When such self-report instruments are used, response-shift bias is a possible confounder of results. According to the response-shift theory, pretest information given to subjects might reduce or diminish response-shift bias. In this experiment pretest information was given prior to a course in leadership. Contrary to expectation, the subjects' ratings were somewhat lower in the pretest-information condition. It was concluded that the pretest information provided was not effective enough. Use of a correct amount of reliable pretest information is recommended, otherwise this information may function as a ‘minicourse’ in itself and thereby confound the hypothesized or expected results.