The effect of response format on the criterion related validity of a measure of work orientation

by Yugo, Jennifer Ellen.

Jennifer Z. Gillespie, Advisor Researchers have long been interested in the meaning derived from paid employment. One conceptualization of work meaning is work orientation. The literature on this concept proposes three ways a person can experience paid employment: as a job, a career or a calling (Wrzesniewski, McCauley, Rozin & Schwartz, 1997). The established measure of work orientation uses a binary, true/false response format. This investigation addressed whether a 5- point Likert response format provides enhanced criterion related validity over the traditional response format. Two explanations were proposed that may contribute to differences in validity: reliability and participant experience. The Likert response format was believed to be more reliable and allow participants to more readily express themselves. The first study found that the Likert response format provided greater criterion related validity but significant differences in reliability were found only for the calling subscale. In the second study, participants perceived the Likert response format as allowing an easier and more accurate response. These results show that the Likert response format facilitates greater validity not just through greater reliability, but by increasing the ability of the measure to capture true variance. iii This thesis is dedicated to my parents, Joanne and Mike Yugo, for always encouraging me to learn, and for their untiring love and support. iv