Validating the Rating Process of an English as a Second Language Writing Portfolio Exam Validating the Rating Process of an English as a Second Language Writing Portfolio Exam
Results indicated that the exam has a high degree of validity based on the MFRM analysis. The survey and TAPs revealed that although raters follow a similar pattern for rating portfolios, they differed both in the time they took to rate portfolios and in the degree to which they favored the rating criteria. This may explain some of the discrepancies in the MFRM rater analysis. Conclusions from the MFRM analysis, surveys, TAPs, and interviews were all used to make recommendations to improve the rating process of the LAT, as well as to strengthen the relationship between LAT rating and classroom teaching and grading.
School:Brigham Young University
School Location:USA - Utah
Source Type:Master's Thesis
Keywords:language testing rasch model think aloud protocols rater writing esl validity teaching tesol portfolio rating scale criteria
Date of Publication:04/16/2006