Assessing paired orals: raters' orientation to interaction

Ducasse, A and Brown, A 2009, 'Assessing paired orals: raters' orientation to interaction', Language Testing, vol. 26, no. 3, pp. 423-443.

Document type: Journal Article
Collection: Journal Articles

Title Assessing paired orals: raters' orientation to interaction
Author(s) Ducasse, A
Brown, A
Year 2009
Journal name Language Testing
Volume number 26
Issue number 3
Start page 423
End page 443
Total pages 21
Publisher Sage Publications
Abstract Speaking tasks involving peer-to-peer candidate interaction are increasingly being incorporated into language proficiency assessments, in both large-scale international testing contexts, and in smaller-scale, for example course-related, ones. This growth in the popularity and use of paired and group orals has stimulated research, particularly into the types of discourse produced and the possible impact of candidate background factors on performance. However, despite the fact that the strongest argument for the validity of peer-to-peer assessment lies in the claim that such tasks allow for the assessment of a broader range of interactional skills than the more traditional interview-format tests do, there is surprisingly little research into the judgments that are made of such performances. The fact that raters, and rating criteria, are in a crucial mediating position between output and outcomes, warrants investi gation into how raters construe the interaction in these tasks. Such investigations have the potential to inform the development of interaction-based rating scales and ensure that validity claims are moved beyond the content level to the construct level. This paper reports the findings of a verbal protocol study of teacher-raters viewing the paired test discourse of 17 beginner dyads in a university-based Spanish as a foreign language course. The findings indicate that the raters identified three interaction parameters: non-verbal interpersonal communication, interactive listening, and interactional management. The findings have implications for our understanding of the construct of effective interaction in paired candidate speaking tests, and for the development of appropriate rating scales.
Subject Applied Linguistics and Educational Linguistics
Education Assessment and Evaluation
Keyword(s) paired interaction construct
rating oral proficiency
DOI - identifier 10.1177/0265532209104669
Copyright notice © The Author(s), 2009
ISSN 0265-5322
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 45 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 26 times in Scopus Article | Citations
Altmetric details:
Access Statistics: 131 Abstract Views  -  Detailed Statistics
Created: Thu, 15 Jan 2015, 13:42:00 EST by Catalyst Administrator
© 2014 RMIT Research Repository • Powered by Fez SoftwareContact us