Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Effect of rating scales on scores given to junior doctors in multi-source feedback

Hassell, Andrew, Bullock, Alison Deborah, Whitehouse, Andrew, Wood, Lawrence, Jones, Peter and Wall, David 2012. Effect of rating scales on scores given to junior doctors in multi-source feedback. Postgraduate Medical Journal 88 (1035) , pp. 10-14. 10.1136/postgradmedj-2011-130010

This is the latest version of this item.

Full text not available from this repository.

Abstract

Background Multi-source feedback (MSF) has an established role in the workplace based assessment of doctors in training. Different models of MSF are currently used in different training programmes and settings. One important way in which these models differ is the rating scale on which assessors score the trainee. The aim of this study was to explore the effect of rating scale on MSF scores. Methods Foundation Year 2 trainees in hospitals in the West Midlands underwent MSF using the validated MSF tool, team assessment of behaviour (TAB) in autumn 2005. Trainees were scored with TAB using one of four different rating scales, ranging from 3- to 9-point scales. Each participating hospital used only one rating scale. The proportions of trainees scored as having potential problems were related to the different rating scale used. Similarly, the proportions scored as ‘above expectations’ were compared. Assessors also completed a short questionnaire regarding the assessment. Results 245 trainees underwent 2594 assessments. Longer rating scales were associated with a lower proportion of trainees awarded ‘problem’ scores and higher proportions of trainees scored as ‘above expectations’. Assessors generally reported no difficulties whichever rating scale they had used. Conclusion Careful consideration, recognising its potential impact on assessment score, should be given to the rating scale used when instituting MSF within a system of workplace based assessment.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Cardiff Unit for Research and Evaluation in Medical and Dental Education (CUREMeDE)
Postgraduate Medical and Dental Education
Social Sciences (Includes Criminology and Education)
Subjects: R Medicine > R Medicine (General)
Publisher: BMJ Group
ISSN: 0032-5473
Last Modified: 14 Sep 2017 15:20
URI: http://orca.cf.ac.uk/id/eprint/24159

Available Versions of this Item

  • Effect of rating scales on scores given to junior doctors in multi-source feedback. (deposited 25 Apr 2012 08:11) [Currently Displayed]

Citation Data

Cited 13 times in Google Scholar. View in Google Scholar

Cited 8 times in Scopus. View in Scopus. Powered By Scopus® Data

Cited 4 times in Web of Science. View in Web of Science.

Actions (repository staff only)

Edit Item Edit Item