Variability in modified rankin scoring across a large cohort of observers

Quinn, T.J. , Dawson, J. , Walters, M. and Lees, K.R. (2008) Variability in modified rankin scoring across a large cohort of observers. Stroke, 39(11), pp. 2975-2979. (doi: 10.1161/STROKEAHA.108.515262)

Abstract

<br>Background and Purpose— The modified Rankin scale (mRS) is the most commonly used outcome measure in stroke trials. However, substantial interobserver variability in mRS scoring has been reported. These studies likely underestimate the variability present in multicenter clinical trials, because exploratory work has only been undertaken in single centers by a few observers, all of similar training. We examined mRS variability across a large cohort of international observers using data from a video training resource.</br> <br>Methods— The mRS training package includes a series of “real-life” patient interviews for grading. Training data were collected centrally and analyzed for variability using kappa statistics. We examined variability against a standard of “correct” mRS grades; examined variability by country; and for UK assessors, examined variability by center and by professional background of the observer.</br> <br>Results— To date, 2942 assessments from 30 countries have been submitted. Overall reliability for mRS grading has been moderate to good with substantial heterogeneity across countries. Native English language has had little effect on reliability. Within the United Kingdom, there was no significant variation by profession.</br> <br>Conclusion— Our results confirm interobserver variability in mRS assessment. The heterogeneity across countries is intriguing because it appears not to be related solely to language. These data highlight the need for novel strategies to improve reliability.</br>

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Lees, Professor Kennedy and Dawson, Professor Jesse and Walters, Professor Matthew and Quinn, Professor Terry
• Authors: Quinn, T.J., Dawson, J., Walters, M., and Lees, K.R.
• College/School: College of Medical Veterinary and Life Sciences > School of Cardiovascular & Metabolic Health; College of Medical Veterinary and Life Sciences > School of Medicine, Dentistry & Nursing
• Journal Name: Stroke
• Publisher: American Heart Association
• ISSN: 0039-2499
• ISSN (Online): 1524-4628
• Published Online: 07 August 2008
• Copyright Holders: Copyright © 2008 American Heart Association
• First Published: First published in Stroke 39(11):2975-2979
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher