Investigating the disagreement between clinicians’ ratings of patients in ICUs

Rogers, S. , Sleeman, D. and Kinsella, J. (2013) Investigating the disagreement between clinicians’ ratings of patients in ICUs. IEEE Journal of Biomedical and Health Informatics, 17(4), pp. 843-852. (doi:10.1109/JBHI.2013.2252182)

Full text not currently available from Enlighten.


We present a Bayesian analysis of ordinal annotations made by clinicians of patients in intensive care. In particular, we investigate the different ways in which clinicians can disagree and how their disagreement is reduced once they take part in a recently proposed procedure (INSIGHT) that aims at improving consistency. The model combines a non-parametric function (loosely interpretable as the health of the patient) with clinician-specific generative procedures for producing the observed ordinal values. Our analysis provides valuable details of the rating behaviour of the individual clinicians and shows that the INSIGHT procedure is particularly effective at removing (some) clinician-specific inconsistencies and biases.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Kinsella, Professor John and Rogers, Dr Simon and Sleeman, Prof Derek
Authors: Rogers, S., Sleeman, D., and Kinsella, J.
College/School:College of Medical Veterinary and Life Sciences > School of Medicine, Dentistry & Nursing
College of Science and Engineering > School of Computing Science
Journal Name:IEEE Journal of Biomedical and Health Informatics
ISSN (Online):2168-2208
Published Online:20 March 2013

University Staff: Request a correction | Enlighten Editors: Update this record