Insightful practice: a reliable measure for medical revalidation

Murphy, D.J., Guthrie, B., Sullivan, F.M., Mercer, S.W. , Russell, A. and Bruce, D.A. (2012) Insightful practice: a reliable measure for medical revalidation. BMJ Quality and Safety, 21, pp. 649-656. (doi:10.1136/bmjqs-2011-000429)

Full text not currently available from Enlighten.

Publisher's URL: http://dx.doi.org/10.1136/bmjqs-2011-000429

Abstract

<b>Background</b> Medical revalidation decisions need to be reliable if they are to reassure on the quality and safety of professional practice. This study tested an innovative method in which general practitioners (GPs) were assessed on their reflection and response to a set of externally specified feedback.<p></p> <b>Setting and participants</b> 60 GPs and 12 GP appraisers in the Tayside region of Scotland, UK.<p></p> <b>Methods</b> A feedback dataset was specified as (1) GP-specific data collected by GPs themselves (patient and colleague opinion; open book self-evaluated knowledge test; complaints) and (2) Externally collected practice-level data provided to GPs (clinical quality and prescribing safety). GPs' perceptions of whether the feedback covered UK General Medical Council specified attributes of a ‘good doctor’ were examined using a mapping exercise. GPs' professionalism was examined in terms of appraiser assessment of GPs' level of insightful practice, defined as: engagement with, insight into and appropriate action on feedback data. The reliability of assessment of insightful practice and subsequent recommendations on GPs' revalidation by face-to-face and anonymous assessors were investigated using Generalisability G-theory.<p></p> <b>Main outcome measures</b> Coverage of General Medical Council attributes by specified feedback and reliability of assessor recommendations on doctors' suitability for revalidation.<p></p> <b>Results</b> Face-to-face assessment proved unreliable. Anonymous global assessment by three appraisers of insightful practice was highly reliable (G=0.85), as were revalidation decisions using four anonymous assessors (G=0.83).<p></p> <b>Conclusions</b> Unlike face-to-face appraisal, anonymous assessment of insightful practice offers a valid and reliable method to decide GP revalidation. Further validity studies are needed.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Mercer, Professor Stewart
Authors: Murphy, D.J., Guthrie, B., Sullivan, F.M., Mercer, S.W., Russell, A., and Bruce, D.A.
College/School:College of Medical Veterinary and Life Sciences > Institute of Health and Wellbeing > General Practice and Primary Care
Journal Name:BMJ Quality and Safety
Publisher:BMJ Publishing Group
ISSN:2044-5415

University Staff: Request a correction | Enlighten Editors: Update this record