A system to detect inconsistencies between a domain expert’s different perspectives on (classification) tasks

Sleeman, D., Aiken, A., Moss, L. , Kinsella, J. and Sim, M. (2010) A system to detect inconsistencies between a domain expert’s different perspectives on (classification) tasks. Studies in Computational Intelligence, 263, pp. 293-314. (doi:10.1007/978-3-642-05179-1_14)

[img] Text
25434.pdf

202kB

Abstract

This paper discusses the range of knowledge acquisition, including machine learning, approaches used to develop knowledge bases for Intelligent Systems. Specifically, this paper focuses on developing techniques which enable an expert to detect inconsistencies in 2 (or more) perspectives that the expert might have on the same (classification) task. Further, the INSIGHT system has been developed to provide a tool which supports domain experts exploring, and removing, the inconsistencies in their conceptualization of a task. We report here a study of Intensive Care physicians reconciling 2 perspectives on their patients. The high level task which the physicians had set themselves was to classify, on a 5 point scale (A-E), the hourly reports produced by the Unit’s patient management system. The 2 perspectives provided to INSIGHT were an annotated set of patient records where the expert had selected the appropriate category to describe that snapshot of the patient, and a set of rules which are able to classify the various time points on the same 5-point scale. Inconsistencies between these 2 perspectives are displayed as a confusion matrix; moreover INSIGHT then allows the expert to revise both the annotated datasets (correcting data errors, and/or changing the assigned categories) and the actual rule-set. Each expert achieved a very high degree of consensus between his refined knowledge sources (i.e., annotated hourly patient records and the rule-set). Further, the consensus between the 2 experts was ~95%. The paper concludes by outlining some of the follow-up studies planned with both INSIGHT and this general approach.

Item Type:Articles
Additional Information:The original publication is available at www.springerlink.com
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Sim, Malcolm and Sleeman, Prof Derek and Kinsella, Professor John and Moss, Miss Laura
Authors: Sleeman, D., Aiken, A., Moss, L., Kinsella, J., and Sim, M.
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
College/School:College of Medical Veterinary and Life Sciences > School of Medicine, Dentistry & Nursing > Clinical Specialities
Journal Name:Studies in Computational Intelligence
Publisher:Springer
ISSN:1860-949X
ISSN (Online):1860-9503
Published Online:27 November 2009
Copyright Holders:Copyright © 2010 Springer
First Published:First published in Studies in Computational Intelligence 263:293-314
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher.

University Staff: Request a correction | Enlighten Editors: Update this record