Intra-assessor consistency in question answering

Ruthven, I., Azzopardi, L., Baillie, M., Bierig, R., Nicol, E., Sweeney, S. and Yakici, M. (2007) Intra-assessor consistency in question answering. In: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, The Netherlands, 23-27 July 2007, pp. 727-728. ISBN 9781595935977 (doi: 10.1145/1277741.1277879)

Abstract

In this paper we investigate the consistency of answer assessment in a complex question answering task examining features of assessor consistency, types of answers and question type.

• Item Type: Conference Proceedings
• Additional Information: © ACM, 2007. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in Proceedings of the 30th Annual International ACM Conference on Research and Development in Information Retrieval http://doi.acm.org/10.1145/1277741.1277879
• Keywords: Relevance, question answering, evaluation.
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Azzopardi, Dr Leif
• Authors: Ruthven, I., Azzopardi, L., Baillie, M., Bierig, R., Nicol, E., Sweeney, S., and Yakici, M.
• Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: ACM
• ISBN: 9781595935977
• Copyright Holders: Copyright © 2007 ACM
• First Published: First published in Proceedings of the 30th Annual International ACM Conference on Research and Development in Information Retrieval
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher.