Content-based collaborative filtering for question difficulty calibration

Nguyen, M. L., Hui, S. C. and Fong, A.C.M. (2012) Content-based collaborative filtering for question difficulty calibration. In: 12th Pacific Rim International Conference on Artificial Intelligence., Kuching, Malaysia, 3-7 Sept 2012, pp. 359-371. (doi: 10.1007/978-3-642-32695-0_33)

Abstract

Question calibration especially on difficulty degree is important for supporting Web-based testing and assessment. Currently, Item Response Theory (IRT) has traditionally applied for question difficulty calibration. However, it is tedious and time-consuming to collect sufficient historical response information manually, and computational expensive to calibrate question difficulty especially for large-scale question datasets. In this paper, we propose an effective Content-based Collaborative Filtering (CCF) approach for automatic calibration of question difficulty degree. In the proposed approach, a dataset of questions with available user responses and knowledge features is first gathered. Next, collaborative filtering is used to predict unknown user responses from known responses of questions. With all the responses, the difficulty degree of each question in the dataset is then estimated using IRT. Finally, when a new question is queried, the content-based similarity approach is used to find similar existing questions from the dataset based on the knowledge features for estimating the new question’s difficulty degree. In this paper, we will present the proposed CCF approach and its performance evaluation in comparison with other techniques.

• Item Type: Conference Proceedings
• Additional Information: <br>Print ISBN: 9783642326943 ; online: 9783642326950</br> <br>Lecture Notes in Computer Science; 7458</br> <br>Series ISSN: 0302-9743</br>
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Fong, Dr Alvis Cheuk Min
• Authors: Nguyen, M. L., Hui, S. C., and Fong, A.C.M.
• College/School: College of Science and Engineering > School of Computing Science
• ISSN: 0302-9743