Collections for automatic image annotation and photo tag recommendation

McParlane, P. J., Moshfeghi, Y. and Jose, J. M. (2014) Collections for automatic image annotation and photo tag recommendation. Lecture Notes in Computer Science, 8325, pp. 133-145. (doi: 10.1007/978-3-319-04114-8_12)

Full text not currently available from Enlighten.


This paper highlights a number of problems which exist in the evaluation of existing image annotation and tag recommendation methods. Crucially, the collections used by these state-of-the-art methods contain a number of biases which may be exploited or detrimental to their evaluation, resulting in misleading results. In total we highlight seven issues for three popular annotation evaluation collections, i.e. Corel5k, ESP Game and IAPR, as well as three issues with collections used in two state-of-the-art photo tag recommendation methods. The result of this paper is two freely available Flickr image collections designed for the fair evaluation of image annotation and tag recommendation methods called Flickr-AIA and Flickr-PTR respectively. We show through experimentation and demonstration that these collection are ultimately fairer benchmarks than existing collections.

Item Type:Articles
Glasgow Author(s) Enlighten ID:Jose, Professor Joemon and Mcparlane, Mr Philip and Moshfeghi, Dr Yashar
Authors: McParlane, P. J., Moshfeghi, Y., and Jose, J. M.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Lecture Notes in Computer Science

University Staff: Request a correction | Enlighten Editors: Update this record