COPE: interactive image retrieval using conversational recommendation

Balcer, B., Halvey, M., Jose, J.M. and Brewster, S. (2012) COPE: interactive image retrieval using conversational recommendation. In: BCS-HCI '12 - 26th Annual BCS Interaction Specialist Group Conference on People and Computers, Birmingham, UK, 12-14 Sep 2012, pp. 1-10.

Abstract

Most multimedia retrieval services e.g. YouTube, Flickr, Google etc. rely on users searching using textual queries or examples. However, this solution is inadequate when there is no text, very little text, the text is in a foreign language or the user cannot form textual a query. In order to overcome these shortcomings we have developed an image retrieval system called COPE (COnversational Picture Exploration) that can use a number of different preference feedback mechanisms, inspired by conversational recommendation paradigms, for image retrieval. In COPE users are presented with a small number of search results and simply have to express whether these results match their information need. We examine the suitability of a number of feedback approaches for semiautomatic and interactive image retrieval. For interactive retrieval we compared our preference based approaches to text based search (where we consider text to be an upper bound), our results indicate that users prefer preference based search to text based search and in some cases our approaches can outperform text based search.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Jose, Professor Joemon and Brewster, Professor Stephen and Halvey, Dr Martin
• Authors: Balcer, B., Halvey, M., Jose, J.M., and Brewster, S.
• College/School: College of Science and Engineering > School of Computing Science