Analysing Compression Techniques for In-Memory Collaborative Filtering

Vargas, S., Macdonald, C. and Ounis, I. (2015) Analysing Compression Techniques for In-Memory Collaborative Filtering. In: RecSys 2015 Poster Proceedings, Vienna, Austria, 16-20 Sep 2015,

109204.pdf - Accepted Version


Publisher's URL:


Following the recent trend of in-memory data processing, it is a usual practice to maintain collaborative filtering data in the main memory when generating recommendations in academic and industrial recommender systems. In this paper, we study the impact of integer compression techniques for in-memory collaborative filtering data in terms of space and time efficiency. Our results provide relevant observations about when and how to compress collaborative filtering data. First, we observe that, depending on the memory constraints, compression techniques may speed up or slow down the performance of state-of-the art collaborative filtering algorithms. Second, after comparing different compression techniques, we find the Frame of Reference (FOR) technique to be the best option in terms of space and time efficiency under different memory constraints.

Item Type:Conference Proceedings
Keywords:Recommender Systems, Collaborative Filtering, Index Compression
Glasgow Author(s) Enlighten ID:Macdonald, Professor Craig and Vargas, Mr Saul and Ounis, Professor Iadh
Authors: Vargas, S., Macdonald, C., and Ounis, I.
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
College/School:College of Science and Engineering > School of Computing Science
Research Group:Terrier Team

University Staff: Request a correction | Enlighten Editors: Update this record