Empirical analysis of hidden technical debt patterns in machine learning software

Alahdab, M. and Çalıklı, G. (2019) Empirical analysis of hidden technical debt patterns in machine learning software. In: Franch, X., Männistö, T. and Martínez-Fernández, S. (eds.) Product-Focused Software Process Improvement: 20th International Conference, PROFES 2019, Barcelona, Spain, November 27–29, 2019, Proceedings. Series: Lecture notes in computer science (11915). Springer: Cham, pp. 195-202. ISBN 9783030353322 (doi: 10.1007/978-3-030-35333-9_14)

Abstract

[Context/Background] Machine Learning (ML) software has special ability for increasing technical debt due to ML-specific issues besides having all the problems of regular code. The term “Hidden Technical Debt” (HTD) was coined by Sculley et al. to address maintainability issues in ML software as an analogy to technical debt in traditional software. [Goal] The aim of this paper is to empirically analyse how HTD patterns emerge during the early development phase of ML software, namely the prototyping phase. [Method] Therefore, we conducted a case study with subject systems as ML models planned to be integrated into the software system owned by Västtrafik, the public transportation agency in the west area of Sweden. [Results] During our case study, we could detect HTD patterns, which have the potential to emerge in ML prototypes, except for “Legacy Features”, “Correlated features”, and “Plain Old Data Type Smell”. [Conclusion] Preliminary results indicate that emergence of significant amount of HTD patterns can occur during prototyping phase. However, generalizability of our results require analyses of further ML systems from various domains.

• Item Type: Book Sections
• Status: Published
• Glasgow Author(s) Enlighten ID: Calikli, Dr Handan Gul
• Authors: Alahdab, M., and Çalıklı, G.
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: Springer
• ISSN: 0302-9743
• ISBN: 9783030353322
• Published Online: 18 November 2019