Local federated learning at the network edge for efficient predictive analytics

Harth, N., Voegel, H.-J., Kolomvatsos, K. and Anagnostopoulos, C. (2022) Local federated learning at the network edge for efficient predictive analytics. Future Generation Computer Systems, 134, pp. 107-122. (doi: 10.1016/j.future.2022.03.030)

Abstract

The ability to perform computation on devices present in the Internet of Things (IoT) and Edge Computing (EC) environments leads to bandwidth, storage, and energy constraints, as most of these devices are limited with resources. Using such device computational capacity, coined as Edge Devices (EDs), in performing locally Machine Learning (ML) and analytics tasks enables accurate and real-time predictions at the network edge. The locally generated data in EDs is contextual and, for resource efficiency reasons, should not be distributed over the network. In such context, the local trained models need to adapt to occurring concept drifts and potential data distribution changes to guarantee a high prediction accuracy. We address the importance of personalization and generalization in EDs to adapt to data distribution over evolving environments. In the following work, we propose a methodology that relies on Federated Learning (FL) principles to ensure the generalization capability of the locally trained ML models. Moreover, we extend FL with Optimal Stopping Theory (OST) and adaptive weighting over personalized and generalized models to incorporate optimal model selection decision making. We contribute with a personalized, efficient learning methodology in EC environments that can swiftly select and switch models inside the EDs to provide accurate predictions towards changing environments. Theoretical analysis of the optimality and uniqueness of the proposed solution is provided. Additionally, comprehensive comparative and performance evaluation over real contextual data streams testing our methodology against current approaches in the literature for FL and centralized learning are provided concerning information loss and prediction accuracy metrics. We showcase improvement of the prediction quality towards FL-based approaches by at least 50% using our methodology.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Kolomvatsos, Dr Kostas and Anagnostopoulos, Dr Christos and Harth, Miss Natascha

Creator Roles

Harth, N.: Conceptualization, Methodology, Formal analysis, Writing – original draft, Visualization, Investigation, Software, Validation
Anagnostopoulos, C.: Conceptualization, Formal analysis
Kolomvatsos, K.: Writing – review and editing, Supervision

• Authors: Harth, N., Voegel, H.-J., Kolomvatsos, K., and Anagnostopoulos, C.
• College/School: College of Science and Engineering > School of Computing Science
• Journal Name: Future Generation Computer Systems
• Publisher: Elsevier
• ISSN: 0167-739X
• ISSN (Online): 1872-7115
• Published Online: 25 March 2022
• Copyright Holders: Copyright © 2022 Elsevier B.V.
• First Published: First published in Future Generation Computer Systems 134: 107-122
• Publisher Policy: Reproduced in accordance with the publisher copyright policy

Related URLs

• Research Data