Voting consensus based decentralized federated learning

Gou, Y., Weng, S., Imran, M. A. and Zhang, L. (2024) Voting consensus based decentralized federated learning. IEEE Internet of Things Journal, (doi: 10.1109/JIOT.2024.3355853) (Early Online Publication)

Abstract

With the fourth industrial revolution, the construction of the Internet of Things (IoT) has developed vigorously, and machine learning is also widely used in IoT management and data processing. Given the existence of massive distributed and private datasets generated by a large number of IoT devices, centralized machine learning is unsatisfactory. Therefore, federated learning (FL), as a distributed learning method, becomes a promising solution. In FL, clients can train models by transferring model parameters to the aggregation server while keeping private data locally. However, FL still relies on a central server, which has questionable reliability. The single point of failure and limited communication resources also hinder the application of FL in the IoT. In this paper, we propose a voting consensus based decentralized federated learning method (VCDFL) by incorporating the leader-candidate-follower hierarchical management method and the consensus based leader election mechanism to solve the single point of failure and exclude outlier models for accelerating convergence during aggregation. Then, we propose a joint decision method to exchange decision information rather than model transfer between clients to further protect privacy and reduce communication overhead while ensuring accuracy. Furthermore, we mathematically derive the probability of successfully electing a leader, the communication efficiency and the joint decision accuracy. We conduct our method in an image recognition scenario. The results show that our joint decision mechanism promotes the accuracy of both system and local decision-making. Meanwhile, the proposed scheme greatly reduces communication costs compared to benchmark learning methods.

• Item Type: Articles
• Keywords: Computer Networks and Communications, Computer Science Applications, Hardware and Architecture, Information Systems, Signal Processing
• Status: Early Online Publication
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Weng, Mr Shangyin and Zhang, Professor Lei and Gou, Miss Yan and Imran, Professor Muhammad
• Authors: Gou, Y., Weng, S., Imran, M. A., and Zhang, L.
• College/School: College of Science and Engineering > School of Engineering; College of Science and Engineering > School of Engineering > Autonomous Systems and Connectivity
• Journal Name: IEEE Internet of Things Journal
• Publisher: IEEE
• ISSN: 2327-4662
• ISSN (Online): 2327-4662
• Published Online: 18 January 2024
• Copyright Holders: Copyright © 2024, IEEE
• First Published: First published in IEEE Internet of Things Journal 2024
• Publisher Policy: Reproduced in accordance with the publisher copyright policy