Privacy-Preserving Federated Learning based on Differential Privacy and Momentum Gradient Descent

Weng, S., Zhang, L. , Feng, D., Feng, C., Wang, R., Valente Klaine, P. and Imran, M. A. (2022) Privacy-Preserving Federated Learning based on Differential Privacy and Momentum Gradient Descent. In: IEEE World Congress on Computational Intelligence (WCCI 2022), Padua, Italy, 18-23 Jul 2022, ISBN 9781728186719 (doi: 10.1109/IJCNN55064.2022.9889795)

[img] Text
271300.pdf - Accepted Version

407kB

Abstract

To preserve participants' privacy, Federated Learning (FL) has been proposed to let participants collaboratively train a global model by sharing their training gradients instead of their raw data. However, several studies have shown that con-ventional FL is insufficient to protect privacy from adversaries, as even from gradients, useful information can still be recovered. To obtain stronger privacy protection, Differential Privacy (DP) has been proposed on the server's side and the clients' side. Although adding artificial noise to the raw data can enhance users' privacy, the accuracy performance of the FL is inevitably degraded. In addition, although the communication overhead caused by the FL is much smaller than that of centralized learning, it still becomes a bottleneck of the learning performance and utilization efficiency due to its frequent parameters exchange. To tackle these problems, we propose a new FL framework via applying DP both locally and centrally in order to strengthen the protection of par-ticipants' privacy. To improve the accuracy performance of the model, we also apply sparse gradients and Momentum Gradient Descent on the server's side and the clients' side. Moreover, using sparse gradients can reduce the total communication costs. We provide the experiments to evaluate our proposed framework and the results show that our framework not only outperforms other DP-based FL frameworks in terms of the model accuracy but also provides a more powerful privacy guarantee. Besides, our framework can save up to 90% of communication costs while achieving the best accuracy performance.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Zhang, Professor Lei and Weng, Shangyin and Valente Klaine, Mr Paulo and Imran, Professor Muhammad and Wang, Mr Ruiyu
Authors: Weng, S., Zhang, L., Feng, D., Feng, C., Wang, R., Valente Klaine, P., and Imran, M. A.
College/School:College of Science and Engineering > School of Engineering > Autonomous Systems and Connectivity
ISBN:9781728186719
Copyright Holders:Copyright © 2022 IEEE
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record