Multi-Sensing Data Fusion for Human Activity Recognition Based on Neuromorphic Computing

Yu, Z., Zahid, A., Taylor, W. , Heidari, H. , Imran, M. A. and Abbasi, Q. H. (2021) Multi-Sensing Data Fusion for Human Activity Recognition Based on Neuromorphic Computing. In: 2021 IEEE USNC-URSI Radio Science Meeting (Joint with AP-S Symposium), Singapore, 04-10 Dec 2021, pp. 64-65. ISBN 9781946815101 (doi: 10.23919/USNC-URSI51813.2021.9703558)

Abstract

This paper proposes a multi-sensing Human Activity Recognition framework, which uses Neuromorphic computing to processing from Sensors and Radars of different type signals for data fusion and classification. At this point, Inertial Measurement Unit sensors and Universal Software-defined Radio Peripheral, and Radar devices are used to collect human activities signals separately. The feature extraction and selection process the sensors signal to dimension reduction without time factor by design an attention mechanism. And then, following Expectation-Maximization calculation to achieve a binary feature pattern that fits the discrete Hopfield neural network input. Depend on the Neuromorphic computing of associative memory function and similarity calculation to the neurons’ feedback output. It finally achieves human activity recognition with one-shot learning. There are explores multi-sensing human activity recognition between limited dataset and ensures accuracy without dropping. The technique can be extended to include more hardware signal processing to the system.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Yu, Zheqi and Imran, Professor Muhammad and Zahid, Mr Adnan and Heidari, Professor Hadi and Abbasi, Professor Qammer and Taylor, William
• Authors: Yu, Z., Zahid, A., Taylor, W., Heidari, H., Imran, M. A., and Abbasi, Q. H.
• College/School: College of Science and Engineering > School of Engineering > Electronics and Nanoscale Engineering; College of Science and Engineering > School of Engineering > Systems Power and Energy
• ISBN: 9781946815101
• Published Online: 10 February 2022
• Copyright Holders: Copyright © 2021 IEEE
• Publisher Policy: Reproduced in accordance with the publisher copyright policy

Related URLs

• Organisation
• Publisher