Multi-Sensing Data Fusion for Human Activity Recognition Based on Neuromorphic Computing

Yu, Z., Zahid, A., Taylor, W., Heidari, H. , Imran, M. A. and Abbasi, Q. H. (2022) Multi-Sensing Data Fusion for Human Activity Recognition Based on Neuromorphic Computing. In: 2021 IEEE USNC-URSI Radio Science Meeting (Joint with AP-S Symposium), Singapore, 04-10 Dec 2021, pp. 64-65. ISBN 9781946815101 (doi: 10.23919/USNC-URSI51813.2021.9703558)

[img] Text
246917.pdf - Accepted Version

572kB

Abstract

This paper proposes a multi-sensing Human Activity Recognition framework, which uses Neuromorphic computing to processing from Sensors and Radars of different type signals for data fusion and classification. At this point, Inertial Measurement Unit sensors and Universal Software-defined Radio Peripheral, and Radar devices are used to collect human activities signals separately. The feature extraction and selection process the sensors signal to dimension reduction without time factor by design an attention mechanism. And then, following Expectation-Maximization calculation to achieve a binary feature pattern that fits the discrete Hopfield neural network input. Depend on the Neuromorphic computing of associative memory function and similarity calculation to the neurons’ feedback output. It finally achieves human activity recognition with one-shot learning. There are explores multi-sensing human activity recognition between limited dataset and ensures accuracy without dropping. The technique can be extended to include more hardware signal processing to the system.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Imran, Professor Muhammad and Zahid, Mr Adnan and Yu, Mr Zheqi and Heidari, Professor Hadi and Abbasi, Dr Qammer and Taylor, William
Authors: Yu, Z., Zahid, A., Taylor, W., Heidari, H., Imran, M. A., and Abbasi, Q. H.
College/School:College of Science and Engineering > School of Engineering > Electronics and Nanoscale Engineering
College of Science and Engineering > School of Engineering > Systems Power and Energy
ISBN:9781946815101
Published Online:10 February 2022
Copyright Holders:Copyright © 2021 IEEE
Publisher Policy:Reproduced in accordance with the publisher copyright policy
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record