Continuous human activity classification from FMCW radar with Bi-LSTM networks

Shrestha, A., Li, H., Le Kernec, J. and Fioranelli, F. (2020) Continuous human activity classification from FMCW radar with Bi-LSTM networks. IEEE Sensors Journal, 20(22), pp. 13607-13619. (doi: 10.1109/JSEN.2020.3006386)

Abstract

Recognition of human movements with radar for ambient activity monitoring is a developed area of research that yet presents outstanding challenges to address. In real environments, activities and movements are performed with seamless motion, with continuous transitions between activities of different duration and a large range of dynamic motions, compared with discrete activities of fixed-time lengths which are typically analysed in the literature. This paper proposes a novel approach based on recurrent LSTM and Bi-LSTM network architectures for continuous activity monitoring and classification. This approach uses radar data in the form of a continuous temporal sequence of micro-Doppler or range-time information, differently from from other conventional approaches based on convolutional networks that interpret the radar data as images. Experimental radar data involving 15 participants and different sequences of 6 actions are used to validate the proposed approach. It is demonstrated that using the Dopplerdomain data together with the Bi-LSTM network and an optimal learning rate can achieve over 90% mean accuracy, whereas range-domain data only achieved approximately 76%. The details of the network architectures, insights in their behaviour as a function of key hyper-parameters such as the learning rate, and a discussion on their performance across are provided in the paper.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Fioranelli, Dr Francesco and Le Kernec, Dr Julien and Shrestha, Mr Aman and Li, Haobo
• Authors: Shrestha, A., Li, H., Le Kernec, J., and Fioranelli, F.
• College/School: College of Science and Engineering > School of Engineering; College of Science and Engineering > School of Engineering > Systems Power and Energy
• Journal Name: IEEE Sensors Journal
• Publisher: IEEE
• ISSN: 1530-437X
• ISSN (Online): 1558-1748
• Published Online: 01 July 2020
• Copyright Holders: Copyright © 2020 The Authors
• First Published: First published in IEEE Sensors Journal 20(22): 13607-13619
• Publisher Policy: Reproduced under a Creative Commons License

Project Code	Award No	Project Name	Principal Investigator	Funder's Name	Funder Ref	Lead Dept
301526		Intelligent RF Sensing for Fall and Health Prediction	Francesco Fioranelli	Engineering and Physical Sciences Research Council (EPSRC)	EP/R041679/1	ENG - Systems Power & Energy