Dependable IoT Data Stream Processing for Monitoring and Control of Urban Infrastructures

Geldenhuys, M. K., Will, J., Pfister, B. J.J., Haug, M., Scharmann, A. and Thamsen, L. (2021) Dependable IoT Data Stream Processing for Monitoring and Control of Urban Infrastructures. In: 1st International Workshop on Testing Distributed Internet of Things Systems (TDIS) at 9th IEEE International Conference on Cloud Engineering (IC2E), 04-08 Oct 2021, pp. 244-250. ISBN 9781665449700 (doi: 10.1109/IC2E52221.2021.00041)

Abstract

The Internet of Things describes a network of physical devices interacting and producing vast streams of sensor data. At present there are a number of general challenges which exist while developing solutions for use cases involving the monitoring and control of urban infrastructures. These include the need for a dependable method for extracting value from these high volume streams of time sensitive data which is adaptive to changing workloads. Low-latency access to the current state for live monitoring is a necessity as well as the ability to perform queries on historical data. At the same time, many design choices need to be made and the number of possible technology options available further adds to the complexity. In this paper we present a dependable IoT data processing platform for the monitoring and control of urban infrastructures. We define requirements in terms of dependability and then select a number of mature open-source technologies to match these requirements. We examine the disparate parts necessary for delivering a holistic overall architecture and describe the dataflows between each of these components. We likewise present generalizable methods for the enrichment and analysis of sensor data applicable across various application areas. We demonstrate the usefulness of this approach by providing an exemplary prototype platform executing on top of Kubernetes and evaluate the effectiveness of jobs processing sensor data in this environment.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Thamsen, Dr Lauritz
• Authors: Geldenhuys, M. K., Will, J., Pfister, B. J.J., Haug, M., Scharmann, A., and Thamsen, L.
• Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science; Q Science > QA Mathematics > QA76 Computer software
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: IEEE
• ISBN: 9781665449700
• Copyright Holders: Copyright © 2021 IEEE
• First Published: First published in
• Publisher Policy: Reproduced in accordance with the publisher copyright policy

Related URLs

• arXiv