Drone-Based AI and 3D Reconstruction for Digital Twin Augmentation

To, A., Liu, M., Hazeeq Bin Muhammad Hairul, M., Davis, J. G., Lee, J. S. A., Hesse, H. and Nguyen, H. D. (2021) Drone-Based AI and 3D Reconstruction for Digital Twin Augmentation. In: 23rd HCI International Conference, 24-29 Jul 2021, pp. 511-529. (doi: 10.1007/978-3-030-77626-8_35)

Abstract

Digital Twin is an emerging technology at the forefront of Industry 4.0, with the ultimate goal of combining the physical space and the virtual space. To date, the Digital Twin concept has been applied in many engineering fields, providing useful insights in the areas of engineering design, manufacturing, automation, and construction industry. While the nexus of various technologies opens up new opportunities with Digital Twin, the technology requires a framework to integrate the different technologies, such as the Building Information Model used in the Building and Construction industry. In this work, an Information Fusion framework is proposed to seamlessly fuse heterogeneous components in a Digital Twin framework from the variety of technologies involved. This study aims to augment Digital Twin in buildings with the use of AI and 3D reconstruction empowered by unmanned aviation vehicles. We proposed a drone-based Digital Twin augmentation framework with reusable and customisable components. A proof of concept is also developed, and extensive evaluation is conducted for 3D reconstruction and applications of AI for defect detection.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Hesse, Dr Henrik and Nguyen, Dr Hoang
• Authors: To, A., Liu, M., Hazeeq Bin Muhammad Hairul, M., Davis, J. G., Lee, J. S. A., Hesse, H., and Nguyen, H. D.
• College/School: College of Science and Engineering > School of Engineering; College of Science and Engineering > School of Engineering > Infrastructure and Environment
• ISSN: 0302-9743
• Copyright Holders: Copyright © 2021 Springer Nature Switzerland AG
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher