Interaction-aware decision-making for automated vehicles using social value orientation

Crosato, L., Shum, H. P.H., Ho, E. S.L. and Wei, C. (2023) Interaction-aware decision-making for automated vehicles using social value orientation. IEEE Transactions on Intelligent Vehicles, 8(2), pp. 1339-1349. (doi: 10.1109/TIV.2022.3189836)

Abstract

Motion control algorithms in the presence of pedes- trians are critical for the development of safe and reliable Autonomous Vehicles (AVs). Traditional motion control algo- rithms rely on manually designed decision-making policies which neglect the mutual interactions between AVs and pedestrians. On the other hand, recent advances in Deep Reinforcement Learning allow for the automatic learning of policies without manual designs. To tackle the problem of decision-making in the presence of pedestrians, the authors introduce a framework based on Social Value Orientation and Deep Reinforcement Learning (DRL) that is capable of generating decision-making policies with different driving styles. The policy is trained using state- of-the-art DRL algorithms in a simulated environment. A novel computationally-efficient pedestrian model that is suitable for DRL training is also introduced. We perform experiments to validate our framework and we conduct a comparative analysis of the policies obtained with two different model-free Deep Reinforcement Learning Algorithms. Simulations results show how the developed model exhibits natural driving behaviours, such as short-stopping, to facilitate the pedestrian's crossing.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Ho, Dr Edmond S. L
• Authors: Crosato, L., Shum, H. P.H., Ho, E. S.L., and Wei, C.
• College/School: College of Science and Engineering > School of Computing Science
• Journal Name: IEEE Transactions on Intelligent Vehicles
• Publisher: IEEE
• ISSN: 2379-8858
• ISSN (Online): 2379-8904
• Published Online: 11 July 2022
• Copyright Holders: Copyright © 2022 IEEE
• First Published: First published in IEEE Transactions on Intelligent Vehicles 8(2): 1339-1349
• Publisher Policy: Reproduced in accordance with the copyright policy of the publisher