Performance analysis of AI-based energy management in electric vehicles: A case study on classic reinforcement learning

Hu, J., Lin, Y., Li, J., Hou, Z., Chu, L., Zhao, D. , Zhou, Q., Jiang, J. and Zhang, Y. (2024) Performance analysis of AI-based energy management in electric vehicles: A case study on classic reinforcement learning. Energy Conversion and Management, 300, 117964. (doi: 10.1016/j.enconman.2023.117964)

Abstract

Reinforcement learning-based (RL-based) energy management strategy (EMS) is considered a promising solution for the energy management of electric vehicles with multiple power sources. Research and applications of reinforcement learning and deep reinforcement learning in energy management issues are emerging. However, previous studies have not systematically examined the essential elements of RL-based EMS. This paper presents a performance analysis of RL-based EMS in a Plug-in Hybrid Electric Vehicle (PHEV) and Fuel Cell Electric Vehicle (FCEV). The performance analysis is developed in four aspects: algorithm, perception and decision granularity, hyperparameters, and reward function. The results show that the Off-policy algorithm effectively develops a more fuel-efficient solution within the complete driving cycle compared with other algorithms. Improving the perception and decision granularity reduces the frequency of tabular-based policy updates but better balances battery power and fuel consumption. Setting a high initial SOC in training will effectively improve the performance of RL-based EMS. The construction of an equivalent energy loss reward function for RL-based EMS based on instantaneous State of Charge (SOC) variation should be approached with caution. This approach is highly sensitive to parameters and is more likely to lead to violations of SOC constraints. In contrast, an equivalent energy reward function based on overall SOC variation is a safer alternative.

• Item Type: Articles
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Zhao, Dr Dezong
• Authors: Hu, J., Lin, Y., Li, J., Hou, Z., Chu, L., Zhao, D., Zhou, Q., Jiang, J., and Zhang, Y.
• College/School: College of Science and Engineering > School of Engineering > Autonomous Systems and Connectivity
• Journal Name: Energy Conversion and Management
• Publisher: Elsevier
• ISSN: 0196-8904
• ISSN (Online): 1879-2227
• Published Online: 09 December 2023