Research Output
Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC
  Connected and autonomous vehicles (CAVs) are an important paradigm of intelligent transportation systems. Cooperative perception (CP) and vehicular edge computing (VEC) enhance CAVs’ perception capacity of the region of interest (RoI) while alleviating the pressure of intensive computation on onboard resources. However, existing CP and computation schemes are based on inefficient broadcast communications and still face challenges such as highly dynamic communication link channel conditions caused by vehicle mobility, and limited computing resources in VEC environments. Considering the delay sensitivity of CAVs’ perception tasks and the need for enhanced perception, we propose a unicast-based cooperative perception and computation scheme to achieve more efficient resource utilization and perception task execution in VEC scenarios. Our goal is to maximize CP gain and minimize task execution delay by optimizing the decision of each ego CAVs. To solve the sequential decision-making problem of multi-objective optimization, we propose a solution based on improved multi-agent proximal policy optimization deep reinforcement learning, where CAVs agents make adaptive decisions distributed based on partial observations. Simulation results show that compared with the baseline algorithm, our proposed scheme effectively reduces the execution delay of ego CAVs perception tasks and ensures a high perception gain.

  • Date:

    03 March 2025

  • Publication Status:

    Early Online

  • Publisher

    Institute of Electrical and Electronics Engineers (IEEE)

  • DOI:

    10.1109/jiot.2025.3546915

  • Funders:

    Edinburgh Napier Funded

Citation

Zhao, L., Li, L., Tan, Z., Hawbani, A., He, Q., & Liu, Z. (online). Multi-Agent Deep Reinforcement Learning-Based Cooperative Perception and Computation in VEC. IEEE Internet of Things Journal, https://doi.org/10.1109/jiot.2025.3546915

Authors

Keywords

Connected and autonomous vehicles, Cooperative perception, Vehicular edge computing, Multi-agent deep reinforcement learning

Monthly Views:

Available Documents