GNN-based Multi-Agent Control of Traffic Shockwaves in Sparse Vehicular Ad-hoc Networks
This paper proposes a decentralized Multi-Agent Reinforcement Learning framework with a Graph Neural Network for connected and autonomous vehicles to reduce traffic shockwaves.
Proposes a decentralized MARL framework with a GNN for CAVs to mitigate traffic shockwaves using locally available information.
Keywords
Before reading this…
Applications
- →Transportation Systems
- →Connected and Autonomous Vehicles
To understand this paper, make sure you know these concepts first:
- Understanding of Multi-Agent Reinforcement Learningfind papers →
- Graph Neural Networksfind papers →
Abstract
More Like ThisTraffic shockwaves are stop-and-go waves that propagate upstream through the streams of vehicles and are one of the major causes of traffic congestion, fuel inefficiency, and increased accident rates in modern transportation systems. Although Connected and Autonomous Vehicles (CAVs) offer a promising opportunity to mitigate such shockwaves, most existing control strategies rely on global traffic state information, making them impractical for early-stage deployment of Vehicular Ad-hoc Networks (VANETs). In this paper, we propose a decentralized Multi-Agent Reinforcement Learning (MARL) framework that integrates a Graph Neural Network (GNN) to enhance the control architecture of connected and autonomous vehicles. The proposed approach enables vehicles to learn cooperative control policies using locally available information and interaction with neighboring vehicles. The effectiveness of the proposed scheme is evaluated using a scalable simulation environment under realistic highway traffic conditions. Simulation results show that the proposed GNN-based MARL framework can reduce the propagation of traffic shockwaves by up to 80\%, even when only 10\% of the vehicles are connected.