Machine Learning-Based Resource Allocation in 6G Integrated Space and Terrestrial Networks-Aided Intelligent Autonomous Transportation

The integration of terrestrial and non-terrestrial networks with mobile edge computing (MEC) and orbital edge computing (OEC) technologies is essential for advancing 6G communication networks. This paper introduces a network architecture that combines terrestrial and non-terrestrial networks by integrating drones (also known as UAV)-carried reconfigurable intelligent surfaces (RIS) and satellite-based MEC to optimize resource allocation in intelligent autonomous transportation systems (IATS). The primary objective is to minimize total system utility costs through the optimal allocation of bandwidth, computational power at the base station and low Earth orbit (LEO) satellite, and offloading decisions, all while adhering to strict performance and delay constraints. We address the complex resource optimization challenge by formulating a nonlinear programming (NLP) problem. To solve this problem, we employ long short-term memory (LSTM)-enhanced deep deterministic policy gradient (DDPG) and LSTM-enhanced twin delayed deep deterministic policy gradient (TD3) algorithms, which enable dynamic and adaptive resource management. These LSTM-enhanced algorithms improve convergence speed by 44.44% and 73.81%, respectively, compared to their conventional counterparts, while significantly enhancing cost efficiency. Our simulation results demonstrate substantial improvements in system performance, with effective resource allocation and minimal utility costs, providing a robust solution for ensuring high-quality, low-latency communication in diverse 6G IATS environments.