电子科技 ›› 2024, Vol. 37 ›› Issue (11): 7-12.doi: 10.16180/j.cnki.issn1007-7820.2024.11.002

• • 上一篇    下一篇

基于深度强化学习的异构融合网络接入算法

肖雄1, 刘鸿雁1, 衣孟杰2   

  1. 1.beoplay体育提现 通信工程学院,陕西 西安 710071
    2.beoplay体育提现 网络与信息安全学院,陕西 西安 710126
  • 收稿日期:2023-03-23 出版日期:2024-11-15 发布日期:2024-11-21
  • 作者简介:肖雄(1994-),男,硕士研究生。研究方向:信息通信网络理论。
    刘鸿雁(1981-),男,副研究员。研究方向:通信网络、数字基带信号处理。
    衣孟杰(1994-),女,博士研究生。研究方向:人工智能与无人机路径规划。
  • 基金资助:
    国家自然科学基金(42127802)

Heterogeneous Converged Network Access Algorithm Based on Deep Reinforcement Learning

XIAO Xiong1, LIU Hongyan1, YI Mengjie2   

  1. 1. School of Telecommunications Engineering,Xidian University,Xi'an 710071,China
    2. School of Cyber Engineering,Xidian University,Xi'an 710126,China
  • Received:2023-03-23 Online:2024-11-15 Published:2024-11-21
  • Supported by:
    National Natural Science Foundation of China(42127802)

摘要:

随着空、天、地各域通信网络的日趋成熟,跨域异构融合技术已成为未来通信网络一体化发展的重要方向。文中在空天地一体化网络向跨域异构融合需求的驱动下,针对异构网络中频谱资源利用率较低的问题,采用深度强化学习方法,通过建立异构融合网络系统模型,设计具有公平尺度的智能体接入算法,以系统吞吐量为最大化目标,选取符合空天地一体化特征的各通信网络制式并提取对应的接入协议。遵照公平原则,设置无量纲的信道参数,建立仿真场景。在仿真中引入多种对比策略,统计系统吞吐量、碰撞率、利用率和信道选择比例等指标。仿真结果表明,跨域异构融合网络的系统吞吐量提高了60%以上,系统信道利用效率提升了20%,业务分组碰撞率维持在10%,验证了文中算法对不同业务场景的适应性。

关键词: 异构融合网络, 空天地一体化, 深度强化学习, 频谱利用率, 接入协议, 公平尺度, 无量纲, 系统吞吐量

Abstract:

With the increasingly mature communication networks in the fields of air, space and ground, cross-domain heterogeneous converged technology has become an important direction for the integrated development of future communication networks. Driven by the demand for cross-domain heterogeneous in the converged network of air, space and ground, this study aims to solve the problem of low spectrum resource utilization in heterogeneous networks. It uses deep reinforcement learning method to establish a heterogeneous converged network system model and designs intelligent agent access algorithm with fair scale. The system throughput is selected as the maximization objective. The communication network standards that meet the characteristics of air, space and ground integration are selected and corresponding access protocols are extracted. Non-dimensional channel parameters are set according to the principle of fairness and simulation scenarios are established. Multiple comparison strategies are introduced in the simulation to statistically analyze system throughput, collision rate, utilization rate and channel selection ratio. The simulation results show that the system throughput of cross-domain heterogeneous fusion network is increased by more than 60%, system channel utilization efficiency is increased by 20%, and the collision rate of service packets is maintained at 10%, which verifies the adaptability of the algorithm to different business scenarios.

Key words: heterogeneous converged network, air, space and ground integration, deep reinforcement learning, spectrum utilization rate, access protoco, fair scale, dimensioning, system throughput

中图分类号: 

  • TN92