Network Topology Optimization via Deep Reinforcement Learning
| العنوان: | Network Topology Optimization via Deep Reinforcement Learning |
|---|---|
| المؤلفون: | Zhuoran Li, Xing Wang, Ling Pan, Lin Zhu, Zhendong Wang, Junlan Feng, Chao Deng, Longbo Huang |
| المصدر: | IEEE Transactions on Communications. 71:2847-2859 |
| بيانات النشر: | Institute of Electrical and Electronics Engineers (IEEE), 2023. |
| سنة النشر: | 2023 |
| مصطلحات موضوعية: | Networking and Internet Architecture (cs.NI), FOS: Computer and information sciences, Computer Science - Networking and Internet Architecture, Computer Science - Machine Learning, Artificial Intelligence (cs.AI), Computer Science - Artificial Intelligence, Electrical and Electronic Engineering, Machine Learning (cs.LG) |
| الوصف: | Topology impacts important network performance metrics, including link utilization, throughput and latency, and is of central importance to network operators. However, due to the combinatorial nature of network topology, it is extremely difficult to obtain an optimal solution, especially since topology planning in networks also often comes with management-specific constraints. As a result, local optimization with hand-tuned heuristic methods from human experts are often adopted in practice. Yet, heuristic methods cannot cover the global topology design space while taking into account constraints, and cannot guarantee to find good solutions. In this paper, we propose a novel deep reinforcement learning (DRL) algorithm, called Advantage Actor Critic-Graph Searching (A2C-GS), for network topology optimization. A2C-GS consists of three novel components, including a verifier to validate the correctness of a generated network topology, a graph neural network (GNN) to efficiently approximate topology rating, and a DRL actor layer to conduct a topology search. A2C-GS can efficiently search over large topology space and output topology with satisfying performance. We conduct a case study based on a real network scenario, and our experimental results demonstrate the superior performance of A2C-GS in terms of both efficiency and performance. |
| تدمد: | 1558-0857 0090-6778 |
| الوصول الحر: | https://explore.openaire.eu/search/publication?articleId=doi_dedup___::89a13156286f24eb3faacba5cbf5615dTest https://doi.org/10.1109/tcomm.2023.3244239Test |
| حقوق: | OPEN |
| رقم الانضمام: | edsair.doi.dedup.....89a13156286f24eb3faacba5cbf5615d |
| قاعدة البيانات: | OpenAIRE |
| تدمد: | 15580857 00906778 |
|---|