作者
Yue Xu, Jianyuan Yu, William C Headley, R Michael Buehrer
发表日期
2018/10/29
研讨会论文
MILCOM 2018-2018 IEEE Military Communications Conference (MILCOM)
页码范围
207-212
出版商
IEEE
简介
This paper investigates the use of deep reinforcement learning (DRL) to solve the dynamic spectrum access problem. Specifically, we examine the scenario where multiple discrete channels are shared by different types of nodes which lack the ability to communicate (with other node types) and do not have a priori knowledge of the other nodes' behaviors. Each node's objective is to maximize its own long-term expected number of successful transmissions. The problem is formulated as a Markov Decision Process (MDP) with unknown system dynamics. In order to overcome the challenge of an unknown environment combined with a prohibitively large transition matrix, we apply two specific DRL approaches: The Deep Q Network (DQN) and The Double Deep Q Network (DDQN). Additionally, we also introduce techniques to improve DQNs including an eligibility trace, prior experience and the “guess process”. We …
学术搜索中的文章
Y Xu, J Yu, WC Headley, RM Buehrer - MILCOM 2018-2018 IEEE Military Communications …, 2018