Imperfect CSI based intelligent dynamic spectrum management using cooperative reinforcement learning framework in cognitive radio networks

A Kaur, K Kumar - IEEE Transactions on Mobile Computing, 2020 - ieeexplore.ieee.org
… by modeling CSI imperfections as Gaussian error [18] to analyze the impact of imperfect
CSI on resource allocation in CR networks. Further, authors in [19] modeled CSI imperfections

Multi-IRS-assisted multi-cell uplink MIMO communications under imperfect CSI: A deep reinforcement learning approach

J Kim, S Hosseinalipour, T Kim… - 2021 IEEE …, 2021 - ieeexplore.ieee.org
… We consider the scenario in which (i) channels are dynamic and (ii) only partial CSI is …
problem, we propose a multiagent deep reinforcement learning algorithm to solve it, where each …

Imperfect CSI-Based Resource Management in Cognitive IoT Networks: A Deep Recurrent Reinforcement Learning Framework

A Kaur, K Kumar, A Prakash… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
… Cognitive IoT networks under imperfect CSI. The CSI imperfections are modeled as ellipsoidal
… To solve this problem, Deep Reinforcement Learning based robust scheme is proposed …

Partially Cooperative RL for Hybrid Action CRNs With Imperfect CSI

S Khaf, G Kaddoum… - IEEE Open Journal of the …, 2024 - ieeexplore.ieee.org
… In this context, reinforcement learning-based algorithms that … As exciting as the application
of reinforcement learning to … -continuous space deep reinforcement learning algorithm that …

Dynamic Resource Management for Federated Edge Learning With Imperfect CSI: A Deep Reinforcement Learning Approach

S Zhou, L Feng, M Mei, M Yao - IEEE Internet of Things Journal, 2024 - ieeexplore.ieee.org
imperfect CSI. Due to the FEL training rounds are non-independent, we use a deep reinforcement
learning (… To cope with the dynamic resources and unpredictable CSI in each round, …

Task offloading for vehicular edge computing with imperfect CSI: A deep reinforcement approach

Y Wu, J Xia, C Gao, J Ou, C Fan, J Ou, D Fan - Physical Communication, 2022 - Elsevier
… We devise a novel approach, which is combined by deep reinforcement learning (DRL) with
the Lagrangian multiplier to jointly minimize the system cost, where the DRL is employed to …

… reinforcement learning based joint downlink beamforming and RIS configuration in RIS-aided MU-MISO systems under hardware impairments and imperfect CSI

B Saglam, D Gurgunoglu… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
… Abstract—We introduce a novel deep reinforcement learning (… challenge of imperfect channel
state information (CSI) and … CSI and phase-dependent RIS amplitudes, and mismatched …

User association in a VHetNet with delayed CSI: A deep reinforcement learning approach

H Khoshkbari, S Sharifi… - IEEE Communications …, 2023 - ieeexplore.ieee.org
… time slot using the CSI of the previous time slot. … imperfect CSI and show our proposed
method outperforms the convex optimization user association scheme in the presence of noisy CSI

Deep reinforcement learning based end-to-end multiuser channel prediction and beamforming

M Chu, A Liu, VKN Lau, C Jiang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
… schemes, reinforcement learning (RL) agent could learn certain … CSI and statistical channel
models, or large numbers of true … and downlink CSI caused by the delay or imperfect channel …

Deep Reinforcement Learning for Improving Resource Utilization Efficiency of URLLC with Imperfect Channel State Information

L Zhang, C She, K Ying, Y Li… - IEEE Wireless …, 2023 - ieeexplore.ieee.org
imperfect CSI, the problem can be formulated as a Partially Observed Markov Decision Process
(POMDP), which can then be solved using deep reinforcement learning (… imperfect CSI. …