This paper considers opportunistic communication over multiple channels where the state
(ldquogoodrdquo or ldquobadrdquo) of each channel evolves as independent and
identically distributed (iid) Markov processes. A user, with limited channel sensing capability,
chooses one channel to sense and decides whether to use the channel (based on the
sensing result) in each time slot. A reward is obtained whenever the user senses and
accesses a ldquogoodrdquo channel. The objective is to design a channel selection policy …

We consider opportunistic communications over multiple channels where the state (" good"
or" bad") of each channel evolves as independent and identically distributed Markov
processes. A user, with limited sensing and access capability, chooses one channel to
sense and subsequently access (based on the sensed channel state) in each time slot. A
reward is obtained when the user senses and accesses a" good" channel. The objective is
to design the optimal channel selection policy that maximizes the expected reward accrued …