On Optimality of Myopic Sensing Policy with Imperfect Sensing in Multi-Channel Opportunistic Access - Laboratoire Interdisciplinaire des Sciences du Numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Communications Année : 2013

On Optimality of Myopic Sensing Policy with Imperfect Sensing in Multi-Channel Opportunistic Access

Lin Chen
Khaldoun Al Agha
  • Fonction : Auteur
  • PersonId : 833572

Résumé

We consider the channel access problem in a multi-channel opportunistic communication system with imperfect channel sensing, where the state of each channel evolves as an independent and identically distributed Markov process. The considered problem can be cast into a restless multi-armed bandit (RMAB) problem that is of fundamental importance in decision theory. It is well-known that the optimal policy of RMAB problem is intractable for its exponential computation complexity. A natural alternative is to consider the easily implementable myopic policy that maximizes the immediate reward but ignores the impact of the current strategy on the future reward. In this paper, we perform an analytical study on the optimality of the myopic policy under imperfect sensing for the considered RMAB problem. Specifically, for a family of generic and practically important utility functions, we establish the closed-form conditions to guarantee the optimality of the myopic policy even under imperfect sensing. Despite our focus on the opportunistic channel access, the obtained results are generic in nature and are widely applicable in a wide range of engineering domains.

Dates et versions

hal-01761109 , version 1 (07-04-2018)

Identifiants

Citer

Kehao Wang, Lin Chen, Quan Liu, Khaldoun Al Agha. On Optimality of Myopic Sensing Policy with Imperfect Sensing in Multi-Channel Opportunistic Access. IEEE Transactions on Communications, 2013, 61 (9), pp.3854-3862. ⟨10.1109/TCOMM.2013.071213.120573⟩. ⟨hal-01761109⟩
38 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More