This book concerns continuous-time controlled Markov chains, also known as continuous-
time Markov decision processes. They form a class of stochastic control problems in which a …

Due to the deregulation of retail electricity market, consumers can choose retail electric
suppliers freely, and market entities are facing fierce competition because of the increasing …

This paper attempts to study the constrained average optimality for continuous-time Markov
decision processes in the class of randomized history-dependent policies. The states and …

In this paper we study absorbing continuous-time Markov decision processes in Polish state
spaces with unbounded transition and cost rates, and history-dependent policies. The …

We study the policy iteration algorithm (PIA) for continuous-time jump Markov decision
processes in general state and action spaces. The corresponding transition rates are …

Stochastic jump processes, especially birth-and-death processes, are widely used in the
queuing theory, computer networks and information transmission. The state of such process …

This paper studies the strong n (n=− 1, 0)-discount and finite horizon criteria for continuous-
time Markov decision processes in Polish spaces. The corresponding transition rates are …

This paper studies the limit average variance criterion for continuous-time Markov decision
processes in Polish spaces. Based on two approaches, this paper proves not only the …

This paper studies the policy iteration algorithm (PIA) for zero-sum stochastic differential
games with the basic long-run average criterion, as well as with its more selective version …

This article deals with multiconstrained continuous-time Markov decision processes in a
denumerable state space, with unbounded cost and transition rates. The criterion to be …