Asymptotic optimality of tailored base-surge policies in dual-sourcing inventory systems

L Xin, DA Goldberg - Management Science, 2018 - pubsonline.informs.org
Dual-sourcing inventory systems, in which one supplier is faster (ie, express) and more
costly, while the other is slower (ie, regular) and cheaper, arise naturally in many real-world …

Continuous-time Markov decision processes

A Piunovskiy, Y Zhang - Probability Theory and Stochastic Modelling, 2020 - Springer
The study of continuous-time Markov decision processes dates back at least to the 1950s,
shortly after that of its discrete-time analogue. Since then, the theory has rapidly developed …

Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces

X Guo, J Zhang - Discrete Event Dynamic Systems, 2019 - Springer
This paper considers the finite-horizon risk-sensitive optimality for continuous-time Markov
decision processes, and focuses on the more general case that the transition rates are …

[HTML][HTML] Toma de decisiones de agentes racionales con procesos markovianos. Avances recientes en economía y finanzas

O Hernández-Lerma, F Venegas-Martínez - El trimestre económico, 2012 - scielo.org.mx
En esta investigación se revisa la evolución teórica y práctica de los procesos markovianos
y se resalta su rápido avance y notorio potencial en el modelado de los procesos de toma …

Optimal control of parallel queues for managing volunteer convergence

G Zayas‐Cabán, EJ Lodree… - Production and …, 2020 - journals.sagepub.com
Volunteer convergence refers to the influx of volunteers to affected areas after large‐scale
disasters. There are not only many benefits to volunteer convergence, but it also creates …

Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates

X Guo, X Huang, Y Huang - Advances in Applied Probability, 2015 - cambridge.org
In this paper we focus on the finite-horizon optimality for denumerable continuous-time
Markov decision processes, in which the transition and reward/cost rates are allowed to be …

Impulsive control for continuous-time Markov decision processes

F Dufour, AB Piunovskiy - Advances in Applied Probability, 2015 - cambridge.org
In this paper our objective is to study continuous-time Markov decision processes on a
general Borel state space with both impulsive and continuous controls for the infinite time …

Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach

A Piunovskiy, Y Zhang - 4OR, 2014 - Springer
This paper deals with a continuous-time Markov decision process in Borel state and action
spaces and with unbounded transition rates. Under history-dependent policies, the …

Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations

H Blok, FM Spieksma - Advances in Applied Probability, 2015 - cambridge.org
This paper considers Markov decision processes (MDPs) with unbounded rates, as a
function of state. We are especially interested in studying structural properties of optimal …

Impulsive control for continuous-time Markov decision processes: A linear programming approach

F Dufour, AB Piunovskiy - Applied Mathematics & Optimization, 2016 - Springer
In this paper, we investigate an optimization problem for continuous-time Markov decision
processes with both impulsive and continuous controls. We consider the so-called …