A practitioner's guide to MDP model checking algorithms

A Hartmanns, S Junges, T Quatmann… - … Conference on Tools …, 2023 - Springer
Abstract Model checking undiscounted reachability and expected-reward properties on
Markov decision processes (MDPs) is key for the verification of systems that act under …

Markov decision process for multi-manned mixed-model assembly lines with walking workers

SE Hashemi-Petroodi, S Thevenin, S Kovalev… - International Journal of …, 2023 - Elsevier
Product customization and frequent market changes force manufacturing companies to
employ mixed-model instead of simple assembly lines. To well adjust the line's capacity to …

Determining ambulance destinations when facing offload delays using a Markov decision process

M Li, A Carter, J Goldstein, T Hawco, J Jensen… - Omega, 2021 - Elsevier
When emergency departments (EDs) are crowded and cannot accept incoming ambulance
patients immediately, paramedics commonly continue to provide patient care until an ED …

Reward-based Monte Carlo-Bayesian reinforcement learning for cyber preventive maintenance

TT Allen, S Roychowdhury, E Liu - Computers & Industrial Engineering, 2018 - Elsevier
This article considers a preventive maintenance problem related to cyber security in
universities. A Bayesian Reinforcement Learning (BRL) problem is formulated using limited …

A techno-economic framework for replacing aged XLPE cables in the distribution network

AA Hamad, RA Ghunem - IEEE Transactions on Power …, 2020 - ieeexplore.ieee.org
In this paper, a stochastic framework is proposed for optimizing replacement strategies of
aged XLPE cables in the electric power distribution network. The proposed framework …

An optimal replacement policy for complex multi-component systems

R Ahmadi - International Journal of Production Research, 2016 - Taylor & Francis
Given a reward structure, this paper addresses an optimal replacement problem for complex
multi-component systems. To maintain revenue stream resulting from system, the system is …

Optimal admission control under premature discharge decisions for operational effectiveness

F Yang, Y Jiang, Z Tang - International Transactions in …, 2023 - Wiley Online Library
The shortage of inpatient beds causes surgery cancellations, treatment delays, and
inappropriate ward arrangements. That is why studying how to make admission decisions …

Linear programming-based solution methods for constrained partially observable Markov decision processes

RK Helmeczi, C Kavaklioglu, M Cevik - Applied Intelligence, 2023 - Springer
Constrained partially observable Markov decision processes (CPOMDPs) have been used
to model various real-world phenomena. However, they are notoriously difficult to solve to …

An optimal dynamic admission control policy and upper bound analysis in wireless sensor networks

X Zhang, D Li, WW Li, W Zhao - IEEE Access, 2019 - ieeexplore.ieee.org
Data admission control is an important issue in wireless sensor networks (WSNs) because
of the limited transmission coverage area and the limited battery capability of each sensor …

Approximate Bilevel Difference Convex Programming for Bayesian Risk Markov Decision Processes

Y Lin, E Zhou - arXiv preprint arXiv:2301.11415, 2023 - arxiv.org
We consider infinite-horizon Markov Decision Processes where parameters, such as
transition probabilities, are unknown and estimated from data. The popular distributionally …