Dynamic programming with state-dependent discounting

J Stachurski, J Zhang - Journal of Economic Theory, 2021 - Elsevier
This paper extends the core results of discrete time infinite horizon dynamic programming to
the case of state-dependent discounting. We obtain a condition on the discount factor …

Some advances on constrained Markov decision processes in Borel spaces with random state-dependent discount factors

H Jasso-Fuentes, RR López-Martínez… - Optimization, 2024 - Taylor & Francis
This paper addresses a class of discrete-time Markov decision processes in Borel spaces
with a finite number of cost constraints. The constrained control model considers costs of …

Transition based discount factor for model free algorithms in reinforcement learning

A Sharma, R Gupta, K Lakshmanan, A Gupta - Symmetry, 2021 - mdpi.com
Reinforcement Learning (RL) enables an agent to learn control policies for achieving its
long-term goals. One key parameter of RL algorithms is a discount factor that scales down …

Discrete-time hybrid control with risk-sensitive discounted costs

R Blancas-Rivera, H Jasso-Fuentes - Discrete Event Dynamic Systems, 2024 - Springer
This paper studies discrete-time hybrid control problems where the controller's payoff
function follows a risk-sensitive discounted model. The associated discount factor can …

Constrained Markov Decision Processes with Non-constant Discount Factor

H Jasso-Fuentes, T Prieto-Rumeau - Journal of Optimization Theory and …, 2024 - Springer
This paper studies constrained Markov decision processes under the total expected
discounted cost optimality criterion, with a state-action dependent discount factor that may …

Discrete-time hybrid control processes with unbounded costs

H Jasso-Fuentes, GD Salgado-Suárez - Applied Mathematics & …, 2024 - Springer
This paper extends the results provided in Jasso-Fuentes et al.(Appl Math Optim 81 (2): 409–
441, 2020b) and Jasso-Fuentes et al.(Pure Appl Funct Anal 9 (3): 675–704, 2024) regarding …

A mean field absorbing control model for interacting objects systems

ME Martínez-Manzanares, JA Minjárez-Sosa - Discrete Event Dynamic …, 2021 - Springer
We study a class of discrete-time stochastic systems composed of a large number of N
interacting objects, which are classified in a finite number of classes. The behavior of the …

[PDF][PDF] Opportunity Hunters

R Eilat, Z Neeman, E Solan - 2023 - eilatr.github.io
We propose a novel framework for analyzing competition for opportunities. We introduce a
new type of games, called “opportunity-hunting games,” in which two players compete to …

Ergodic switching control for Markov chains

JL Menaldi, M Robin - Numerical Algebra, Control and …, 2025 - aimsciences.org
Switching control problems for coupled finite Markov chains with a long term average cost
(ergodic) are considered as a continuation of the model in [16]. The vanishing discount …

[PDF][PDF] Opportunity Hunters: A Model of Competitive Sequential Inspections.

R Eilat, Z Neeman, E Solan - EC, 2023 - people.socsci.tau.ac.il
We propose a novel framework for analyzing competition for opportunities. We introduce a
new type of games, called “opportunity-hunting games,” in which two players compete to …