Towards the development of numerical procedure for control of connected Markov chains

A Miller, B Miller, A Popov… - 2015 5th Australian …, 2015 - ieeexplore.ieee.org
The system of controlled time-inhomogeneous Markov chains (MCs) is considered. The
principal problem related to this kind of systems and could be called as the" curse of …

Optimal channel choice for lossy data flow transmission

BM Miller, GB Miller, KV Semenikhin - Automation and Remote Control, 2018 - Springer
We consider the optimal control problem for the load of several communication channels
defined by independent Markov jump processes. Implicit information on the state of a …

Control of connected Markov chains. Application to congestion avoidance in the Internet

A Miller, B Miller - 2011 50th IEEE Conference on Decision and …, 2011 - ieeexplore.ieee.org
The article considers the optimal control for the system of finite number of controlled
connected Markov chains (CMC). Such models come from queuing systems with many …

Controlling G-AIMD by index policy

KE Avrachenkov, VS Borkar… - 2017 IEEE 56th Annual …, 2017 - ieeexplore.ieee.org
We consider the Generalized Additive Increase Multiplicative Decrease (G-AIMD) dynamics
for resource allocation with alpha fairness utility function. This dynamics has a number of …

Optimal control problem regularization for the Markov process with finite number of states and constraints

BM Miller, GB Miller, KV Semenikhin - Automation and Remote Control, 2016 - Springer
The optimal control problem is considered for a system given by the Markov chain with
integral constraints. It is shown that the solution to the optimal control problem on the set of …

Resource allocation in cloud computing via optimal control to queuing systems

A Madankan, A Delavarkhalafi… - Вестник Южно …, 2019 - cyberleninka.ru
We consider resource allocation problem in the cloud computing. We use queuing model to
model the process of entering into the cloud and to schedule and to serve incoming jobs. In …

Towards tensor representation of controlled coupled markov chains

D McInnes, B Miller, G Miller, S Schreider - Mathematics, 2020 - mdpi.com
For a controlled system of coupled Markov chains, which share common control parameters,
a tensor description is proposed. A control optimality condition in the form of a dynamic …

Предотвращение перегрузок в сетях передачи данных с помощью методов стохастического управления

АБ Миллер - Автоматика и телемеханика, 2010 - mathnet.ru
В последние несколько лет были сделаны огромные шаги на пути внедрения
аналитических моделей в методы управления в сетях передачи данных. Ключом к этим …

Control and observation for dynamical queueing networks. I

YV Solodyannikov - Automation and Remote Control, 2014 - Springer
For the optimal control problem for a queueing network state, we write the Bellman equation
and give examples of its analytic and numerical solutions. In the first part, we give examples …

Control of M| M| 1| N queue parameters under constraints

DV Myasnikov, KV Siemenikhin - Journal of Computer and Systems …, 2016 - Springer
An optimal control of the MM1N queue is considered on the basis of the minimum criterion
for the expected service time if constraints on the average number of rejected demands and …