Infinite horizon optimal impulsive control with applications to Internet congestion control

K Avrachenkov, O Habachi, A Piunovskiy… - International Journal of …, 2015 - Taylor & Francis
We investigate infinite-horizon deterministic optimal control problems with both gradual and
impulsive controls, where any finitely many impulses are allowed simultaneously. Both …

Optimal management of a two dam system via stochastic control: Parallel computing approach

B Miller, D McInnes - 2011 50th IEEE Conference on Decision …, 2011 - ieeexplore.ieee.org
In this paper we consider a model for the optimal management of a two dam system. Each
dam is modelled via a continuous-time controlled Markov chain on a finite control period and …

Towards the development of numerical procedure for control of connected Markov chains

A Miller, B Miller, A Popov… - 2015 5th Australian …, 2015 - ieeexplore.ieee.org
The system of controlled time-inhomogeneous Markov chains (MCs) is considered. The
principal problem related to this kind of systems and could be called as the" curse of …

Simultaneous impulse and continuous control of a Markov chain in continuous time

AB Miller, BM Miller, KV Stepanyan - Automation and Remote Control, 2020 - Springer
We consider continuous and impulse control of a Markov chain (MC) with a finite set of
states in continuous time. Continuous control determines the intensity of transitions between …

Impulsive control for G-AIMD dynamics with relaxed and hard constraints

K Avrachenkov, A Piunovskiy… - 2018 IEEE conference on …, 2018 - ieeexplore.ieee.org
Motivated by various applications from Internet congestion control to power control in smart
grids and electric vehicle charging, we study Generalized Additive Increase Multiplicative …

Towards tensor representation of controlled coupled markov chains

D McInnes, B Miller, G Miller, S Schreider - Mathematics, 2020 - mdpi.com
For a controlled system of coupled Markov chains, which share common control parameters,
a tensor description is proposed. A control optimality condition in the form of a dynamic …

Optimisation of gas flows in South Eastern Australia via controllable Markov chains

D McInnes, B Miller, S Schreider - 2016 Australian Control …, 2016 - ieeexplore.ieee.org
We consider the optimal flows of intra-day gas supply for the production and pipeline
network for Adelaide, Melbourne and Sydney. We model the demand in the network of three …

Optimal quadratic control of queues by dynamic service rates

R Milocco, P Mühlethaler… - NOMS 2024-2024 …, 2024 - ieeexplore.ieee.org
A method to improve dynamic service provision is presented, catering to variable future
demands while minimizing energy consumption and waiting times, maximizing customer …

Одновременное импульсное и непрерывное управление марковской цепью в непрерывном времени

АБ Миллер, БМ Миллер, КВ Степанян - Автоматика и телемеханика, 2020 - mathnet.ru
Рассматривается непрерывное и импульсное управление марковской цепью (МЦ) с
конечным множеством состояний в непрерывном времени. Непрерывное управление …

Optimal redesign of Markov chains with prescribed repulsive distribution

M Santilli, A Gasparri, G Oliva - 2018 IEEE Conference on …, 2018 - ieeexplore.ieee.org
Optimization over Markov chains is a popular topic, since Markov chains can be used to
model several important systems, such as telecommunications, railways or dams. However …