Partially observable markov decision processes and robotics

H Kurniawati - Annual Review of Control, Robotics, and …, 2022 - annualreviews.org
Planning under uncertainty is critical to robotics. The partially observable Markov decision
process (POMDP) is a mathematical framework for such planning problems. POMDPs are …

Partially observable markov decision processes in robotics: A survey

M Lauri, D Hsu, J Pajarinen - IEEE Transactions on Robotics, 2022 - ieeexplore.ieee.org
Noisy sensing, imperfect control, and environment changes are defining characteristics of
many real-world robot tasks. The partially observable Markov decision process (POMDP) …

Decision making in multiagent systems: A survey

Y Rizk, M Awad, EW Tunstel - IEEE Transactions on Cognitive …, 2018 - ieeexplore.ieee.org
Intelligent transport systems, efficient electric grids, and sensor networks for data collection
and analysis are some examples of the multiagent systems (MAS) that cooperate to achieve …

DESPOT: Online POMDP planning with regularization

N Ye, A Somani, D Hsu, WS Lee - Journal of Artificial Intelligence Research, 2017 - jair.org
The partially observable Markov decision process (POMDP) provides a principled general
framework for planning under uncertainty, but solving POMDPs optimally is computationally …

Motion planning under uncertainty using iterative local optimization in belief space

J Van Den Berg, S Patil… - The International Journal …, 2012 - journals.sagepub.com
We present a new approach to motion planning under sensing and motion uncertainty by
computing a locally optimal solution to a continuous partially observable Markov decision …

FIRM: Sampling-based feedback motion-planning under motion uncertainty and imperfect measurements

AA Agha-Mohammadi… - … Journal of Robotics …, 2014 - journals.sagepub.com
In this paper we present feedback-based information roadmap (FIRM), a multi-query
approach for planning under uncertainty which is a belief-space variant of probabilistic …

Intention-aware motion planning

T Bandyopadhyay, KS Won, E Frazzoli, D Hsu… - … Foundations of Robotics …, 2013 - Springer
As robots venture into new application domains as autonomous vehicles on the road or as
domestic helpers at home, they must recognize human intentions and behaviors in order to …

POMDPs. jl: A framework for sequential decision making under uncertainty

M Egorov, ZN Sunberg, E Balaban, TA Wheeler… - Journal of Machine …, 2017 - jmlr.org
POMDPs. jl is an open-source framework for solving Markov decision processes (MDPs)
and partially observable MDPs (POMDPs). POMDPs. jl allows users to specify sequential …

An online POMDP solver for uncertainty planning in dynamic environment

H Kurniawati, V Yadav - Robotics Research: The 16th International …, 2016 - Springer
Motion planning under uncertainty is important for reliable robot operations in uncertain and
dynamic environments. Partially Observable Markov Decision Process (POMDP) is a …

Qmdp-net: Deep learning for planning under partial observability

P Karkus, D Hsu, WS Lee - Advances in neural information …, 2017 - proceedings.neurips.cc
This paper introduces the QMDP-net, a neural network architecture for planning under
partial observability. The QMDP-net combines the strengths of model-free learning and …