Online planning for constrained POMDPs with continuous spaces through dual ascent

A Jamgochian, A Corso, MJ Kochenderfer - Proceedings of the …, 2023 - ojs.aaai.org
Rather than augmenting rewards with penalties for undesired behavior, Constrained
Partially Observable Markov Decision Processes (CPOMDPs) plan safely by imposing …

Optimality guarantees for particle belief approximation of POMDPs

MH Lim, TJ Becker, MJ Kochenderfer, CJ Tomlin… - Journal of Artificial …, 2023 - jair.org
Partially observable Markov decision processes (POMDPs) provide a flexible representation
for real-world decision and control problems. However, POMDPs are notoriously difficult to …

Task-directed exploration in continuous pomdps for robotic manipulation of articulated objects

A Curtis, L Kaelbling, S Jain - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Representing and reasoning about uncertainty is crucial for autonomous agents acting in
partially observable environments with noisy sensors. Partially observable Markov decision …

Intention-aware navigation in crowds with extended-space POMDP planning

H Gupta, B Hayes, Z Sunberg - arXiv preprint arXiv:2206.10028, 2022 - arxiv.org
This paper presents a hybrid online Partially Observable Markov Decision Process
(POMDP) planning system that addresses the problem of autonomous navigation in the …

Simplifying complex observation models in continuous pomdp planning with probabilistic guarantees and practice

I Lev-Yehudi, M Barenboim, V Indelman - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Solving partially observable Markov decision processes (POMDPs) with high dimensional
and continuous observations, such as camera images, is required for many real life robotics …

Speeding up POMDP planning via simplification

O Sztyglic, V Indelman - 2022 IEEE/RSJ International …, 2022 - ieeexplore.ieee.org
In this paper, we consider online planning in par-tially observable domains. Solving the
corresponding POMDP problem is a very challenging task, particularly in an online setting …

Constrained hierarchical monte carlo belief-state planning

A Jamgochian, H Buurmeijer, KH Wray… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Optimal plans in Constrained Partially Observable Markov Decision Processes (CPOMDPs)
maximize reward objectives while satisfying hard cost constraints, generalizing safe …

Multilevel monte-carlo for solving pomdps online

M Hoerger, H Kurniawati, A Elfes - The International Symposium of …, 2019 - Springer
Planning under partial obervability is essential for autonomous robots. A principled way to
address such planning problems is the Partially Observable Markov Decision Process …

Assistance in Teleoperation of Redundant Robots through Predictive Joint Maneuvering

C Brooks, W Rees, D Szafir - ACM Transactions on Human-Robot …, 2024 - dl.acm.org
In teleoperation of redundant robotic manipulators, translating an operator's end effector
motion command to joint space can be a tool for maintaining feasible and precise robot …

Autonomous Reconnaissance Trajectory Guidance at Small Near-Earth Asteroids via Reinforcement Learning

S Takahashi, DJ Scheeres - Journal of Guidance, Control, and …, 2023 - arc.aiaa.org
Autonomous capabilities could be an essential aspect of future near-Earth asteroid
exploration missions, enabling a fleet of low-cost spacecraft to be distributed to various …