The application of robotics and autonomous systems in space has increased dramatically.
The ongoing Mars rover mission involving the Curiosity rover, along with the success of its …

This paper focuses on online obstacle avoidance planning for unmanned underwater
vehicles. To improve the autonomous ability and intelligence of obstacle avoidance …

Autonomous decision making and motion planning in complex dynamic traffic environments,
such as left-turn without traffic signals and multi-lane merging from side-ways, are still …

Dyna-Q is a reinforcement learning method widely used in AGV path planning. However, in
large complex dynamic environments, due to the sparse reward function of Dyna-Q and the …

Because of a powerful temporal-difference (TD) with λ [TD (λ)] learning method, this paper
presents a novel n-step adaptive dynamic programming (ADP) architecture that combines …

In problems with complex dynamics and challenging state spaces, the dual heuristic
programming (DHP) algorithm has been shown theoretically and experimentally to perform …

Finding the most appropriate path in robot navigation has been an interesting challenge in
recent years. A number of different techniques have been proposed to address this problem …

Robotic systems that are developed for social and dynamic environments require adaptive
mechanisms to successfully operate. Consequently, learning from rewards has provided …

This paper provides the stability analysis for a model-free action-dependent heuristic
dynamic programing (HDP) approach with an eligibility trace long-term prediction parameter …

In this paper, we present an online obstacle avoidance planning method for unmanned
underwater vehicle (UUV) based on clockwork recurrent neural network (CW‐RNN) and …