Recent advances in hierarchical reinforcement learning

AG Barto, S Mahadevan - Discrete event dynamic systems, 2003 - Springer
Reinforcement learning is bedeviled by the curse of dimensionality: the number of
parameters to be learned grows exponentially with the size of any compact encoding of a …

Map-based navigation in mobile robots:: I. a review of localization strategies

D Filliat, JA Meyer - Cognitive systems research, 2003 - Elsevier
For a robot, an animal, and even for man, to be able to use an internal representation of the
spatial layout of its environment to position itself is a very complex task, which raises …

Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data

C Sutton, K Rohanimanesh, A McCallum - Proceedings of the twenty-first …, 2004 - dl.acm.org
In sequence modeling, we often wish to represent complex interaction between labels, such
as when performing multiple, cascaded labeling tasks on the same sequence, or when long …

Map-based navigation in mobile robots:: Ii. a review of map-learning and path-planning strategies

JA Meyer, D Filliat - Cognitive Systems Research, 2003 - Elsevier
This article reviews map-learning and path-planning strategies within the context of map-
based navigation in mobile robots. Concerning map-learning, it distinguishes metric maps …

[PDF][PDF] Dynamic bayesian networks

KP Murphy - Probabilistic Graphical Models, M. Jordan, 2002 - webdocs.cs.ualberta.ca
Chapter?? introduced hidden Markov models (HMMs), and Chapter?? introduced state
space models (SSMs), both of which are popular, but somewhat inflexible, models of …

Linear-time inference in hierarchical HMMs

KP Murphy, M Paskin - Advances in neural information …, 2001 - proceedings.neurips.cc
The hierarchical hidden Markov model (HHMM) is a generalization of the hidden Markov
model (HMM) that models sequences with structure at many length/time scales [FST98] …

Imagining geographies of the 'new Europe': geo-economic power and the new European architecture of integration

A Smith - Political geography, 2002 - Elsevier
Since 1989, East-Central Europe has witnessed a series of transformations that have
resulted in the region's geopolitical and geoeconomic repositioning within Europe. This …

A multi-agent approach to controlling a smart environment

DJ Cook, M Youngblood, SK Das - Designing smart homes: The role of …, 2006 - Springer
The goal of the MavHome (M anaging A n Intelligent V ersa-tile Home) project is to create a
home that acts as a rational agent. The agent seeks to maximize inhabitant comfort and …

Managing adaptive versatile environments

GM Youngblood, DJ Cook, LB Holder - Pervasive and Mobile Computing, 2005 - Elsevier
The goal of the MavHome project is to develop technologies to Manage Adaptive Versatile
environments. In this paper, we present a complete agent architecture for a single inhabitant …

Predictive autonomous robot navigation

AF Foka, PE Trahanias - IEEE/RSJ international conference on …, 2002 - ieeexplore.ieee.org
This paper considers the problem of a robot navigating in a crowded or congested
environment. A robot operating in such an environment can get easily blocked by moving …