An Isaac Newton Institute Programme

Logic and Algorithms

Connecting Logic and Learning

15th May 2006

Author: Eyal Amir (Illinois)

Abstract

Many complex domains offer limited information about their exact state and the way actions affect them. For example, a robot exploring a building does not know how pressing a button affects the world, and also may not see the effect of pressing the button immediately. There, we need to learn action models to act effectively, at the same time that we track the (partially observed) state of the domain.

In this presentation I will describe polynomial-time algorithms for learning logical models of actions' effects and preconditions in deterministic partially observable domains. These algorithms represent the set of possible action models compactly, and update it after every action execution and partial observation. This approach is the first tractable learning algorithm for partially observable dynamic domains. I will mention recent extensions of this work to relational domains, and will also discuss potential applications of this work to agents playing adventure games and to formal verification.