Learning Symbolic Action Definitions from Unlabelled Image Pairs

Harman, H. & Simoens, P. (2020), Accepted in Knowledge Engineering for Planning and Scheduling (KEPS) workshop part of ICAPS'20 [PDF]

Abstract: Task planners and goal recognisers often require symbolic models of an agent's behaviour. These models are usually manually developed, which can be a time consuming and error prone process. Therefore, our work transforms unlabelled pairs of images, showing the state before and after an action has been executed, into reusable action definitions. Each action definition consist of a set of parameters, effects and pre-conditions. To evaluate these action definitions, states weregenerated and a task planner invoked. Problems with large state spaces were solved using the action definitions learnt from smaller state spaces. On average, the task plans contained 5.46 actions and planning took 0.06 seconds. Moreover, when 20 % of transitions were missing, our approach generated the correct number of objects, action definitions and plans 70 % of the time.