What if we could teach robots using language?

This research question is being tackled by the field of Interactive Task Learning. My focus is on creating robotic agents that can learn new tasks in one-shot from natural language instruction. My research involves a cognitive architecture approach, where we investigate issues of knowledge representation, reasoning, and explanation-based learning.


Rosie is the name of the Interactive Task Learning agent I have helped develop at the University of Michigan in the Soar Lab. It is written in the Soar Cognitive Architecture. It can learn many different tasks, games, and puzzles and has been deployed in many different real and simulated environments.

Watch a demo video of it learning tasks in a mobile environment