Accession Number : AD1008203

Title :   Integrated Intelligence: Robot Instruction via Interactive Grounded Learning

Descriptive Note : Technical Report,15 Jun 2012,14 Jun 2015

Corporate Author : University of Washington Seattle United States

Personal Author(s) : Zettlemoyer,Luke ; Fox,Dieter

Full Text :

Report Date : 14 Feb 2016

Pagination or Media Count : 11

Abstract : People communicate using a variety of modalities, including speech, gestures, gaze, and whole body motion. To be effective, robots must beable to interpret the rich information contained in human communication. The goal of this project is to allow people to instruct robots and toteach them about objects and attributes using a combination of modalities. To achieve this goal, we are developing an interactive groundedlearning system that can interpret rich human input such as speech, gesture, body motion, and gaze; and learn to identify objects based on thenames and attributes people use to refer to them. This progress report summarizes the final findings and describes completed work towards afull, interactive grounded learning system.

Descriptors :   natural language , robotics , learning , robots , speech , motion , social communication

Distribution Statement : APPROVED FOR PUBLIC RELEASE