In Situ Training of Robonaut for In-Space Assembly, Maintenance and Servicing

The goal of the proposed FieldTrainer control system is to enable astronauts to teach Robonaut on-orbit how to perform new complex tasks using EVA tools. Employing a show-and-tell approach to robot training, the control system acquires rule-based task plans through verbal dialog between robot and astronaut, and acquires neural network-based skills incrementally though verbal, visual, and manual inputs. The project builds upon previous research that demonstrates the viability of verbally constructing non-trivial task descriptions. In Phase I, a simulator for a Robonaut-based Hubble rescue mission is developed. Baseline tool manipulation behaviors are created using an existing behavior development system. Verbal construction of high-level rule-based behaviors is demonstrated. Refinement of motion sequences through verbal training of neural networks is studied whereby perturbations are added to nominal rule-based task execution. The training methodology is also evaluated for its potential use in education. FieldTrainer technology is expected to give Robonaut an unending ability to learn and flightcrews the ability to customize Robonaut's behavior for routine tasks and unexpected situations.