SBIR Phase I: Personal Service Robotics with Tiered Human-in-the-Loop Assistance

This Small Business Innovation Research (SBIR) Phase I project proposes a methodology and novel algorithms for Personal Service Robotics. Recognizing that, in unstructured environments, autonomous robotics alone is not yet reliable enough for performing complete tasks, and complete manual teleoperation is too labor intensive, this approach combines autonomous operation with human assistance in a Tiered Human in-the-Loop framework. At all levels, the autonomy will request help when unexpected or anomalous events occur. For example, at high levels the user may be asked to identify objects or adjust plans. At the low level the user may be asked to remote control the robot end-e ector to unstick a wedged object. Automation will focus on the most frequent task components, including motion planning, object grasping, and simple rigid-environment manipulation. The major innovations arise from (a) the design of limit-aware autonomy in each of these areas, requesting human intervention when needed and (b) multi-tiered human-assisted fallback options that necessitate greater involvement for severe failures or complex circumstances. Phase I will demonstrate an operator assisting a robot completing personal service tasks in non-industrial environments. Phase II will parallelize for an operator supporting multiple robots, with the multiplicative effect demonstrating overall labor savings. The broader impact/commercial potential of this project includes accelerating the deployment of robots in unstructured environments, extending the market for personal robotic services beyond single-purpose autonomous devices, and increasing access to in-home assistance in daily living for an aging population. With demographics shifting to an older population, we face a major shortage of manual labor, particularly for unskilled work. This will impact the once and home environments, and dramatically affect the older population for whom daily tasks become increasingly burdensome, but also for whom appropriate service workers may not be available. Allowing an operator to assist robots performing personal service tasks can increase the productivity of such labor and perform greater personal service than traditionally possible. Meanwhile, customers are clearly ready to invest into robotic technology. For reference, even today's highly limited personal and home robots created a $1.28 Billion global market. A human-in-the-loop personal service robot will greatly expand that market, as well as create markets for operator services and infrastructures. Delivering personal robotic service will have the immediate bene ts of reduced labor costs and increased productivity, while also allowing older adults to age in familiar housing and retain greater independence.