Battlespace Target Presentation in the Live Training Environment

The proposed system creates augmented reality targets for live fire training using novel optical beacons. These optical beacons are easily added to current training facilities and are use to determine the soldiers position in a scene with respect to an environment model of the surrounding structures. The system uses a forward looking camera to ascertain the soldier’s position with respect to the buildings, and then overlays virtual 3D targets into the scene via a heads up display. Because of the environment map the virtual targets can realistically move in and out of buildings, and take cover. The targets will use scripting tools acquired from the gaming industry to perform complex maneuvers, and adaptively respond to the soldier’s behavior. The location of misses and hits from the rifle is determined using Cybernet’s I3M rifle pose detection device. This device has the added benefit of allowing the soldier to interact with the target via gross body movements, and reposition of the rifle. The head mounted display is kept stationary using helmet-mounted actuators and an eye-tracking camera. This eye-tracking camera is also used to monitor the soldier’s gaze direction for enhanced training.