Sensor Enabled 3D Model Generation

We propose to create a prototype of a shape and structure capture system which can construct accurate, realistic three dimensional models of typical commercial and residential building interiors from video imagery taken with a freely moving handheld camera. A precision inertial motion measurement unit will be developed and mounted on the camera and its measurements recorded with the video. We will develop environment capture hardware and reconstruction software that may be used by technicians after minimal training. This work will be based on work completed in our phase 1 contract as well as the work of ImageCorp and PercepTek, two firms experienced in image processing and 3D reconstruction. A typical system will include a video camera and IMU, and a laptop computer and a workstation for data processing. Software installed on the laptop will be capable of performing an analysis of the video data to determine coverage of the area filmed before the camera leaves the site. Software for the workstation will reconstruct the structure and surfaces filmed, and allow interactive structure editing tasks to be performed. Commercially available end user software which allows viewing and 3D interaction will also be integrated.