Accession Number:

ADA513644

Title:

Geo-Referenced Dynamic Pushbroom Stereo Mosaics for 3D and Moving Target Extraction - A New Geometric Approach

Descriptive Note:

Final rept. 7 Mar 2005-6 Sep 2009

Corporate Author:

CITY COLL NEW YORK DEPT OF COMPUTER SCIENCE

Personal Author(s):

Report Date:

2009-12-01

Pagination or Media Count:

58.0

Abstract:

We propose a content-based 3D mosaic CB3M representation for long video sequences of 3D and dynamic urban scenes captured by a camera on a mobile platform. In the first phase, a set of parallel-perspective pushbroom mosaics with varying viewing directions is generated to capture both the 3D and dynamic aspects of the scene under the camera coverage. In the second phase, a segmentation-based stereo matching algorithm is applied to extract parametric representations of the color, structure and motion of the dynamic andor 3D objects in urban scenes, where a lot of planar surfaces exist. Multiple pairs of stereo mosaics are used for facilitating reliable stereo matching, occlusion handling, accurate 3D reconstruction and robust moving target detection. We use the fact that all the static objects obey the epipolar geometry of pushbroom stereo, whereas an independent moving object either violates the epipolar geometry if the motion is not in the direction of sensor motion or exhibits unusual 3D structures otherwise. The CB3M is a highly compressed visual representation for a dynamic 3D scene, and has object contents of both 3D and motion information. Experimental results are given for both simulated and several different real video sequences of large-scale 3D scenes to show the accuracy and effectiveness of the representation. Applications include airborne or ground video surveillance, 3D urban scene construction, traffic survey and transportation planning. We also discuss the extension of the method to other kind of camera motion.

Subject Categories:

  • Computer Programming and Software
  • Photography
  • Optical Detection and Detectors
  • Miscellaneous Detection and Detectors
  • Cartography and Aerial Photography

Distribution Statement:

APPROVED FOR PUBLIC RELEASE