Abstract: The present invention provides a system and method for detecting edges of an object in a pre-crash sensing environment. The method includes extracting vertical edges from peaks in an array of column sums of absolute values of normalized horizontal derivates computed in the intensity image. The pixels with corresponding range image depths proximate the estimated object's closest surface contribute the column sums. The search is conducted for all likely combinations of left/right edge pairs preferably within a pre-determined horizontal range about the object's detected center. The left/right edge pairs that delimit a width within the pre-determined range of possible widths for the object are selected. Alternatively, an additional search is performed on each pair of edges to support any angular or inward slant on the edges of the object.

Abstract: A system and method for fusing depth and radar data to estimate at least a position of a threat object relative to a host object is disclosed. At least one contour is fitted to a plurality of contour points corresponding to the plurality of depth values corresponding to a threat object. A depth closest point is identified on the at least one contour relative to the host object. A radar target is selected based on information associated with the depth closest point on the at least one contour. The at least one contour is fused with radar data associated with the selected radar target based on the depth closest point to produce a fused contour. Advantageously, the position of the threat object relative to the host object is estimated based on the fused contour. More generally, a method is provided for aligns two possibly disparate sets of 3D points.

Abstract: A method of quickly and robustly localizing a pair of concentric circular region boundaries in a digital image, such as the pupil and iris boundaries in an image of a human eye is disclosed. Specularities in the image are optionally filled. An object containing concentric regions, e.g., a pupil and iris, is found within the image.

Abstract: The present invention provides a collision avoidance apparatus and method employing stereo vision applications for adaptive vehicular control. The stereo vision applications are comprised of a road detection function and a vehicle detection and tracking function. The road detection function makes use of three-dimensional point data, computed from stereo image data, to locate the road surface ahead of a host vehicle. Information gathered by the road detection function is used to guide the vehicle detection and tracking function, which provides lead motion data to a vehicular control system of the collision avoidance apparatus. Similar to the road detection function, stereo image data is used by the vehicle detection and tracking function to determine the depth of image scene features, thereby providing a robust means for identifying potential lead vehicles in a headway direction of the host vehicle.

Abstract: A method and apparatus for producing a fused image is described. In one embodiment, a first image at a first wavelength and a second image at a second wavelength are generated. Next, range information is generated and subsequently used to warp the first image in a manner that correlates to the second image. In turn, the warped first image is fused with the second image to produce the fused image.

Abstract: A method and apparatus for classifying an object in an image is disclosed. A plurality of sub-classifiers is provided. An object is classified using input from each of the plurality of sub-classifiers.

Abstract: The present invention provides a system and method for detecting edges of an object in a pre-crash sensing environment. The method includes extracting vertical edges from peaks in an array of column sums of absolute values of normalized horizontal derivates computed in the intensity image. The pixels with corresponding range image depths proximate the estimated object's closest surface contribute the column sums. The search is conducted for all likely combinations of left/right edge pairs preferably within a pre-determined horizontal range about the object's detected center. The left/right edge pairs that delimit a width within the pre-determined range of possible widths for the object are selected. Alternatively, an additional search is performed on each pair of edges to support any angular or inward slant on the edges of the object.

Abstract: A vision system that forms a map of a scene proximate a platform, e.g., a vehicle, that determines the actual ground plane form the map, and that corrects the map for differences between the actual ground plane and an assumed ground plane. The vision system may remove the actual ground plane from the map to prevent false positives. The vision system can further identify and classify objects and, if appropriate, take evasive action.

Abstract: A method and apparatus for generating stereo imagery scenario data to be used to test stereo vision methods such as detection, tracking, classification, steering, collision detection and avoidance methods is provided.

Abstract: A method and apparatus for classifying an object in an image is disclosed. A depth image is provided. At least one area of the depth image unsatisfactory for object identification are identified. A plurality of two-dimensional projections of surface normals in the depth image is determined without considering the unsatisfactory at least one area. One or more objects are classified based on the plurality of two-dimensional projections of surface normals.

Abstract: A method and apparatus for classifying an object in an image is disclosed. Edges of an object are detected within a region of interest. Edge analysis is performed on a plurality of sub-regions within the region of interest to generate an edge score. The object is classified based on the edge score.

Abstract: A method and apparatus for detecting a target in an image is disclosed. A plurality of depth images is provided. A plurality of target templates is compared to at least one of the plurality of depth images. A scores image is generated based on the plurality of target templates and the at least one depth image.

Abstract: A method and apparatus for performing collision detection is described. An object is detected within a first operational range of an object tracker. A classification of the object is determined using the object tracker. The object tracker tracks the object. The object is detected within a second operational range of a collision detector. A safety measure is activated based on the classification using the collision detector.

Abstract: A method and apparatus for classifying an object in an image is disclosed. Edge energy information and/or intensity variation information is generated for an object in a region of interest of the image. The object occupying the region of interest is classified based on the edge energy information and/or intensity variation information.

Abstract: A vehicle vision system that uses a depth map, image intensity data, and system calibration parameter to determine a target's dimensions and relative position. Initial target boundary information is projected onto the depth map and onto the image intensity. A visibility analysis determines whether the rear of a target is within the system's field of view. If so, the mapped image boundary is analyzed to determine an upper boundary of the target. Then, vertical image edges of the mapped image boundary are found by searching for a strongest pair of vertical image edges that are located at about the same depth. Then, the bottom of the mapped image boundary is found (or assumed from calibration parameters). Then, the target's position is found by an averaging technique. The height and width of the target are then computed.

Abstract: A method of quickly and robustly localizing a pair of concentric circular region boundaries in a digital image, such as the pupil and iris boundaries in an image of a human eye is disclosed. Specularities in the image are optionally filled. An object containing concentric regions, e.g., a pupil and iris, is found within the image.

Abstract: In a method of integrating one or more l-dimensional filters into a digital image stream interface a single digital video input is processed by multiple 1-dimensional digital image filters, especially recursive filters, and combined into a single digital image stream which can be transmitted via a high-speed interface to a host computer's memory such that each 1-dimensional filter output can be automatically extracted and placed into its own separate memory buffer for subsequent processing by a secondary image processing device. This additional processing can include the second pass of a two-pass separable filter implemented in software on a general-purpose CPU, and in particular can result in the generation of an image pyramid. This combined hardware and software approach can produce low-cost 2-D digital image filter implementations small enough to be added to existing standard ASIC's while still retaining high performance.

Abstract: In a method for correlating two stereo images, the images are subjected to a Laplacian operator and further processed to produce reduced gray scale Laplacian images in which the pixels have a value of +1, 0 or −1. Then the two images are overlapped to produce pairs of overlapping pixels. The values of the two overlapping pixels are summed in a manner so that if both pixels are +1 or both pixels are −1 the summed value is +1, if one pixel is +1 and the other pixel is −1, the resulting sum is −1 and if one or both pixel are zero, the resulting sum is zero. All of the sums or correlation values in regions about each pixel in the two overlapping images are added together to get a new correlation value for each pixel in the overlap resulting in a correlation image. Then, the two Laplacian images are shifted relative to one another and correlation values are again computed for this new overlap.

Abstract: A reliable method and apparatus for illuminating and imaging eyes uses multiple light sources producing multiple images of a subject each created under illumination by different illuminators. A composite image of the subject is formed by selecting pixels based upon their gray scale values or using pyramid image processing. A composite image can be created which is free of bright spots commonly caused by reflection of illumination from eyeglasses that may be worn by a subject or for which is free of dark shadows or which is free of both bright spots and dark shadows.

Abstract: In a method of image subtraction a series of frames of a subject are taken using a video camera The subject is illuminated in a manner so that illumination is alternately on then off for successive fields within the image frame. A single frame is grabbed and an absolute difference between the odd field and the even field within that single image frame is determined. The resulting absolute difference image will represent the subject as illuminated by the system illumination only, and not by any ambient illumination, and can then be used to identify the subject in the image.