Abstract: A method of detecting and tracking objects includes (a) obtaining point-cloud data captured by camera sensors on a vehicle travelling along a road surface, (b) compressing the point-cloud data to bird's-eye-view (BEV) data representing a view along a BEV direction oriented approximately perpendicular to the road surface, the BEV data representing the objects on a BEV plane oriented approximately parallel the road surface, (c) establishing a grid of cells for the BEV plane, (d) for each cell, determining occupancy values of the cell for a time tn and performing noise reduction by assigning weights to the cell based on predicted occupancy values of the cell for the time tn and on occupancy values of the cell for a previous time tn?1, and (e) outputting to a controller of the vehicle, in real time or nearly real time, an occupancy evidence map of objects in the vehicle's environment.

Abstract: A system and a method are provided for repairing a depth map. The repairing includes representing pixels of the depth map using a matrix H having values corresponding to depths, the pixels including hole pixels and non-hole pixels; determining a confidence mask matrix C for the depth map; for each hole pixel, determining a kernel G of neighboring pixels, the neighboring pixels having values corresponding to a predetermined distribution, and convolving the kernel G with corresponding portions of the matrix C and the matrix H to obtain an estimated depth; generating a corrected matrix ? in which values for non-hole pixels are retained and in which the hole pixels have values corresponding to their estimated depths. The estimated depths may be normalized based on the matrix C. An updated depth map based on the corrected matrix ? may be outputted to a control system of a vehicle.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: An automatically calibrated vision system includes: a vision calibration system; a first sensor system that receives first data of a scene captured by a first sensor on a movable machine and outputs a first map based on the first data; a second sensor system that receives second data of the scene captured by a second sensor on the movable machine and outputs a second map based on the second data. The vision calibration system computes calibration data based on the first and second maps, supplies the calibration data to the first sensor system and/or the second sensor system for automatic calibration of the first sensor system and/or the second sensor system, and outputs, to a controller of the movable machine, a calibrated depth map comprised of depth measurements calibrated using the calibration data. The first sensor system and/or the second sensor system automatically perform(s) a self-calibration using the calibration data.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: An automatically calibrated vision system includes: a vision calibration system; a first sensor system that receives first data of a scene captured by a first sensor on a movable machine and outputs a first map based on the first data; a second sensor system that receives second data of the scene captured by a second sensor on the movable machine and outputs a second map based on the second data. The vision calibration system computes calibration data based on the first and second maps, supplies the calibration data to the first sensor system and/or the second sensor system for automatic calibration of the first sensor system and/or the second sensor system, and outputs, to a controller of the movable machine, a calibrated depth map comprised of depth measurements calibrated using the calibration data. The first sensor system and/or the second sensor system automatically perform(s) a self-calibration using the calibration data.

Abstract: In one aspect, a vehicle is provided that includes i) a plurality of wheel-leg components and ii) a surround view imaging system for generating a surround view image of the vehicle. The plurality of wheel-leg components can operate to provide locomotion to the vehicle. The surround view image comprising a 360-degree, three-dimensional view of an environment surrounding the vehicle. The vehicle is configured to operate autonomously using the surround image view to control the locomotion of the plurality of the wheel-leg components.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

Abstract: A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.