Abstract: Systems and methods are provided for navigating a host vehicle. A navigation system for the host vehicle may include at least one processor programmed to receive an image representative of an environment of a host vehicle; analyze the image to determine a predicted path of the host vehicle; determine, based on the image, an indicator of comfort associated with the predicted path; identify, based on the indicator of comfort, an alternative path of the host vehicle; and output a control signal configured to modify an operation of a component of the host vehicle to follow the alternative path of the host vehicle.

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A device for modeling an environment comprises: a hardware sensor interface to obtain a sequence of unrectified images representative of a road environment, the sequence of unrectified images including a first unrectified image, a previous unrectified image, and a previous-previous unrectified image; and processing circuitry to: provide the first unrectified image, the previous unrectified image, and the previous-previous unrectified image to an artificial neural network (ANN) to produce a three-dimensional structure of a scene; determine a selected homography; and apply the selected homography to the three-dimensional structure of the scene to create a model of the road environment.

Abstract: Systems and methods for navigating a host vehicle are disclosed. In one implementation, a system includes a processor configured to receive a first image acquired by a first camera and a second image acquired by a second camera onboard the host vehicle; identify a first representation of an object in the first image and a second representation of the object in the second image; input to a first trained model at least a portion of the first image; input to a second trained model at least a portion of the second image; receive the first signature encoding determined by the first trained model and the second signature encoding determined by the second trained model; input to a third trained model the first signature encoding and the second signature encoding; and receive an indicator of a location of the object determined by the third trained model.

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A time-ordered sequence of images representative of a road surface may be obtained. An image from this sequence is a current image. A data set may then be provided to an artificial neural network (ANN) to produce a three-dimensional structure of a scene. Here, the data set includes a portion of the sequence of images that includes the current image, motion of the sensor from which the images were obtained, and an epipole. The road surface is then modeled using the three-dimensional structure of the scene.

Abstract: Various systems and methods for modeling a scene. A device for modeling a scene includes a hardware interface to obtain a time-ordered sequence of images representative of a scene, the time-ordered sequence including a plurality of images, one of the sequence of images being a current image, the scene captured by a monocular imaging system; and processing circuitry to: provide a data set to an artificial neural network (ANN) to produce a three-dimensional structure of the scene, the data set including: a portion of the sequence of images, the portion of the sequence of images including the current image; and motion of a sensor that captured the sequence of images; and model the scene using the three-dimensional structure of the scene, wherein the three-dimensional structure is determined for both moving and fixed objects in the scene.

Abstract: A navigation system for a host vehicle may include a processor programmed to: receive from a center camera onboard the host vehicle a captured center image including a representation of at least a portion of an environment of the host vehicle, receive from a left surround camera onboard the host vehicle a captured left surround image including a representation of at least a portion of the environment of the host vehicle, and receive from a right surround camera onboard the host vehicle a captured right surround image including a representation of at least a portion of the environment of the host vehicle; provide the center image, the left surround image, and the right surround image to an analysis module configured to generate an output relative to the at least one captured center image; and cause a navigational action by the host vehicle based on the generated output.

Abstract: Systems and methods for navigating a host vehicle are disclosed. In one implementation, a system includes a processor configured to receive a first image acquired by a first camera and a second image acquired by a second camera onboard the host vehicle; identify a first representation of an object in the first image and a second representation of the object in the second image; input to a first trained model at least a portion of the first image; input to a second trained model at least a portion of the second image; receive the first signature encoding determined by the first trained model and the second signature encoding determined by the second trained model; input to a third trained model the first signature encoding and the second signature encoding; and receive an indicator of a location of the object determined by the third trained model.

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A device for modeling an environment comprises: a hardware sensor interface to obtain a sequence of unrectified images representative of a road environment, the sequence of unrectified images including a first unrectified image, a previous unrectified image, and a previous-previous unrectified image; and processing circuitry to: provide the first unrectified image, the previous unrectified image, and the previous-previous unrectified image to an artificial neural network (ANN) to produce a three-dimensional structure of a scene; determine a selected homography; and apply the selected homography to the three-dimensional structure of the scene to create a model of the road environment.

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A device for modeling an environment comprises: a hardware sensor interface to obtain a sequence of unrectified images representative of a road environment, the sequence of unrectified images including a first unrectified image, a previous unrectified image, and a previous-previous unrectified image; and processing circuitry to: provide the first unrectified image, the previous unrectified image, and the previous-previous unrectified image to an artificial neural network (ANN) to produce a three-dimensional structure of a scene; determine a selected homography; and apply the selected homography to the three-dimensional structure of the scene to create a model of the road environment.

Abstract: A navigation system for a host vehicle may include a processor programmed to: receive, from an entity remotely located relative to the host vehicle, a sparse map associated with at least one road segment to be traversed by the host vehicle; receive point cloud information from a LIDAR system onboard the host vehicle, the point cloud information being representative of distances to various objects in an environment of the host vehicle; compare the received point cloud information with at least one of the plurality of mapped navigational landmarks in the sparse map to provide a LIDAR-based localization of the host vehicle relative to at least one target trajectory; determine an navigational action for the host vehicle based on the LIDAR-based localization of the host vehicle relative to the at least one target trajectory; and cause the at least one navigational action to be taken by the host vehicle.

Abstract: A navigation system for a host vehicle may include a processor programmed to determine at least one indicator of ego motion of the host vehicle. A processor may be also programmed to receive, from a LIDAR system, a first point cloud including a first representation of at least a portion of an object and a second point cloud including a second representation of the at least a portion of the object. The processor may further be programmed to determine a velocity of the object based on the at least one indicator of ego motion of the host vehicle, and based on a comparison of the first point cloud, including the first representation of the at least a portion of the object, and the second point cloud, including the second representation of the at least a portion of the object.

Abstract: A navigation system for a host vehicle may include a processor programmed to: receive from a center camera onboard the host vehicle a captured center image including a representation of at least a portion of an environment of the host vehicle, receive from a left surround camera onboard the host vehicle a captured left surround image including a representation of at least a portion of the environment of the host vehicle, and receive from a right surround camera onboard the host vehicle a captured right surround image including a representation of at least a portion of the environment of the host vehicle; provide the center image, the left surround image, and the right surround image to an analysis module configured to generate an output relative to the at least one captured center image; and cause a navigational action by the host vehicle based on the generated output.

Abstract: A navigation system for a host vehicle may include a processor programmed to: receive from a camera onboard the host vehicle at least one captured image representative of an environment of the host vehicle, wherein the camera is positioned at a first location relative to the host vehicle; receive point cloud information from a LIDAR system onboard the host vehicle, wherein the LIDAR system is positioned at a second location relative to the host vehicle; analyze the at least one captured image and the received point cloud information to detect one or more objects in the shared field of view region; determine whether a vantage point difference between the first location of the camera and the second location of the LIDAR system accounts for the one or more detected objects being represented in only one of the at least one captured image or the received point cloud information.

Abstract: Techniques are disclosed for improving upon the usage of Light Detection and Ranging (LIDAR) supervision to perform image depth estimation. The techniques use a generator and adversary network to generate respective models that “compete” against one another to enable the generator model to output a desired output image that compensates for a LIDAR image having a structured or lined data pattern. The techniques described herein may be suitable for use by vehicles and/or other agents operating in a particular environment as part of machine vision algorithms that are implemented to perform autonomous and/or semi-autonomous functions.

Abstract: Various systems and methods for modeling a scene. A device for modeling a scene includes a hardware interface to obtain a time-ordered sequence of images representative of a scene, the time-ordered sequence including a plurality of images, one of the sequence of images being a current image, the scene captured by a monocular imaging system; and processing circuitry to: provide a data set to an artificial neural network (ANN) to produce a three-dimensional structure of the scene, the data set including: a portion of the sequence of images, the portion of the sequence of images including the current image; and motion of a sensor that captured the sequence of images; and model the scene using the three-dimensional structure of the scene, wherein the three-dimensional structure is determined for both moving and fixed objects in the scene.

Abstract: Systems and methods are provided for determining a road profile along a predicted path. In one implementation, a system includes at least one image capture device configured to acquire a plurality of images of an area in a vicinity of a user vehicle; a data interface; and at least one processing device configured to receive the plurality of images captured by the image capture device through the data interface; and compute a profile of a road along one or more predicted paths of the user vehicle. At least one of the one or more predicted paths is predicted based on image data.

Abstract: Systems and methods are provided for determining a road profile along a predicted path. In one implementation, a system includes at least one image capture device configured to acquire a plurality of images of an area in a vicinity of a user vehicle; a data interface; and at least one processing device configured to receive the plurality of images captured by the image capture device through the data interface; and compute a profile of a road along one or more predicted paths of the user vehicle. At least one of the one or more predicted paths is predicted based on image data.

Abstract: System and techniques for vehicle environment modeling with a camera are described herein. A time-ordered sequence of images representative of a road surface may be obtained. An image from this sequence is a current image. A data set may then be provided to an artificial neural network (ANN) to produce a three-dimensional structure of a scene. Here, the data set includes a portion of the sequence of images that includes the current image, motion of the sensor from which the images were obtained, and an epipole. The road surface is then modeled using the three-dimensional structure of the scene.

Abstract: In some embodiments, a first homography, created from two images of a roadway, is decomposed to determine an ego-motion, and the ego-motion is used to adjust a previous estimate of a road plane. The adjusted previous estimate of the road plane is combined with the current estimate of the plane to create a second homography, and the second homography is used to determine residual motion and vertical deviation in the surface of the roadway. In some embodiments, multiple road profiles each corresponding to a common portion of a roadway are adjusted in slope and offset by optimizing a function having a data term, a smoothness term and a regularization term; and the adjusted road profiles are combined into a multi-frame road profile. In some embodiments, road profile information for a predetermined number of data points is transmitted in periodic data bursts, with more than one data point per data burst.

Abstract: In some embodiments, a first homography, created from two images of a roadway, is decomposed to determine an ego-motion, and the ego-motion is used to adjust a previous estimate of a road plane. The adjusted previous estimate of the road plane is combined with the current estimate of the plane to create a second homography, and the second homography is used to determine residual motion and vertical deviation in the surface of the roadway. In some embodiments, multiple road profiles each corresponding to a common portion of a roadway are adjusted in slope and offset by optimizing a function having a data term, a smoothness term and a regularization term; and the adjusted road profiles are combined into a multi-frame road profile. In some embodiments, road profile information for a predetermined number of data points is transmitted in periodic data bursts, with more than one data point per data burst.