Abstract: A method for autonomously parking a vehicle-trailer system is provided. The method includes receiving sensor system data from a sensor system supported by the vehicle. The sensor system data includes images of surroundings along a driving path of the vehicle-trailer system. The method includes determining a local map based on the sensor system data. The local map includes surroundings along the driving path. The method includes receiving a user selection of an image location within the images. The image location representing a position in the local map associated with a selected location within the surroundings. The method includes determining a parking path from a current location of the vehicle-trailer system to the position based on the local map and instructing a drive system to execute an autonomous parking behavior causing the vehicle-trailer system to autonomously drive along the parking path and autonomously park in the selected location.

Abstract: A localization and mapping system and method for a motor vehicle is disclosed and includes at least one camera configured to obtain images of an environment surrounding the motor vehicle, at least one sensor configured to obtain location information for objects surrounding the motor vehicle and a controller configured to receive the images captured by the at least one camera and the location information obtained by the at least one sensor. The controller enhances the captured images utilizing a neural network and combines the enhanced images with the location information to localize the vehicle within the mapped environment.

Abstract: An automated vehicle parking system for a motor vehicle is disclosed and includes at least one camera obtaining images proximate a vehicle, at least one sensor array detecting objects proximate the vehicle, and a controller configured to generate a mask of an area proximate the vehicle from the images obtained by the at least one camera including labeled features identified within the obtained images and project the generated mask onto an occupancy grid generated with information from the at least one sensor array, wherein the controller is configured to locate a parking space responsive to open spaces defined within the generated mask.

Abstract: A method for autonomously maneuvering a vehicle in a rearward direction towards a point of interest is provided. The method includes receiving one or more images from a camera positioned on a back portion of the vehicle. The method includes overlaying a path on the one or more images. In addition, the method includes receiving a command by way of a user interface. The command includes instructions to adjust the path. The method includes adjusting the path based on the received command. The method also includes transmitting a drive command to a drive system supported by the vehicle. The drive command causes the vehicle to autonomously maneuver along the adjusted path in a rearward direction.

Abstract: A method for determining a distance between a camera positioned on a rear portion of a tow vehicle and a trailer coupler supported by a trailer positioned behind the tow vehicle as the tow vehicle approaches the trailer. The method includes identifying the trailer coupler of the trailer within one or more images of a rearward environment of the tow vehicle. The method also includes receiving sensor data from an inertial measurement unit supported by the tow vehicle. The method includes determining a pixel-wise intensity difference between a current received image from the one or more images and a previously received image from the one or more images. The method includes determining the distance based on the identified trailer coupler, the sensor data, and the pixel-wise intensity difference, the distance includes a longitudinal distance, a lateral distance, and a vertical distance.

Abstract: A method includes receiving one or more images from a camera positioned on a back portion of the vehicle and receiving a driver planned path from a user interface. The driver planned path includes a plurality of waypoints. The method also includes transmitting one or more commands to a drive system causing the vehicle to autonomously maneuver along the driver planned path. The method also includes determining a current vehicle position and an estimated subsequent vehicle position. The method also includes determining a path adjustment from the current vehicle position to the estimated subsequent vehicle position. The method also includes transmitting instructions to the drive system causing the vehicle to autonomously maneuver towards the estimated subsequent vehicle position based on the path adjustment.

Abstract: A localization and mapping system and method for a motor vehicle is disclosed and includes at least one camera configured to obtain images of an environment surrounding the motor vehicle, at least one sensor configured to obtain location information for objects surrounding the motor vehicle and a controller configured to receive the images captured by the at least one camera and the location information obtained by the at least one sensor. The controller enhances the captured images utilizing a neural network and combines the enhanced images with the location information to localize the vehicle within the mapped environment.

Abstract: A method of visual-inertial odometry for a ground vehicle is disclosed and includes obtaining an initial set of images with a camera on-board a vehicle, identifying features within the initial set of images, determining a three-dimensional pose using the visual features in the initial set of images, obtaining information indicative of vehicle movement with an inertial measurement unit, obtaining information indicative of vehicle movement with wheel speed sensors and a steering wheel angle sensor, fusing the identified features within the images, the vehicle movement from the IMU, and vehicle sensors within a two-dimensional plane, and determining a vehicle position relative to an initial start location based on the visual features in the images and the vehicle movement information from the IMU, wheel speed sensors, and the steering wheel angle.

Abstract: An automated vehicle parking system for a motor vehicle is disclosed and includes at least one camera obtaining images proximate a vehicle, at least one sensor array detecting objects proximate the vehicle, and a controller configured to generate a mask of an area proximate the vehicle from the images obtained by the at least one camera including labeled features identified within the obtained images and project the generated mask onto an occupancy grid generated with information from the at least one sensor array, wherein the controller is configured to locate a parking space responsive to open spaces defined within the generated mask.

Abstract: A method for autonomously parking a vehicle-trailer system is provided. The method includes receiving sensor system data from a sensor system supported by the vehicle. The sensor system data includes images of surroundings along a driving path of the vehicle-trailer system. The method includes determining a local map based on the sensor system data. The local map includes surroundings along the driving path. The method includes receiving a user selection of an image location within the images. The image location representing a position in the local map associated with a selected location within the surroundings. The method includes determining a parking path from a current location of the vehicle-trailer system to the position based on the local map and instructing a drive system to execute an autonomous parking behavior causing the vehicle-trailer system to autonomously drive along the parking path and autonomously park in the selected location.

Abstract: A method for tracking a trailer coupler positioned behind a tow vehicle is provided. The method includes receiving one or more images from a camera positioned on a back portion of the tow vehicle. The method also includes determining a trailer coupler position within the one or more images. The trailer coupler position associated with the trailer coupler. Additionally, the method includes receiving vehicle sensor data from one or more vehicle sensors. The method includes determining vehicle motion data based on the received vehicle sensor data. The method also includes determining an updated coupler position based on the trailer coupler position and the vehicle motion data.

Abstract: A method of autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle is provided. The method includes receiving one or more images from a camera positioned on a back portion of the tow vehicle. The method also includes receiving, at the data processing hardware, a first user selection of a trailer representation within the one or more images. The method includes sending first instructions to a drive system causing the tow vehicle to autonomously maneuver towards the trailer associated with the first user selection of the trailer representation. The method also includes receiving a second user selection of a coupler representation within the one or more images. The coupler representation associated with a trailer coupler of the trailer. The method also includes sending second instructions to the drive system causing the tow vehicle to autonomously maneuver towards the trailer coupler associated with the second user selection.

Abstract: A system for locating a coupler of a trailer includes at least one camera positioned on a rear portion of a tow vehicle. A coupler detector module is constructed and arranged 1) to receive images of the coupler from the at least one camera and 2) to determining a two-dimensional (2D) pixel position of the coupler. A camera motion estimator module is constructed and arranged 1) to receive images from the at least one camera and data regarding motion of the tow vehicle and 2) determine a pose of the camera including a three-dimensional (3D) position and heading of the at least one camera. A coupler estimator module is constructed and arranged 1) to receive the pose of the camera and the 2D pixel position of the coupler and based thereon, 2) to determine an estimated 3D position of the coupler in real world coordinates.

Abstract: A method of calibrating a driver assistance system comprises entering a calibration mode for a driver assistance system, determining a first estimated position and heading of the vehicle at a first location, capturing an image from a camera and selecting at least one feature in the image. The method of calibrating also includes moving the vehicle to a second location and heading and determining a second estimated position and heading of the vehicle, capturing a second image from a camera and selecting at least one feature in the second image, where the selected feature in the second image the same feature as the selected feature in the first image. The method also includes calculating new vehicle motion parameter values based on the first estimated position and heading, second estimated position and heading, first recorded at least one feature data, and second recorded at least one feature data.

Abstract: A method for autonomously driving a vehicle in a rearward direction towards a point of interest is provided. The method includes receiving one or more images from a camera positioned on a back portion of the vehicle and receiving a driver planned path from a user interface. The driver planned path includes a plurality of waypoints. The method also includes transmitting one or more commands to a drive system causing the vehicle to autonomously maneuver along the driver planned path. The method also includes determining a current vehicle position and an estimated subsequent vehicle position. The method also includes determining a path adjustment from the current vehicle position to the estimated subsequent vehicle position. The method also includes transmitting instructions to the drive system causing the vehicle to autonomously maneuver towards the estimated subsequent vehicle position based on the path adjustment.

Abstract: A method of autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle is provided. The method includes receiving one or more images from a camera positioned on a back portion of the tow vehicle. The method also includes receiving, at the data processing hardware, a first user selection of a trailer representation within the one or more images. The method includes sending first instructions to a drive system causing the tow vehicle to autonomously maneuver towards the trailer associated with the first user selection of the trailer representation. The method also includes receiving a second user selection of a coupler representation within the one or more images. The coupler representation associated with a trailer coupler of the trailer. The method also includes sending second instructions to the drive system causing the tow vehicle to autonomously maneuver towards the trailer coupler associated with the second user selection.

Abstract: A method of calibrating a driver assistance system comprises entering a calibration mode for a driver assistance system, determining a first estimated position and heading of the vehicle at a first location, capturing an image from a camera and selecting at least one feature in the image. The method of calibrating also includes moving the vehicle to a second location and heading and determining a second estimated position and heading of the vehicle, capturing a second image from a camera and selecting at least one feature in the second image, where the selected feature in the second image the same feature as the selected feature in the first image. The method also includes calculating new vehicle motion parameter values based on the first estimated position and heading, second estimated position and heading, first recorded at least one feature data, and second recorded at least one feature data.

Abstract: A method for tracking a trailer coupler positioned behind a tow vehicle is provided. The method includes receiving one or more images from a camera positioned on a back portion of the tow vehicle. The method also includes determining a trailer coupler position within the one or more images. The trailer coupler position associated with the trailer coupler. Additionally, the method includes receiving vehicle sensor data from one or more vehicle sensors. The method includes determining vehicle motion data based on the received vehicle sensor data. The method also includes determining an updated coupler position based on the trailer coupler position and the vehicle motion data.

Abstract: A method for autonomously maneuvering a vehicle in a rearward direction towards a point of interest is provided. The method includes receiving one or more images from a camera positioned on a back portion of the vehicle. The method includes overlaying a path on the one or more images. In addition, the method includes receiving a command by way of a user interface. The command includes instructions to adjust the path. The method includes adjusting the path based on the received command. The method also includes transmitting a drive command to a drive system supported by the vehicle. The drive command causes the vehicle to autonomously maneuver along the adjusted path in a rearward direction.

Abstract: A method for determining a distance between a camera positioned on a rear portion of a tow vehicle and a trailer coupler supported by a trailer positioned behind the tow vehicle as the tow vehicle approaches the trailer. The method includes identifying the trailer coupler of the trailer within one or more images of a rearward environment of the tow vehicle. The method also includes receiving sensor data from an inertial measurement unit supported by the tow vehicle. The method includes determining a pixel-wise intensity difference between a current received image from the one or more images and a previously received image from the one or more images. The method includes determining the distance based on the identified trailer coupler, the sensor data, and the pixel-wise intensity difference, the distance includes a longitudinal distance, a lateral distance, and a vertical distance.