Abstract: A method of classifying a work machine within a worksite is provided. The method may include receiving one or more captured images of the work machine from one or more image capture devices, identifying at least two classifiers within the captured images of the work machine, determining spatial relationships between the classifiers within the captured images, determining a classification and a pose of the work machine based on the spatial relationships, and displaying analytics based on the classification and the pose of the work machine.

Abstract: A method of classifying a work machine within a worksite is provided. The method may include receiving one or more captured images of the work machine from one or more image capture devices, identifying at least two classifiers within the captured images of the work machine, determining spatial relationships between the classifiers within the captured images, determining a classification and a pose of the work machine based on the spatial relationships, and displaying analytics based on the classification and the pose of the work machine.

Abstract: An image processing system is disclosed for an articulated machine. The system includes a plurality of cameras mounted on the machine for capturing images, and a machine state sensor for obtaining machine state data of machine. The system also includes a processor connected to the plurality of cameras and the machine state sensor, the processor being configured to establish camera extrinsic models for the plurality of cameras based on positions and orientations of the cameras, obtain the machine state data from the machine state sensor, establish a machine geometric model based on the machine state data, and establish image mapping rules for the plurality of cameras based on the machine geometric model and the camera extrinsic models. The processor is further configured to generate a unified image from the images captured by the plurality of cameras based on the image mapping rules, and render the unified image on a display.

Abstract: An imaging system is disclosed for use with a mobile machine. The imaging system may have at least one onboard camera configured to generate image data for an actual environment of the mobile machine, and an onboard sensor configured to generate object data regarding detection and ranging of an object in the actual environment. The imaging system may also have a display mounted on the machine, and a processor in communication with the at least one camera, the sensor, and the display. The processor may be configured to generate a virtual geometry, and generate a virtual object within the virtual geometry based on the object data. The processor may further be configured to generate a unified image of the actual environment based on the image data, to map a projection of the unified image onto the virtual geometry and the virtual object, and to render a selected portion of the projection on the display.

Abstract: An image processing system has a plurality of cameras and a display that are mounted on a machine. The plurality of cameras are configured to generate image data for an environment of the machine. The image processing system also has a processor connected to the plurality of cameras and the display. The processor is configured to access the image data from the plurality of cameras, access parameters associated with the plurality of cameras, generate a unified image by combining the image data from the plurality of cameras based at least in part on the parameters, access state data associated with the machine, select a portion of the unified image based at least in part on the state data, and render the portion of the unified image on the display.

Abstract: A personnel classification and response system, and related method and computer program product are disclosed. The system may comprise an image capture member and a controller connected to the image capture member. Some embodiments may also comprise a ranging apparatus. The ranging apparatus may be configured to provide a distance from a person to a vehicle. The image capture member may be configured to provide an image of the vicinity of the vehicle, the image including the person. The controller may be configured to identify in the image a marker and to activate a warning apparatus based on the marker and a zone in which the marker is disposed.

Abstract: A object recognition system has a camera configured to generate image data of an environment of a machine and a radar device configured to generate radar data of the environment of the machine. The object recognition system also has a processor configured to detect an object in the environment based on the radar data, map the radar data to a portion of the image data corresponding to the detected object, and classify the detected object using the mapped portion of the image data.

Abstract: A system for determining a coverage region of a radar device is disclosed. The system may have one or more processors and a memory. The memory may store instructions that, when executed, enable the one or more processors to receive radar data generated by a radar device and lidar data generated by a lidar device. The radar data may include radar data points representing objects detected by the radar device and the lidar data may include lidar data points representing objects detected by the lidar device. The one or more processors may be further enabled to determine a radar coverage region for the radar device by comparing one or more radar data points to one or more lidar data points, and to generate data used to display a graphical representation of the radar coverage region.

Abstract: A object recognition system has a camera configured to generate image data of an environment of a machine and a radar device configured to generate radar data of the environment of the machine. The object recognition system also has a processor configured to detect an object in the environment based on the radar data, map the radar data to a portion of the image data corresponding to the detected object, and classify the detected object using the mapped portion of the image data.

Abstract: An image processing system has a plurality of cameras and a display that are mounted on a machine. The plurality of cameras are configured to generate image data for an environment of the machine. The image processing system also has a processor connected to the plurality of cameras and the display. The processor is configured to access the image data from the plurality of cameras, access parameters associated with the plurality of cameras, generate a unified image by combining the image data from the plurality of cameras based at least in part on the parameters, access state data associated with the machine, select a portion of the unified image based at least in part on the state data, and render the portion of the unified image on the display.

Abstract: A object recognition system has a camera configured to generate source image data and a processor configured to access the source image data from the camera. The processor is also configured to accesses state data of the camera and generate transformed image data from the source image data based at least in part on the state data. The processor is also configured to detect an object in the transformed image data and to classify the detected object using the transformed image data.

Abstract: A personnel classification and response system, and related method and computer program product are disclosed. The system may comprise an image capture member and a controller connected to the image capture member. Some embodiments may also comprise a ranging apparatus. The ranging apparatus may be configured to provide a distance from a person to a vehicle. The image capture member may be configured to provide an image of the vicinity of the vehicle, the image including the person. The controller may be configured to identify in the image a marker and to activate a warning apparatus based on the marker and a zone in which the marker is disposed.

Abstract: A system for determining a coverage region of a radar device is disclosed. The system may have one or more processors and a memory. The memory may store instructions that, when executed, enable the one or more processors to receive radar data generated by a radar device and lidar data generated by a lidar device. The radar data may include radar data points representing objects detected by the radar device and the lidar data may include lidar data points representing objects detected by the lidar device. The one or more processors may be further enabled to determine a radar coverage region for the radar device by comparing one or more radar data points to one or more lidar data points, and to generate data used to display a graphical representation of the radar coverage region.

Abstract: In one embodiment, a method for evaluating calibration data collected by a range sensor of a mobile machine on a site includes collecting a calibration data set using the range sensor. The calibration data set includes information indicating the locations of a plurality of points on a surface of the site relative to the range sensor. The method further includes determining an expected error score of the calibration data set. Finally, the method includes determining whether to use the calibration data set to calibrate the range sensor based on the expected error score.

Abstract: An automated lost load response system for work machines is disclosed. The response system has a container supported by the machine to retain material. It also has a sensor situated to detect material lost from the container. The sensor generates a signal corresponding to detection of material lost. Additionally, the response system has a controller that is in communication with the sensor. The controller is configured to provide a load loss warning based on the signal generated by the sensor.

Abstract: An automated lost load response system for work machines is disclosed. The response system has a first sensor situated to detect the contour of the road surface forward of a first machine, and a second sensor situated to detect the contour of the road surface rearward of the first machine. Each of the first and second sensors generates a signal corresponding to its detection of the contour of the road surface. The response system also has a controller that is in communication with both sensors. The controller is configured to provide a load loss warning based on the signals.

Abstract: An automated lost load response system for work machines is disclosed. The response system has a first sensor situated to detect the contour of the road surface forward of a first machine, and a second sensor situated to detect the contour of the road surface rearward of the first machine. Each of the first and second sensors generates a signal corresponding to its detection of the contour of the road surface. The response system also has a controller that is in communication with both sensors. The controller is configured to provide a load loss warning based on the signals.

Abstract: An automated lost load response system for work machines is disclosed. The response system has a container supported by the machine to retain material. It also has a sensor situated to detect material lost from the container. The sensor generates a signal corresponding to detection of material lost. Additionally, the response system has a controller that is in communication with the sensor. The controller is configured to provide a load loss warning based on the signal generated by the sensor.