Abstract: An enhanced visibility system for a work machine includes an image capture device, a sensor, one or more control circuits, and a display. The image capture device is configured to obtain image data of an area surrounding the work machine. The sensor is configured to obtain data regarding physical properties of the area surrounding the work machine. The control circuits are configured to receive the image data and the data regarding the physical properties, and augment the image data with the data regarding the physical properties to generate augmented image data. The display is configured to display the augmented image data to provide an enhanced view of the area surrounding the work machine.

Abstract: A system and a method for detecting a pile of material by an autonomous machine. A 3D point cloud method includes obtaining a 3D point cloud indicative of an environment having a material pile, performing a ground surface estimation on the point cloud to identify non-ground points, grouping the non-ground points into clusters based on a proximity metric, creating a normalized height histogram for each of the clusters, comparing the normalized height histogram of each cluster to a generalized pile histogram, and identifying a cluster as a pile based on the similarity between the normalized height histogram and the generalized pile histogram. A 2D image method includes obtaining a 2D image from an imaging device, calibrating the imaging device with respect to a coordinate frame of the machine, and autonomously detecting an image of a material pile in the two-dimensional image using a trained deep-learning neural network.

Abstract: An intelligent three dimensional scanner system mountable on a movable machine, including three dimensional scanner, a camera, and control circuitry. The control circuitry is configured to receive three dimensional point data from the three dimensional scanner, receive two dimensional image data from the camera, input the two dimensional image data to a machine learning model, which identifies objects in the two dimensional image data, fuse the three dimensional point data with the identified objects in the two dimensional image data in order to identify the objects in the three dimensional point data, and control a scan pattern to direct scanning resolution of the three dimensional scanner based on the identified objects.

Abstract: A wear detection system can be configured to capture a video stream from a camera associated with a work machine. The video stream includes a plurality of images associated with a bucket with a plurality of teeth of the work machine. The system can also be configured to segment the plurality of images using a bucket-tool template including a template image of the bucket having a plurality of unworn tools and select an image for wear detection based on the segmenting. The system is also configured to identify the plurality of teeth in the selected image based at least in part on locations of the plurality of unworn tools in the bucket-tool template. The system is also configured to determine a wear level for the plurality of teeth by comparing the plurality of teeth from the selected image with the plurality of unworn tools from the bucket-tool template.

Abstract: A wear detection system can be configured to receive a video stream including a plurality of images of a bucket of the work machine from a camera associated with the work machine. The bucket has one or more ground engaging tools (GET). The wear detection system can also be configured to identify a plurality of tool images from the video stream over a period of time. The plurality of tool images depict the GET at a plurality of instances over a period of time. The wear detection system can also be configured to determine a plurality of tool pixel counts from the plurality of tool image and determine a wear level for the GET based on the plurality of tool pixel counts.

Abstract: A system and a method for detecting a pile of material by an autonomous machine. A 3D point cloud method includes obtaining a 3D point cloud indicative of an environment having a material pile, performing a ground surface estimation on the point cloud to identify non-ground points, grouping the non-ground points into clusters based on a proximity metric, creating a normalized height histogram for each of the clusters, comparing the normalized height histogram of each cluster to a generalized pile histogram, and identifying a cluster as a pile based on the similarity between the normalized height histogram and the generalized pile histogram. A 2D image method includes obtaining a 2D image from an imaging device, calibrating the imaging device with respect to a coordinate frame of the machine, and autonomously detecting an image of a material pile in the two-dimensional image using a trained deep-learning neural network.

Abstract: An enhanced visibility system for a work machine includes an image capture device, a sensor, one or more control circuits, and a display. The image capture device is configured to obtain image data of an area surrounding the work machine. The sensor is configured to obtain data regarding physical properties of the area surrounding the work machine. The control circuits are configured to receive the image data and the data regarding the physical properties, and augment the image data with the data regarding the physical properties to generate augmented image data. The display is configured to display the augmented image data to provide an enhanced view of the area surrounding the work machine.