Abstract: A method for determining a wear or loss condition of a ground engaging tool (GET). The method includes receiving imaging data and environmental data from a plurality of sensors, the plurality of sensors includes a plurality of imaging sensors of different modalities. The method also includes determining network selection weights for each of a plurality of deep learning networks based on the imaging data or environmental data, wherein each of the plurality of deep learning networks utilizes a different respective combination of one or more of the plurality of imaging sensors as inputs. The method further includes determining at least one physical dimension of at least one portion of the GET using one or more of the plurality of deep learning networks based on the network selection weights. The wear or loss condition of the GET is determined based on the at least one physical dimension.

Abstract: A controller-implemented method for automated control of at least one of an autonomous or semiautonomous machine to clear at least one windrow along a work surface. The method includes utilizing a visual perception sensor to detect said windrow, generating a plurality of windrow visual detection signals, determining a position of a windrow relative to the machine based upon the plurality of windrow visual detection signals, and generating machine control commands to clear the windrow.

Abstract: A method for monitoring and confirming damaged or missing ground-engaging tools at a worksite includes receiving an alert associated with a damaged or missing ground-engaging tool of an earthmoving machine, receiving a confirmation for the damaged or missing tool, and generating a containment area representing one or more locations where at least part of the ground-engaging tool is potentially located. The method also includes determining that an additional machine was present in the containment area and taking an action for the additional machine based on the presence of the machine in the containment area, the action including generating a notification or controlling an action of the additional machine.

Abstract: The present disclosure is directed to systems and methods for operating a machine. The method includes (1) receiving image data of a component of the machine by a camera module of the machine, the camera module having multiple camera components; (2) detecting an incident associated with the camera module; (3) in response to the incident, instructing the camera module to collect image data from a subset of the multiple camera components; and (4) generating a status image of the component based on the collected image data from the subset of the multiple camera components.

Abstract: A controller-implemented method for automated control of at least one of an autonomous or semiautonomous machine to clear at least one windrow along a work surface. The method includes utilizing a visual perception sensor to detect said windrow, generating a plurality of windrow visual detection signals, determining a position of a windrow relative to the machine based upon the plurality of windrow visual detection signals, and generating machine control commands to clear the windrow.