Abstract: The present disclosure is directed to systems and methods for estimating machine rotation state. The rotation state can include the rotation speed and/or angle as the machine rotates. In some implementations, an estimating machine rotation state system can receive image data, timestamped consecutively, from camera devices of a machine. The estimating machine rotation state system can generate optical flow vectors for the pixels of the image data and determine the hue and intensity of the pixels based on the optical flow vectors. Using the hues, intensities, and timestamps of the image data, the estimating machine rotation state system can generate an intensity plot over time. The estimating rotation states system can then determine a rotation speed of the machine based on the intensity plot. The estimating rotation states system can also determine a rotation angle of the machine by integrating the intensity plot over time.

Abstract: An object detection vision system and methods are disclosed. A method for detecting objects in a vision system of an industrial machine includes receiving image data from one or more vision cameras and receiving detection data from one or more detect devices. The detection data includes one or more detected objects. The method includes combining the detection data and the image data and transforming the detection data in the image data based on one or more objects in the image data. The method also includes displaying an indication of the detected one or more objects in the image data based on the transformed detection data.

Abstract: The present disclosure is directed to systems and methods for estimating machine rotation state. The rotation state can include the rotation speed and/or angle as the machine rotates. In some implementations, an estimating machine rotation state system can receive image data, timestamped consecutively, from camera devices of a machine. The estimating machine rotation state system can generate optical flow vectors for the pixels of the image data and determine the hue and intensity of the pixels based on the optical flow vectors. Using the hues, intensities, and timestamps of the image data, the estimating machine rotation state system can generate an intensity plot over time. The estimating rotation states system can then determine a rotation speed of the machine based on the intensity plot. The estimating rotation states system can also determine a rotation angle of the machine by integrating the intensity plot over time.

Abstract: A method of monitoring a loading status of a machine includes receiving signals indicative of a load carried by a dump body of the machine from a perception sensor and receiving point cloud, derived based on the signals received from the perception sensor, corresponding to a profile of the load from an image processing module. A three dimensional polygonal layout corresponding to the profile of the load is generated based on the signals received from the perception sensor and the point cloud. A fill model image is generated using the generated three dimensional polygonal layout, and the fill model image is further superimposed on a preset image of the dump body of the machine to generate a real time image of the machine. The method further includes monitoring the loading status of the machine based on the generated real time image of the machine.