Abstract: Techniques for orchestrating activities at an earthmoving site are described. In an example, a stream of images are captured by an image capturing device removably fixed to a mobile earthmoving machine with a field of view overlapping with a working range of an attachment coupled to the mobile earthmoving machine. Using a selected subset of images from the stream captured during a time period, a first trained algorithm generates a probability that the subset of images depicts an action performable by the machine. Based on the probability, it is determined that the machine was performing the action during the time period, and in response, an image from the subset of images is selected. The image and an indication that the machine was performing the action during the time period are transmitted to a remote server system through a network.

Abstract: Embodiments describe a method for capturing objects in action at an earthmoving site. The method includes capturing an image of a region of the earthmoving site including an object, the image being recorded as captured digital data; identifying a classification of the object using a trained algorithm existing in memory of the image capturing device; sending the classification of the object to a remote server through a network; determining a pixel location and a boundary of the object within a field of view of the image capturing device based on positions of pixels of the object in the image; sending a set of images including the image to the remote server; determining an activity being performed by the object based on an analysis of digital data associated with the classification of the object and the movement of the object at the earthmoving site; and outputting a report to a user.