Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable determining a route between a start point and an end point in a site and navigating over the route. The sensors collect any or more of spatial, imaging, measurement, and location data to detect an obstacle between two locations within the site. Based on the collected data and identified obstacles, the excavation vehicle generates unobstructed routes circumventing the obstacles, obstructed routes traveling through the obstacles, and instructions for removing certain modifiable obstacles. The excavation vehicle determines and selects the shortest route of the unobstructed and obstructed route and navigates over the selected path to move within the site.

Abstract: An autonomous earth moving system can determine a desired state for a portion of the EMV including at least one control surface. Then the EMV selects a set of control signals for moving the portion of the EMV from the current state to the desired state using a machine learning model trained to generate control signals for moving the portion of the EMV to the desired state based on the current state. After the EMV executes the selected set of control signals, the system measures an updated state of the portion of the EMV. In some cases, this updated state of the EMV is used to iteratively update the machine learning model using an online learning process.

Abstract: In some implementations, the EMV uses a calibration to inform autonomous control over the EMV. To calibrate an EMV, the system first selects a calibration action comprising a control signal for actuating a control surface of the EMV. Then, using a calibration model comprising a machine learning model trained based on one or more previous calibration actions taken by the EMV, the system predicts a response of the control surface to the control signal of the calibration action. After the EMV executes the control signal to perform the calibration action, the EMV system monitors the actual response of the control signal and uses that to update the calibration model based on a comparison between the predicted and monitored states of the control surface.

Abstract: An earth moving vehicle (EMV) autonomously performs an earth moving operation within a dig site. If the EMV determines that a state of the EMV or the dig site triggers a triggering condition associated with a pause in the autonomous behavior of the EMV, the EMV determines a risk associated with the state or triggering condition. If the risk is greater than a first threshold, the EMV continues the autonomous performance and notifies a remote operator that the triggering condition was triggered. If the risk is greater than the first threshold risk but less than a second threshold risk, the EMV is configured to operate in a default state before continuing and notifying the remote operator. If the risk is greater than the second threshold risk, the EMV notifies the remote operator of the state pauses the performance until feedback is received from the remote operator.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying out an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collect any one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to carry out an excavation routine. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool and helping prepare a digital terrain model of the site as part of a process for creating the excavation routine.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying out an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collects any one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to carry out an excavation routine. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool, and helping prepare a digital terrain model of the site as part of a process for creating the excavation routine.

Abstract: When an EMV performs an action comprising moving a tool of the EMV through soil or other material, the EMV can measure a current speed of the tool through the material and a current kinematic pressure exerted on the tool by the material. Using the measured current speed and kinematic pressure, the EMV system can use a machine learned model to determine one or more soil parameters of the material. The EMV can then make decisions based on the soil parameters, such as by selecting a tool speed for the EMV based on the determined soil parameters.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collect one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to perform an excavation routine by excavating earth from a hole using an excavation tool positioned at a single location within the site. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool, navigating the excavation vehicle over a distance while continuously excavating earth from a below surface depth, and preparing a digital terrain model of the site as part of a process for creating the excavation routine.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying out an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collects any one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to carry out an excavation routine. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool, and helping prepare a digital terrain model of the site as part of a process for creating the excavation routine.

Abstract: This description provides an autonomous or semi-autonomous earth shaping vehicle that is capable of cooperatively filling earth into a fill location in a dig site. A first earth shaping vehicle configured with a hauling tool carrying a volume of earth navigates to the fill location. At the fill location, the first earth shaping vehicle navigates over a target tool path to fill earth from the hauling tool into the fill location. As the first earth shaping vehicle fills earth into the fill location, a measurement sensor coupled to the first earth shaping vehicle measures a compaction level of earth filled into the fill location. If the measured compaction level is determined to be below a threshold compaction level, the first earth shaping vehicle communicates a request for a second earth shaping vehicle configured with a compaction tool to compact earth in the fill location.

Abstract: An excavation vehicle capable of autonomously actuating an excavation tool or navigating an excavation vehicle to perform an excavation routine within an excavation site is described herein. Sensors mounted to the excavation vehicle and the excavation tool produce signals representative of a position and orientation of the corresponding joint relative on the excavation vehicle relative to the excavation site, a position and orientation of the excavation vehicle relative to the excavation site, and one or more features of the excavation site based on the position of the excavation vehicle within the excavation site. A set of solenoids are configured to couple to corresponding hydraulic valves of the excavation tool to actuate the valve. A controller produces actuating signals to control the joints of the excavation tool to autonomously perform the excavation routine based on the signals produced by the sensors.

Abstract: This description provides an autonomous or semi-autonomous earth shaping vehicle that is capable of cooperatively executing an earth shaping routine in a dig site with other earth shaping vehicles. A first earth shaping vehicle configured with a tool for excavating earth navigates to a dig location containing earth to be excavated. The first earth shaping vehicle identifies a loading location where the first vehicle may transfer earth to a second earth shaping vehicle configured with a tool for hauling earth between locations. Upon navigating to the loading location and detecting the second earth shaping vehicle at the loading location, the first earth shaping vehicle transfers earth from its excavation tool to the hauling tool of the second earth shaping vehicle.

Abstract: In some implementations, the EMV uses a calibration to inform autonomous control over the EMV. To calibrate an EMV, the system first selects a calibration action comprising a control signal for actuating a control surface of the EMV. Then, using a calibration model comprising a machine learning model trained based on one or more previous calibration actions taken by the EMV, the system predicts a response of the control surface to the control signal of the calibration action. After the EMV executes the control signal to perform the calibration action, the EMV system monitors the actual response of the control signal and uses that to update the calibration model based on a comparison between the predicted and monitored states of the control surface.

Abstract: An autonomous earth moving system can select an action for an earth moving vehicle (EMV) to autonomously perform using a tool (such as an excavator bucket). The system then generates a set of candidate tool paths, each illustrating a potential path for the tool to trace as the earth moving vehicle performs the action. In some cases, the system uses an online learning model iteratively trained to determine which candidate tool path best satisfies one or more metrics measuring the success of the action. The earth moving vehicle the executes the earth moving action using the selected tool path and measures the results of the action. In some implementations, the autonomous earth moving system updates the machine learning model based on the result of the executed action.

Abstract: When an EMV performs an action comprising moving a tool of the EMV through soil or other material, the EMV can measure a current speed of the tool through the material and a current kinematic pressure exerted on the tool by the material. Using the measured current speed and kinematic pressure, the EMV system can use a machine learned model to determine one or more soil parameters of the material. The EMV can then make decisions based on the soil parameters, such as by selecting a tool speed for the EMV based on the determined soil parameters.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collect one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to perform an excavation routine by excavating earth from a hole using an excavation tool positioned at a single location within the site. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool, navigating the excavation vehicle over a distance while continuously excavating earth from a below surface depth, and preparing a digital terrain model of the site as part of a process for creating the excavation routine.

Abstract: An autonomous earth moving system can determine a desired state for a portion of the EMV including at least one control surface. Then the EMV selects a set of control signals for moving the portion of the EMV from the current state to the desired state using a machine learning model trained to generate control signals for moving the portion of the EMV to the desired state based on the current state. After the EMV executes the selected set of control signals, the system measures an updated state of the portion of the EMV. In some cases, this updated state of the EMV is used to iteratively update the machine learning model using an online learning process.

Abstract: A computing device generates a graphical user interface displaying a three-dimensional representation of the site comprising a position of a vehicle capable of moving material within the site and a target location within the site for the vehicle to move material. The computing device transmits a set of instructions for the vehicle to move a volume of material from the target location. The computing device receives sensor data describing a depth of the target location, a current volume of material moved from the target location, and a position of the vehicle. The graphical user interface displayed on the computing device is modified to display the current depth of the target location, and the position of the vehicle relative to the target location. The computing device modifies the set of instructions based on the received sensor data and provides the modified set of instructions to the vehicle.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying out an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collects any one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to carry out an excavation routine. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool, and helping prepare a digital terrain model of the site as part of a process for creating the excavation routine.

Abstract: This description provides an autonomous or semi-autonomous excavation vehicle that is capable of navigating through a dig site and carrying out an excavation routine using a system of sensors physically mounted to the excavation vehicle. The sensors collect any one or more of spatial, imaging, measurement, and location data representing the status of the excavation vehicle and its surrounding environment. Based on the collected data, the excavation vehicle executes instructions to carry out an excavation routine. The excavation vehicle is also able to carry out numerous other tasks, such as checking the volume of excavated earth in an excavation tool, and helping prepare a digital terrain model of the site as part of a process for creating the excavation routine.