Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot motion planning using unmanned aerial vehicles (UAVs). One of the methods includes determining that a current plan for performing a particular task with a robot requires modification; in response, generating one or more flight plans for an unmanned aerial vehicle (UAV) based on a robotic operating environment comprising the robot; obtaining, using the UAV in accordance with the one or more flight plans, a new measurement of the robotic operating environment comprising the robot; and generating, based at least on a difference between the new measurement of the robotic operating environment and a previous measurement of the robotic operating environment, a modified plan for performing the particular task with the robot.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a robotic control plan. One of the methods includes obtaining, from a user device, image data depicting an instruction manual for assembling a plurality of assembly components; processing the image data using a machine learning model to generate instruction data representing a sequence of instructions for assembling the plurality of assembly components, wherein the machine learning model has been configured through training to process images depicting instruction manuals and to generate instruction data characterizing sequences of instructions identified in the instruction manuals; processing the instruction data to generate a robotic control plan to be executed by one or more robotic components for assembling the plurality of assembly components; and providing the robotic control plan to a robotic control system for executing the robotic control plan using the one or more robotic components.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a system for decentralized and validated robotic planning. One of the methods includes obtaining data representing an optimization challenge for a task to be performed by one or more robots in a robotic operating environment, wherein the optimization challenge has one or more associated goal criteria for the task; providing, by the validation platform system to a development platform system operated by a different entity than the validation platform system, information related to the optimization challenge; obtaining a candidate robotic control plan; executing the candidate robotic control plan using the digital representation of the robotic operating environment; determining that the candidate robotic control plan is valid according to the one or more goal criteria; and in response, providing the valid robotic control plan for deployment in the robotic operating environment.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for executing a robotic control plan in a robotic operating environment. One of the methods includes: obtaining, by a mobile automation setup device, sensor data characterizing a robotic operating environment that comprises one or more assembly components; providing, by the mobile automation setup device, the sensor data to a robotic planning system; receiving, by the mobile automation setup device from the robotic planning system, a robotic control plan to be executed by one or more robotic components in the robotic operating environment, wherein the robotic control plan has been generated according to the obtained sensor data; obtaining, by the mobile automation setup device and for each assembly component, a respective initial position of the assembly component in the robotic control plan; and presenting a visual representation of the respective initial position for each assembly component.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot motion planning using unmanned aerial vehicles (UAVs). One of the methods includes determining that a current plan for performing a particular task with a robot requires modification; in response, generating one or more flight plans for an unmanned aerial vehicle (UAV) based on a robotic operating environment comprising the robot; obtaining, using the UAV in accordance with the one or more flight plans, a new measurement of the robotic operating environment comprising the robot; and generating, based at least on a difference between the new measurement of the robotic operating environment and a previous measurement of the robotic operating environment, a modified plan for performing the particular task with the robot.