Abstract: A motion capture setup records the movements of an operator, and a control engine then translates those movements into control signals for controlling a robot. The control engine may directly translate the operator movements into analogous movements to be performed by the robot, or the control engine may compute robot dynamics that cause a portion of the robot to mimic a corresponding portion of the operator.

Abstract: A motion capture setup records the movements of an operator, and a control engine then translates those movements into control signals for controlling a robot. The control engine may directly translate the operator movements into analogous movements to be performed by the robot, or the control engine may compute robot dynamics that cause a portion of the robot to mimic a corresponding portion of the operator.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for reconfigurable spaces. One of the methods includes identifying plan information relating to a space under evaluation. Constraints related to structures associated with the plan information are identified. Input regarding uses or elements to be included in a reconfigurable design for the space is received. A library of elements for inclusion in the space is evaluated, including determining one or more reconfigurable elements that satisfy the received input. A first configuration of a reconfigurable element is determined including a first placement in a first design associated with the space, and the first design in accordance with the first configuration is presented. A second different configuration is determined, including a second placement in a second different design associated with the space, and the second different design in accordance with the second different configuration is presented.

Abstract: An agent engine allocates a collection of agents to scan the surface of an object model. Each agent operates autonomously and implements particular behaviors based on the actions of nearby agents. Accordingly, the collection of agents exhibits swarm-like behavior. Over a sequence of time steps, the agents traverse the surface of the object model. Each agent acts to avoid other agents, thereby maintaining a relatively consistent distribution of agents across the surface of the object model over all time steps. At a given time step, the agent engine generates a slice through the object model that intersects each agent in a group of agents. The slice associated with a given time step represents a set of locations where material should be deposited to fabricate a 3D object. Based on a set of such slices, a robot engine causes a robot to fabricate the 3D object.

Abstract: One embodiment of the present invention sets forth a technique for generating simulated training data for a physical process. The technique includes receiving, as input to at least one machine learning model, a first simulated image of a first object, wherein the at least one machine learning model includes mappings between simulated images generated from models of physical objects and real-world images of the physical objects. The technique also includes performing, by the at least one machine learning model, one or more operations on the first simulated image to generate a first augmented image of the first object. The technique further includes transmitting the first augmented image to a training pipeline for an additional machine learning model that controls a behavior of the physical process.

Abstract: One embodiment of the present invention sets forth a technique for controlling the execution of a physical process. The technique includes receiving, as input to a machine learning model that is configured to adapt a simulation of the physical process executing in a virtual environment to a physical world, simulated output for controlling how the physical process performs a task in the virtual environment and real-world data collected from the physical process performing the task in the physical world. The technique also includes performing, by the machine learning model, one or more operations on the simulated output and the real-world data to generate augmented output. The technique further includes transmitting the augmented output to the physical process to control how the physical process performs the task in the physical world.

Abstract: A robotic assembly cell is configured to generate a physical mesh of physical polygons based on a simulated mesh of simulated triangles. A control application configured to operate the assembly cell selects a simulated polygon in the simulated mesh and then causes a positioning robot in the cell to obtain a physical polygon that is similar to the simulated polygon. The positioning robot positions the polygon on the physical mesh, and a welding robot in the cell then welds the polygon to the mesh. The control application captures data that reflects how the physical polygon is actually positioned on the physical mesh, and then updates the simulated mesh to be geometrically consistent with the physical mesh. In doing so, the control application may execute a multi-objective solver to generate an updated simulated mesh that meets specific design criteria.

Abstract: A robot system is configured to identify gestures performed by an end-user proximate to a work piece. The robot system then determines a set of modifications to be made to the work piece based on the gestures. A projector coupled to the robot system projects images onto the work piece that represent the modification to be made and/or a CAD model of the work piece. The robot system then performs the modifications.

Abstract: A robot is configured to assist an end-user with creative tasks. While the end-user modifies the work piece, the robot observes the modifications made by the end-user and determines one or more objectives that the end-user may endeavor to accomplish. The robot then determines a set of actions to perform that assist the end-user with accomplishing the objectives.

Abstract: A control engine is trained to operate a robotic camera according to a variety of different cinematographic techniques. The control engine may reconfigure the robotic camera to respond to a set of cues, to enforce a set of constraints, or to apply one or more characteristic styles. A training engine trains a network within the control engine based on training data that exemplifies cue responses, enforced constraints, and characteristic styles.

Abstract: A motion capture setup records the movements of an operator, and a control engine then translates those movements into control signals for controlling a robot. The control engine may directly translate the operator movements into analogous movements to be performed by the robot, or the control engine may compute robot dynamics that cause a portion of the robot to mimic a corresponding portion of the operator.

Abstract: A technique for displaying a representative path associated with a robotic device. The technique includes detecting at least one reference point within a first image of a workspace, generating the representative path based on path instructions associated with the robotic device and the at least one reference point, and displaying the representative path within the workspace.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for reconfigurable spaces. One of the methods includes identifying plan information relating to a space under evaluation. Constraints related to structures associated with the plan information are identified. Input regarding uses or elements to be included in a reconfigurable design for the space is received. A library of elements for inclusion in the space is evaluated, including determining one or more reconfigurable elements that satisfy the received input. A first configuration of a reconfigurable element is determined including a first placement in a first design associated with the space, and the first design in accordance with the first configuration is presented. A second different configuration is determined, including a second placement in a second different design associated with the space, and the second different design in accordance with the second different configuration is presented.