Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Example methods and systems for augmented reality interfaces to display virtual representations of robotic device actions are provided. An example method includes receiving information that indicates an action or an intent of a robotic device to perform a task, and the action or the intent includes one or more of a planned trajectory of the robotic device to perform at least a portion of the task and an object to be handled by the robotic device to perform at least a portion of the task. The method also includes providing, for display by a computing device on an augmented reality interface, a virtual representation of the action or the intent, and the virtual representation includes as annotations on the augmented reality interface at least a portion of the planned trajectory of the robotic device or highlighting the object to be handled by the robotic device.

Abstract: Instructions indicative of changing a view of a virtual object may be received by a device. At least a portion of the virtual object may be viewable from a viewpoint that is at a given distance from a surface of the virtual object. The device may cause a change of the view along a rotational path around the virtual object in response to the receipt of the instructions based on the given distance being greater than a threshold distance. The device may cause a change of the view along a translational path indicative of a shape of the surface of the virtual object in response to the receipt of the instructions based on the given distance being less than the threshold distance.

Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Instructions indicative of changing a view of a virtual object may be received by a device. At least a portion of the virtual object may be viewable from a viewpoint that is at a given distance from a surface of the virtual object. The device may cause a change of the view along a rotational path around the virtual object in response to the receipt of the instructions based on the given distance being greater than a threshold distance. The device may cause a change of the view along a translational path indicative of a shape of the surface of the virtual object in response to the receipt of the instructions based on the given distance being less than the threshold distance.

Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Example embodiments may relate to robot-cloud interaction. In particular, a cloud-based service may receive a query from a first robotic system including sensor data, a request for instructions to carry out a task, and information associated with a configuration of the first robotic system. The cloud-based service may then identify stored data including a procedure previously used by a second robotic system to carry out the task and information associated with a configuration of the second robotic system. The cloud-based service may then generate instructions for the first robotic system to carry out the task based at least in part on the sensor data, the procedure used by the second robotic system to carry out the task, the information associated with the configuration of the first robotic system, and the information associated with the configuration of the second robotic system.

Abstract: Instructions indicative of changing a view of a virtual object may be received by a device. At least a portion of the virtual object may be viewable from a viewpoint that is at a given distance from a surface of the virtual object. The device may cause a change of the view along a rotational path around the virtual object in response to the receipt of the instructions based on the given distance being greater than a threshold distance. The device may cause a change of the view along a translational path indicative of a shape of the surface of the virtual object in response to the receipt of the instructions based on the given distance being less than the threshold distance.

Abstract: Methods and systems for dynamically maintaining a map of robotic devices in an environment are provided herein. A map of robotic devices may be determined, where the map includes predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform a task. During a performance of the task by the one or more robotic devices, task progress data may be received from the robotic devices, indicative of which of the task phases have been performed. Based on the data, the map may be updated to include a modification to the predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform at least one other task in accordance with the updated map.

Abstract: Within examples, object image masking is provided. An example method includes receiving a depth mask of an object, projecting the depth mask of the object onto an image of the object in a background so as to generate a depth image of the object in the background, determining portions of the depth image of the object in the background that are representative of the object and that are representative of the background, based on the portions of the depth image of the object in the background that are representative of the object determining a foreground mask of the object, and using the foreground mask of the object to identify portions of the image representative of the object.

Abstract: Example implementations relate to robotic operations libraries. An example library may include sets of operation instructions and other information for robotic devices to use to complete desired tasks. For instance, a respective set of operation instructions is determined based on successive simulations in which a virtual robotic device comprising an adjustable configuration initially based on the given configuration of a robotic device performs operations related to a task in an adjustable virtual environment until one or more simulations result in the virtual robotic device performing respective operations that complete the task at a success level that satisfies a predefined threshold. The library may provide a set of instructions for performing operations to a robotic device based on a query received from the robotic device that includes information indicative of a configuration and an environment of the robotic device.

Abstract: Methods and systems for dynamically maintaining a map of robotic devices in an environment are provided herein. A map of robotic devices may be determined, where the map includes predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform a task. During a performance of the task by the one or more robotic devices, task progress data may be received from the robotic devices, indicative of which of the task phases have been performed. Based on the data, the map may be updated to include a modification to the predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform at least one other task in accordance with the updated map.

Abstract: Methods and systems for dynamically maintaining a map of robotic devices in an environment are provided herein. A map of robotic devices may be determined, where the map includes predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform a task. During a performance of the task by the one or more robotic devices, task progress data may be received from the robotic devices, indicative of which of the task phases have been performed. Based on the data, the map may be updated to include a modification to the predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform at least one other task in accordance with the updated map.

Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Example embodiments may relate to robot-cloud interaction. In particular, a cloud-based service may receive a query from a first robotic system including sensor data, a request for instructions to carry out a task, and information associated with a configuration of the first robotic system. The cloud-based service may then identify stored data including a procedure previously used by a second robotic system to carry out the task and information associated with a configuration of the second robotic system. The cloud-based service may then generate instructions for the first robotic system to carry out the task based at least in part on the sensor data, the procedure used by the second robotic system to carry out the task, the information associated with the configuration of the first robotic system, and the information associated with the configuration of the second robotic system.

Abstract: Example implementations may relate to a robotic system configured to provide feedback. In particular, the robotic system may determine a model of an environment in which the robotic system is operating. Based on this model, the robotic system may then determine one or more of a state or intended operation of the robotic system. Then, based one or more of the state or the intended operation, the robotic system may select one of one or more of the following to represent one or more of the state or the intended operation: visual feedback, auditory feedback, and one or more movements. Based on the selection, the robotic system may then engage in one or more of the visual feedback, the auditory feedback, and the one or more movements.

Abstract: Example implementations relate to robotic operations libraries. An example library may include sets of operation instructions and other information for robotic devices to use to complete desired tasks. For instance, a respective set of operation instructions is determined based on successive simulations in which a virtual robotic device comprising an adjustable configuration initially based on the given configuration of a robotic device performs operations related to a task in an adjustable virtual environment until one or more simulations result in the virtual robotic device performing respective operations that complete the task at a success level that satisfies a predefined threshold. The library may provide a set of instructions for performing operations to a robotic device based on a query received from the robotic device that includes information indicative of a configuration and an environment of the robotic device.

Abstract: Examples relating to controlling extendable legs of a robotic device for use of a mechanical gripper are described herein. A robotic device may include one or more legs configured with a mechanical gripper coupled to the leg at a first position away from the distal end of the leg. The mechanical gripper may transition between the first position and a second position on the leg proximate to the distal end that enables the robotic device to use the mechanical gripper to perform grip operations. A control system of the robotic device may modify an orientation of the robotic device to at least position the robotic device on one or more legs other than the leg comprising the mechanical gripper, and transitions the mechanical gripper from the first position to the second position to perform the given grip operation of the input.