Abstract: Data indicating a corresponding safety state information indicating an extent to which that operating zone currently is or is not available to the robotic system to perform tasks using one or more robotic instrumentalities associated with a robotic system is used, for each of a plurality of operating zones, to dynamically schedule and perform tasks associated with a higher level objective. The corresponding safety state information associated with the first operating zone indicating one of a plurality of safety states associated with a presence of a human worker in the first operating zone is received from one or more sensors associated with a first operating zone of the plurality of operating zones. Autonomous behavior of the one or more robotic instrumentalities is altered based on the one of the plurality of safety states associated with the presence of the human worker in the first operating zone indicated by the corresponding safety state information.

Abstract: A method and system for obtaining an identifier from an item is disclosed. The method includes autonomously operating a robotic structure having a robotic arm to pick an item using an end effector of the robotic arm along a predetermined path from a source location to a destination location according to a plan. The picked item is moved according to the plan. An active measure is determined to be performed at least in part to obtain an identifier determined to be missing based on information received via the communication interface from one or more sensors. The robotic structure is autonomously operated to place the item at the destination location based at least in part on the plan.

Abstract: A value associated with a plurality of measurement objects that are embedded in a material associated with an intermediate layer of a plurality of layers associated with a tactile sensing unit is sensed. The value associated with the plurality of measurement objects is sensed by a sensor that is included a layer below the intermediate layer of the tactile sensing unit. An output of the sensor is used to make a determination associated with engagement of a robotic arm end effector with an item.

Abstract: An end effector is disclosed. The end effector includes a first set of one or more suction cups of a first size having a first diameter, and a second set of one or more suction cups of a second size having a second diameter that is smaller than the first diameter. The end effector further includes a first actuation mechanism configured to apply suction to at least a subset of the first set of suction cups independently of actuation of the second set of suction cups and a second actuation mechanism configured to apply suction to at least a subset of the second set of suction cups independently of actuation of the first set of suction cups.

Abstract: A robotic sorting system, method, and device is disclosed. The robotic sorting system includes a communication interface, and one or more processors coupled to the communication interface. The one or more processors are configured to (a) obtain item data via the communication interface, the item data including an indication of one or more items to be routed across a plurality of outbound stations, (b) obtain capability data for the plurality of outbound stations, the capability data indicating one or more capabilities for at least one outbound station, (c) determine a plan to route a selected item to a destination outbound station selected from among the plurality of outbound station, the plan being determined based at least in part on the item data and the capability data for the destination outbound station, and (d) cause the plan to be implemented to route the item to a particular handling path associated with the destination outbound station.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: Techniques are disclosed to use robotic system simulation to control a robotic system. In various embodiments, a communication indicating an action to be performed by a robotic element is received from a robotic control system. Performance of the action by the robotic element is simulated. A state tracking data is updated to reflect a virtual change to one or more state variables as a result of simulated performance of the action. Successful completion of the action by the robotic element is reported to the robotic control system.

Abstract: A robot having seven or more degrees of freedom is disclosed. In various embodiments, the robot includes a positioning robot having m degrees of freedom and a manipulator robot having n degrees of freedom coupled to the positioning robot. The robot is configured to be operated in a first mode of operation, in which the positioning robot is controlled to position move the manipulator robot into a position to perform a task and the manipulator robot is controlled independently of the positioning robot to perform the task; and in a second mode of operation, in which at least a subset of the m degrees of freedom of the positioning robot and at least a subset of the n degrees of freedom of the manipulator robot are controlled together, by a single controller, to perform the task.

Abstract: A robot having seven or more degrees of freedom is disclosed. In various embodiments, the robot includes a positioning robot having m degrees of freedom and a manipulator robot having n degrees of freedom coupled to the positioning robot. The robot is configured to be operated in a first mode of operation, in which the positioning robot is controlled to position move the manipulator robot into a position to perform a task and the manipulator robot is controlled independently of the positioning robot to perform the task; and in a second mode of operation, in which at least a subset of the m degrees of freedom of the positioning robot and at least a subset of the n degrees of freedom of the manipulator robot are controlled together, by a single controller, to perform the task.

Abstract: A method and system for obtaining an identifier from an item is disclosed. The method includes autonomously operate a robotic structure to move an item along a predetermined path from a source location to a destination location, and autonomously operating the robotic structure to place the item at the destination location based at least in part on the plan. The item comprises one or more identifiers, and in response to a determination that at least one of the one or more identifiers was not obtained by one or more sensors, an active measure is performed to cause the one or more sensors to obtain the at least one identifier that was not obtained. The predetermined path corresponds to a path along which the item is moved from the source location to the destination location. The predetermined path is planned so that the item is moved within a threshold range of the one or more sensors while the item is moved along the predetermined path.

Abstract: A robotic line kitting system is disclosed. Data indicating for each of a plurality of operating zones comprising a workspace with which the robotic line kitting system is associated a corresponding safety state information is stored. The data is used to dynamically schedule and perform tasks associated with a higher level objective, including by operating the one or more robotic instrumentalities in one or more operating zones, if any, indicated by the data to currently be available to perform tasks using the one or more robotic instrumentalities and by not operating the one or more robotic instrumentalities in one or more operating zones, if any, indicated by the data to not currently be available to perform tasks using the one or more robotic instrumentalities.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Abstract: A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Abstract: A robot configured to use a gripper to grasp one or more tools is disclosed. In various embodiments, the robot comprises a robotic arm having a gripper disposed at a free moving end of the robotic arm, and a set of two or more tools configured to grasped or otherwise engaged by the gripper. Each tool in the set of two or more tools may be disposed in a corresponding tool holder, optionally attached to the robot or situated near the robot. The robot is configured to use the gripper to retrieve a selected tool from its tool holder to perform a task; use the tool to perform the task; and return the tool to its tool holder.

Abstract: A robotic system comprising a plurality of autonomously acting robots configured to cooperate with each other to perform an operation is disclosed. In various embodiments, a system as disclosed herein includes a first robot configured to determine a plurality of items required to be obtained to fulfill a first order; and a second robot configured to receive an indication to retrieve and provide to the first robot a first item included in the plurality of items; and to plan and perform a first subtask to retrieve the first item and provide the first item to the first robot.

Abstract: A robotic system is disclosed comprising a communication interface and a processor coupled to the communication interface and configured to: receive via the communication interface an indication to establish a conveyance path to convey one or more items from a source location at an originating end of the conveyance path to a destination location at a terminating end of the conveyance path; determine programmatically a plan to arrange and configured one or more conveyance structures to provide the conveyance path; and invoke one or more robots to position, couple as needed, and configure as needed the one or more conveyance structures to provide the conveyance path.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: An end effector is disclosed. The end effector includes a first set of one or more suction cups of a first size having a first diameter, and a second set of one or more suction cups of a second size having a second diameter that is smaller than the first diameter. The end effector further includes a first actuation mechanism configured to apply suction to at least a subset of the first set of suction cups independently of actuation of the second set of suction cups and a second actuation mechanism configured to apply suction to at least a subset of the second set of suction cups independently of actuation of the first set of suction cups.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.