Abstract: A value associated with a plurality of measurement objects that are embedded in a material associated with an intermediate layer of a plurality of layers associated with a tactile sensing unit is sensed. The value associated with the plurality of measurement objects is sensed by a sensor that is included a layer below the intermediate layer of the tactile sensing unit. An output of the sensor is used to make a determination associated with engagement of a robotic arm end effector with an item.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: Techniques are disclosed to use a robotic arm to palletize or depalletize diverse items. In various embodiments, data associated with a plurality of items to be stacked on or in a destination location is received. A plan to stack the items on or in the destination location is generated based at least in part on the received data. The plan is implemented at least in part by controlling a robotic arm of the robot to pick up the items and stack them on or in the receptacle according to the plan, including by for each item: using one or more first order sensors to move the item to a first approximation of a destination position for that item at the destination location; and using one or more second order sensors to snug the item into a final position.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Abstract: The present application discloses a system, a method, and a computer system for moving items deemed to be too heavy to be picked up by a robotic arm. The method includes (i) receiving sensor data from one or more sensors associated with a source conveyor configured to convey items to a pick location, (ii) determining, based at least in part on the sensor data, that an item that is too heavy to be lifted by a robotic arm controlled by the one or more processors has entered the source conveyor, and (iii) providing an output indicating that the item too heavy to be lifted by the robotic arm has been detected.

Abstract: The present application discloses a system, a method, and a computer system for detecting objects that require special handling. The method includes (i) receiving image data from one or more cameras associated with a source conveyor configured to convey items to a pick location, (ii) determining, based at least in part on the image data, that an item requiring special handling has entered the source conveyor, and (iii) providing an output indicating that the item requiring special handling has been detected.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: The present application discloses a system, a method, and a computer system for moving items deemed to be too heavy to be picked up by a robotic arm. The method includes (i) receiving image data associated with a workspace, wherein the workspace includes a source of items to be placed singly each in a respective corresponding location on a segmented conveyance structure adjacent to at least a portion of the source of items, (ii) receiving an indication that a first item in the source of items is too heavy to be picked up by a first robotic arm the one or more processors are configured to control, (iii) determining, based at least in part on the image data, a plan to use the first robotic arm to push the first item onto an associated corresponding location on the segmented conveyance structure as the associated corresponding location on the segmented conveyance structure moves past the source of items, and (iv) controlling the first robotic arm to implement the plan.

Abstract: The present application discloses a system, a method, and a computer system for handling items deemed to require special handling. The method includes (i) receiving via the communication interface an indication that a given item in a source of items requires special handling, and (ii) actuating an item diversion structure comprising or otherwise associated with the source of items to divert the given item to a location associated with alternative item handling.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A robotic system comprising a mobile chassis, a conveyor oriented substantially parallel to a longitudinal axis of the chassis, one or more robotic arms disposed adjacent to the conveyor, and one or more cameras positioned to view at least a portion of a top surface of the conveyor is disclosed. The system uses the mobile chassis, the conveyor, and the robotic arms to load items into a truck or other container, including by using image data generated by the one or more cameras to assess a state of items on the top surface of the conveyor; determine based at least in part on the image data that an additional item is to be added to the top surface of the conveyor; and operate a robotically controlled structure to cause an item to be added to the top surface of the conveyor.

Abstract: A robotic system is disclosed which includes a robotic arm having n degrees of freedom, the robotic arm comprising a base and a set of serially connected links and joints connected to the base; an enabler joint assembly comprising a mounting location at which the base of the robotic arm is mounted and having a rotational axis, offset from the mounting location, about which the enabler joint assembly is configured to rotate the mounting location; and a processor configured to control a first set of motors associated with the n degrees of freedom of the robotic arm and an enabler joint motor comprising the enabler joint assembly to control operation of the robotic arm within an extended operating space defined at least in part by the n degrees of freedom of the robotic arm and an (n+1)th degree of freedom provided by the enabler joint assembly.

Abstract: A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.

Abstract: A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.