Abstract: A value associated with a plurality of measurement objects that are embedded in a material associated with an intermediate layer of a plurality of layers associated with a tactile sensing unit is sensed. The value associated with the plurality of measurement objects is sensed by a sensor that is included a layer below the intermediate layer of the tactile sensing unit. An output of the sensor is used to make a determination associated with engagement of a robotic arm end effector with an item.

Abstract: Techniques are disclosed to use robotic system simulation to control a robotic system. In various embodiments, a communication indicating an action to be performed by a robotic element is received from a robotic control system. Performance of the action by the robotic element is simulated. A state tracking data is updated to reflect a virtual change to one or more state variables as a result of simulated performance of the action. Successful completion of the action by the robotic element is reported to the robotic control system.

Abstract: A containerized robotic system is disclosed. The containerized robotic system includes a base having a first attachment area configured to securely mount a robot and a second attachment area configured to securely mount a compressor, the base further including a set of one or more channels to provide an electrical connection to supply power to the robot and the compressor, respectively, and to provide compressed air from the compressor to the robot, a detachable superstructure configured to be removably connected to the base to define an enclosed space of sufficient size to accommodate at least the robot and the compressor, and a power distribution unit secured to the base and coupled to receive electrical power as input and to provide electrical power to the robot and the compressor via the set of one or more channels.

Abstract: A method and system for obtaining an identifier from an item is disclosed. The method includes autonomously operate a robotic structure to move an item along a predetermined path from a source location to a destination location, and autonomously operating the robotic structure to place the item at the destination location based at least in part on the plan. The item comprises one or more identifiers, and in response to a determination that at least one of the one or more identifiers was not obtained by one or more sensors, an active measure is performed to cause the one or more sensors to obtain the at least one identifier that was not obtained. The predetermined path corresponds to a path along which the item is moved from the source location to the destination location. The predetermined path is planned so that the item is moved within a threshold range of the one or more sensors while the item is moved along the predetermined path.

Abstract: A robotic line kitting system is disclosed. Data indicating for each of a plurality of operating zones comprising a workspace with which the robotic line kitting system is associated a corresponding safety state information is stored. The data is used to dynamically schedule and perform tasks associated with a higher level objective, including by operating the one or more robotic instrumentalities in one or more operating zones, if any, indicated by the data to currently be available to perform tasks using the one or more robotic instrumentalities and by not operating the one or more robotic instrumentalities in one or more operating zones, if any, indicated by the data to not currently be available to perform tasks using the one or more robotic instrumentalities.

Abstract: Techniques are disclosed to use a robotic arm to palletize or depalletize diverse items. In various embodiments, data associated with a plurality of items to be stacked on or in a destination location is received. A plan to stack the items on or in the destination location is generated based at least in part on the received data. The plan is implemented at least in part by controlling a robotic arm of the robot to pick up the items and stack them on or in the receptacle according to the plan, including by for each item: using one or more first order sensors to move the item to a first approximation of a destination position for that item at the destination location; and using one or more second order sensors to snug the item into a final position.

Abstract: An end effector is disclosed. The end effector includes a first set of one or more suction cups of a first size having a first diameter, and a second set of one or more suction cups of a second size having a second diameter that is smaller than the first diameter. The end effector further includes a first actuation mechanism configured to apply suction to at least a subset of the first set of suction cups independently of actuation of the second set of suction cups and a second actuation mechanism configured to apply suction to at least a subset of the second set of suction cups independently of actuation of the first set of suction cups.

Abstract: A moving system comprising a master controller for monitoring and controlling a master operation comprising one or more individual movers such that each mover arrives at predefined end point at selected times. Each mover includes a mover control system that interacts with the master controller and has a predefined virtual vector path with one or more defined end points. The predefined virtual vector path comprises a plurality of discrete points, wherein each discrete point has a vector axis for use by the master controller and the mover control system to direct the mover to move such that it arrives at each defined end point at a selected time. In operation, the master controller functions to modify the predefined virtual path and sends commands to the mover control system in response to changes in the master operations.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Abstract: Techniques are disclosed to perform robotic handling of soft products in non-rigid packaging. In various embodiments, sensor data associated with a workspace is received. An action to be performed in the workspace using one or more robotic elements is determined, the action including moving an end effector of one of the robotic elements relatively quickly to a location in proximity to an item to be grasped; actuating a grasping mechanism of the end effector to grasp the item using an amount of force and structures associated with minimized risk of damage to one or both of the item and its packaging; and using sensor data generated subsequent to the item being grasped to ensure the item has been grasped securely. Control communications are sent to the robotic element via the communication interface to cause robotic element to perform the action.

Abstract: A robot configured to use a gripper to grasp one or more tools is disclosed. In various embodiments, the robot comprises a robotic arm having a gripper disposed at a free moving end of the robotic arm, and a set of two or more tools configured to grasped or otherwise engaged by the gripper. Each tool in the set of two or more tools may be disposed in a corresponding tool holder, optionally attached to the robot or situated near the robot. The robot is configured to use the gripper to retrieve a selected tool from its tool holder to perform a task; use the tool to perform the task; and return the tool to its tool holder.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: An autonomous tray handling robotic system is disclosed. In various embodiments, data indicating a set of output stacks to be assembled is stored, each output stack including an associated set of trays each of a corresponding tray type. Operation of one or more robots is controlled, each robot being configured to grasp, move, and place one or more trays at a time, according to a plan, to iteratively pick trays from source stacks of trays and assemble the set of output stacks, including by building each output stack by successively placing on the output stack trays picked from one or more corresponding source stacks. Each of the robots comprises a robotic arm and a tray handling end effector configured to grasp, move, and place one or more trays without assistance from another robot.

Abstract: A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.

Abstract: A robotic end effector is disclosed. The end effector is configured to grasp, move, and place one or more objects without assistance from another robot. The end effector includes a lateral member configured to be coupled to a robotic arm, a passive side member coupled substantially rigidly to the lateral member at a first distal end and configured to engage mechanically with a first recess on a first side of an object to be grasped, and an active side member coupled to the lateral member at a second distal end opposite the first distal end and configured to engage mechanically with a second recess on a second side of the object to be grasped, the second side being opposite the first side of the object to be grasped. The passive side member and the active side member each include a structure, and the structure on the passive side member and the active side member have different profiles.

Abstract: A kitting machine is disclosed. In various embodiments, the machine includes an actuator configured to move a surface or receptacle to a position associated with item retrieval; and a controller configured to control operation of the actuator to position an item in the position associated with item retrieval, in a manner that is synchronized at least in part with operation of a robotic retrieval device configured to retrieve the item from the position associated with item retrieval.

Abstract: A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.