Abstract: A plurality of sensors are configured to provide a corresponding output that reflects a sensed value associated with engagement of a robotic arm end effector with an item. The respective outputs of one or more sensors comprising the plurality of sensors are used to determine one or more inputs to a multi-modal model configured to provide, based at least in part on the one or more inputs, an output associated with slippage of the item within or from a grasp of the robotic arm end effector. A determination associated with slippage of the item within or from the grasp of the robotic arm end effector is made based at least in part on an output of the multi-modal model. A responsive action is taken based at least in part on the determination associated with slippage of the item within or from the grasp of the robotic arm end effector.

Abstract: A containerized robotic system is disclosed. The containerized robotic system includes a base having a first attachment area configured to securely mount a robot and a second attachment area configured to securely mount a compressor, the base further including a set of one or more channels to provide an electrical connection to supply power to the robot and the compressor, respectively, and to provide compressed air from the compressor to the robot, a detachable superstructure configured to be removably connected to the base to define an enclosed space of sufficient size to accommodate at least the robot and the compressor, and a power distribution unit secured to the base and coupled to receive electrical power as input and to provide electrical power to the robot and the compressor via the set of one or more channels.

Abstract: A robotic system is disclosed. The system includes a communication interface that receives, from one or more sensors deployed in a workspace, sensor data indicative of a current state of the workspace. The system includes one or more processors that use the sensor data to estimate a state of one or both of the pallet or other receptacle and the set of zero or more items stacked on or in the receptacle, and use the estimated state to generate or update a plan to control a robotic arm to place a next set of items on or in, or remove the next set of items from, the pallet or other receptacle, the plan comprising an ordered sequence of item placements or removals. The plan is generated or updated based at least in part by performing a bounded tree search in which a subset of possible ordered sequences is explored.

Abstract: A method and system for obtaining an identifier from an item is disclosed. The method includes autonomously operating a robotic structure having a robotic arm to pick an item using an end effector of the robotic arm along a predetermined path from a source location to a destination location according to a plan. The picked item is moved according to the plan. An active measure is determined to be performed at least in part to obtain an identifier determined to be missing based on information received via the communication interface from one or more sensors. The robotic structure is autonomously operated to place the item at the destination location based at least in part on the plan.

Abstract: The present application discloses a robotic control system, and a method and a computer system for controlling a robot. The robotic control system includes a memory and one or more processors coupled to the memory. The memory is configured to store configured to store a model of a robot having a plurality of axes of control including at least a linear axis and one or more rotational axes. The one or more processors are configured to use the model to control the robot to perform a task, including by sending to the robot a set of control signals to cause the robot to move with respect to two or more of said axes of control including at least the linear axis.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including data associated with an item present in a workspace is received. The sensor data is used to determine and implement a plan to autonomously operate a robotic structure to move and place the item singly in a corresponding location in a singulation conveyance structure. The plan takes into consideration an attribute of the item determined based at least in part on the sensor data.

Abstract: The present application discloses a robotic modular stack mover system, and a method and a computer system for controlling the robotic modular pusher system. The robotic modular stack mover system includes a first stack mover system configured to cause a vehicle to traverse a first path and a second stack mover system configured to cause the vehicle to traverse a second path. The first stack mover system moves the vehicle along the first path from a source location to a first end location. The vehicle is retrieved from the first end location and the second mover system moves the vehicle along the second path to a destination location.

Abstract: Techniques are disclosed to use robotic system simulation to control a robotic system. In various embodiments, a communication indicating an action to be performed by a robotic element is received from a robotic control system. Performance of the action by the robotic element is simulated. A state tracking data is updated to reflect a virtual change to one or more state variables as a result of simulated performance of the action. Successful completion of the action by the robotic element is reported to the robotic control system.

Abstract: A kitting machine is disclosed. In various embodiments, the machine includes an actuator configured to move a surface or receptacle to a position associated with item retrieval; and a controller configured to control operation of the actuator to position an item in the position associated with item retrieval, in a manner that is synchronized at least in part with operation of a robotic retrieval device configured to retrieve the item from the position associated with item retrieval.

Abstract: Data indicating a corresponding safety state information indicating an extent to which that operating zone currently is or is not available to the robotic system to perform tasks using one or more robotic instrumentalities associated with a robotic system is used, for each of a plurality of operating zones, to dynamically schedule and perform tasks associated with a higher level objective. The corresponding safety state information associated with the first operating zone indicating one of a plurality of safety states associated with a presence of a human worker in the first operating zone is received from one or more sensors associated with a first operating zone of the plurality of operating zones. Autonomous behavior of the one or more robotic instrumentalities is altered based on the one of the plurality of safety states associated with the presence of the human worker in the first operating zone indicated by the corresponding safety state information.

Abstract: A robotic system is disclosed. The system includes a memory that stores for each of a plurality of items a set of attribute values. The system includes a processor(s) that uses the attribute values to simulate the placement of items, including by determining, iteratively, for each next item a placement location at which to place the item on a simulated stack of items on the pallet, using the attribute values and a geometric model of where items have been simulated to have been placed to estimate a state of the stack after each of a subset of simulated placements, and using the estimated state to inform a next placement decision. The steps of determining for each next item a placement location and estimating the state of the stack until all of at least a subset of the plurality of items have been simulated as having been placed on the stack.

Abstract: A robotic system comprising an end effector-mounted sensor is disclosed. In various embodiments, a robotic arm is manipulated to move a sensor to a position such that an object of interest is within a read range of the sensor. A sensor data read by the sensor is received via a communication interface. The sensor data is used to determine an attribute of the object; and the determined attribute of the object is used to determine a plan to grasp and move the object.

Abstract: A robotic system is disclosed which includes a robotic arm having n degrees of freedom, the robotic arm comprising a base and a set of serially connected links and joints connected to the base; an enabler joint assembly comprising a mounting location at which the base of the robotic arm is mounted and having a rotational axis, offset from the mounting location, about which the enabler joint assembly is configured to rotate the mounting location; and a processor configured to control a first set of motors associated with the n degrees of freedom of the robotic arm and an enabler joint motor comprising the enabler joint assembly to control operation of the robotic arm within an extended operating space defined at least in part by the n degrees of freedom of the robotic arm and an (n+1)th degree of freedom provided by the enabler joint assembly.

Abstract: A robotic palletization/depalletization system is disclosed. In various embodiments, data associated with a plurality of items to be stacked on or in a destination location is received, and a plan to stack the items on or in the destination location is generated based at least in part on the received data. The generating the plan includes determining a source location from which to pick the item based at least in part on (i) an attribute of the source location, and (ii) a state of a platform or receptacle on which one or more items are to be stacked.

Abstract: A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.

Abstract: A robotic system is disclosed. The system includes a communication interface that receives, from a sensor(s) deployed in a workspace, sensor data indicative of a current state of the workspace, the workspace comprising a pallet or other receptacle and a plurality of items stacked on or in the receptacle. The system includes one or more processors that control a robotic arm to place a first set of items on or in, or remove the first set of items from, the pallet or other receptacle, update a geometric model based on the first set of items placed on or in a receptacle, use the geometric model in combination with the sensor data to estimate a stack of one or more items on or in the receptacle, and use the estimated state to generate or update a plan to control the robotic arm to place a second set of items.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.

Abstract: A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.

Abstract: The present application discloses a system, a method, and a computer system for detecting objects that require special handling. The method includes (i) receiving image data from one or more cameras associated with a source conveyor configured to convey items to a pick location, (ii) determining, based at least in part on the image data, that an item requiring special handling has entered the source conveyor, and (iii) providing an output indicating that the item requiring special handling has been detected.