Abstract: A robotic system is disclosed to control multiple robots to cooperatively pick and place objects. In various embodiments, the robotic system includes a first robotic arm having a first end effector; a second robotic arm having a second end effector; and a control computer configured to use the first robotic arm and the second robotic arm to pick and place a plurality of objects, including by using the first robotic arm and the second robotic arm to work cooperatively to pick and place one or more of the objects.

Abstract: A set of one or more potentially graspable features for one or more objects present in a workspace area are determined based on visual data received from a plurality of cameras. For each of at least a subset of the one or more potentially graspable features one or more corresponding grasp strategies are determined to grasp the feature with a robotic arm and end effector. A score associated with a probability of a successful grasp of a corresponding feature is determined with respect to each of a least a subset of said grasp strategies. A first feature of the one or more potentially graspable features is selected to be grasped using a selected grasp strategy based at least in part on a corresponding score associated with the selected grasp strategy with respect to the first feature. The robotic arm and the end effector are controlled to attempt to grasp the first feature using the selected grasp strategy.

Abstract: A robotic system includes a robotic arm that includes a first joint that connects a first segment to a second segment, the first segment being connected at an end of the first segment opposite the first joint to a shoulder joint of the robotic arm and the second segment being connected at an end of the second segment opposite the first joint to an elbow joint of the robotic arm; and a processor coupled to the robotic arm and configured to receive an end effector trajectory and determine a motion plan to move the end effector through the end effector trajectory, including by using the first joint to vary the distance between the shoulder joint and the elbow joint, as and if needed, to realize the end effector trajectory while using the joints and links other than the first joint in a preferred pose.

Abstract: A robotic system is disclosed. The system includes a communication interface that receives, from a sensor(s) deployed in a workspace, sensor data indicative of a current state of the workspace, the workspace comprising a pallet or other receptacle and a plurality of items stacked on or in the receptacle. The system includes one or more processors that control a robotic arm to place a first set of items on or in, or remove the first set of items from, the pallet or other receptacle, update a geometric model based on the first set of items placed on or in a receptacle, use the geometric model in combination with the sensor data to estimate a stack of one or more items on or in the receptacle, and use the estimated state to generate or update a plan to control the robotic arm to place a second set of items.

Abstract: A stack containment fixture is disclosed. The stack containment fixture includes an insertion zone structure including an insertion zone structure and a kitting area structure. The insertion zone structure includes a pair of substantially vertically oriented deflecting arms. each having one or more funnels configured to guide a stack into a position between the deflecting arms as the stack is lowered into the insertion zone structure from above. The kitting area structure is configured to support the vehicle or the stack during kitting operations for items being placed in the vehicle or stack or for items being picked from the vehicle or stack.

Abstract: A robotic system is disclosed. The system includes a memory that stores for each of a plurality of items a set of attribute values. The system includes a processor(s) that uses the attribute values to simulate the placement of items, including by determining, iteratively, for each next item a placement location at which to place the item on a simulated stack of items on the pallet, using the attribute values and a geometric model of where items have been simulated to have been placed to estimate a state of the stack after each of a subset of simulated placements, and using the estimated state to inform a next placement decision. The steps of determining for each next item a placement location and estimating the state of the stack until all of at least a subset of the plurality of items have been simulated as having been placed on the stack.

Abstract: The present application discloses a method, system, and computer system for controlling a gating structure to mediate a flow of items an input source to a pick area. The system includes: (i) the gating structure, which is configured to use a plurality of gate elements to mediate a flow of items from the input source to the pick area, (ii) a sensor configured to provide a sensor output associated with the pick area, and (iii) a processor configured to provide a control input to the gating structure to adjust a configuration of one or more of the plurality of gating elements based at least in part on the sensor output. The sensor output comprises the sensor output comprises one or more of a flow rate, a number, and an orientation of objects in an area associated with picking of objects by one or more robots. The control input is determined based at least in part on one or more of the flow rate, the number, and the orientation of objects in the area associated with picking of objects by one or more robots.

Abstract: Techniques are disclosed to perform robotic handling of soft products in non-rigid packaging. In various embodiments, sensor data associated with a workspace is received. An action to be performed in the workspace using one or more robotic elements is determined, the action including moving an end effector of one of the robotic elements relatively quickly to a location in proximity to an item to be grasped; actuating a grasping mechanism of the end effector to grasp the item using an amount of force and structures associated with minimized risk of damage to one or both of the item and its packaging; and using sensor data generated subsequent to the item being grasped to ensure the item has been grasped securely. Control communications are sent to the robotic element via the communication interface to cause robotic element to perform the action.

Abstract: Use of hardware-accelerated raytracing for intelligent robot task execution is disclosed. In various embodiments, data comprising a geometric representation of a robot and one or more obstacles in a workspace in which the robot is located are used to determine, with respect to a pose of the robot in the workspace, whether the pose is associated with a collision condition with respect to one or more of the one or more obstacles, at least in part by performing hardware accelerated ray tracing with respect to rays originating from each of a plurality of points associated with the robot.

Abstract: A robotic system with independently controllable higher derivatives is disclosed. An indication is received of a trajectory through which an end effector comprising a robotic arm is to be moved. A plan is determined to use a combination of one or more motors and one or more energy removal devices to move one or more elements comprising the robotic arm in a manner that will result in the end effector being moved through the trajectory, including by using the one or more motors to apply torque to said one or more elements comprising the robotic arm during a first interval and using the one or more energy removal devices to remove energy from one or more of said elements during a second interval that starts after the start of the first interval. Commands to implement the plan are sent via a communication interface.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: The present application discloses a method, system, and computer system for determining an arrangement of a set of objects for loading to a transport container. The method includes (i) receiving an indication of the set of objects to be loaded into the transport container for transport from a source location to a destination location, (ii) determining, based at least in part on object information corresponding to the set of objects, an arrangement of the set of objects loaded into the transport container according to a stability model, and (iii) providing the arrangement of the set of objects to a robotic system to implement in connection with loading the set of objects to the transport container.

Abstract: The present application discloses a method, system, and computer system for sequencing a set of objects to be loaded into a transport container. The method includes (i) receiving an indication of the set of objects to be loaded into the transport container for transport from a source location to a destination location, (ii) determining, based at least in part on object information corresponding to the set of objects and resources available to load the set of objects, a sequence according to which the set of objects are to be loaded into the transport container, and (iii) providing the sequence to a robotic system to implement in connection with loading the set of objects to the transport container.

Abstract: A robotic system is disclosed. The robotic system includes (i) a robotic arm positioned in a known location adjacent to a work zone with respect to which the robotic arm is configured to manipulate one or more items, (ii) one or more sensors each positioned in a corresponding fixed location relative to the work zone, and (iii) one or more processors configured to configure the robotic system to use the robotic arm to manipulate the one or more items, the robotic system being configured based at least in part on sensor data, the sensor data comprising information indicative of a relative position of the robotic arm and one or more other objects in the work zone.

Abstract: A robotic system comprising a mobile chassis, a conveyor oriented substantially parallel to a longitudinal axis of the chassis, one or more robotic arms disposed adjacent to the conveyor, and one or more cameras positioned to view at least a portion of a top surface of the conveyor is disclosed. The system uses the mobile chassis, the conveyor, and the robotic arms to load items into a truck or other container, including by using image data generated by the one or more cameras to assess a state of items on the top surface of the conveyor; determine based at least in part on the image data that an additional item is to be added to the top surface of the conveyor; and operate a robotically controlled structure to cause an item to be added to the top surface of the conveyor.

Abstract: A robotic singulation system that provides an automated visual indication for human intervention is disclosed. In various embodiments, the system includes a communication interface; and a processor coupled to the communication interface and configured to: receive via the communication interface an indication of an error with respect to a receptacle comprising a conveyance structure; and in response to the indication, cause a visual indication to be provided with respect to the receptacle as it is moved through a workspace by the conveyance structure.

Abstract: The present application discloses a method, system, and computer system for partitioning a set of objects among a set of transport containers. The method includes (i) receiving an indication of the set of objects to be loaded into the set of transport containers, (ii) determining, based at least in part on object information corresponding to the set of objects and resources available to load the set of objects, an plan to partition the set of objects across the set of transport containers, the plan including an indication of a subset of the objects allocated to a corresponding subset of the containers, and (iii) providing the plan as an output to be used in connection with loading various subsets of objects to corresponding subsets of containers.

Abstract: The present application discloses a robotic stack pusher system, and a method and a computer system for controlling the robotic stack pusher system. The robotic stack pusher system includes an actuation device and a plurality of pusher structures that are substantially planar. At least one of the plurality of pusher structures is nested within one or more other pusher structures of the plurality of pusher structures. The actuation device is the actuation device is operatively coupled to at least one of the plurality of pusher structures. The actuation device is configured to actuate a position of the plurality of pusher structures between a retracted state and an extended state in response to a control signal. Actuation of the actuation device causes the one of the plurality of structures that is nested to extend telescopically with sufficient force and to controllably push a payload.

Abstract: A robotic singulation system configured to enable automated routing of manually scanned packages is disclosed. In various embodiments, image data associated with a workspace in which at least a portion of a segmented conveyance structure is located is received at a processor via a communication interface. A visually-provided user input indicating a receptacle comprising the segmented conveyance structure is detected, based at least in part on the image data. A receptacle identifier associated with the receptacle indicated by the visually-provided user input is determined, in response to the visually-provided input and based at least in part on the image data. A scanned package information is associated with the receptacle identifier, at least in part in response to the visually-provided input.