Abstract: A manifest or other data indicating a high-level objective to move a plurality of items from a source location to a destination location is received. The manifest or other data is utilized to generate a plan to pick and place the plurality of items from the source location to the destination location in a particular order and manner. A first item of the plurality of items is moved to a first location at the destination location as indicated by the manifest or other data using a robotic arm having an end effector. Force sensor information generated by a force sensor is received. The force sensor information is used to align a structure comprising the first item with an opening associated with the first location. The first item is inserted into the opening associated with the first location.

Abstract: A kitting machine is disclosed. In various embodiments, the machine includes an actuator configured to move a surface or receptacle to a position associated with item retrieval; and a controller configured to control operation of the actuator to position an item in the position associated with item retrieval, in a manner that is synchronized at least in part with operation of a robotic retrieval device configured to retrieve the item from the position associated with item retrieval.

Abstract: A robotic system with autonomous gripper selection is disclosed. Sensor data is received from a sensor in a workspace. The sensor data is used to determine an end effector to be used to perform a task with respect to an object in the workspace. The determined end effector is autonomously mounted on a free moving end of a robotic arm comprising the robotic system, and the robotic arm and end effector are used to perform the task with respect to the object.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: A robotic system is disclosed which includes a robotic arm having n degrees of freedom, the robotic arm comprising a base and a set of serially connected links and joints connected to the base; an enabler joint assembly comprising a mounting location at which the base of the robotic arm is mounted and having a rotational axis, offset from the mounting location, about which the enabler joint assembly is configured to rotate the mounting location; and a processor configured to control a first set of motors associated with the n degrees of freedom of the robotic arm and an enabler joint motor comprising the enabler joint assembly to control operation of the robotic arm within an extended operating space defined at least in part by the n degrees of freedom of the robotic arm and an (n+1)th degree of freedom provided by the enabler joint assembly.

Abstract: A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. A grasp strategy is determined for each of at least a subset of items, and for each grasp strategy a corresponding probability of grasp success is computed. The grasp strategies and corresponding probabilities of grasp success are used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A robotic kitting machine is disclosed. In various embodiments, a robotic arm is used to move an item to a location in proximity to a slot into which the item is to be inserted. Force information generated by a force sensor is received via a communication interface. The force sensor information is used to align a structure comprising the item with a corresponding cavity comprising the slot, and the item is inserted into the slot.

Abstract: A multicamera image processing system is disclosed. In various embodiments, image data is received from each of a plurality of sensors associated with a workspace, the image data comprising for each sensor in the plurality of sensors one or both of visual image information and depth information. Image data from the plurality of sensors is merged to generate a merged point cloud data. Segmentation is performed based on visual image data from at least a subset of the sensors in the plurality of sensors to generate a segmentation result. One or both of the merged point cloud data and the segmentation result is/are used to generate a merged three dimensional and segmented view of the workspace.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: A robot configured to use a gripper to grasp one or more tools is disclosed. In various embodiments, the robot comprises a robotic arm having a gripper disposed at a free moving end of the robotic arm, and a set of two or more tools configured to grasped or otherwise engaged by the gripper. Each tool in the set of two or more tools may be disposed in a corresponding tool holder, optionally attached to the robot or situated near the robot. The robot is configured to use the gripper to retrieve a selected tool from its tool holder to perform a task; use the tool to perform the task; and return the tool to its tool holder.

Abstract: A velocity control-based robotic system is disclosed. In various embodiments, sensor data is received from one or more sensors deployed in a physical space in which a robot is located. A processor is used to determine based at least in part on the sensor data an at least partly velocity-based trajectory along which to move an element comprising the robot. A command to implement the velocity-based trajectory is sent to the robot.

Abstract: A robotic system to control multiple robots to perform a task cooperatively is disclosed. A first robot determines to perform a task cooperatively with a second robot, moves independently to a first grasp position to grasp an object associated with the task, receives an indication that the second robot is prepared to perform the task cooperatively, and moves the object independently of the second robot in a leader mode along a trajectory determined by the first robot. The second robot assists the first robot in performing the task cooperatively, at least in part by moving independently to a second grasp position, grasping the object, and cooperating with the first robot to move the object, at least in part by operating in a follower mode of operation to maintain engagement with the object as the first robot moves the object along the trajectory.

Abstract: A robot configured to use a gripper to grasp one or more tools is disclosed. In various embodiments, the robot comprises a robotic arm having a gripper disposed at a free moving end of the robotic arm, and a set of two or more tools configured to grasped or otherwise engaged by the gripper. Each tool in the set of two or more tools may be disposed in a corresponding tool holder, optionally attached to the robot or situated near the robot. The robot is configured to use the gripper to retrieve a selected tool from its tool holder to perform a task; use the tool to perform the task; and return the tool to its tool holder.

Abstract: A robotic singulation system is disclosed. In various embodiments, sensor data including image data associated with a workspace is received. The sensor data is used to generate a three dimensional view of at least a portion of the workspace, the three dimensional view including boundaries of a plurality of items present in the workspace. The three dimensional view as generated at successive points in time is used to model a flow of at least a subset of said plurality of items through at least a portion of the workspace. The model is used to determine and implement a plan to autonomously operate a robotic structure to pick one or more items from the workplace and place each item singly in a corresponding location in a singulation conveyance structure.

Abstract: Data associated with a plurality of items to be stacked on or in a destination location is received. The data associated with the plurality of items enables a first attribute associated with a first item of the plurality of items to be identified. A plan to stack the items on or in the destination location is generated based at least in part on the received data. The plan includes with respect to the first item a plan, determined based at least in part on the first attribute, to place the first item in a stackable container along with one or more other items and to place the stackable container, once filled, in a corresponding location on or in the destination location. The plan is implemented at least in part by controlling a robotic arm to pick up the items and stack them on or in the destination location according to the plan.

Abstract: A robot is operated in an autonomous mode of operation to perform a plurality of tasks. It is determined that a later task of the plurality of tasks needs human assistance while performing a current task of the plurality of tasks. The human assistance is scheduled for the later task. A teleoperator is communicated with to perform the human assistance associated with the later task.

Abstract: A velocity control-based robotic system is disclosed. In various embodiments, sensor data is received from one or more sensors deployed in a physical space in which a robot is located. A processor is used to determine based at least in part on the sensor data an at least partly velocity-based trajectory along which to move an element comprising the robot. A command to implement the velocity-based trajectory is sent to the robot.

Abstract: A robotic system is disclosed. In various embodiments, sensor data is received. A plan is determined, based at least in part on the received sensor data, to use a robotic arm to build a stack of items comprising a plurality of items, the plan including with respect to at least a subset of the items a plan to move the item to an initial position on the stack and then reposition and use the robotic arm to pack the item more snugly against an adjacent surface. The plan is implemented at least in part by sending one or more commands to a robotic arm.

Abstract: A robotic system includes a robotic arm that includes a first joint that connects a first segment to a second segment, the first segment being connected at an end of the first segment opposite the first joint to a shoulder joint of the robotic arm and the second segment being connected at an end of the second segment opposite the first joint to an elbow joint of the robotic arm; and a processor coupled to the robotic arm and configured to receive an end effector trajectory and determine a motion plan to move the end effector through the end effector trajectory, including by using the first joint to vary the distance between the shoulder joint and the elbow joint, as and if needed, to realize the end effector trajectory while using the joints and links other than the first joint in a preferred pose.