Abstract: A mobile manipulator robot for retrieving inventory items from a storage system. The robot includes a body, a wheel assembly, a sensor to locate a position of the robot within the storage system, an interface configured to send processor readable data to a remote processor and to an operator interface, and receive processor executable instructions from the remote processor and from the operator interface, an imaging device to capture images of the inventory items, a picking manipulator, first and second pneumatic gripping elements for grasping the inventory items, and a coupler configured to mate with a valve to access a pneumatic supply for operating at least one of the first or second pneumatic gripping elements. The robot is configured to transition the valve from a closed condition to an open condition and selectively place one of the first or the second pneumatic gripping elements in communication with the pneumatic supply.

Abstract: A storage system configured to house a plurality of containers housing inventory items includes support members, a first set of parallel rails to support a mobile, manipulator robot, and a fluid supply line having a plurality of valves disposed within the fluid supply line. Each of the valves having a closed condition in which the supply line is in fluid isolation from an outside environment and an open condition in which the supply line is in fluid communication with the environment such that the supply line is configured to supply fluid to a mobile, manipulator robot. Mobile, manipulator robots for retrieving inventory items stored within the containers and retrieval methods are also disclosed herein.

Abstract: The technology is directed to providing pick and place instructions to a robot. Sensor data including an image feed of a picking container in which at least one product is located may be output. An input indicating a selected product including at least one of the products located in the picking container may be received. A representation of the selected product and at least one image of the order container may be output for display. The representation of the product may be scaled relative to the at least one image of the order container. A place input corresponding to the position of the representation of the product at a packing location within the at least one image of the order container may be received and transmitted to a robot control system.

Abstract: The technology is directed to training a system to generate pick instructions. A teleoperator system may receive data corresponding to a robot attempting a picking task including picking an item of an identified product type from a container. The data may include imagery of an end effector of the robot after the attempted picking task. The teleoperator system may display the imagery on a display and an input indicating whether the picking task was successfully or unsuccessfully performed by the robot may be received. The data may be labeled based on the input and transmitted to a processor for training a learning algorithm for use in generating future pick instructions.

Abstract: A robotic end effector tool having multiple manipulator elements. The end effector includes a body, a suction cup movable relative to the body between a retracted position and an extended position, a plurality of fingers spaced around the suction cup and being actuatable between an open condition and a clamped condition, and a roller coupled to at least one of the fingers such that the roller is arranged to rotate about a first axis. The combination of the suction cup, the fingers and the rollers are arranged to pick an item and adjust the orientation of an object without setting the object down.

Abstract: A robot includes a body coupled to a wheel assembly and a container retrieval device. The wheel assembly has a plurality of wheels and a drive mechanism arranged to move the body along a first set of parallel rails and along a second set of parallel rails. The container retrieval device includes an extendable and retractable grapple arranged to selectively secure an engagement feature positioned between a rim and a bottom surface of a container. The grapple thus allows the robot to lift multiple containers in a single lift.

Abstract: A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.

Abstract: An order fulfillment and delivery system for autonomously fulfilling orders while en route to a delivery location. The system includes a delivery vehicle having a storage area, a robotic system at least partially disposed within the storage area and one or more processors. The one or more processors being configured to receive an order of one or more inventory items, generate container retrieval instructions for the robotic system to perform based on the received order and transmit to the robotic system the container retrieval instructions to perform. The robot system includes a container retrieval device movable in at least two dimensions to engage and move a container, based upon the container retrieval instructions, from a first location within the delivery vehicle to a second location within the delivery vehicle.

Abstract: A mobile manipulator robot having a pneumatic charging system. The mobile robot includes an energy source and a charging system to charge the energy source. The charging system includes a coupler having a mating end configured to mate with an external pneumatic supply system to access a pneumatic supply and a pneumatic actuator disposed downstream of the coupler. The pneumatic actuator is configured to convert energy from the pneumatic supply to charge the energy source. The pneumatic actuator may be an air motor or a piezo.

Abstract: A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.

Abstract: An order fulfillment and delivery system for autonomously fulfilling orders while en route to a delivery location. The system includes a delivery vehicle having a storage area, a robotic system at least partially disposed within the storage area and one or more processors. The one or more processors being configured to receive an order of one or more inventory items, generate container retrieval instructions for the robotic system to perform based on the received order and transmit to the robotic system the container retrieval instructions to perform. The robot system includes a container retrieval device movable in at least two dimensions to engage and move a container, based upon the container retrieval instructions, from a first location within the delivery vehicle to a second location within the delivery vehicle.

Abstract: A parsing system includes an imaging device and one or more processors. The imaging device may capture visual instructions displayed on a monitor. The one or more processors may be configured to receive, from the imaging device, the captured visual instructions, generate functions for a robot to perform based on the captured visual instructions, and transmit, to a robot, the functions to perform.

Abstract: A system enables teleoperation of a robot based on a pose of a subject. The system includes an image capturing device and an operator system controller that are remotely located from a robotic system controller and a robot. The image capturing device captures images of the subject. The operator system controller maps a processed version of the captured image to a three-dimensional skeleton model of the subject and generates body pose information of the subject in the captured image. The robotic system controller communicates with the operator system controller over a network. The robotic system controller generates a plurality of kinematic parameters for the robot and causes the robot to take a pose corresponding to the pose of the subject in the captured image.

Abstract: A robotic system includes a robot having a picking arm to grasp an inventory item and a shuttle. The shuttle includes a platform adapted to receive the inventory item from the picking arm of the robot. The platform is moveable between a pick-up location located substantially adjacent to the robot and an end location spaced a distance apart from the pick-up location. The system improves efficiency as transportation of the item from the pick-up location to the end location is divided between the robot and the shuttle.

Abstract: A mobile manipulator robot for retrieving inventory items from a storage system. The robot includes a body, a wheel assembly, a sensor to locate a position of the robot within the storage system, an interface configured to send processor readable data to a remote processor and to an operator interface, and receive processor executable instructions from the remote processor and from the operator interface, an imaging device to capture images of the inventory items, a picking manipulator, first and second pneumatic gripping elements for grasping the inventory items, and a coupler configured to mate with a valve to access a pneumatic supply for operating at least one of the first or second pneumatic gripping elements. The robot is configured to transition the valve from a closed condition to an open condition and selectively place one of the first or the second pneumatic gripping elements in communication with the pneumatic supply.

Abstract: A mobile manipulator robot for retrieving inventory items from a storage system. The robot includes a body, a wheel assembly, a sensor to locate a position of the robot within the storage system, an interface configured to send processor readable data to a remote processor and to an operator interface, and receive processor executable instructions from the remote processor and from the operator interface, an imaging device to capture images of the inventory items, a picking manipulator, first and second pneumatic gripping elements for grasping the inventory items, and a coupler configured to mate with a valve to access a pneumatic supply for operating at least one of the first or second pneumatic gripping elements. The robot is configured to transition the valve from a closed condition to an open condition and selectively place one of the first or the second pneumatic gripping elements in communication with the pneumatic supply.

Abstract: A system enables teleoperation of a robot based on a pose of a subject. The system includes an image capturing device and an operator system controller that are remotely located from a robotic system controller and a robot. The image capturing device captures images of the subject. The operator system controller maps a processed version of the captured image to a three-dimensional skeleton model of the subject and generates body pose information of the subject in the captured image. The robotic system controller communicates with the operator system controller over a network. The robotic system controller generates a plurality of kinematic parameters for the robot and causes the robot to take a pose corresponding to the pose of the subject in the captured image.

Abstract: A storage system configured to house a plurality of containers housing inventory items includes support members, a first set of parallel rails to support a mobile, manipulator robot, and a fluid supply line having a plurality of valves disposed within the fluid supply line. Each of the valves having a closed condition in which the supply line is in fluid isolation from an outside environment and an open condition in which the supply line is in fluid communication with the environment such that the supply line is configured to supply fluid to a mobile, manipulator robot. Mobile, manipulator robots for retrieving inventory items stored within the containers and retrieval methods are also disclosed herein.

Abstract: A storage system configured to house a plurality of containers housing inventory items includes support members, a first set of parallel rails to support a mobile, manipulator robot, and a fluid supply line having a plurality of valves disposed within the fluid supply line. Each of the valves having a closed condition in which the supply line is in fluid isolation from an outside environment and an open condition in which the supply line is in fluid communication with the environment such that the supply line is configured to supply fluid to a mobile, manipulator robot. Mobile, manipulator robots for retrieving inventory items stored within the containers and retrieval methods are also disclosed herein.

Abstract: A mobile manipulator robot for retrieving inventory items from a storage system. The robot includes a body, a wheel assembly, a sensor to locate a position of the robot within the storage system, an interface configured to send processor readable data to a remote processor and to an operator interface, and receive processor executable instructions from the remote processor and from the operator interface, an imaging device to capture images of the inventory items, a picking manipulator, first and second pneumatic gripping elements for grasping the inventory items, and a coupler configured to mate with a valve to access a pneumatic supply for operating at least one of the first or second pneumatic gripping elements. The robot is configured to transition the valve from a closed condition to an open condition and selectively place one of the first or the second pneumatic gripping elements in communication with the pneumatic supply.