Abstract: Embodiments provide functionality to prevent collisions between robots and objects. An example embodiment detects a type and a location of an object based on a camera image of the object, where the image has a reference frame. Motion of the object is then predicted based on at least one of: the detected type of the object, the detected location of the object, and a model of object motion. To continue, a motion plan for the robot is generated that avoids having the robot collide with the object based on the predicted motion of the object and a transformation between the reference frame of the image and a reference frame of the robot. The robot can be controlled to move in accordance with the motion plan or a signal can be generated that controls the robot to operate in accordance with the motion plan.

Abstract: A cover for an automated robot includes elastic sheets that are adhered to each other in a geometry. The geometry is configured to allow the elastic sheets to expand and contract while the automated robot moves within its range of motion. The elastic sheets are attached to the automated robot by elasticity of the elastic sheets. A first group of the elastic sheets forms an elastic collar configured to grip the automated robot at a distal end and a proximal end of the cover in a non-breakable manner such that during operation of the robot, the elastic sheets hold their elasticity and integrity without breaking.

Abstract: In an embodiment, a method for handling an order includes determining a plurality of ingredients based on an order, received from a user over a network, for a location having a plurality of robots. The method further includes planning at least one trajectory for at least one robot based on the plurality of ingredients and utensils available at the location, and proximity of each ingredient and utensil to the at least one robot. Each trajectory can be configured to move one of the plurality of ingredients into a container associated with the order. In an embodiment, the method includes executing the at least one trajectory by the at least one robot to fulfill the order. In an embodiment, the method includes moving the container to a pickup area.

Abstract: In an embodiment, a method and system use various sensors to determine a shape of a collection of materials (e.g., foodstuffs). A controller can determine a trajectory which achieves the desired end-state, possibly chosen from a set of feasible, collision-free trajectories to execute, and a robot executes that trajectory. The robot, executing that trajectory, scoops, grabs, or otherwise acquires the desired amount of material from the collection of materials at a desired location. The robot then deposits the collected material in the desired receptacle at a specific location and orientation.

Abstract: Robots, including robot arms, can interface with other modules to affect the world surrounding the robot. However, designing modules from scratch when human analogues exist is not efficient. In an embodiment, a mechanical tool, converted from human use, to be used by robots includes a monolithic adaptor having two interface components. The two interface components include a first interface component cabal be of mating with an actuated mechanism on the robot side, the second interface capable of clamping to an existing utensil. In such a way, utensils that are intended for humans can be adapted for robots and robotic arms.

Abstract: A problem with current food service robots is making the robots safe to work around food. A solution provided by the present disclosure is a food-safe tool switcher and corresponding tool. The tool switcher can mate with a variety of tools, which can be molded or 3D printed out of food-safe materials into a single-part, instead of constructed modularly. This provides for easier cleaning.

Abstract: Current technologies allow a robot to acquire a tool only if the tool is in a set known location, such as in a rack. In an embodiment, a method and corresponding system, can determine the previously unknown pose of a tool freely placed in an environment. The method can then calculate a trajectory that allows for a robot to move from its current position to the tool and attach with the tool. In such a way, tools can be located and used by a robot when placed at any location in an environment.

Abstract: In an embodiment, a method during execution of a motion plan by a robotic arm includes determining a voice command from speech of a user said during the execution of the motion plan, determining a modification of the motion plan based on the voice command from the speech of the user, and executing the modification of the motion plan by the robotic arm.

Abstract: In an embodiment, a method includes identifying a force and torque for a robot to accomplish a task and identifying context of a portion of a movement plan indicating motion of the robot to perform the task. Based on the identified force, torque, and context, a context specific torque is determined for at least one aspect of the robot while the robot executes the portion of the movement plan. In turn, a control signal is generated for the at least one aspect of the robot to operate in accordance with the determined context specific torque.

Abstract: A robotic system includes a hub assembly rotatable about a vertical axis. A robotic arm has a first end connected to the hub assembly and an opposite second end connected to an end effector, which is configured for holding an item. The system is configured to support an agent on or above the hub assembly for working on the item held by the end effector. The operation of the robotic arm and end effector to move the item does not obstruct operation of the agent.

Abstract: In an embodiment, a method includes determining a given material to manipulate to achieve a goal state. The goal state can be one or more deformable or granular materials in a particular arrangement. The method further includes, for the given material, determining, a respective outcome for each of a plurality of candidate actions to manipulate the given material. The determining can be performed with a physics-based model, in one embodiment. The method further can include determining a given action of the candidate actions, where the outcome of the given action reaching the goal state is within at least one tolerance. The method further includes, based on a selected action of the given actions, generating a first motion plan for the selected action.

Abstract: A robotic system includes a hub assembly rotatable about a vertical axis. A robotic arm has a first end connected to the hub assembly and an opposite second end connected to an end effector, which is configured for holding an item. The system is configured to support an agent on or above the hub assembly for working on the item held by the end effector. The operation of the robotic arm and end effector to move the item does not obstruct operation of the agent.

Abstract: Current technologies allow a robot to acquire a tool only if the tool is in a set known location, such as in a rack. In an embodiment, a method and corresponding system, can determine the previously unknow pose of a tool freely placed in an environment. The method can then calculate a trajectory that allows for a robot to move from its current position to the tool and attach with the tool. In such a way, tools can be located and used by a robot when placed at any location in an environment.

Abstract: In an embodiment, a method for handling an order includes determining a plurality of ingredients based on an order, received from a user over a network, for a location having a plurality of robots. The method further includes planning at least one trajectory for at least one robot based on the plurality of ingredients and utensils available at the location, and proximity of each ingredient and utensil to the at least one robot. Each trajectory can be configured to move one of the plurality of ingredients into a container associated with the order. In an embodiment, the method includes executing the at least one trajectory by the at least one robot to fulfill the order. In an embodiment, the method includes moving the container to a pickup area.

Abstract: A problem with current food service robots is making the robots safe to work around food. A solution provided by the present disclosure is a food-safe tool switcher and corresponding tool. The tool switcher can mate with a variety of tools, which can be molded or 3D printed out of food-safe materials into a single-part, instead of constructed modularly. This provides for easier cleaning.

Abstract: In an embodiment, a method includes identifying a force and torque for a robot to accomplish a task and identifying context of a portion of a movement plan indicating motion of the robot to perform the task. Based on the identified force, torque, and context, a context specific torque is determined for at least one aspect of the robot while the robot executes the portion of the movement plan. In turn, a control signal is generated for the at least one aspect of the robot to operate in accordance with the determined context specific torque.

Abstract: In an embodiment, a method includes determining a given material to manipulate to achieve a goal state. The goal state can be one or more deformable or granular materials in a particular arrangement. The method further includes, for the given material, determining, a respective outcome for each of a plurality of candidate actions to manipulate the given material. The determining can be performed with a physics-based model, in one embodiment. The method further can include determining a given action of the candidate actions, where the outcome of the given action reaching the goal state is within at least one tolerance. The method further includes, based on a selected action of the given actions, generating a first motion plan for the selected action.

Abstract: Embodiments provide functionality to prevent collisions between robots and objects. An example embodiment detects a type and a location of an object based on a camera image of the object, where the image has a reference frame. Motion of the object is then predicted based on at least one of: the detected type of the object, the detected location of the object, and a model of object motion. To continue, a motion plan for the robot is generated that avoids having the robot collide with the object based on the predicted motion of the object and a transformation between the reference frame of the image and a reference frame of the robot. The robot can be controlled to move in accordance with the motion plan or a signal can be generated that controls the robot to operate in accordance with the motion plan.

Abstract: In an embodiment, a method and system use various sensors to determine a shape of a collection of materials (e.g., foodstuffs). A controller can determine a trajectory which achieves the desired end-state, possibly chosen from a set of feasible, collision-free trajectories to execute, and a robot executes that trajectory. The robot, executing that trajectory, scoops, grabs, or otherwise acquires the desired amount of material from the collection of materials at a desired location. The robot then deposits the collected material in the desired receptacle at a specific location and orientation.

Abstract: In an embodiment, a cover for an automated robot includes elastic sheets that are adhered to each other in a geometry. The geometry is configured to allow the elastic sheets to expand and contract while the automated robot moves within its range of motion. The elastic sheets are attached to the automated robot by elasticity of the elastic sheets. A first group of the elastic sheets forms an elastic collar configured to grip the automated robot at a distal end and a proximal end of the cover. A person of ordinary skill in the art can recognize that nonbreakably means that during operation of the robot, the elastic sheets hold their elasticity and integrity without breaking.