Abstract: An actuator and end effector are controlled according to images from cameras having a surface in their field of view. Vessels (cups, bowls, etc.) and other objects are identified in the images and their configuration is assigned to a finite set of categories by a classifier that does not output a 3D bounding box or determine a 6D pose. For objects assigned to a first subset of categories, grasping parameters for controlling the actuator and end effector are determined using only 2D bounding boxes, such as oriented 2D bounding boxes. For objects not assigned to the first subset, a righting operation may be performed using only 2D bounding boxes. Objects that are still not in the first set may then be grasped by estimating a 3D bounding box and 6D pose.

Abstract: Example intelligent dishwashing systems and methods are described. In one implementation, a system includes a light source that is configured to illuminate an article of dishware. An imaging system is configured to capture at least one image of the article of dishware. A processing system is configured to analyze the at least one image to determine a presence of a stain on the article of dishware.

Abstract: Example intelligent dishwashing systems and methods are described. In one implementation, a system includes an imaging system configured to capture at least one image of an article of dishware. A processing system analyzes the at least one image to determine a presence and a location of a stain on the article of dishware. Responsive to determining the presence of a stain, a cleaning system is configured to clean the location of the stain on the article of dishware.

Abstract: An actuator and end effector are controlled according to images from cameras having a surface in their field of view. Vessels (cups, bowls, etc.) and other objects are identified in the images and their configuration is assigned to a finite set of categories by a classifier that does not output a 3D bounding box or determine a 6D pose. For objects assigned to a first subset of categories, grasping parameters for controlling the actuator and end effector are determined using only 2D bounding boxes, such as oriented 2D bounding boxes. For objects not assigned to the first subset, a righting operation may be performed using only 2D bounding boxes. Objects that are still not in the first set may then be grasped by estimating a 3D bounding box and 6D pose.

Abstract: Example intelligent dishwashing systems and methods are described. In one implementation, a system includes an imaging system configured to capture at least one image of an article of dishware. A processing system analyzes the at least one image to determine a presence and a location of a stain on the article of dishware. Responsive to determining the presence of a stain, a cleaning system is configured to clean the location of the stain on the article of dishware.

Abstract: An imaging system captures images of a work surface having articles of cutlery distributed thereon. An end effector, such as a magnetic end effector, may be used to grasp articles of cutlery and place them in a designated location according to the type of the article of cutlery as determined using an image of the work surface and machine vision. A type of articles of cutlery may be classified based on the image such as according to category (knife, fork, spoon), size, or brand. Multiple articles of cutlery occluding one another may be dealt with by stirring or grasping multiple items and releasing them on a separate work surface in order to disperse them. Whether the end effector is grasping multiple articles of cutlery may be determined by capturing an image of the end effector. Machine vision may determine whether an article of cutlery is contaminated or damaged.

Abstract: An actuator and end effector are controlled according to images from cameras having a surface in their field of view. Vessels (cups, bowls, etc.) and other objects are identified in the images and their configuration is assigned to a finite set of categories by a classifier that does not output a 3D bounding box or determine a 6D pose. For objects assigned to a first subset of categories, grasping parameters for controlling the actuator and end effector are determined using only 2D bounding boxes, such as oriented 2D bounding boxes. For objects not assigned to the first subset, a righting operation may be performed using only 2D bounding boxes. Objects that are still not in the first set may then be grasped by estimating a 3D bounding box and 6D pose.

Abstract: An actuator and end effector are controlled according to images from cameras having a surface in their field of view. Vessels (cups, bowls, etc.) and other objects are identified in the images and their configuration is assigned to a finite set of categories by a classifier that does not output a 3D bounding box or determine a 6D pose. For objects assigned to a first subset of categories, grasping parameters for controlling the actuator and end effector are determined using only 2D bounding boxes, such as oriented 2D bounding boxes. For objects not assigned to the first subset, a righting operation may be performed using only 2D bounding boxes. Objects that are still not in the first set may then be grasped by estimating a 3D bounding box and 6D pose.

Abstract: Example intelligent dishwashing systems and methods are described. In one implementation, a system includes an imaging system configured to capture at least one image of an article of dishware. A processing system analyzes the at least one image to determine a presence and a location of a stain on the article of dishware. Responsive to determining the presence of a stain, a cleaning system is configured to clean the location of the stain on the article of dishware.

Abstract: Example intelligent dishwashing systems and methods are described. In one implementation, a system includes a light source that is configured to illuminate an article of dishware. An imaging system is configured to capture at least one image of the article of dishware. A processing system is configured to analyze the at least one image to determine a presence of a stain on the article of dishware.