Abstract: The present disclosure generally relates to a system of a delivery device for combining sensor data from various types of sensors to generate a map that enables the delivery device to navigate from a first location to a second location to deliver an item to the second location. The system obtains data from RGB, LIDAR, and depth sensors and combines this sensor data according to various algorithms to detect objects in an environment of the delivery device, generate point cloud and pose information associated with the detected objects, and generates object boundary data for the detected objects. The system further identifies object states for the detected object and generates the map for the environment based on the detected object, the generated object proposal data, the labeled point cloud data, and the object states. The generated map may be provided to other systems to navigate the delivery device.

Abstract: Autonomous ground vehicles capture images during operation, and process the images to recognize ground surfaces or features within their vicinity, such as by providing the images to a segmentation network trained to recognize the ground surfaces or features. Semantic maps of the ground surfaces or features are generated from the processed images. A point on a semantic map is selected, and the autonomous ground vehicle is instructed to travel to a location corresponding to the selected point. The point is selected in accordance with one or more goals, such as to maintain the autonomous ground vehicle at a selected distance from a roadway or other hazardous surface, or along a centerline of a sidewalk.

Abstract: The present disclosure generally relates to a system of a delivery device for combining sensor data from various types of sensors to generate a map that enables the delivery device to navigate from a first location to a second location to deliver an item to the second location. The system obtains data from RGB, LIDAR, and depth sensors and combines this sensor data according to various algorithms to detect objects in an environment of the delivery device, generate point cloud and pose information associated with the detected objects, and generates object boundary data for the detected objects. The system further identifies object states for the detected object and generates the map for the environment based on the detected object, the generated object proposal data, the labeled point cloud data, and the object states. The generated map may be provided to other systems to navigate the delivery device.

Abstract: An autonomous delivery robot system to enable delivery of a product to a customer is described. One autonomous ground vehicle (AGV) includes a processing device that receives a delivery request comprising a route divided into multiple navigation segments and computes a navigable space from perception data stored in a perception map. The perception map is a robot-centered local map that stores the perception data indicative of the surroundings of the AGV. The processing device computes a cost inflation from the perception data stored in the perception map, determines a sub-goal that is on the navigable space and reachable by the AGV using the navigable space and the cost inflation, and determines a path to achieve the sub-goal using the using the navigable space and the cost inflation. The processing device controls one or more actuators to move along the path.

Abstract: Image classification and related imaging tasks performed using machine learning tools may be accelerated by using one or more of such tools to associate an image with a cluster of such labels or categories, and then to select one of the labels or categories of the cluster as associated with the image. The clusters of labels or categories may comprise labels that are mutually confused for one another, e.g., two or more labels or categories that have been identified as associated with a single image. By defining clusters of labels or categories, and configuring a machine learning tool to associate an image with one of the clusters, processes for identifying labels or categories associated with images may be accelerated because computations associated with labels or categories not included in the cluster may be omitted.